EP2761362A2 - Videoanzeigeänderung auf der basis einer sensoreingabe für durchsichtige augennahe anzeige - Google Patents

Videoanzeigeänderung auf der basis einer sensoreingabe für durchsichtige augennahe anzeige

Info

Publication number
EP2761362A2
EP2761362A2 EP12837262.0A EP12837262A EP2761362A2 EP 2761362 A2 EP2761362 A2 EP 2761362A2 EP 12837262 A EP12837262 A EP 12837262A EP 2761362 A2 EP2761362 A2 EP 2761362A2
Authority
EP
European Patent Office
Prior art keywords
light
display
image
sensor
optical
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP12837262.0A
Other languages
English (en)
French (fr)
Other versions
EP2761362A4 (de
Inventor
John D. Haddick
Ralph F. Osterhout
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Microsoft Technology Licensing LLC
Original Assignee
Microsoft Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Microsoft Corp filed Critical Microsoft Corp
Publication of EP2761362A4 publication Critical patent/EP2761362A4/de
Publication of EP2761362A2 publication Critical patent/EP2761362A2/de
Withdrawn legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0176—Head mounted characterised by mechanical features
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/163—Wearable computers, e.g. on a belt
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0112—Head-up displays characterised by optical features comprising device for genereting colour display
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0118—Head-up displays characterised by optical features comprising devices for improving the contrast of the display / brillance control visibility

Definitions

  • Provisional Patent Application 61/373,791 filed August 13, 2010; United States Provisional Patent Application 61/382,578, filed September 14, 2010; United States Provisional Patent Application 61/410,983, filed November 8, 2010; United States Provisional Patent Application 61/429,445, filed January 3, 201 1 ; and United States Provisional Patent Application 61/429,447, filed January 3, 201 1.
  • the present disclosure relates to an augmented reality eyepiece, associated control technologies, and applications for use, and more specifically to software applications running on the eyepiece.
  • This disclosure also relates to a thin display technology that uses switchable mirrors in a sequenced pattern to provide an image from a waveguide.
  • Head mounted displays with reflecting surfaces are well known in the industry. Head mounted displays with angled single partial reflecting beam splitter plates are described in United States patent 4969714. While this approach provides excellent uniformity of brightness and color over the displayed field of view, the optical system is relatively thick due to the angled beam splitter plate.
  • Head mounted displays with arrays of partially reflecting surfaces to provide a thinner optical system are described in United States Patents 6829095 and 7724441 and shown in FIG. 124 wherein the array of partially reflecting surfaces 12408 is used to provide image light 12404 over a display field of view enabling a user to view displayed images combined with a view of the environment in front of the user.
  • the image light 12404 viewed by the user is comprised of the combined reflected light from each of the multiple partially reflecting surfaces 12408.
  • the light from the image source 12402 has to pass through the multiple partially reflecting surfaces 12408 where a portion of the light 12402 is reflected toward the user's eye thereby providing image light 12404.
  • the reflection characteristics of the partially reflecting surfaces 12408 must be precisely controlled.
  • the reflectivity of the partially reflective surfaces 12408 must be lowest for surfaces that are closest to the image source and highest for surfaces that are farthest from the image source.
  • the reflectivity of the partially reflective surfaces 12408 must increase linearly in relation to the distance from the image source. This presents a manufacturing and cost problem as the reflectivity of each partially reflective surface 12408 is different from the neighboring surfaces and the reflectivity of each surface must be tightly controlled. As such, providing an image that is of uniform brightness and color over the entire display field of view is difficult with an array of partially reflective surfaces.
  • a diffractive grating is used to redirect the image light into and out of a waveguide to the display field of view as described in United States Patent 471 1512.
  • diffraction gratings are costly and subject to color aberrations.
  • This disclosure also concerns a compact and lightweight frontlight that includes a wire grid polarizer film as a partially reflective surface to deflect the illumination light downwards to the reflective image source.
  • illumination light 13308 passes from an edge light source 13300 and is deflected by the frontlight 13304 to illuminate the reflective image source 13302.
  • the illumination light 13308 then reflects from the reflective image source 13302 turning into image light 13310 which then passes back through the frontlight 13304 and into the display optics.
  • the frontlight 13304 simultaneously deflects illumination light 13308 entering from the edge light source 13300 and allows reflected image light 13310 to pass through without being deflected so it can pass into the display optics, where the display optics can be dispersive when the display is a flat screen display or refractive or diffractive when the display is a near eye display.
  • the display optics may include diffusers.
  • the illumination light is polarized and the reflective image source includes a quarter wave retardation film that changes the polarization state during the reflection from the reflective image source.
  • a polarizer is then included in the display optics which causes the polarization effects imparted by the liquid crystal to form an image as the image light passes through the display optics.
  • United States Patent 7163330 describes a series of frontlights which include grooves in the upper surface of the frontlight to deflect light from the edge light source down to the reflective image source along with flat sections between the grooves to allow the reflected image light to pass into the display optics.
  • FIG. 134 shows an illustration of the frontlight 13400 with the grooves 13410 and the flat sections 13408.
  • the illumination light 13402 from the edge light source 13300 reflects from the grooves 13410 and is deflected downwards to illuminate the reflective image source 13302.
  • the image light 13404 reflects from the reflective image source 13302 and passes through the flat sections 13408 of the frontlight 13400. Linear and curved grooves 13410 are described.
  • the grooves 13410 must occupy a substantial area of the frontlight thereby limiting the area of the flat sections 13408 and degrading the image quality provided to the display optics due to light scatter from the grooves as it passes back through the frontlight .
  • Frontlights 13400 are typically formed from a solid plate of material and as such can be relatively heavy.
  • a wearable display system which includes a reflective image source 13502 with a polarizing beam splitter 13512 as a frontlight to deflect and polarize illumination light 13504 supplied by an edge light source 13500 onto the reflective image source 13502 as shown in FIG. 135.
  • the polarizing beam splitter 13512 is an angled plane in a solid block with a separate curved reflector 13514 associated with the edge light source 13500.
  • the curved reflector 13514 can be a total internal reflection block 13510 that is connected to the polarizing beam splitter 13512.
  • the frontlight disclosed in this patent with the solid block of the polarizing beam splitter and the total internal reflection block provides a frontlight that is bulky and relatively heavy.
  • FIG. 135 also shows image light rays 13508.
  • the disclosure also pertains to optically flat surfaces produced with optical films. More particularly, the disclosure provides a method for making an optically flat beam splitter using an optical film.
  • Optical films can be obtained for a variety of purposes including: beam splitters, polarizing beam splitters, holographic reflectors and mirrors. In imaging applications and particularly in reflective imaging applications, it is important to provide that the optical film be very flat to preserve the wavefront of the image. Some optical films are available with pressure sensitive adhesive on one side to allow the optical films to be attached to a substrate for structural support and to aid in keeping the optical film flat. However, optical films attached to substrates in this manner tend to have surfaces with small-scale undulations and pock marks known orange peel that prevent the surface from reaching optical flatness and as a result, reflected images are degraded. [0025] In United States Patent Application 20090052030 a method for producing an optical film is provided wherein the optical film is a wire grid polarizer. However, techniques for providing the film with optical flatness are not provided.
  • a method for lamination of a functional film to a lens uses a thermally cured adhesive to adhere a functional film to a lens.
  • this process includes thermoforming the optical film while the lens is hot so that the optical film, the adhesive and the lens are deformed together during the bonding process. As such this method is not suited to making optically flat surfaces.
  • the eyepiece may include an internal software application running on an integrated multimedia computing facility that has been adapted for 3D augmented reality (AR) content display and interaction with the eyepiece.
  • 3D AR software applications may be developed in conjunction with mobile applications and provided through application store(s), or as stand-alone applications specifically targeting the eyepiece as the end-use platform and through a dedicated 3D AR eyepiece store.
  • Internal software applications may interface with inputs and output facilities provided by the eyepiece through facilities internal and external to the eyepiece, such as initiated from the surrounding environment, sensing devices, user action capture devices, internal processing facilities, internal multimedia processing facilities, other internal applications, camera, sensors, microphone, through a transceiver, through a tactile interface, from external computing facilities, external applications, event and/or data feeds, external devices, third parties, and the like.
  • Command and control modes operating in conjunction with the eyepiece may be initiated by sensing inputs through input devices, user action, external device interaction, reception of events and/or data feeds, internal application execution, external application execution, and the like.
  • the disclosure also provides a method for providing a relatively thin optical system that provides an image with improved uniformity of brightness and color over the display field of view.
  • the disclosure includes an integral array of narrow switchable mirrors over the display area, to provide a display field of view wherein the switchable mirrors are used sequentially to reflect portions of the light from an image source to present sequential portions of an image to a user.
  • the narrow switchable mirrors By rapidly switching the narrow switchable mirrors from transparent to reflective in a repeating sequence, the user perceives the portions of the image to be combined into the entire image as presented by the image source.
  • each of the narrow switchable mirrors is switched at 60 Hz or greater, the user does not perceive flicker in portions of the image.
  • the switchable mirrors are liquid crystal switchable mirrors.
  • the switchable mirrors are moveable prism elements, which use an air gap to provide a switchable total internal reflective mirror.
  • switchable mirrors are used in the sequence, instead the switchable mirrors are used in a selected group that varies based on the eye spacing of the user
  • the present disclosure further provides a compact and light weight frontlight that includes a wire grid polarizer film as a partially reflective surface to deflect the illumination light downwards to the reflective image source.
  • the edge light source is polarized and the wire grid polarizer is oriented such that the illumination light is reflected and the image light is allowed to pass through to the display optics.
  • the disclosure provides a partially reflective surface that can be curved to focus the illumination light onto the reflective image source thereby increasing efficiency and increasing uniformity of image brightness.
  • the wire grid polarizer also has very low light scattering as the image light passes through the frontlight on the way to the display optics, so image quality is preserved.
  • the partially reflective surface is a wire grid polarizer film, the majority of the frontlight is comprised of air and as such the frontlight is much lighter in weight.
  • the optical film can comprise a beam splitter, a polarizing beam splitter, a wire grid polarizer, a mirror, a partial mirror or a holographic film.
  • the advantage provided by the disclosure is that the surface of the optical film is optically flat so that the wavefront of the light is preserved to provide improved image quality.
  • the disclosure provides an image display system including an optically flat optical film.
  • the optically flat optical film includes a substrate to hold the optical film optically flat in a display module housing with an image source and a viewing location. Wherein the image provided by the image source is reflected from the optical film to the viewing location and the substrate with the optical film is replaceable within the display module housing.
  • the optical film is attached to a molded structure so the optical film is part of the display module housing.
  • light 18712 passes from an light source 18702 into a diffuser 18704 where it is made more uniform to provide illumination light 18714.
  • the illumination light 18714 is redirected by a partially reflective layer 18708 to thereby illuminate the reflective image source 18720.
  • the illumination light 18714 then reflects from the reflective image source 18720 turning into image light 18710 which then passes back through the partially reflective layer 18708 and into the associated imaging optics (not shown) which present the image to a viewer.
  • the solid beam splitter cube 18718 simultaneously redirects illumination light 18714 and allows reflected image light 18710 to pass through without being redirected so it can pass into the imaging optics, where the imaging optics can be dispersive when the display is a flat screen display or refractive or diffractive when the display is a projector or a near eye display.
  • a reflective image source such as a liquid crystal on silicon (LCOS) image source
  • the illumination light is polarized and the reflective image source changes the polarization state when the illumination light is reflected from the reflective image source based on the image content presented by the image source thereby forming image light.
  • An analyzer polarizer is then included which causes the polarization effects imparted by the LCOS to form an image as the image light passes through the imaging optics and an image is presented to a viewer.
  • a wearable display system which includes a reflective image source with a polarizing beam splitter as a frontlight to deflect and polarize illumination light supplied by an edge light source onto the reflective image source.
  • the polarizing beam splitter is an angled plane in a solid block with a separate curved reflector associated with the edge light source.
  • the curved reflector can be a total internal reflection block that is connected to the polarizing beam splitter.
  • United States Patent 6195136 discloses a series of frontlight illumination methods for use with reflective image sources.
  • a method using a curved beam splitter is disclosed for making the frontlight more compact.
  • the curved beam splitter is located a substantial distance away from the image source to reduce the angle of the light from the light source that is then reflected by the beam splitter to the image source.
  • the light is provided only on one side of the frontlight so the size of the beam splitter must be at least as big as the image source.
  • the overall size of the frontlight is still relatively large when measured along the optical axis compared to the illuminated area on the image source.
  • the present disclosure provides a compact, efficient and light weight frontlight in a display assembly that includes a partially reflective surface to redirect the illumination light from a light source at the side to a reflective image source, wherein the size of the display assembly as measured by the height of the diffuser area is substantially smaller than the width of the reflective image source that is illuminated.
  • the partially reflective surface can be curved to focus or concentrate the light from the light source onto the reflective image source.
  • the light source can be polarized and a polarizing beam splitter film can be used as the curved partially reflective surface such that the illumination light is redirected and the reflected image light is allowed to pass through to the imaging optics.
  • Polarizing beam splitter film is light in weight and has very low light scattering as the image light passes through the frontlight on the way to the display optics, so image quality is preserved.
  • the partially reflective surface is comprised of two surfaces, wherein one surface deflects the illumination light from one light source to one half of the image source and the other surface deflects light to the other half of the image source.
  • the partially reflective surfaces can be curved or flat.
  • the partially reflective surface is a polarizing beam splitter and the light source is polarized so the light from the light source is first redirected by the polarizing beam splitter and then transmitted after being reflected and changed in polarization by the reflective image source.
  • the light from the light source is unpolarized so the polarizing beam splitter reflects one polarization state of the light to illuminate half of the reflective image source while transmitting the other polarization state of the light.
  • the transmitted polarization state of the light passes to the opposite side of the frontlight where the light is recycled.
  • the recycling of the transmitted polarization state can be done by passing through a quarter wave film and being reflected by a mirror so that it passes back through the quarter wave film and thereby changes polarization state. After the polarization state of the transmitted and reflected light has changed, it is redirected by the polarizing beam splitter to illuminate the other half of the reflective image source.
  • light from the two sidelights of the frontlight acts in a complimentary fashion where the transmitted polarization state of the light from the opposite side becomes unpolarized when it interacts with the diffuser on the opposite side and is thereby recycled.
  • methods are provided for making frontlights with flexible partially reflecting films.
  • the flexible films can be supported at the edges and freestanding over the reflective image source or the flexible films can be clamped between two or more solid pieces that are transparent.
  • the solid pieces can be shaped prior to being placed in contact with the flexible films.
  • the solid pieces can hold the flexible film in a flat geometry or a curved geometry.
  • the flexible film can be supported at the edges and then solid pieces can be cast in place so that the flexible film is embedded in the transparent solid material.
  • a system may include an interactive head-mounted eyepiece worn by a user, wherein the eyepiece includes an optical assembly through which the user views a surrounding environment and displayed content, an integrated processor for handling content for display to the user, an integrated image source for introducing the content to the optical assembly; the processor adapted to modify the content, wherein the modification is made in response to a sensor input.
  • the content may be a video image.
  • the modification may be at least one of adjust brightness, adjust color saturation, adjust color balance, adjust color hue, adjust video resolution, adjust transparency, adjust compression rate, adjust frames per second rate, isolate part of the video, stop the video from playing, pause the video, or restart the video.
  • the sensor input may be derived from at least one of a charge- coupled device, black silicon sensor, I sensor, acoustic sensor, induction sensor, motion sensor, optical sensor, opacity sensor, proximity sensor, inductive sensor, Eddy-current sensor, passive infrared proximity sensor, radar, capacitance sensor, capacitive displacement sensor, hall-effect sensor, magnetic sensor, GPS sensor, thermal imaging sensor, thermocouple, thermistor, photoelectric sensor, ultrasonic sensor, infrared laser sensor, inertial motion sensor, MEMS internal motion sensor, ultrasonic 3D motion sensor, accelerometer, inclinometer, force sensor, piezoelectric sensor, rotary encoders, linear encoders, chemical sensor, ozone sensor, smoke sensor, heat sensor, magnetometer, carbon dioxide detector, carbon monoxide detector, oxygen sensor, glucose sensor, smoke detector, metal detector, rain sensor, altimeter, GPS, detection of being outside, detection of context, detection of activity, object detector (e.g.
  • the content may be stopped from playing in response to an indication from an accelerometer input that the user's head is moving.
  • Audio sensor input may be generated by the speaking of at least one participant of a video conference.
  • Visual sensor input may be a video image of at least one participant of a video conference or a video image of a visual presentation.
  • the modification may be at least one of making the video image more or less transparent in response to an indication from a sensor that the user is moving.
  • a system may include an interactive head-mounted eyepiece worn by a user, wherein the eyepiece includes an optical assembly through which the user views a surrounding environment and displayed content, an integrated processor for handling content for display to the user, an integrated image source for introducing the content to the optical assembly, the processor adapted to modify the content, wherein the modification is made in response to a sensor input; and further comprising, an integrated video image capture facility that records an aspect of the surrounding environment and provides the content for display.
  • Fig. 1 1 depicts a plot of responsivity versus wavelength for three substrates.
  • Fig. 12 illustrates the performance of the black silicon sensor.
  • Fig. 13A depicts an incumbent night vision system
  • Fig. 13B depicts the night vision system of the present disclosure
  • Fig. 13C illustrates the difference in responsivity between the two.
  • Fig. 14 depicts a tactile interface of the eyepiece.
  • Fig. 14A depicts motions in an embodiment of the eyepiece featuring nod control.
  • Fig. 15 depicts a ring that controls the eyepiece.
  • Fig. 15AA depicts a ring that controls the eyepiece with an integrated camera, where in an embodiment may allow the user to provide a video image of themselves as part of a videoconference.
  • Fig. 15A depicts hand mounted sensors in an embodiment of a virtual mouse.
  • Fig. 15B depicts a facial actuation sensor as mounted on the eyepiece.
  • Fig. 15C depicts a hand pointing control of the eyepiece.
  • Fig. 15D depicts a hand pointing control of the eyepiece.
  • Fig. 15E depicts an example of eye tracking control.
  • Fig. 15F depicts a hand positioning control of the eyepiece.
  • Fig. 16 depicts a location-based application mode of the eyepiece.
  • Fig. 17 shows the difference in image quality between A) a flexible platform of uncooled
  • CMOS image sensors capable of VIS/NIR/SWIR imaging and B) an image intensified night vision system
  • Fig. 32 depicts a typical camera for use in video calling or conferencing.
  • Fig. 33 illustrates an embodiment of a block diagram of a video calling camera.
  • Fig. 34 depicts embodiments of the eyepiece for optical or digital stabilization.
  • Fig. 35 depicts an embodiment of a classic cassegrain configuration.
  • Fig. 36 depicts the configuration of the micro-cassegrain telescoping folded optic camera.
  • Fig. 37 depicts a swipe process with a virtual keyboard.
  • Fig. 38 depicts a target marker process for a virtual keyboard.
  • Fig. 38A depicts an embodiment of a visual word translator.
  • Fig. 39 illustrates glasses for biometric data capture according to an embodiment.
  • Fig. 40 illustrates iris recognition using the biometric data capture glasses according to an embodiment.
  • Fig. 41 depicts face and iris recognition according to an embodiment.
  • Fig. 42 illustrates use of dual omni-microphones according to an embodiment.
  • Fig. 43 depicts the directionality improvements with multiple microphones.
  • Fig. 44 shows the use of adaptive arrays to steer the audio capture facility according to an embodiment.
  • Fig. 45 shows the mosaic finger and palm enrollment system according to an embodiment.
  • Fig. 46 illustrates the traditional optical approach used by other finger and palm print systems.
  • Fig. 47 shows the approach used by the mosaic sensor according to an embodiment.
  • Fig. 48 depicts the device layout of the mosaic sensor according to an embodiment.
  • Fig. 49 illustrates the camera field of view and number of cameras used in a mosaic sensor according to another embodiment.
  • Fig. 50 shows the bio-phone and tactical computer according to an embodiment.
  • Fig. 51 shows the use of the bio-phone and tactical computer in capturing latent fingerprints and palm prints according to an embodiment.
  • Fig. 52 illustrates a typical DOMEX collection.
  • Fig. 53 shows the relationship between the biometric images captured using the bio-phone and tactical computer and a biometric watch list according to an embodiment.
  • Fig. 54 illustrates a pocket bio-kit according to an embodiment.
  • Fig. 55 shows the components of the pocket bio-kit according to an embodiment.
  • Fig. 56 depicts the fingerprint, palm print, geo-location and POI enrollment device according to an embodiment.
  • Fig. 57 shows a system for multi-modal biometric collection, identification, geo-location, and POI enrollment according to an embodiment.
  • Fig. 58 illustrates a fingerprint, palm print, geo-location, and POI enrollment forearm wearable device according to an embodiment.
  • Fig. 59 shows a mobile folding biometric enrollment kit according to an embodiment.
  • Fig. 60 is a high level system diagram of a biometric enrollment kit according to an embodiment.
  • FIG. 61 is a system diagram of a folding biometric enrollment device according to an embodiment.
  • Fig. 62 shows a thin-film finger and palm print sensor according to an embodiment.
  • Fig. 63 shows a biometric collection device for finger, palm, and enrollment data collection according to an embodiment.
  • Fig. 68 depicts a process for taking contactless fingerprints, palmprints or other biometric prints.
  • Fig. 69 depicts an embodiment of a watch controller.
  • Fig. 70A-D depicts embodiment cases for the eyepiece, including capabilities for charging and integrated display.
  • Fig. 71 depicts an embodiment of a ground stake data system.
  • Fig. 72 depicts a block diagram of a control mapping system including the eyepiece.
  • Fig. 73 depicts a biometric flashlight.
  • Fig. 74 depicts a helmet-mounted version of the eyepiece.
  • Fig. 75 depicts an embodiment of situational awareness glasses.
  • Fig. 76A depicts an assembled 360° imager and Fig. 76B depicts a cutaway view of the 360° imager.
  • Figure 77 depicts an exploded view of the multi-coincident view camera.
  • Figure 78 depicts a flight eye.
  • Fig. 79 depicts an exploded top view of the eyepiece.
  • Fig. 80 depicts an exploded electro-optic assembly.
  • Fig. 81 depicts an exploded view of the shaft of the electro-optic assembly.
  • Fig. 82 depicts an embodiment of an optical display system utilizing a planar illumination facility with a reflective display.
  • Fig. 83 depicts a structural embodiment of a planar illumination optical system.
  • Fig. 84 depicts an embodiment assembly of a planar illumination facility and a reflective display with laser speckle suppression components.
  • Fig. 85 depicts an embodiment of a planar illumination facility with grooved features for redirecting light.
  • Fig. 86 depicts an embodiment of a planar illumination facility with grooved features and 'anti-grooved' features paired to reduce image aberrations.
  • Fig. 87 depicts an embodiment of a planar illumination facility fabricated from a laminate structure.
  • Fig. 88 depicts an embodiment of a planar illumination facility with a wedged optic assembly for redirecting light.
  • Fig. 89 depicts a block diagram of an illumination module, according to an embodiment of the disclosure.
  • Fig. 90 depicts a block diagram of an optical frequency converter, according to an embodiment of the disclosure.
  • Fig. 91 depicts a block diagram of a laser illumination module, according to an embodiment of the disclosure.
  • Fig. 92 depicts a block diagram of a laser illumination system, according to another embodiment of the disclosure.
  • Fig. 93 depicts a block diagram of an imaging system, according to an embodiment of the disclosure.
  • Fig. 94A & B depict a lens with a photochromic element and a heater element in a top down and side view, respectively.
  • Fig. 95 depicts an embodiment of an LCoS front light design.
  • Fig 96 depicts optically bonded prisms with a polarizer.
  • Fig 97 depicts optically bonded prisms with a polarizer.
  • Fig 98 depicts multiple embodiments of an LCoS front light design.
  • Fig 99 depicts a wedge plus OBS overlaid on an LCoS.
  • Fig 100 depicts two versions of a wedge.
  • Fig 101 depicts a curved PBS film over the LCoS chip.
  • Fig 102A depicts an embodiment of an optical assembly.
  • Fig 102B depicts an embodiment of an optical assembly with an in-line camera.
  • Fig 103 depicts an embodiment of an image source.
  • Fig. 104 depicts an embodiment of an image source.
  • Fig. 105 depicts embodiments of image sources.
  • Fig. 106 depicts a top-level block diagram showing software application facilities and markets in conjunction with functional and control aspects of the eyepiece in an embodiment of the present disclosure.
  • Fig. 107 depicts a functional block diagram of the eyepiece application development environment in an embodiment of the present disclosure.
  • Fig. 108 depicts a platform elements development stack in relation to software applications for the eyepiece in an embodiment of the present disclosure.
  • FIG. 109 is an illustration of a head mounted display with see-through capability according to an embodiment of the present disclosure.
  • FIG. 1 10 is an illustration of a view of an unlabeled scene as viewed through the head mounted display depicted in FIG. 109.
  • FIG. I l l is an illustration of a view of the scene of FIG. 1 10 with 2D overlaid labels.
  • FIG. 1 12 is an illustration of 3D labels of FIG. I l l as displayed to the viewer's left eye.
  • FIG. 1 13 is an illustration of 3D labels of FIG. 1 1 1 as displayed to the viewer's right eye.
  • FIG. 1 14 is an illustration of the left and right 3D labels of FIG. I l l overlaid on one another to show the disparity.
  • FIG. 1 15 is an illustration of the view of a scene of FIG. 1 10 with the 3D labels.
  • FIG. 1 16 is an illustration of stereo images captured of the scene of FIG. 1 10.
  • FIG. 1 17 is an illustration of the overlaid left and right stereo images of FIG. 116 showing the disparity between the images.
  • FIG. 1 18 is an illustration of the scene of FIG. 110 showing the overlaid 3D labels.
  • FIG. 1 19 is a flowchart for a depth cue method embodiment of the present disclosure for providing 3D labels.
  • FIG. 120 is a flowchart for another depth cue method embodiment of the present disclosure for providing 3D labels.
  • FIG. 121 is a flowchart for yet another depth cue method embodiment of the present disclosure for providing 3D labels.
  • FIG. 122 is a flowchart for a still another depth cue method embodiment of the present disclosure for providing 3D labels.
  • FIG. 123 A depicts a processor for providing display sequential frames for image display through a display component.
  • FIG. 123B depicts a display interface configured to eliminate the display driver.
  • FIG. 124 is a schematic drawing of a prior art waveguide with multiple partial reflectors
  • FIG. 125 is a schematic drawing of a waveguide with multiple electrically switchable mirrors in a first position
  • FIG. 125A is an illustration of a waveguide assembly with electrical connections
  • FIG. 126 is a schematic drawing of a waveguide with multiple electrically switchable mirrors in a second position
  • FIG. 127 is a schematic drawing of a waveguide with multiple electrically switchable mirrors in a third position
  • FIG. 128 is a schematic drawing of a waveguide with multiple mechanically switchable mirrors in a first position
  • FIG. 128A is a schematic drawing of a waveguide assembly with microactuators and associated hardware
  • FIG. 129 is a schematic drawing of a waveguide with multiple mechanically switchable mirrors in a second position
  • FIG. 130 is a schematic drawing of a waveguide with multiple mechanically switchable mirrors in a third position
  • FIG. 131 A and FIG. 13 IB are illustrations of a waveguide display with switchable mirrors on the face of a user.
  • FIG. 132A - 132C are illustrations of the display area provided for users with different eye spacings.
  • FIG. 133 is a schematic drawing of a reflective image source with an edge light source and a frontlight that shows the rays of light passing through;
  • FIG. 134 is a schematic drawing of a prior art frontlight which includes grooves
  • FIG. 135 is a schematic drawing of a prior art frontlight which includes a planar polarizing beam splitter and the curved reflector in a solid block;
  • FIG. 136 is a schematic drawing of an embodiment of the present disclosure with a single edge light and a curved wire grid polarizer film;
  • FIG. 137 is a schematic drawing of an embodiment of the present disclosure with two edge lights and a curved wire grid polarizer film;
  • FIG. 138 is a schematic drawing of a side frame to hold the flexible wire grid polarizer film in the desired curved shape.
  • FIG. 139 is a flowchart of the method of the disclosure.
  • FIG. 140 is a schematic drawing of a near eye imaging system with a beam splitter
  • FIG. 141 is a schematic drawing of an optics module for a near eye imaging system
  • FIG. 142 is an illustration of a pellicle style optical plate
  • FIG. 143 is an illustration of an insert molded module housing with an embedded optical plate
  • FIG. 144 is an illustration of compression molding of a laminate style optical plate.
  • FIG. 145A-C is an illustration of the application of an optical film within a molded module housing.
  • FIG. 146 depicts a schematic front perspective view of an AR eyepiece (without its temple pieces) according to an embodiment of the present disclosure.
  • FIG. 147 depicts a schematic rear perspective view of the AR eyepiece of FIG. 146.
  • FIG. 148 depicts a schematic rear perspective partial view of the wearer's right side of the AR eyepiece of FIG. 146.
  • FIG. 149 depicts a schematic rear perspective partial view of the wearer's right side of the AR eyepiece of FIG. 146.
  • FIG. 150 depicts a schematic perspective view of components of the AR eyepiece shown in FIG. 146 for supporting one of the projection screens.
  • FIG. 151 depicts a schematic perspective view of the adjustment platform of the A eyepiece shown in FIG. 146.
  • FIG. 152 depicts a schematic perspective view of a component of the lateral adjustment mechanism of the AR eyepiece shown in FIG. 146.
  • FIG. 153 depicts a schematic perspective view of a component of the tilt adjustment mechanism of the AR eyepiece shown in FIG. 146.
  • FIG. 154 is a chart showing the dark adaptation curve for a human eye.
  • FIG. 155 is a chart showing the effect of progressively decreasing the illuminance on the dark adaptation curve for the human eye.
  • FIG. 156 is an illustration of a head mounted display with see-through capabilities.
  • FIG. 157 is a graph showing a relationship between display brightness and time when entering a dark environment.
  • FIG. 158 is a flow chart for a method of dark adaptation.
  • Fig. 159 depicts a virtual keyboard presented in a user's field of view.
  • FIG. 160 depicts an example of a display system with an optically flat reflective surface.
  • FIG. 161 shows an illustration of a near eye display module.
  • FIG. 162 shows an illustration of the optics associated with a type of head mounted display.
  • FIG. 163 shows an illustration in which baffles are added inside the housing between the illumination beam splitter and the lens.
  • FIG. 164 shows an illustration of another embodiment of the disclosure in which baffles are added at the entering surface of the lens.
  • FIG. 165 shows an illustration of another embodiment of the disclosure in which baffles are added at the output of the lens.
  • FIG. 166 shows an illustration of another embodiment of the disclosure in which a baffle is attached to the housing between the lens and the imaging beam splitter.
  • FIG. 167 shows an illustration of a further embodiment of the disclosure in which absorbing coatings are applied to the sidewalls of the housing.
  • FIG. 168 shows an illustration of another source of stray light in a head mounted display wherein the stray light comes directly from the edge of the light source.
  • Fig. 169 depicts stray light reflecting off of any reflective surface in the housing or the edge of the lens.
  • FIG. 170 shows an illustration of a yet further embodiment of the disclosure in which a baffle is provided adjacent to the light source.
  • FIG. 171 depicts an absorbing coating with ridges can be used wherein a series of small ridges or steps act as a series of baffles to block or clip edge rays over the entire sidewall area of the housing.
  • FIG. 172 shows a further embodiment of a tape or sheet which includes a carrier sheet and ridges that can be used to block reflected light.
  • Fig. 173 depicts an exploded view of an embodiment of the glasses.
  • Fig. 174 depicts a wiring design and wire guide of the glasses.
  • Fig. 175 depicts an enlarged version of the wiring design and wire guide of the glasses.
  • Fig. 176A shows a cutaway view of the wiring design and wire guide of the glasses.
  • Fig. 176B shows a cutaway view of the wiring design and wire guide of the glasses.
  • Fig. 176C shows an intact version of the wiring design and wire guide of the glasses.
  • Fig. 177 depicts a U-shaped accessory for securing the glasses.
  • Fig. 178 depicts an embodiment of a cable-tensioned system for securing the glasses to a user's head.
  • Fig. 179 A and Fig. 179 B depicts an embodiment of a cable-tensioned system for securing the glasses to a user's head in a bent configuration.
  • Fig. 180 depicts an embodiment of a cable-tensioned system for securing the glasses to a user's head.
  • Fig. 181 depicts an embodiment of a system for securing the glasses to a user's head.
  • Fig. 182 depicts an embodiment of a system for securing the glasses to a user's head.
  • Fig. 183 depicts an embodiment of a system for securing the glasses to a user's head.
  • Fig. 184 depicts an embodiment of a system for securing the glasses to a user's head.
  • Fig. 185A depicts an embodiment of the optical train.
  • Fig. 185B depicts sample ray traces for light in an embodiment of the optical train.
  • Fig. 186 depicts an embodiment of an LCoS plus ASIC package.
  • FIG. 187 is a schematic illustration of a prior art frontlight using a single light source and a beam splitter cube
  • FIG. 188 is a schematic illustration of a prior art frontlight using a single light source and a reflective beam splitter layer
  • FIG. 189 is a schematic illustration of a frontlight using a single light source wherein a flat reflective beam splitter layer is positioned at a reduced angle;
  • FIG. 190 is a schematic illustration of a frontlight using a single light source wherein the reflective beam splitter layer is curved;
  • FIG. 191 is a schematic illustration of a frontlight using dual light sources wherein a folded reflective beam splitter film with flat surfaces is positioned in a transparent solid;
  • FIG. 192 is a schematic illustration of a frontlight using a dual light sources wherein a folded free standing reflective beam splitter film with flat surfaces is used;
  • FIG. 193 is a schematic illustration of a frontlight using a dual light sources wherein a folded free standing reflective beam splitter film with curved surfaces is used;
  • FIG. 194 is a schematic illustration of a frontlight using a dual light sources wherein a folded reflective beam splitter film with curved surfaces is positioned in a transparent solid;
  • FIG. 195 is a schematic illustration of a frontlight using a single light source with an opposing mirror and a quarter wave film to recycle a portion of the polarized light wherein a folded reflective beam splitter film with flat surfaces is provided in a transparent solid;
  • FIG. 196 is a schematic illustration of a frontlight using a single light source with an opposing mirror and a quarter wave film to recycle a portion of the polarized light wherein a free standing folded reflective polarizer beam splitter film with flat surfaces is provided;
  • FIG. 197 is a schematic illustration of a frontlight using a single light source with an opposing mirror and a quarter wave film to recycle a portion of the polarized light wherein a free standing folded reflective polarizer beam splitter film with curved surfaces is provided;
  • FIG. 198 is a schematic illustration of a method for making a frontlight such as that shown in FIG. 197 but with the folded reflective beam splitter film with flat surfaces positioned in a transparent solid wherein top and bottom film holders are used to shape and position the reflective beam splitter film is provided and portions of the polarized light are recycled;
  • FIG. 199 is a schematic illustration of a frontlight for use with dual light sources and recycled portions of polarized light made using the method illustrated in FIG. 198;
  • FIG. 200 is a schematic illustration of a folded free standing reflective beam splitter film that is supported on the edges in a first step of a method for casting a solid frontlight;
  • FIG. 201 is a schematic illustration showing the holes for injecting the transparent casting material and venting the air in a method for casting a solid frontlight;
  • FIG. 202 is a schematic illustration showing the casting of the upper portion of the cast solid frontlight
  • FIG. 203 is a schematic illustration showing the use of a flat transparent sheet to flatten the top of the cast solid frontlight
  • Fig. 204 is a flow chart of a method for making a solid frontlight by assembly
  • FIG. 205 is a flow chart of a method for making a solid frontlight by casting.
  • FIG. 206 is a flow chart of a method for making a solid film holder using a multi-step molding process.
  • Fig. 207 depicts an embodiment of a near field communications watch.
  • Fig. 208 depicts an embodiment of a near field communications watch interfacing with a near field communications enabled point of service device.
  • Fig. 209 depicts an embodiment of a near field communications watch interfacing with a near field communications enabled point of service device and with a user's smart phone.
  • the present disclosure relates to eyepiece electro-optics.
  • the eyepiece may include projection optics suitable to project an image onto a see-through or translucent lens, enabling the wearer of the eyepiece to view the surrounding environment as well as the displayed image.
  • the projection optics also known as a projector, may include an RGB LED module that uses field sequential color. With field sequential color, a single full color image may be broken down into color fields based on the primary colors of red, green, and blue and imaged by an LCoS (liquid crystal on silicon) optical display 210 individually. As each color field is imaged by the optical display 210, the corresponding LED color is turned on. When these color fields are displayed in rapid sequence, a full color image may be seen.
  • LCoS liquid crystal on silicon
  • the resulting projected image in the eyepiece can be adjusted for any chromatic aberrations by shifting the red image relative to the blue and/or green image and so on.
  • the image may thereafter be reflected into a two surface freeform waveguide where the image light engages in total internal reflections (TIR) until reaching the active viewing area of the lens where the user sees the image.
  • a processor which may include a memory and an operating system, may control the LED light source and the optical display.
  • the projector may also include or be optically coupled to a display coupling lens, a condenser lens, a polarizing beam splitter, and a field lens.
  • a processor 12302 may provide display sequential frames 12324 for image display through a display component 12328 (e.g. an LCOS display component) of the eyepiece 100.
  • the sequential frames 12324 may be produced with or without a display driver 12312 as an intermediate component between the processor 12302 and the display component 12328.
  • the processor 12302 may include a frame buffer 12304 and a display interface 12308 (e.g. a mobile industry processor interface (MIPI), with a display serial interface (DSI)).
  • MIPI mobile industry processor interface
  • DSI display serial interface
  • the display interface 12308 may provide per-pixel RGB data 12310 to the display driver 12312 as an intermediate component between the processor 12302 and the display component 12328, where the display driver 12312 accepts the per-pixel RGB data 12310 and generates individual full frame display data for red 12318, green 12320, and blue 12322, thus providing the display sequential frames 12324 to the display component 12328.
  • the display driver 12312 may provide timing signals, such as to synchronize the delivery of the full frames 12318 12320 12322 as display sequential frames 12324 to the display component 12328.
  • timing signals such as to synchronize the delivery of the full frames 12318 12320 12322 as display sequential frames 12324 to the display component 12328.
  • the display interface 12330 may be configured to eliminate the display driver 12312 by providing full frame display data for red 12334, green 12338, and blue 12340 directly to the display component 12328 as display sequential frames 12324.
  • timing signals 12332 may be provided directly from the display interface 12330 to the display components. This configuration may provide significantly lower power consumption by removing the need for a display driver. Not only may this direct panel information remove the need for a driver, but also may simplify the overall logic of the configuration, and remove redundant memory required to reform panel information from pixels, to generate pixel information from frame, and the like.
  • the ASIC may be mounted onto a flexible printed circuit (FPC) 18604 with a stiffener on the topside.
  • the topside stiffener does not add thickness to the overall package if it is as tall as the ASIC.
  • the FPC can connect to a standard LCoS package, such as LCoS on fiberglass reinforced epoxy laminates (FR4) 18608 via a connector 18602, such as a zero insertion force (ZIF) connection or Board to Board connector for a higher pin count.
  • a pressure sensitive adhesive may be used to bond the ASIC, stiffener(s) and LCoS to the FPC.
  • Fig. 1 an illustrative embodiment of the augmented reality eyepiece 100 may be depicted. It will be understood that embodiments of the eyepiece 100 may not include all of the elements depicted in Fig. 1 while other embodiments may include additional or different elements.
  • the optical elements may be embedded in the arm portions 122 of the frame 102 of the eyepiece. Images may be projected with a projector 108 onto at least one lens 104 disposed in an opening of the frame 102.
  • One or more projectors 108 such as a nanoprojector, picoprojector, microprojector, femtoprojector, LASER-based projector, holographic projector, and the like may be disposed in an arm portion of the eyepiece frame 102.
  • both lenses 104 are see- through or translucent while in other embodiments only one lens 104 is translucent while the other is opaque or missing.
  • more than one projector 108 may be included in the eyepiece 100.
  • the eyepiece 100 may also include at least one articulating ear bud 120, a radio transceiver 118 and a heat sink 1 14 to absorb heat from the LED light engine, to keep it cool and to allow it to operate at full brightness.
  • a radio transceiver 118 and a heat sink 1 14 to absorb heat from the LED light engine, to keep it cool and to allow it to operate at full brightness.
  • TI OMAP4 open multimedia applications processors
  • a flex cable with RF antenna 1 all of which will be further described herein.
  • the projector 200 may be an RGB projector.
  • the projector 200 may include a housing 202, a heatsink 204 and an RGB LED engine or module 206.
  • the RGB LED engine 206 may include LEDs, dichroics, concentrators, and the like.
  • a digital signal processor (DSP) (not shown) may convert the images or video stream into control signals, such as voltage drops / current modifications, pulse width modulation (PWM) signals, and the like to control the intensity, duration, and mixing of the LED light.
  • PWM pulse width modulation
  • the DSP may control the duty cycle of each PWM signal to control the average current flowing through each LED generating a plurality of colors.
  • a still image co-processor of the eyepiece may employ noise-filtering, image / video stabilization, and face detection, and be able to make image enhancements.
  • An audio back-end processor of the eyepiece may employ buffering, SRC, equalization and the like.
  • the projector 200 may include an optical display 210, such as an LCoS display, and a number of components as shown.
  • the projector 200 may be designed with a single panel LCoS display 210; however, a three panel display may be possible as well.
  • the display 210 is illuminated with red, blue, and green sequentially (aka field sequential color).
  • the projector 200 may make use of alternative optical display technologies, such as a back-lit liquid crystal display (LCD), a front- lit LCD, a transflective LCD, an organic light emitting diode (OLED), a field emission display (FED), a ferroelectric LCoS (FLCOS), liquid crystal technologies mounted on Sapphire, transparent liquid-crystal micro-displays, quantum-dot displays, and the like.
  • LCD liquid crystal display
  • front- lit LCD a transflective LCD
  • OLED organic light emitting diode
  • FED field emission display
  • FLCOS ferroelectric LCoS
  • the display may be a 3D display, LCD, thin film transistor LCD, LED, LCOS, ferroelectric liquid crystal on silicon display, CMOS display, OLED, QLED, OLED arrays that have CMOS style pixels sensors at the junctions between the OED pixels, transmissive LCoS display, CRT display, VGA display, SXGA display, QVGA display, display with video based gaze tracker, display with exit pupil expanding technology, Asahi film display, a free form optics display, an XY polynomial combiner display, a light guide transfer display, an Amoled display, and the like.
  • the display may be a holographic display that allows the eyepiece to display an image from the image source as a hologram.
  • the display may be a liquid crystal reflective micro-display. Such a display may contain polarization optics and may improve brightness as compared to certain OLED micro displays.
  • the display may be a free form prism display. Free form prism displays may achieve 3D stereo imaging capability.
  • the display may be similar or the same as those displays described by Cannon and/or Olympus in patent nos. 6,384,983 and 6,181 ,475 respectively.
  • the display may contain a video based gaze tracker.
  • a light beam of an infrared light source may be divided and expanded inside an exit pupil expander (EPE) to produce collimated beams from the EPE toward the eyes.
  • EPE exit pupil expander
  • a Miniature video camera may image the cornea and eye gaze direction may be calculated by locating the pupil and the glints of the infrared beams.
  • the data from the gaze tracker may reflect the user focus point in the displayed image which may be used as an input device.
  • the display may contain an exit pupil expander which enlarges the exit pupil and transfers the image to a new position.
  • the display may be an off axis optics display. In embodiments, such a display may not be coincident with the mechanical center of the aperture. This may avoid obstruction of the primary aperture by secondary optical elements, instrument packages and/or sensors and may provide access to instrument packages and/ or sensors at the focus.
  • the active-maxtrix organic light-emitting diode (Amoled) display may use a pixel design, called PenTile, from Nouvoyance which lets more light through in a couple of ways. First, the red, blue, and green subpixels are larger than those in traditional displays. Second, one out of every four subpixels is clear.
  • the disclosure provides an integral array of switchable mirrors in a waveguide that can be used sequentially to provide a progressive scan of portions of the image across the display field of view. By rapidly switching the mirrors from reflective to transmissive in a sequential manner, the image can be provided to the user without perceptible flicker. Since each switchable mirror is in the transmissive state more than the reflective state, the array of switchable mirrors appears to be transparent to the user while also presenting the displayed image to the user.
  • FIG. 125 shows a waveguide display device 12500 with an integral array of switchable mirrors 12508a-12508c that redirect the light from the image source 12502 that is transported through the waveguide 12510 to provide image light 12504 to the user.
  • Three switchable mirrors 12508a-12508c, are shown but the array can include a different number of switchable mirrors in the disclosure.
  • the switchable mirrors shown in FIG. 125 are electrically switchable mirrors including liquid crystal switchable mirrors.
  • Cover glasses 12512 are provided to contain the liquid crystal material in the thin layers which are shown as switchable mirrors 12508a- 12508c.
  • FIG. 125 further shows power wires 12514 and 12518.
  • the waveguide 12510 and the integral array of switchable mirrors 12508a-12508c can be made from plastic or glass material so long as it is suitably flat. Thickness uniformity is not as important as in most liquid crystal devices since the switchable mirror has high reflectivity. Construction of a switchable liquid crystal mirror is described in United States Patent 6999649.
  • FIGS. 126 and 127 show the sequential aspect of the disclosure in that only one of the switchable mirrors in the array is in the reflective state at a time, the other switchable mirrors in the array are then in the transmissive state.
  • FIG. 124 shows the first switchable mirror 12508a in the reflective state thereby redirecting the light from the image source 12502 to become image light 12504 that presents a portion of the image to the user.
  • the other switchable mirrors 12508b and 12508c are in the transmissive state.
  • Fig. 124 further shows waveguide 12410.
  • switchable mirrors 12508a and 12508c are in the transmissive while switchable mirror 12508b is in the reflective state.
  • This condition provides image light 12600 with its associated portion of the image to the user.
  • switchable mirrors 12508a and 12508b are in the transmissive state while switchable mirror 12508c is in the reflective state.
  • This last condition provides image light 12700 with its associated portion of the image to the user.
  • the sequence is repeated as shown in FIG. 124, followed by that shown in FIG. 125 and then as shown in FIG. 126 to provide a progressive scan of the image. The sequence is repeated continuously while the user is viewing displayed images.
  • the image source 12502 can operate continuously while the switchable mirrors provide a progressive scan of the image light 12504 across the field of view. If the image light is perceived to be brighter or there is a different color balance for different switchable mirrors, the image source can be adjusted to compensate and the brightness or color balance of the image source can be modulated to synchronize with the switching sequence of the array of switchable mirrors. In another embodiment of the disclosure, the order of switching of the switchable mirrors can be changed to provide an interlaced image to the user such as 1 , 3, 2, 4 in a repeating fashion for an array of four switchable mirrors. [00300] FIG.
  • the switchable mirrors in the waveguide display device 12800 comprise prisms 12804a - 12804c that are moved to alternately provide an air gap or an optical contact with surfaces 12810a-12810c respectively.
  • prism 12804a has been moved downward to provide an air gap so that surface 12810a is a reflective surface that operates by total internal reflection.
  • prisms 12804b and 12804c are forced upwards to provide optical contact at surfaces 12810b and 12810c respectively so that surfaces 12810b and 12810c are transmissive.
  • FIG. 128 also shows power wires 12812, mount and common ground connection 12814, and microactuators 12818a-c.
  • FIGS. 129 and 130 show other conditions in the sequence for the mechanically driven switchable mirrors in the switchable mirror array.
  • prisms 12804a and 12804c are forced upwards to provide optical contact with surfaces 12810a and 12810c respectively thereby providing a transmissive state for the light from the image source 12502.
  • prism 12804b is moved downward to create an air gap at surface 12810b so that the light from the image source 12502 is redirected to become image light 12900 that presents an associated portion of the image to the user.
  • prisms 12804a and 12804b are forced upwards to provide optical contact at surfaces 12810a and 12810b respectively so that the light from the image source passes through to surface 12810c.
  • Prism 12804c is moved downwards to provide an air gap at surface 12810c so that surface 12810c becomes a reflecting surface with total internal reflection and the light from the image source 12502 is redirected to become image light 13000 with its associated portion of the image.
  • the conditions for total internal reflection are based on the optical properties of the material of the waveguide 12808 and the air as is well known to those skilled in the art.
  • the refractive index of the waveguide 12808 must be greater than 1.42.
  • the surfaces of the prisms 12804a-12804c must match those of the surfaces 12810a-12810c within 1.0 micron.
  • the refractive index of the prisms 12804a - 12804c must be the same as the refractive index of the waveguide 12808 within approximately 0.1.
  • FIGS. 131 a and 131b show illustrations of waveguide assemblies 13102 with arrays of switchable mirrors as included in the disclosure.
  • FIG. 131 a shows a side view of the waveguide assembly 13102 on the user's head wherein the long axis of the array of switchable mirrors is oriented vertically so that the image light 13100 is directed into the user's eye.
  • FIG. 131b shows an overhead view of the waveguide assembly 13102 on the user's head wherein the short axis of the array of switchable mirrors 13104 can be seen and image light 13100 is provided to the user's eye 131 10.
  • FIGS. 131a and 131b the field of view provided in the image light 13100 can be clearly seen.
  • FIG. 131a and 131b the field of view provided in the image light 13100 can be clearly seen.
  • FIG. 131b also shows an embodiment of the waveguide assembly 13102 including the image source 13108 wherein the image source 13108 has an internal light source to provide light from a miniature display such as an LCOS display or an LCD display that is then transported by the waveguide to the switchable mirrors where it is redirected by the switchable mirrors and becomes image light 13100 that is presented to the user' s eye 131 10.
  • the switchable mirror sequence is preferentially operated at faster than 60 Hz.
  • each of the n switchable mirrors in the array is in the reflective state for (1/60) X 1/n seconds then in the transmissive state for (1/60) X (n-l)/n seconds in each cycle of the sequence.
  • each switchable mirror is in the transmissive state for a greater portion of each cycle in the sequence than it is in the reflective state and consequently the user perceives the array of switchable mirrors to be relatively transparent.
  • the integral array of switchable mirrors has more switchable mirrors than are needed to cover the display area.
  • the extra switchable mirrors are used to provide an adjustment for different users that have different eye spacings (also known as interpupillary distance).
  • the switchable mirrors that are used to present the image to the user are adjacent to one another so that they present a contiguous image area.
  • the switchable mirrors at the edges of the array are used depending on the eye spacing of the user.
  • an array 13200 is provided with seven switchable mirrors each 3mm wide.
  • five adjacent switchable mirrors are used to provide a 15mm wide display area (13202a- 13202c) with +/- 3mm of adjustment for eye spacing.
  • the five switchable mirrors toward the inner edge are used to display while the two outer switchable mirrors are not used.
  • the five switchable mirrors toward the outer edge are used to display while the two inner switchable mirrors are not used.
  • the centered case is shown in FIG. 132B where the center five switchable mirrors are used and the outer and inner switchable mirrors are not used.
  • the term "not used” refers to the switchable mirror being held in the transmissive state while the other switchable mirrors are used in a repeating sequence between the transmissive state and the reflective state.
  • a liquid crystal switchable mirror with a fast response is used as provided by Kent Optronics Inc., Hopewell Junction, NY (http://www.kentoptronics.com/).
  • the waveguide is made of glass or plastic and the liquid crystal is contained in spaces between layers so that the liquid crystal is 5 microns thick. Coverglasses contain the liquid crystal on the outer surfaces.
  • the response time is 10 millisec with reflectivity of 87% in the reflective state and transmission of 87% in the transmissive state.
  • Three switchable mirrors can be driven in a sequence that operates at 30 Hz. If the switchable mirrors are 5mm wide, a 15mm wide display area is provided which equates to a 38 degree field of view when viewed with the eye 10 mm from the waveguide with an 8 mm wide eyebox.
  • a mechanically driven array of prisms is provided made of glass or plastic with a refractive index of 1.53, the waveguide is made of the same material with a refractive index of 1.53.
  • the surfaces of the prisms are polished to provide a flatness of less than 1 micron and piezoelectric microactuators are used to move the prisms approximately 10 microns from the transmissive state to the reflective state.
  • the waveguide is molded to provide a flatness of less than 1 micron on the mating surfaces to the prisms.
  • Five switchable mirrors can be driven by the piezoelectric actuators to operate in a sequence at 100 Hz.
  • the piezoelectric microactuators are obtained from Steiner & Martins Inc., Miami, FL
  • microactuators provide a 10 micron movement with over 200 pounds of force in a 5X5X10mm package driven by 150V.
  • An array of 5 prisms that are each 5mm wide are used to provide a 25mm wide display area which equates to a 72 degree field of view when viewed with the eye 10 mm from the waveguide with an 8 mm wide eyebox.
  • a waveguide display system may comprise an image source that provides image light from a displayed image, a waveguide to transport the image light to a display area, and an integral array of switchable mirrors to redirect the image light from the waveguide to the display area where the displayed image can be viewed by the user.
  • the switchable mirrors may be electrically driven.
  • the switchable mirrors may be mechanically driven in embodiments.
  • the microactuators may be used to mechanically drive the switchable mirrors. Further, the microactuators may be piezoelectric.
  • the switchable mirrors may be switched between transmissive and reflective states to provide portions of the image light in a progressive scan across the display area.
  • a method of providing a displayed image from a waveguide may comprise providing image light from an image source to waveguide, providing an integral array of switchable mirrors in the waveguide over the display area and sequentially operating the switchable mirrors between transmissive and reflective states to provide portions of the image light in a progressive scan across the display area.
  • a waveguide display system with interpupillary adjustment may comprise an image source that provides image light from a displayed image, a waveguide to transport the image light to a display area and an internal array of switchable mirrors to redirect the image light from the waveguide to the display.
  • the array of switchable mirrors may have more mirrors than are needed to cover the display area and the switchable mirrors at the edges of the array may be used to provide a display area that matches the eye spacing of the user.
  • the eyepiece may be powered by any power supply, such as battery power, solar power, line power, and the like.
  • the power may be integrated in the frame 102 or disposed external to the eyepiece 100 and in electrical communication with the powered elements of the eyepiece 100.
  • a solar energy collector may be placed on the frame 102, on a belt clip, and the like.
  • Battery charging may occur using a wall charger, car charger, on a belt clip, in an eyepiece case, and the like.
  • the projector 200 may include the LED light engine 206, which may be mounted on heat sink 204 and holder 208, for ensuring vibration-free mounting for the LED light engine, hollow tapered light tunnel 220, diffuser 212 and condenser lens 214.
  • Hollow tunnel 220 helps to homogenize the rapidly -varying light from the RGB LED light engine.
  • hollow light tunnel 220 includes a silvered coating.
  • the diffuser lens 212 further homogenizes and mixes the light before the light is led to the condenser lens 214. The light leaves the condenser lens 214 and then enters the polarizing beam splitter (PBS) 218.
  • PBS polarizing beam splitter
  • the LED light is propagated and split into polarization components before it is refracted to a field lens 216 and the LCoS display 210.
  • the LCoS display provides the image for the microprojector.
  • the image is then reflected from the LCoS display and back through the polarizing beam splitter, and then reflected ninety degrees.
  • the image leaves microprojector 200 in about the middle of the microprojector.
  • the light then is led to the coupling lens 504, described below.
  • Fig. 2 depicts an embodiment of the projector assembly along with other supporting figures as described herein, but one skilled in the art will appreciate that other configurations and optical technologies may be employed.
  • transparent structures such as with substrates of Sapphire, may be utilized to implement the optical path of the projector system rather than with reflective optics, thus potentially altering and/or eliminating optical components, such as the beam splitter, redirecting mirror, and the like.
  • the system may have a backlit system, where the LED RGB triplet may be the light source directed to pass light through the display.
  • the back light and the display may be mounted either adjacent to the wave guide, or there may be columnizing/directing optics after the display to get the light to properly enter the optic.
  • the display may be mounted on the top, the side, and the like, of the waveguide.
  • a small transparent display may be implemented with a silicon active backplane on a transparent substrate (e.g. sapphire), transparent electrodes controlled by the silicon active backplane, a liquid crystal material, a polarizer, and the like.
  • the function of the polarizer may be to correct for depolarization of light passing through the system to improve the contrast of the display.
  • the system may utilize a spatial light modulator that imposes some form of spatially- varying modulation on the light path, such as a micro-channel spatial light modulator where a membrane-mirror light shutters based on micro-electromechanical systems (MEMS).
  • MEMS micro-electromechanical systems
  • the system may also utilize other optical components, such as a tunable optical filter (e.g. with a deformable membrane actuator), a high angular deflection micro-mirror system, a discrete phase optical element, and the like.
  • the eyepiece may utilize OLED displays, quantum-dot displays, and the like, that provide higher power efficiency, brighter displays, less costly components, and the like.
  • display technologies such as OLED and quantum-dot displays may allow for flexible displays, and so allowing greater packaging efficiency that may reduce the overall size of the eyepiece.
  • OLED and quantum-dot display materials may be printed through stamping techniques onto plastic substrates, thus creating a flexible display component.
  • the OLED (organic LED) display may be a flexible, low-power display that does not require backlighting. It can be curved, as in standard eyeglass lenses.
  • the OLED display may be or provide for a transparent display.
  • high modulation transfer functions permit the combination of resolution levels and device size, e.g., eyeframe thickness, that have been unachievable heretofore.
  • the eyepiece may utilize a planar illumination facility 8208 in association with a reflective display 8210, where light source(s) 8202 are coupled 8204 with an edge of the planar illumination facility 8208, and where the planar side of the planar illumination facility 8208 illuminates the reflective display 8210 that provides imaging of content to be presented to the eye 8222 of the wearer through transfer optics 8212.
  • the reflective display 8210 may be an LCD, an LCD on silicon (LCoS), cholesteric liquid crystal, guest-host liquid crystal, polymer dispersed liquid crystal, phase retardation liquid crystal, and the like, or other liquid crystal technology know in the art.
  • the reflective display 8210 may be a bi-stable display, such as electrophoretic, electrofluidic, electrowetting, electrokinetic, cholesteric liquid crystal, and the like, or any other bi-stable display known to the art.
  • the reflective display 8210 may also be a combination of an LCD technology and a bi-stable display technology.
  • the coupling 8204 between a light source 8202 and the 'edge' of the planar illumination facility 8208 may be made through other surfaces of the planar illumination facility 8208 and then directed into the plane of the planar illumination facility 8208, such as initially through the top surface, bottom surface, an angled surface, and the like. For example, light may enter the planar illumination facility from the top surface, but into a 45° facet such that the light is bent into the direction of the plane. In an alternate embodiment, this bending of direction of the light may be implemented with optical coatings.
  • the light source 8202 may be an RGB LED source (e.g. an LED array) coupled 8204 directly to the edge of the planar illumination facility.
  • the light entering the edge of the planar illumination facility may then be directed to the reflective display for imaging, such as described herein.
  • Light may enter the reflective display to be imaged, and then redirected back through the planar illumination facility, such as with a reflecting surface at the backside of the reflective display.
  • Light may then enter the transfer optics 8212 for directing the image to the eye 8222 of the wearer, such as through a lens 8214, reflected by a beam splitter 8218 to a reflective surface 8220, back through the beam splitter 8218, and the like, to the eye 8222.
  • the transfer optics 8212 have been described in terms of the 8214, 8218, and 8220, it will be appreciated by one skilled in the art that the transfer optics 8212 may include any transfer optics configuration known, including more complex or simpler configurations than describe herein. For instance, with a different focal length in the field lens 8214, the beam splitter 8218 could bend the image directly towards the eye, thus eliminating the curved mirror 8220, and achieving a simpler design implementation.
  • the light source 8202 may be an LED light source, a laser light source, a white light source, and the like, or any other light source known in the art.
  • the light coupling mechanism 8204 may be direct coupling between the light source 8202 and the planar illumination facility 8208, or through coupling medium or mechanism, such as a waveguide, fiber optic, light pipe, lens, and the like.
  • the planar illumination facility 8208 may receive and redirect the light to a planar side of its structure through an interference grating, optical imperfections, scattering features, reflective surfaces, refractive elements, and the like.
  • the planar illumination facility 8208 may be a cover glass over the reflective display 8210, such as to reduce the combined thickness of the reflective display 8210 and the planar illumination facility 8208.
  • the planar illumination facility 8208 may further include a diffuser located on the side nearest the transfer optics 8212, to expand the cone angle of the image light as it passes through the planar illumination facility 8208 to the transfer optics 8212.
  • the transfer optics 8212 may include a plurality of optical elements, such as lenses, mirrors, beam splitters, and the like, or any other optical transfer element known to the art.
  • Fig. 83 presents an embodiment of an optical system 8302 for the eyepiece 8300, where a planar illumination facility 8310 and reflective display 8308 mounted on substrate 8304 are shown interfacing through transfer optics 8212 including an initial diverging lens 8312, a beam splitter 8314, and a spherical mirror 8318, which present the image to the eyebox 8320 where the wearer's eye receives the image.
  • the flat beam splitter 8314 may be a wire-grid polarizer, a metal partially transmitting mirror coating, and the like
  • the spherical reflector 8318 may be a series of dielectric coatings to give a partial mirror on the surface.
  • the coating on the spherical mirror 8318 may be a thin metal coating to provide a partially transmitting mirror.
  • Fig. 84 shows a planar illumination facility 8408 as part of a ferroelectric light-wave circuit (FLC) 8404, including a configuration that utilizes laser light sources 8402 coupling to the planar illumination facility 8408 through a waveguide wavelength converter 8420 8422, where the planar illumination facility 8408 utilizes a grating technology to present the incoming light from the edge of the planar illumination facility to the planar surface facing the reflective display 8410. The image light from the reflective display 8410 is then redirected back though the planar illumination facility 8408 through a hole 8412 in the supporting structure 8414 to the transfer optics.
  • FLC ferroelectric light-wave circuit
  • the FLC also utilizes optical feedback to reduce speckle from the lasers, by broadening the laser spectrum as described in United States Patent 7265896.
  • the laser source 8402 is an I laser source, where the FLC combines the beams to RGB, with back reflection that causes the laser light to hop and produce a broadened bandwidth to provide the speckle suppression.
  • the speckle suppression occurs in the wave-guides 8420.
  • the laser light from laser sources 8402 is coupled to the planar illumination facility 8408 through a multi-mode interference combiner (MMI) 8422. Each laser source port is positioned such that the light traversing the MMI combiner superimposes on one output port to the planar illumination facility 8408.
  • MMI multi-mode interference combiner
  • the grating of the planar illumination facility 8408 produces uniform illumination for the reflective display.
  • the grating elements may use a very fine pitch (e.g. interferometric) to produce the illumination to the reflective display, which is reflected back with very low scatter off the grating as the light passes through the planar illumination facility to the transfer optics. That is, light comes out aligned such that the grating is nearly fully transparent.
  • the optical feedback utilized in this embodiment is due to the use of laser light sources, and when LEDs are utilized, speckle suppression may not be required because the LEDs are already broadband enough.
  • Fig. 85 In an embodiment of an optics system utilizing a planar illumination facility 8502 that includes a configuration with optical imperfections, in this case a 'grooved' configuration, is shown in Fig. 85.
  • the light source(s) 8202 are coupled 8204 directly to the edge of the planar illumination facility 8502.
  • Light then travels through the planar illumination facility 8502 and encounters small grooves 8504A-D in the planar illumination facility material, such as grooves in a piece of Poly-methyl methacrylate (PMMA).
  • the grooves 8504A-D may vary in spacing as they progress away from the input port (e.g.
  • the light is then redirected by the grooves 8504A-D to the reflective display 8210 as an incoherent array of light sources, producing fans of rays traveling to the reflective display 8210, where the reflective display 8210 is far enough away from the grooves 8504A-D to produce illumination patterns from each groove that overlap to provide uniform illumination of the area of the reflective display 8210.
  • there may be an optimum spacing for the grooves where the number of grooves per pixel on the reflective display 8210 may be increased to make the light more incoherent (more fill), but where in turn this produces lower contrast in the image provided to the wearer with more grooves to interfere within the provided image. While this embodiment has been discussed with respect to grooves, other optical imperfections, such as dots, are also possible.
  • counter ridges 8604 may be applied into the grooves of the planar illumination facility, such as in a 'snap-on' ridge assembly 8602. Wherein the counter ridges 8604 are positioned in the grooves 8504A-D such that there is an air gap between the groove sidewalls and the counter ridge sidewalls. This air gap provides a defined change in refractive index as perceived by the light as it travels through the planar illumination facility that promotes a reflection of the light at the groove sidewall.
  • the application of counter ridges 8604 reduces aberrations and deflections of the image light caused by the grooves.
  • image light reflected from reflective display 8210 is refracted by the groove sidewall and as such it changes direction because of Snell's law.
  • the refraction of the image light is compensated for and the image light is redirected toward the transfer optics 8214.
  • the planar illumination facility 8702 may be a laminate structure created out of a plurality of laminating layers 8704 wherein the laminating layers 8704 have alternating different refractive indices.
  • the planar illumination facility 8702 may be cut across two diagonal planes 8708 of the laminated sheet.
  • the grooved structure shown in Figs. 85 and 86 is replaced with the laminate structure 8702.
  • the laminating sheet may be made of similar materials (PMMA 1 versus PMMA 2 - where the difference is in the molecular weight of the PMMA). As long as the layers are fairly thick, there may be no interference effects, and act as a clear sheet of plastic.
  • the diagonal laminations will redirect a small percentage of light source 8202 to the reflective display, where the pitch of the lamination is selected to minimize aberration.
  • Fig. 88 shows a planar illumination facility 8802 utilizing a 'wedge' configuration.
  • the light source(s) are coupled 8204 directly to the edge of the planar illumination facility 8802.
  • Light then travels through the planar illumination facility 8802 and encounters the slanted surface of the first wedge 8804, where the light is redirected to the reflective display 8210, and then back to the illumination facility 8802 and through both the first wedge 8804 and the second wedge 8812 and on to the transfer optics.
  • multi-layer coatings 8808 8810 may be applied to the wedges to improve transfer properties.
  • the wedge may be made from PMMA, with dimensions of l/2mm high - 10mm width, and spanning the entire reflective display, have 1 to 1.5 degrees angle, and the like.
  • the light may go through multiple reflections within the wedge 8804 before passing through the wedge 8804 to illuminate the reflective display 8210. If the wedge 8804 is coated with a highly reflecting coating 8808 and 8810, the ray may make many reflections inside wedge 8804 before turning around and coming back out to the light source 8202 again. However, by employing multi-layer coatings 8808 and 8810 on the wedge 8804, such as with Si02, Niobium Pentoxide, and the like, light may be directed to illuminate the reflective display 8210.
  • the coatings 8808 and 8810 may be designed to reflect light at a specified wavelength over a wide range of angles, but transmit light within a certain range of angles (e.g. theta out angles). In embodiments, the design may allow the light to reflect within the wedge until it reaches a transmission window for presentation to the reflective display 8210, where the coating is then configured to enable transmission.
  • the angle of the wedge directs light from an LED lighting system to uniformly irradiate a reflective image display to produce an image that is reflected through the illumination system.
  • the image provided to the wearer's eye has uniform brightness as determined by the image content in the image.
  • the see-through optics system including a planar illumination facility 8208 and reflective display 8210 as described herein may be applied to any head- worn device known to the art, such as including the eyepiece as described herein, but also to helmets (e.g. military helmets, pilot helmets, bike helmets, motorcycle helmets, deep sea helmets, space helmets, and the like) ski goggles, eyewear, water diving masks, dusk masks, respirators, Hazmat head gear, virtual reality headgear, simulation devices, and the like.
  • helmets e.g. military helmets, pilot helmets, bike helmets, motorcycle helmets, deep sea helmets, space helmets, and the like
  • goggles e.g. military helmets, pilot helmets, bike helmets, motorcycle helmets, deep sea helmets, space helmets, and the like
  • eyewear e.g. military helmets, pilot helmets, bike helmets, motorcycle helmets, deep sea helmets, space helmets, and the like
  • goggles e.g. military helmet
  • the optics system and protective covering associated with the head-worn device may incorporate the optics system in a plurality of ways, including inserting the optics system into the head-worn device in addition to optics and covering traditionally associated with the head-worn device.
  • the optics system may be included in a ski goggle as a separate unit, providing the user with projected content, but where the optics system doesn't replace any component of the ski goggle, such as the see-through covering of the ski goggle (e.g. the clear or colored plastic covering that is exposed to the outside environment, keeping the wind and snow from the user's eyes).
  • the optics system may replace, at least in part, certain optics traditionally associated with the head- worn gear.
  • certain optical elements of the transfer optics 8212 may replace the outer lens of an eyewear application.
  • a beam splitter, lens, or mirror of the transfer optics 8212 could replace the front lens for an eyewear application (e.g. sunglasses), thus eliminating the need for the front lens of the glasses, such as if the curved reflection mirror 8220 is extended to cover the glasses, eliminating the need for the cover lens.
  • the see-through optics system including a planar illumination facility 8208 and reflective display 8210 may be located in the head- worn gear so as to be unobtrusive to the function and aesthetic of the head- worn gear.
  • the optics system may be located in proximity with an upper portion of the lens, such as in the upper portion of the frame.
  • the optical assembly may be used in configurations such as a head or helmet mounted display, and/or further may comprise a single lens, binocular, holographic binocular, helmet visor, head mounted display with mangin mirror, integrated helmet and display sighting system, helmet integrated display sight system, link advanced head mounted display (AHMD), and multiple micro-display optics.
  • the optical assembly may include a telescopic lens.
  • Such lens may be spectacle mounted or otherwise.
  • Eli Peli's wide-field eplerian telescope may be built within the spectacle lens.
  • Such design may use embedded mirrors inside of a carrier lens to fold the optical path and power elements for higher magnification.
  • the optical assembly may be used in configurations with the Q-Sight helmet mounted display developed by BAE Systems of London, United Kingdom. Such a configuration may provide heads-up and eyes-out capability delivering situational awareness. Furthermore, various embodiments may use any of the optical assemblies in the configurations as noted above.
  • a planar illumination facility also known as an illumination module, may provide light in a plurality of colors including Red-Green-Blue (RGB) light and/or white light.
  • the light from the illumination module may be directed to a 3LCD system, a Digital Light Processing (DLP®) system, a Liquid Crystal on Silicon (LCoS) system, or other micro-display or micro-projection systems.
  • the illumination module may use wavelength combining and nonlinear frequency conversion with nonlinear feedback to the source to provide a source of high- brightness, long-life, speckle-reduced or speckle-free light.
  • Various embodiments of the disclosure may provide light in a plurality of colors including Red-Green-Blue (RGB) light and/or white light.
  • the light from the illumination module may be directed to a 3LCD system, a Digital Light Processing (DLP) system, a Liquid Crystal on Silicon (LCoS) system, or other micro-display or micro-projection systems.
  • the illumination modules described herein may be used in the optical assembly for the eyepiece 100.
  • One embodiment of the disclosure includes a system comprising a laser, LED or other light source configured to produce an optical beam at a first wavelength, a planar lightwave circuit coupled to the laser and configured to guide the optical beam, and a waveguide optical frequency converter coupled to the planar lightwave circuit, and configured to receive the optical beam at the first wavelength, convert the optical beam at the first wavelength into an output optical beam at a second wavelength.
  • the system may provide optically coupled feedback which is nonlinearly dependent on the power of the optical beam at the first wavelength to the laser.
  • Another embodiment of the disclosure includes a system comprising a substrate, a light source, such as a laser diode array or one or more LEDs disposed on the substrate and configured to emit a plurality of optical beams at a first wavelength, a planar lightwave circuit disposed on the substrate and coupled to the light source, and configured to combine the plurality of optical beams and produce a combined optical beam at the first wavelength, and a nonlinear optical element disposed on the substrate and coupled to the planar lightwave circuit, and configured to convert the combined optical beam at the first wavelength into an optical beam at a second wavelength using nonlinear frequency conversion.
  • the system may provide optically coupled feedback which is nonlinearly dependent on a power of the combined optical beam at the first wavelength to the laser diode array.
  • Another embodiment of the disclosure includes a system comprising a light source, such as a semiconductor laser array or one or more LEDs configured to produce a plurality of optical beams at a first wavelength, an arrayed waveguide grating coupled to the light source and configured to combine the plurality of optical beams and output a combined optical beam at the first wavelength, a quasi-phase matching wavelength- converting waveguide coupled to the arrayed waveguide grating and configured to use second harmonic generation to produce an output optical beam at a second wavelength based on the combined optical beam at the first wavelength.
  • a light source such as a semiconductor laser array or one or more LEDs configured to produce a plurality of optical beams at a first wavelength
  • an arrayed waveguide grating coupled to the light source and configured to combine the plurality of optical beams and output a combined optical beam at the first wavelength
  • a quasi-phase matching wavelength- converting waveguide coupled to the arrayed waveguide grating and configured to use second harmonic generation to produce an output optical beam at a second wavelength based
  • Power may be obtained from within a wavelength conversion device and fed back to the source.
  • the feedback power has a nonlinear dependence on the input power provided by the source to the wavelength conversion device.
  • Nonlinear feedback may reduce the sensitivity of the output power from the wavelength conversion device to variations in the nonlinear coefficients of the device because the feedback power increases if a nonlinear coefficient decreases.
  • the increased feedback tends to increase the power supplied to the wavelength conversion device, thus mitigating the effect of the reduced nonlinear coefficient.
  • a processor 10902 may provide display sequential frames 10924 for image display through a display component 10928 (e.g. an LCOS display component) of the eyepiece 100.
  • the sequential frames 10924 may be produced with or without a display driver 10912 as an intermediate component between the processor 10902 and the display component 10928.
  • the processor 10902 may include a frame buffer 10904 and a display interface 10908 (e.g. a mobile industry processor interface (MIPI), with a display serial interface (DSI)).
  • MIPI mobile industry processor interface
  • DSI display serial interface
  • the display interface 10908 may provide per-pixel RGB data 10910 to the display driver 10912 as an intermediate component between the processor 10902 and the display component 10928, where the display driver 10912 accepts the per-pixel RGB data 10910 and generates individual full frame display data for red 10918, green 10920, and blue 10922, thus providing the display sequential frames 10924 to the display component 10928.
  • the display driver 10912 may provide timing signals, such as to synchronize the delivery of the full frames 10918 10920 10922 as display sequential frames 10924 to the display component 10928.
  • timing signals such as to synchronize the delivery of the full frames 10918 10920 10922 as display sequential frames 10924 to the display component 10928.
  • the display interface 10930 may be configured to eliminate the display driver 10912 by providing full frame display data for red 10934, green 10938, and blue 10940 directly to the display component 10928 as display sequential frames 10924.
  • timing signals 10932 may be provided directly from the display interface 10930 to the display components. This configuration may provide significantly lower power consumption by removing the need for a display driver. Not only may this direct panel information remove the need for a driver, but also may simplify the overall logic of the configuration, and remove redundant memory required to reform panel information from pixels, to generate pixel information from frame, and the like.
  • FIG. 89 is a block diagram of an illumination module, according to an embodiment of the disclosure.
  • Illumination module 8900 comprises an optical source, a combiner, and an optical frequency converter, according to an embodiment of the disclosure.
  • An optical source 8902, 8904 emits optical radiation 8910, 8914 toward an input port 8922, 8924 of a combiner 8906.
  • Combiner 8906 has a combiner output port 8926, which emits combined radiation 8918.
  • Combined radiation 8918 is received by an optical frequency converter 8908, which provides output optical radiation 8928.
  • Optical frequency converter 8908 may also provide feedback radiation 8920 to combiner output port 8926.
  • Combiner 8906 splits feedback radiation 8920 to provide source feedback radiation 8912 emitted from input port 8922 and source feedback radiation 8916 emitted from input port 8924.
  • Source feedback radiation 8912 is received by optical source 8902
  • source feedback radiation 8916 is received by optical source 8904.
  • Optical radiation 8910 and source feedback radiation 8912 between optical source 8902 and combiner 8906 may propagate in any combination of free space and/or guiding structure (e.g., an optical fiber or any other optical waveguide).
  • Optical radiation 8914, source feedback radiation 8916, combined radiation 8918 and feedback radiation 8920 may also propagate in any combination of free space and/or guiding structure.
  • Suitable optical sources 8902 and 8904 include one or more LEDs or any source of optical radiation having an emission wavelength that is influenced by optical feedback.
  • sources include lasers, and may be semiconductor diode lasers.
  • optical sources 8902 and 8904 may be elements of an array of semiconductor lasers. Sources other than lasers may also be employed (e.g., an optical frequency converter may be used as a source). Although two sources are shown on FIG. 89, the disclosure may also be practiced with more than two sources.
  • Combiner 8906 is shown in general terms as a three port device having ports 8922, 8924, and 8926.
  • Combiner 8906 may include a wavelength dispersive element and optical elements to define the ports. Suitable wavelength dispersive elements include arrayed waveguide gratings, reflective diffraction gratings, transmissive diffraction gratings, holographic optical elements, assemblies of wavelength-selective filters, and photonic band-gap structures. Thus, combiner 8906 may be a wavelength combiner, where each of the input ports has a corresponding, non-overlapping input port wavelength range for efficient coupling to the combiner output port.
  • optical frequency converter 8908 Various optical processes may occur within optical frequency converter 8908, including but not limited to harmonic generation, sum frequency generation (SFG), second harmonic generation (SHG), difference frequency generation, parametric generation, parametric amplification, parametric oscillation, three-wave mixing, four-wave mixing, stimulated Raman scattering, stimulated Brillouin scattering, stimulated emission, acousto-optic frequency shifting and/or electro-optic frequency shifting.
  • harmonic generation sum frequency generation (SFG), second harmonic generation (SHG), difference frequency generation
  • parametric generation parametric amplification
  • parametric oscillation three-wave mixing
  • four-wave mixing stimulated Raman scattering
  • stimulated Brillouin scattering stimulated emission
  • electro-optic frequency shifting acousto-optic frequency shifting.
  • optical frequency converter 8908 accepts optical inputs at an input set of optical wavelengths and provides an optical output at an output set of optical wavelengths, where the output set differs from the input set.
  • Optical frequency converter 8908 may include nonlinear optical materials such as lithium niobate, lithium tantalate, potassium titanyl phosphate, potassium niobate, quartz, silica, silicon oxynitride, gallium arsenide, lithium borate, and/or beta-barium borate.
  • Optical interactions in optical frequency converter 8908 may occur in various structures including bulk structures, waveguides, quantum well structures, quantum wire structures, quantum dot structures, photonic bandgap structures, and/or multi-component waveguide structures.
  • phase-matching may be birefringent phase- matching or quasi-phase-matching.
  • Quasi-phase matching may include methods disclosed in U.S. Pat. No. 7,1 16,468 to Miller, the disclosure of which is hereby incorporated by reference.
  • Optical frequency converter 8908 may also include various elements to improve its operation, such as a wavelength selective reflector for wavelength selective output coupling, a wavelength selective reflector for wavelength selective resonance, and/or a wavelength selective loss element for controlling the spectral response of the converter.
  • multiple illumination modules as described in Fig. 89 may be associated to form a compound illumination module.
  • One component of the illumination module may be a diffraction grating, or grating, as further described herein.
  • a diffraction grating plate may be less than 1mm thick but may still be rigid enough to bond in place permanently or replace cover glass of the LCOS.
  • One advantage of using the grating in the illumination module is that it would use laser illumination sources to increase efficiency and reduce power.
  • the grating may have inherently less stray light and due to the narrow band, would enable more options for filtering out eye glow with less reduction of the see through brightness.
  • FIG. 90 is a block diagram of an optical frequency converter, according to an embodiment of the disclosure.
  • FIG. 90 illustrates how feedback radiation 8920 is provided by an exemplary optical frequency converter 8908 which provides parametric frequency conversion.
  • Combined radiation 8918 provides forward radiation 9002 within optical frequency converter 8908 that propagates to the right on FIG. 90
  • parametric radiation 9004 also propagating to the right on FIG. 90, is generated within optical frequency converter 8908 and emitted from optical frequency converter 8908 as output optical radiation 8928.
  • there is a net power transfer from forward radiation 9002 to parametric radiation 9004 as the interaction proceeds i.e., as the radiation propagates to the right in this example).
  • a reflector 9008 which may have wavelength-dependent transmittance, is disposed in optical frequency converter 8908 to reflect (or partially reflect) forward radiation 9002 to provide backward radiation 9006 or may be disposed externally to optical frequency converter 8908 after endface 9010.
  • Reflector 9008 may be a grating, an internal interface, a coated or uncoated endface, or any combination thereof. The preferred level of reflectivity for reflector 9008 is greater than 90%.
  • a reflector located at an input interface 9012 provides purely linear feedback (i.e., feedback that does not depend on the process efficiency).
  • a reflector located at an endface 9010 provides a maximum degree of nonlinear feedback, since the dependence of forward power on process efficiency is maximized at the output interface (assuming a phase-matched parametric interaction).
  • FIG. 91 is a block diagram of a laser illumination module, according to an embodiment of the disclosure. While lasers are used in this embodiment, it is understood that other light sources, such as LEDs, may also be used.
  • Laser illumination module 9100 comprises an array of diode lasers 9102, waveguides 9104 and 9106, star couplers 9108 and 91 10 and optical frequency converter 91 14.
  • An array of diode lasers 9102 has lasing elements coupled to waveguides 9104 acting as input ports (such as ports 8922 and 8924 on FIG. 89) to a planar waveguide star coupler 9108.
  • Star coupler 9108 is coupled to another planar waveguide star coupler 91 10 by waveguides 9106 which have different lengths.
  • the combination of star couplers 9108 and 91 10 with waveguides 9106 may be an arrayed waveguide grating, and acts as a wavelength combiner (e.g., combiner 8906 on FIG. 89) providing combined radiation 8918 to waveguide 91 12.
  • Waveguide 91 12 provides combined radiation 8918 to optical frequency converter 91 14.
  • an optional reflector 91 16 provides a back reflection of combined radiation 8918. As indicated above in connection with FIGS. 90, this back reflection provides nonlinear feedback according to embodiments of the disclosure.
  • One or more of the elements described with reference to FIG. 91 may be fabricated on a common substrate using planar coating methods and/or lithography methods to reduce cost, parts count and alignment requirements.
  • a second waveguide may be disposed such that its core is in close proximity with the core of the waveguide in optical frequency converter 8908.
  • this arrangement of waveguides functions as a directional coupler, such that radiation in waveguide may provide additional radiation in optical frequency converter 8908.
  • Significant coupling may be avoided by providing radiation at wavelengths other than the wavelengths of forward radiation 9002 or additional radiation may be coupled into optical frequency converter 8908 at a location where forward radiation 9002 is depleted.
  • traveling wave feedback configurations While standing wave feedback configurations where the feedback power propagates backward along the same path followed by the input power are useful, traveling wave feedback configurations may also be used. In a traveling wave feedback configuration, the feedback re-enters the gain medium at a location different from the location at which the input power is emitted from.
  • FIG. 92 is a block diagram of a compound laser illumination module, according to another embodiment of the disclosure.
  • Compound laser illumination module 9200 comprises one or more laser illumination modules 9100 described with reference to FIG. 91.
  • FIG. 92 illustrates compound laser illumination module 9200 including three laser illumination modules 9100 for simplicity, compound laser illumination module 9200 may include more or fewer laser illumination modules 9100.
  • An array of diode lasers 9210 may include one or more arrays of diode lasers 9102 which may be an array of laser diodes, a diode laser array, and/or a semiconductor laser array configured to emit optical radiation within the infrared spectrum, i.e., with a wavelength shorter than radio waves and longer than visible light.
  • Laser array output waveguides 9220 couple to the diode lasers in the array of diode lasers 9210 and directs the outputs of the array of diode lasers 9210 to star couplers 9108A-C.
  • the laser array output waveguides 9220, the arrayed waveguide gratings 9230, and the optical frequency converters 91 14A-C may be fabricated on a single substrate using a planar lightwave circuit, and may comprise silicon oxynitride waveguides and/or lithium tantalate waveguides.
  • Arrayed waveguide gratings 9230 comprise the star couplers 9108A-C, waveguides 9106A-C, and star couplers 91 lOA-C.
  • Waveguides 91 12A-C provide combined radiation to optical frequency converters 91 14A-C and feedback radiation to star couplers 91 lOA-C, respectively.
  • Optical frequency converters 91 14A-C may comprise nonlinear optical (NLO) elements, for example optical parametric oscillator elements and/or quasi-phase matched optical elements.
  • NLO nonlinear optical
  • Compound laser illumination module 9200 may produce output optical radiation at a plurality of wavelengths.
  • the plurality of wavelengths may be within a visible spectrum, i.e., with a wavelength shorter than infrared and longer than ultraviolet light.
  • waveguide 9240A may similarly provide output optical radiation between about 450 nm and about 470 nm
  • waveguide 9240B may provide output optical radiation between about 525 nm and about 545 nm
  • waveguide 9240C may provide output optical radiation between about 615 nm and about 660 nm.
  • These ranges of output optical radiation may again be selected to provide visible wavelengths (for example, blue, green and red wavelengths, respectively) that are pleasing to a human viewer, and may again be combined to produce a white light output.
  • the waveguides 9240A-C may be fabricated on the same planar lightwave circuit as the laser array output waveguides 9220, the arrayed waveguide gratings 9230, and the optical frequency converters 91 14A-C.
  • the output optical radiation provided by each of the waveguides 9240A-C may provide an optical power in a range between approximately 1 watts and approximately 20 watts.
  • the optical frequency converter 9114 may comprise a quasi-phase matching wavelength- converting waveguide configured to perform second harmonic generation (SHG) on the combined radiation at a first wavelength, and generate radiation at a second wavelength.
  • a quasi-phase matching wavelength-converting waveguide may be configured to use the radiation at the second wavelength to pump an optical parametric oscillator integrated into the quasi-phase matching wavelength-converting waveguide to produce radiation at a third wavelength, the third wavelength optionally different from the second wavelength.
  • the quasi-phase matching wavelength-converting waveguide may also produce feedback radiation propagated via waveguide 9112 through the arrayed waveguide grating 9230 to the array of diode lasers 9210, thereby enabling each laser disposed within the array of diode lasers 9210 to operate at a distinct wavelength determined by a corresponding port on the arrayed waveguide grating.
  • compound laser illumination module 9200 may be configured using an array of diode lasers 9210 nominally operating at a wavelength of approximately 830 nm to generate output optical radiation in a visible spectrum corresponding to any of the colors red, green, or blue.
  • Compound laser illumination module 9200 may be optionally configured to directly illuminate spatial light modulators without intervening optics.
  • compound laser illumination module 9200 may be configured using an array of diode lasers 9210 nominally operating at a single first wavelength to simultaneously produce output optical radiation at multiple second wavelengths, such as wavelengths corresponding to the colors red, green, and blue. Each different second wavelength may be produced by an instance of laser illumination module 9100.
  • the compound laser illumination module 9200 may be configured to produce diffraction- limited white light by combining output optical radiation at multiple second wavelengths into a single waveguide using, for example, waveguide-selective taps (not shown).
  • the array of diode lasers 9210, laser array output waveguides 9220, arrayed waveguide gratings 9230, waveguides 91 12, optical frequency converters 91 14, and frequency converter output waveguides 9240 may be fabricated on a common substrate using fabrication processes such as coating and lithography.
  • the beam shaping element 9250 is coupled to the compound laser illumination module 9200 by waveguides 9240A-C, described with reference to FIG. 92.
  • Beam shaping element 9250 may be disposed on a same substrate as the compound laser illumination module 9200.
  • the substrate may, for example, comprise a thermally conductive material, a semiconductor material, or a ceramic material.
  • the substrate may comprise copper-tungsten, silicon, gallium arsenide, lithium tantalate, silicon oxynitride, and/or gallium nitride, and may be processed using semiconductor manufacturing processes including coating, lithography, etching, deposition, and implantation.
  • Some of the described elements such as the array of diode lasers 9210, laser array output waveguides 9220, arrayed waveguide gratings 9230, waveguides 91 12, optical frequency converters 9114, waveguides 9240, beam shaping element 9250, and various related planar lightwave circuits may be passively coupled and/or aligned, and in some embodiments, passively aligned by height on a common substrate.
  • Each of the waveguides 9240A-C may couple to a different instance of beam shaping element 9250, rather than to a single element as shown.
  • Beam shaping element 9250 may be configured to shape the output optical radiation from waveguides 9240A-C into an approximately rectangular diffraction-limited optical beam, and may further configure the output optical radiation from waveguides 9240A-C to have a brightness uniformity greater than approximately 95% across the approximately rectangular beam shape.
  • the beam shaping element 9250 may comprise an aspheric lens, such as a "top-hat” microlens, a holographic element, or an optical grating.
  • the diffraction-limited optical beam output by the beam shaping element 9250 produces substantially reduced or no speckle.
  • the optical beam output by the beam shaping element 9250 may provide an optical power in a range between approximately 1 watt and approximately 20 watts, and a substantially flat phase front.
  • FIG. 93 is a block diagram of an imaging system, according to an embodiment of the disclosure.
  • Imaging system 9300 comprises light engine 9310, optical beams 9320, spatial light modulator 9330, modulated optical beams 9340, and projection lens 9350.
  • the light engine 9310 may be a compound optical illumination module, such as multiple illumination modules described in Fig. 89, a compound laser illumination module 9200, described with reference to FIG. 92, or a laser illumination system 9300, described with reference to FIG. 93.
  • Spatial light modulator 9330 may be a 3LCD system, a DLP system, a LCoS system, a transmissive liquid crystal display (e.g. transmissive LCoS), a liquid-crystal-on-silicon array, a grating-based light valve, or other micro- display or micro-projection system or reflective display.
  • the spatial light modulator 9330 may be configured to spatially modulate the optical beam 9320.
  • the spatial light modulator 9330 may be coupled to electronic circuitry configured to cause the spatial light modulator 9330 to modulate a video image, such as may be displayed by a television or a computer monitor, onto the optical beam 9320 to produce a modulated optical beam 9340.
  • modulated optical beam 9340 may be output from the spatial light modulator on a same side as the spatial light modulator receives the optical beam 9320, using optical principles of reflection.
  • modulated optical beam 9340 may be output from the spatial light modulator on an opposite side as the spatial light modulator receives the optical beam 9320, using optical principles of transmission.
  • the modulated optical beam 9340 may optionally be coupled into a projection lens 9350.
  • the projection lens 9350 is typically configured to project the modulated optical beam 9340 onto a display, such as a video display screen.
  • a method of illuminating a video display may be performed using a compound illumination module such as one comprising multiple illumination modules 8900, a compound laser illumination module 9100, a laser illumination system 9200, or an imaging system 9300.
  • a diffraction-limited output optical beam is generated using a compound illumination module, compound laser illumination module 9100, laser illumination system 9200 or light engine 9310.
  • the output optical beam is directed using a spatial light modulator, such as spatial light modulator 9330, and optionally projection lens 9350.
  • the spatial light modulator may project an image onto a display, such as a video display screen.
  • the illumination module may be configured to emit any number of wavelengths including one, two, three, four, five, six, or more, the wavelengths spaced apart by varying amounts, and having equal or unequal power levels.
  • An illumination module may be configured to emit a single wavelength per optical beam, or multiple wavelengths per optical beam.
  • An illumination module may also comprise additional components and functionality including polarization controller, polarization rotator, power supply, power circuitry such as power FETs, electronic control circuitry, thermal management system, heat pipe, and safety interlock.
  • an illumination module may be coupled to an optical fiber or a lightguide, such as glass (e.g. B 7).
  • LCoS front light design Some options include: 1) Wedge with MultiLayer Coating (MLC). This concept uses MLC to define specific reflected and transmitted angles.; 2) Wedge with polarized beamsplitter coating. This concept works like a regular PBS Cube, but at a much shallower angle.
  • MLC MultiLayer Coating
  • PBS polarizing beamsplitter
  • the MLC wedge may be rigid and may be robustly glued in place with no air gaps for condensation or thermal deflection. It may work with a broadband LED light source.
  • the MLC wedge may replace the cover glass of the LCOS for a complete module.
  • the MLC wedge may be about less than 4 mm thick. In an embodiment, the MLC wedge may be 2 mm thick or less.
  • the frontlighting systems may be used as a component in any type of optical system as a source of direct or indirect illumination, and are particularly preferred for illumination of any type or types of optical element, optical surface, or optical sensor, most preferably those which have a selectively configurable optical path, e.g., such as LCoS or liquid crystal displays, and/or reflect light.
  • the frontlighting system may illuminate an optical device such as an LCoS to create image light which may be directed back through a component of the frontlighting system and thereafter pass through one or more additional optical systems that condition the image light for ultimate reception by a user's eye.
  • an optical device such as an LCoS
  • Such other optical systems may be, or include among their components, one or more of a waveguide (which may be a freeform waveguide), a beam splitter, a collimator, a polarizer, a mirror, a lens, and a diffraction grating.
  • Fig. 95 depicts an embodiment of an LCoS front light design.
  • light from an RGB LED 9508 illuminates a front light 9504, which can be a wedge, PBS, and the like.
  • the light strikes a polarizer 9510 and is transmitted in its S state to an LCoS 9502 where it gets reflected as image light in its P state back through an asphere 9512.
  • An inline polarizer 9514 may polarize the image light again and/or cause a 1 ⁇ 2 wave rotation to the S state.
  • the image light hits a wire grid polarizer 9520 and reflects to a curved (spherical) partial mirror 9524, passing through a 1 ⁇ 2 wave retarder 9522 on its way.
  • the image light reflects from the mirror to the user's eye 9518, once more traversing the 1 ⁇ 2 wave retarder 9522 and wire grid polarizer 9520.
  • Various examples of the front light 9504 will now be described.
  • the optical assembly includes a partially reflective, partially transmitting optical element that reflects respective portions of image light from the image source and transmits scene light from a see-through view of the surrounding environment, so that a combined image comprised of portions of the reflected image light and the transmitted scene light is provided to a user's eye.
  • Portable display systems it is important to provide a display that is bright, compact and light in weight.
  • Portable display systems include cellphone, laptop computers, tablet computers and head mounted displays.
  • the disclosure provides a compact and lightweight front light for a portable display system comprised of a curved or other non-planar wire grid polarizer film as a partial reflector to efficiently deflect light from an edge light source to illuminate a reflective image source.
  • Wire grid polarizers are known to provide efficient reflection of one polarization state while simultaneously allowing the other polarization state to pass through. While glass plate wire grid polarizers are well known in the industry and a rigid wire grid polarizer can be used in the disclosure, in a preferred embodiment of the present disclosure a flexible wire grid polarizer film is used for the curved wire grid polarizer. Suitable wire grid polarizer film is available from Asahi- asei E-materials Corp, Tokyo Japan.
  • An edge light provides a compact form of lighting for a display, but since it is located at the edge of the image source, the light must be deflected by 90 degrees to illuminate the image source.
  • a curved wire grid polarizer film is used as a partially reflective surface to deflect the light provided by the edge light source downward to illuminate the reflective image source.
  • a polarizer is provided adjacent to the edge light source to polarize the illumination light provided to the curved wire grid polarizer. The polarizer and the wire grid polarizer are oriented such that the light passing through the polarizer is reflected by the wire grid polarizer.
  • the polarization of the reflected image light is the opposite polarization state compared to the illumination light.
  • the reflected image light passes through the wire grid polarizer film and continues to the display optics.
  • the partially reflective surface can be curved in a lightweight structure where the wire grid polarizer performs the dual role of being a reflector for the illumination light and a transparent member for the image light.
  • An advantage provided by the wire grid polarizer film is that it can receive image light over a wide range of incident angles so that the curve doesn't interfere with the image light passing through to the display optics.
  • the wire grid polarizer film is thin (e.g. less than 200 micron), the curved shape doesn't noticeably distort the image light as it passes through to the display optics.
  • FIG. 136 shows a schematic drawing of the frontlighted image source 13600 of the present disclosure.
  • the edge light source 13602 provides illumination light that passes through a polarizer 13614 so that the illumination light 13610 is polarized, where the polarizer 13614 can be an absorptive polarizer or a reflective polarizer.
  • the polarizer is oriented so that the polarization state of the illumination light 13610 is such that the light is reflected by the curved wire grid polarizer 13608, thereby deflecting the illumination light 13610 downwards toward the reflective image source 13604.
  • the passing axis of the polarizer 13614 is perpendicular to the passing axis of the wire grid polarizer 13608.
  • FIG. 136 shows the frontlighted image source 13600 oriented horizontally, other orientations are equally possible.
  • typically reflective image sources such as LCOS image sources, include a quarter wave retarder film so that the polarization state of the illuminating light is changed during the reflection by the reflective image source and as a result the image light has in general the opposite polarization state compared to the illumination light.
  • This change in polarization state is fundamental to the operation of all liquid crystal based displays as is well known to those skilled in the art and as described in United States Patent 4398805.
  • the liquid crystal element of the reflective image source 13604 will cause more or less change in polarization state so that the reflected image light 13612 before passing through the curved wire grid polarizer has a mixed elliptical polarization state.
  • the polarization state of the image light 13612 is determined by the curved wire grid polarizer 13608 and the image content contained in the image light 13612 determines the local intensity of the image light 13612 in the image displayed by the portable display system.
  • the flexible nature of the wire grid polarizer film that is used in the curved wire grid polarizer 13608 allows it to be formed into a shape that focuses the illumination light 13610 onto the reflective image source 13604.
  • the shape of the curve of the curved wire grid polarizer is selected to provide uniform illumination of the reflective image source.
  • FIG. 136 shows a curved wire grid polarizer 13608 with a parabolic shape, but radiused curves, complex sp lined curves or planes are possible as well to uniformly deflect the illumination light 13610 onto the reflective image source 13604 depending on the nature of the edge light source 13602. Experiments have shown that parabolic, radiused and complex splined curves all provide more uniform illumination than a flat surface.
  • FIG. 138 shows a schematic drawing of a frontlighted image source assembly 13800.
  • Side frame 13802 is shown with a curved slot 13804 for the flexible wire grid polarizer film to be held in the desired curved shape. While only one side frame 13802 is shown in FIG. 138, two side frames 13802 would be used to support the curved shape on either side along with the other components of the frontlighted image source.
  • weight is substantially lower compared to prior art front light systems.
  • a frontlighted image source 13700 is provided with two or more edge light sources 13702 positioned along two or more edges of a reflective image source 13604 as shown in FIG. 137.
  • Polarizers 13712 are provided adjacent to each edge light source 13702 to polarize the illumination light 13708.
  • the illumination light 13708 is deflected by the curved wire grid polarizer 13704 to illuminate the reflective image source 13604.
  • the reflected image light 13710 then passes through the curved wire grid polarizer 13704 and on to the display optics.
  • the advantage of using two or more edge light sources 13702 is that more light can be applied to the reflective image source 13604 thereby providing for brighter images.
  • the edge light source can be a fluorescent light, an incandescent light, an organic light emitting diode, a laser or an electroluminescent light.
  • the edge light source is an array of 3 or more light emitting diodes.
  • the edge light source should have a substantial cone angle, for example the edge light source can be a Lambertian light source.
  • the cone angle of the light would need to be expanded.
  • the image light provided by the frontlighted image source of the disclosure passes into display optics for the portable display system.
  • display optics are possible depending on how the displayed image is to be used.
  • the display optics can be dispersive when the display is a flat screen display or alternately the display optics can be refractive or diffractive when the display is a near eye display or a head mounted display.
  • FIG. 139 is a flowchart of the method of the disclosure for the portable display system with a reflective image source.
  • polarized illumination light is provided to one or more edges of the reflective image source.
  • the curved wire grid polarizer receives the illumination light and deflects it to illuminate the reflective image source, wherein the curve of the wire grid polarizer is selected to improve the uniformity of illumination of the area of the reflective image source.
  • the reflective image source receives the illumination light, reflecting the illumination light and simultaneously changing the polarization state of the illumination light in correspondence to the image being displayed. The image light then passes through the curved wire grid polarizer in Step 13908 and passes into the display optics.
  • Step 13910 the image is displayed by the portable display system.
  • a lightweight portable display system with a reflective liquid crystal image source for displaying an image may comprise one or more edge light sources providing polarized illumination light adjacent to one or more edges of the reflective liquid crystal image source, a curved wire grid polarizer partial reflector that may receive the polarized illumination light and may deflect it to illuminate the reflective liquid crystal image source, and display optics that receive reflected image light from the reflective liquid crystal image source and display the image.
  • the one or more ledge light sources may comprise a light emitting diode.
  • the wire grid polarizer may be a flexible film, and the flexible film may be held in a curved shape by side frames.
  • the curved wire grid polarizer of the display system may be parabolic, radiused or complex splined curve.
  • the reflective liquid crystal image source of the display system may be an LCOS.
  • the display optics of the display system may comprise diffusers and the display system may be a flat screen display.
  • the display optics of the display system may comprise refractive or diffractive elements and the display system may be a near eye display or a head mounted display.
  • a method for providing and image on a lightweight portable display system with a reflective liquid crystal image source may comprise providing polarized illumination light to one or more edges of the reflective liquid crystal image source, receiving the illumination light with a curved wire grid polarizer and deflecting the light to illuminate the reflective liquid crystal image source, reflecting and changing the polarization state of the illumination light relative to the image to be displayed with the reflective liquid crystal image source to provide image light, passing the image light through the curved wire grid polarizer, receiving the image light with display optics, and displaying the image.
  • the curved shape of the curved wire grid polar may be selected to improve uniformity of illumination of the reflective liquid crystal image source.
  • the one or more edge light sources may comprise a light emitting diode.
  • the wire grid polarizer may be a flexible film. Further, the flexible film may be held in a curved shape by side frames.
  • the cured wire grid polarizer may be a parabolic radiused or complex sp lined curve.
  • the reflexive liquid crystal image source may be an LCOS.
  • the display optics may comprise diffusers and the display system may be a flat screen display. In embodiments of the method above, the display optics may comprise refractive or diffractive elements and the display system may be a near eye display or a head mounted display.
  • Fig. 96 depicts an embodiment of a front light 9504 comprising optically bonded prisms with a polarizer.
  • the prisms appear as two rectangular solids with a substantially transparent interface 9602 between the two. Each rectangular is diagonally bisected and a polarizing coating 9604 is disposed along the interface of the bisection.
  • the lower triangle formed by the bisected portion of the rectangular solid may optionally be made as a single piece 9608.
  • the prisms may be made from B -7 or the equivalent.
  • the rectangular solids have square ends that measure 2 mm by 2 mm.
  • the length of the solids in this embodiment is 10 mm.
  • the bisection comprises a 50% mirror 9704 surface and the interface between the two rectangular solids comprises a polarizer 9702 that may pass light in the P state.
  • Fig. 98 depicts three versions of an LCoS front light design.
  • Fig. 98A depicts a wedge with MultiLayer Coating (MLC). This concept uses MLC to define specific reflected and transmitted angles.
  • image light of either P or S polarization state is observed by the user's eye.
  • Fig. 98B depicts a PBS with a polarizer coating.
  • S-polarized image light is transmitted to the user's eye.
  • Fig. 98C depicts a right angle prism, eliminating much of the material of the prism enabling the image light to be transmitted through air as S-polarized light.
  • Fig. 99 depicts a wedge plus PBS with a polarizing coating 9902 layered on an LCoS 9904.
  • Fig. 100 depicts two embodiments of prisms with light entering the short end (A) and light entering along the long end (B).
  • a wedge is formed by offset bisecting a rectangular solid to form at least one 8.6 degree angle at the bisect interface.
  • the offset bisection results in a segment that is 0.5 mm high and another that is 1.5 mm on the side through which the RGB LEDs 10002 are transmitting light.
  • a polarizing coating 10004 is disposed.
  • a wedge is formed by offset bisecting a rectangular solid to form at least one 14.3 degree angle at the bisect interface.
  • the offset bisection results in a segment that is 0.5 mm high and another that is 1.5 mm on the side through which the RGB LEDs 10008 are transmitting light.
  • a polarizing coating 10010 is disposed.
  • Fig. 101 depicts a curved PBS film 10104 illuminated by an RGB LED 10102 disposed over an LCoS chip 10108.
  • the PBS film 10104 reflects the RGB light from the LED array 10102 onto the LCOS chip's surface 10108, but lets the light reflected from the imaging chip pass through unobstructed to the optical assembly and eventually to the user's eye.
  • Films used in this system include Asahi Film, which is a Tri-Acetate Cellulose or cellulose acetate substrate (TAC).
  • the film may have UV embossed corrugations at lOOnm and a calendared coating built up on ridges that can be angled for incidence angle of light.
  • the Asahi film may come in rolls that are 20cm wide by 30m long and has BEF properties when used in LCD illumination.
  • the Asahi film may support wavelengths from visible through IR and may be stable up to 100°C.
  • Figs. 21 and 22 depict an alternate arrangement of the waveguide and projector in exploded view.
  • the projector is placed just behind the hinge of the arm of the eyepiece and it is vertically oriented such that the initial travel of the RGB LED signals is vertical until the direction is changed by a reflecting prism in order to enter the waveguide lens.
  • the vertically arranged projection engine may have a PBS 218 at the center, the RGB LED array at the bottom, a hollow, tapered tunnel with thin film diffuser to mix the colors for collection in an optic, and a condenser lens.
  • the PBS may have a pre-polarizer on an entrance face.
  • the pre-polarizer may be aligned to transmit light of a certain polarization, such as p-polarized light and reflect (or absorb) light of the opposite polarization, such as s-polarized light.
  • the polarized light may then pass through the PBS to the field lens 216.
  • the purpose of the field lens 216 may be to create near telecentric illumination of the LCoS panel.
  • the LCoS display may be truly reflective, reflecting colors sequentially with correct timing so the image is displayed properly. Light may reflect from the LCoS panel and, for bright areas of the image, may be rotated to s-polarization. The light then may refract through the field lens 216 and may be reflected at the internal interface of the PBS and exit the projector, heading toward the coupling lens.
  • the hollow, tapered tunnel 220 may replace the homogenizing lenslet from other embodiments.
  • Methods and apparatus may reduce eyeglow through a light control element, such as with a partially reflective mirror in the optics associated with the image source, with polarizing optics, and the like.
  • a light control element such as with a partially reflective mirror in the optics associated with the image source, with polarizing optics, and the like.
  • light entering the waveguide may be polarized, such as s-polarized.
  • the light control element may include a linear polarizer. Wherein the linear polarizer in the light control element is oriented relative to the linearly polarized image light so that the second portion of the linearly polarized image light that passes through the partially reflecting mirror is blocked and eyeglow is reduced.
  • eyeglow may be minimized or eliminated by attaching lenses to the waveguide or frame, such as the snap-fit optics described herein, that are oppositely polarized from the light reflecting from the user's eye, such as p-polarized in this case.
  • the light control element may include a second quarter wave film and a linear polarizer.
  • the second quarter wave film converts a second portion of a circularly polarized image light into linearly polarized image light with a polarization state that is blocked by the linear polarizer in the light control element so that eyeglow is reduced.
  • the light control element includes a linear polarizer and a quarter wave film
  • incoming unpolarized scene light from the external environment in front of the user is converted to linearly polarized light while 50% of the light is blocked.
  • the first portion of scene light that passes through the linear polarizer is linearly polarized light which is converted by the quarter wave film to circularly polarized light.
  • Fig. 22B shows an example of a see-through display assembly with a light control element in a glasses frame.
  • the glasses cross- section 2200B shows the components of see-through display assembly in a glasses frame 2202B.
  • the light control element covers the entire see-through view seen by the user.
  • Supporting members 2204B and 2208B are shown supporting the partially reflecting mirror 2210B and the beam splitter layer 2212B respectively in the field of view of the user's eye 2214B.
  • the supporting members 2204B and 2208B along with the light control element 2218B are connected to the glasses frame 2202B.
  • the other components such as the folding mirror 2220B and the first quarter wave film 2222B are also connected to the supporting members 2204B and 2208B so that the combined assembly is structurally sound.
  • Stray light in a compact optical system typically comes from scattering off sidewalls of the housing or other structures where the light encounters the surface at a steep angle. This type of stray light produces bright areas of scattered light that surround the displayed image.
  • United States Patent 5949583 provides a visor on the top of a head mounted display to block stray light from entering from above. However, this does not address the need for controls to reduce stray light that comes from inside the head mounted display system.
  • United States Patent 6369952 provides two masks to block light that comes from around the edge of a liquid crystal display image source in a head mounted display.
  • the first mask is located on the input side of the liquid crystal image source adjacent to the backlight, while the second mask is located on the output side of the liquid crystal display. Since the two masks are located close to the liquid crystal display, "both the first mask 222 and the second mask 224 have opening or windows 232, 234, respectively which are substantially equal and congruent to the active area of the LCD" (Col 15, lines 15-19).
  • the masks By locating the masks close to the image source, the masks can have little effect on light that is emitted by the image source in a broad cone angle from areas of the image source that are nearer the center of the active area of the image source.
  • This broad cone angle light can reflect off the sidewalls of the housing in a variety of ways and thereby contribute stray light in the form of bright areas and reduced contrast.
  • FIG. 160 shows an example of a display system with an optically flat reflective surface that is a beam splitter comprised of an optical film on a substrate wherein the display system is a near eye display 16002.
  • the image source 16012 includes a projection system (not shown) to provide image light with an optical layout that includes a folded optical axis 16018 located in the near eye display 16002.
  • the optics along the optical axis 16018 can include lenses to focus the image light to provide a focused image from the image source 16012 to the user's eye 16004.
  • a beam splitter 16008 folds the optical axis 16018 from the image source 16012 to a spherical or aspherical reflector 16010.
  • the beam splitter 16008 can be a partially reflecting mirror or a polarizing beam splitter.
  • the beam splitter 16008 in the near eye display 16002 is oriented at an angle to redirect at least a portion of the image light from the image source 16012 to the reflector 16010. From the reflector 16010, at least a further portion of the image light is reflected back to the user's eye 16004. The reflected further portion of the image light passes back through the beam splitter 16008 and is focused at the user's eye 16004.
  • the reflector 16010 can be a mirror or a partial mirror.
  • scene light from the scene in front of the near eye display 16002 can be combined with the image light and thereby present combined image light 16020 comprised of image light along axis 16018 and scene light 16014 to the user's eye 16004.
  • the combined image light 16020 presents a combined image of the scene with an overlaid image from the image source to the user's eye 16004.
  • FIG. 161 shows an illustration of a near eye display module 200.
  • the module 200 is comprised of a reflector 16104, an image source module 16108 and a beam splitter 16102.
  • the module can be open at the sides with attachments between at least some of the joining edges between the reflector 16104, the image source module 16108 and the beam splitter 16102.
  • the module 200 can be closed at the sides by sidewalls to provide an enclosed module to prevent dust, dirt and water from reaching the inner surfaces of the module 200.
  • the reflector 16104, the image source module 16108 and the beam splitter 16102 can be manufactured separately and then joined together, or at least some of the pieces can be manufactured together in joined subassemblies.
  • optical films can be used on the beam splitter 16102 or the reflector 16104.
  • the beam splitter 16102 is shown as a flat surface while the reflector 16104 is shown as a spherical surface.
  • both the reflector 16104 and the beam splitter 16102 are used to provide an image to the user's eye as shown in FIG. 160 and as such it is important that the surfaces be optically flat or optically uniform.
  • the image source 16108 includes a projection system with a light source with a wide cone angle of light the image light also has a wide cone angle.
  • image light interacts with the sidewalls of the module 200 and this interaction can provide reflected and scattered light in the form of bright areas, which are observed by the user as bright areas surrounding the displayed image. These bright areas can be very distracting to the user as they can look like halos surrounding the displayed image.
  • scattered light can degrade the contrast in the displayed image by contributing low level light randomly across the image.
  • FIG. 162 shows an illustration of the optics associated with a type of head mounted display 16200.
  • a light source 16204 provides a broad cone angle of light rays including a center ray 16202 and edge rays 16224.
  • the light source 16204 can provide polarized light.
  • the light rays pass from the light source 16204 to an illumination beam splitter 16210, which reflects a portion of the light toward a reflective image source 16208 which can be an LCOS display.
  • a first portion of the light is reflected by the image source 16208 and simultaneously changed in polarization state in correspondence to the image content that is being displayed.
  • a second portion of the light then passes through the illumination beam splitter 16210 and then passes through one or more lenses 16212 which expand the cone angle of light rays.
  • a third portion of the light is reflected at an angle by an imaging beam splitter 16220 toward a spherical (or aspherical) partial mirror 16214.
  • the partial mirror 16214 reflects a fourth portion of light while causing the light to converge and focus the image at the user's eye 16228.
  • a fifth portion of light passes through the imaging beam splitter 16220 and passes on to the user's eye 16228 where an enlarged version of the image displayed by the image source 16208 is provided to the user's eye 16228.
  • light 16218 from the environment passes through the partial mirror 16214 and the imaging beam splitter 16220 to provide a see-through image of the environment.
  • the user then is provided with a combined image comprised of the displayed image from the image source and the see-through image of the environment.
  • the center ray 16202 passes through the center of the optics of the head mounted display along the optical axis of the optics.
  • the optics include: the illumination beam splitter 16210, the image source 16208, the lens 16212, the imaging beam splitter 16220 and the partial mirror 16214.
  • the edge rays 16224 pass along the sides of the housing 16222 where they can interact with the sidewalls of the housing 16222 where the edge rays 16224 can be reflected or scattered by the sidewalls as shown in FIG. 162. This reflected or scattered light from the edge rays 16224 is visible to the user as bright areas surrounding the displayed image or as a reduction in the contrast in the image.
  • the disclosure provides methods to reduce the bright areas by reducing reflections and scattered light from the sidewalls by blocking or clipping the reflected or scattered light.
  • FIG. 163 shows an illustration of a first embodiment of the disclosure in which baffles 16302 are added inside the housing 16222 between the illumination beam splitter 16210 and the lens 16212.
  • the baffles 16302 block or clip edge rays 16224 before they pass into the lens 16212.
  • the baffles 16302 can be made of any material that is opaque so that the edge rays 16224 are blocked or clipped.
  • the baffles 16302 may be made of a black material with a matte finish so that incident light is absorbed by the baffle.
  • the baffles 16302 can be made from a flat sheet of material with an aperture that is positioned in the housing 16222 or the baffles 16302 can be made as part of the housing 16222.
  • the baffles 16302 are positioned at a distance from the image source 16208 and the image light is diverging, the aperture created by the surrounding baffles 16302 is larger than the active area of the image source 16208 so the image provided by the image source 16208 is not clipped at the edges by the baffles and as a result, the entire image provided by the image source 16208 is visible by the user's eye as shown in FIG. 163.
  • the baffles are preferentially provided with thin cross section (as shown in FIG. 163) or a sharp edge so that light is not scattered from the edge of the baffle.
  • FIG. 164 shows an illustration of another embodiment of the disclosure in which baffles 16402 are added at the entering surface of the lens 16212.
  • the baffles 16402 can be manufactured as part of the housing 16222 or the baffles 16402 can be applied as a mask on the lens 16212. In either case, the baffles 16402 should be opaque and preferentially black with a matte finish to block and absorb incident light.
  • FIG. 165 shows an illustration of an embodiment of the disclosure that is similar to the embodiment shown in FIG. 164but located on the output side of the lens 16212.
  • baffles 16502 are provided to block or clip edge rays 16224 after they have passed through lens 16212.
  • FIG. 166 shows an illustration of another embodiment of the disclosure in which a baffle 16602 is attached to the housing 16222 between the lens 16212 and the imaging beam splitter 16220.
  • the baffle 16602 can be part of the housing 16222 or the baffle 16602 can be a separate structure that is positioned in the housing 16222.
  • the baffle 16602 blocks or clips edge rays 16224 so that bright areas are not provided to the user's eye 16228 around the displayed image.
  • FIG. 167 shows an illustration of a further embodiment of the disclosure in which absorbing coatings 16702 are applied to the sidewalls of the housing 16222 to reduce reflections and scattering of incident light and edge light 16224.
  • the absorbing coatings 16702 can be combined with baffles 16302, 16402, 16502 or 16602.
  • FIG. 168 shows an illustration of another source of stray light in a head mounted display wherein the stray light 16802 comes directly from the edge of the light source 16204.
  • This stray light 16802 can be particularly bright because it comes directly from the light source 16204 without first reflecting from the illuminating beam splitter 16210 and then reflecting from the image source 16208.
  • FIG. 169 shows an illustration of another source of stray light 16902 that comes from the light source 16204 wherein the stray light 16902 reflects off the surface of the image source 16208 where the polarization state is changed and the stray light 16902 can then pass through the illuminating beam splitter at a relatively steep angle.
  • FIG. 170 shows an illustration of a yet further embodiment of the disclosure in which a baffle 17002 is provided adjacent to the light source 16204.
  • the baffle 17002 is opaque and extended from the light source 16204 so that stray light 16802 and 16902 is blocked or clipped immediately after the light source 16204 and thereby prevented from reaching the user's eye 16228.
  • baffles or coatings shown in FIGs 163-167 and 169-170 are combined to further reduce stray light in the head mounted display and thereby reduce bright areas surrounding the displayed image or increase the contrast in the displayed image.
  • Multiple baffles can be used between the light source 16204 and the imaging beam splitter 16220.
  • an absorbing coating with ridges 17102 can be used wherein a series of small ridges or steps act as a series of baffles to block or clip edge rays over the entire sidewall area of the housing 16222.
  • the ridges 17102 can be made as part of the housing 16222 or attached as a separate layer to the inside walls of the housing 16222.
  • FIG. 172 shows a further embodiment of a tape or sheet 17210 which includes a carrier sheet 17212 and ridges 17214 that can be used to block reflected light as shown in FIG. 171.
  • the ridges 17214 are obliquely inclined on one side and sharply inclined on the other side so that incident light approaching from the sharply inclined side is blocked.
  • the ridges 17214 can be solid ridges with a triangular cross section with a sharp edge as shown in FIG. 172, or they can be thin inclined scales attached at one edge, or they can be inclined fibers attached at one end so that a surface is angled relative to the sidewall and incident light is blocked.
  • the advantage of the tape or sheet 17210 is that the ridges 17214 can be relatively thin and the ridges can cover a substantial area of the housing 16222.
  • a further advantage of the tape or sheet 17210 is that the ridges 17214 can be made more easily than the ridges shown in FIG. 171 , which may be difficult to mold as part of the housing.
  • the surrounding baffles may create apertures whose size corresponds to the distance they are located along the optical axis from the image source so that the image light can diverge along the optical axis and thereby provide an undipped view of the image source 16208 to the user's eye 16228.
  • an absorptive polarizer in the optical assembly is used to reduce stray light.
  • the absorptive polarizer may include an anti -reflective coating.
  • the absorptive polarizer may be disposed after a focusing lens of the optical assembly to reduce light passing through an optically flat film of the optical assembly.
  • the light from the image source may be polarized to increase contrast.
  • an anti-reflective coating in the optical assembly may be used to reduce stray light.
  • the anti -reflective coating may be disposed on a polarizer of the optical assembly or a retarding film of the optical assembly.
  • the retarding film may be a quarter wave film or a half wave film.
  • the anti -reflective coating may be disposed on an outer surface of a partially reflecting mirror. The light from the image source may be polarized to increase contrast.
  • an image source 10228 directs image light to a beam splitter layer of the optical assembly.
  • Fig. 103 depicts a blow-up of the image source 10228.
  • the image source 10228 is shown containing a light source (LED Bar 10302) that directs light through a diffuser 10304 and prepolarizer 10308 to a curved wire grid polarizer 10310 where the light is reflected to an LCoS display 10312. Image light from the LCoS is then reflected back through the curved wire grid polarizer 10310 and a half wave film 10312 to the beam splitter layer of the optical assembly 10200.
  • LED Bar 10302 that directs light through a diffuser 10304 and prepolarizer 10308 to a curved wire grid polarizer 10310 where the light is reflected to an LCoS display 10312.
  • Image light from the LCoS is then reflected back through the curved wire grid polarizer 10310 and a half wave film 10312 to the beam splitter layer of the optical assembly 10200
  • an optical assembly including optical components 10204, 10210, 10212, 10212, 10230 may be provided as a sealed optical assembly, such as being detachable (e.g. snaps on and off), exchangeable, and the like, and the image source 10228 provided as an integral component within the frame of the eyepiece.
  • a sealed optical assembly such as being detachable (e.g. snaps on and off), exchangeable, and the like, and the image source 10228 provided as an integral component within the frame of the eyepiece.
  • This may enable the sealed optical assembly to be water proof, dust proof, exchangeable, customizable, and the like.
  • a given sealed optical assembly may be provided with corrective optics for a one person, and be replaceable with a second sealed optical assembly for another person who has different corrective optics needs (e.g. a different prescription).
  • the optics assembly may be considered partitioned into separate portions with respect to what portion is being sealed, such as being comprised of an image generation facility 10228 and a directive optics facility 10204, 10210, 10212, and 10230, as shown in Fig. 102A.
  • Fig. 147 shows an embodiment configuration of the eyepiece showing the directive optics as 'projection screens' 14608a and 14608b.
  • the 102A also shows the eyepiece electronics and the portions of the projections system 14602, where this portion of the projection system may be referred to as the image generation facility.
  • the image generation facility and directive optics facility may be sealed subassemblies, such as to project the optics therein from contaminants in the surrounding environment.
  • the directive optics may be detachable, such as for replacement, for removing to allow for an unobstructed view by the user, to accommodate a non-destructive forced removal (e.g. where the directive optics are hit, and break away from the main body of the eyepiece without damage), and the like.
  • the present disclosure may comprise an interactive head-mounted eyepiece worn by a user, wherein the eyepiece includes an optical assembly through which the user views a surrounding environment and displayed content, and an integrated image source adapted to introduce the content to the optical assembly, wherein the optical assembly includes an image generation facility mounted within the frame of the eyepiece and a directive optics facility positioned in front of the user's eye and detachable from the frame of the eyepiece, where the image generation facility is sealed within the frame to reduce contamination from the surrounding environment.
  • the seal may be a sealed optical window.
  • the eyepiece may further comprise a processing facility, power management facility, a detachment sensor, a battery, and the like, where the power management facility may detect the detachment of the directive optics facility through a detachment indication from the detachment sensor, and selectively reduce power to components of the eyepiece to reduce power consumed from the battery.
  • the component that is reduced in power may be the image source, such as reducing the brightness of the image source, turning off the power to the image source, and the like, where the power management facility may monitor for the reattachment of a directive optics facility and return the power usage of the image source to a pre-detachment operational level.
  • the directive optics facility may be detachable in a break-away manner, such that when if the directive optics facility is inadvertently forced to detach, that it will do so without damaging the eyepiece.
  • the directive optics facility may be detachable through a connection mechanism, such as a magnet, pin, rail, a snap-on connector, and the like.
  • the directive optics facility may provide for vision correction for a user that requires corrective eyewear, where the directive optics facility is replaceable for the purpose of changing the vision correction prescription of the eyepiece.
  • the eyepiece may have two separate detachable optical assemblies for each eye, where one of the separate optical assemblies is removed to enable monocular usage with the remaining of the separate optical assemblies.
  • the monocular usage may be a firearms sighting usage where the side of the eyepiece with the detached directive optics facility is used for sighting the firearm, allowing the user with an unobstructed visual path the firearm's sight, while retaining facilities provided by the eyepiece to the other eye.
  • the directive optics facility may be detachable to enable exchanging between a directive optics facility adapted to indoor use with a directive optics facility adapted to indoor use. For instance, there may be different filters, field of view, contrast, shielding, and the like for indoor use verses outdoor use.
  • the directive optics facility may be adapted to accept an additional element, such as an optical element, a mechanical element, an adjustment element, and the like.
  • an optical element may inserted to adjust for a user's optical prescription.
  • the directive optics facility may also be replaceable in order to change the field of view provided, such as by replacing a directive optics facility with a first field of view with a directive optics facility with a second field of view.
  • LEDs provide unpolarized light.
  • the diffuser spreads and homogenizes the light from the LEDs.
  • the absorptive prepolarizer converts the light to S polarization.
  • the S polarized light is then reflected toward the LCOS by the curved wire grid polarizer.
  • the LCOS reflects the S polarized light and converts it to P polarized light depending on local image content.
  • the P polarized light passes through the curved wire grid polarizer becoming P polarized image light.
  • the half wave film converts the P polarized image light to S polarized image light.
  • the beam splitter layer 10204 is a polarizing beam splitter, or the image source provides polarized image light 10208 and the beam splitter layer 10204 is a polarizing beam splitter, so that the reflected image light 10208 is linearly polarized light, this embodiment and the associated polarization control is shown in FIG. 102A.
  • the polarization state of the image light is aligned to the polarizing beam splitter so that the image light 10208 is reflected by the polarizing beam splitter.
  • FIG. 102A shows the reflected image light as having S state polarization.
  • a first quarter wave film 10210 is provided between the beam splitter layer 10204 and the partially reflecting mirror 10212.
  • the first quarter wave film 10210 converts the linearly polarized image light to circularly polarized image light (shown as S being converted to CR in FIG. 102A).
  • the reflected first portion of image light 10208 is then also circularly polarized where the circular polarization state is reversed (shown as CL in FIG. 102A) so that after passing back through the quarter wave film, the polarization state of the reflected first portion of image light 10208 is reversed (to P polarization) compared to the polarization state of the image light 10208 provided by the image source (shown as S).
  • the reflected first portion of the image light 10208 passes through the polarizing beam splitter without reflection losses.
  • the beam splitter layer 10204 is a polarizing beam splitter and the see-through display assembly 10200 includes a first quarter wave film 10210
  • the light control element 10230 is a second quarter wave film and a linear polarizer 10220.
  • the light control element 10230 includes a controllable darkening layer 10214.
  • the second quarter wave film 10218 converts the second portion of the circularly polarized image light 10208 into linearly polarized image light 10208 (shown as CR being converted to S) with a polarization state that is blocked by the linear polarizer 10220 in the light control element 10230 so that eyeglow is reduced.
  • the light control element 10230 includes a linear polarizer 10220 and a quarter wave film 10218
  • incoming unpolarized scene light 10222 from the external environment in front of the user is converted to linearly polarized light (shown as P polarization state in FIG. 102A) while 50% of the light is blocked.
  • the first portion of scene light 10222 that passes through the linear polarizer 10220 is linearly polarized light which is converted by the quarter wave film to circularly polarized light (shown as P being converted to CL in FIG. 102A).
  • the third portion of scene light that is reflected from the partially reflecting mirror 10212 has reversed circular polarization (shown as converting from CL to CR in FIG.
  • the linear polarizer 10220 then blocks the reflected third portion of the scene light thereby reducing escaping light and reducing eyeglow.
  • the reflected first portion of image light 10208 and the transmitted second portion of scene light have the same circular polarization state (shown as CL) so that they combine and are converted by the first quarter wave film 10210 into linearly polarized light (shown as P) which passes through the beam splitter when the beam splitter layer 10204 is a polarizing beam splitter.
  • the linearly polarized combined light 10224 then provides a combined image to the user's eye 10202 located at the back of the see-through display assembly 10200, where the combined image is comprised of overlaid portions of the displayed image from the image source and the see-through view of the external environment in front of the user.
  • the beamsplitter layer 10204 includes an optically flat film, such as the Asahi TAC film discussed herein.
  • the beamsplitter layer 10204 may be disposed at an angle in front of a user's eye so that it reflects and transmits respective portions of image light and transmits scene light from a see-through view of the surrounding environment, so that a combined image comprised of portions of the image light and the transmitted scene light is provided to a user's eye.
  • the optically flat film may be a polarizer, such as a wire grid polarizer.
  • the optically flat film may be laminated to a transparent substrate.
  • the optically flat film may be molded, over-molded, glued, and the like into or onto a surface of one of the optical surfaces of the eyepiece, such as the beamsplitter 10202.
  • the optically flat film may be positioned at less than 40 degrees from vertical.
  • the curved polarizing film may have a less than 1 : 1 ratio of height of light source to width of illuminated area. The highest point of the curved film is lower than the length of the narrowest axis of the display.
  • additional optics such as corrective optics, prescriptions, and the like, may be added to the surface, such as to keep the film flat in a sandwich layer in between.
  • This disclosure further provides methods for providing an optically flat surface with an optical film.
  • Optical films are a convenient way to form an optical structure with optical characteristics that are very different from the rest of the structure of an imaging device. To provide function for the imaging device, the optical film needs to be attached to the optical device. When the optical film is used in a reflective manner, it is critical that the reflective surface be optically flat or the wave front of the light reflecting from the reflective surface will not be preserved and the image quality will be degraded.
  • An optically flat surface may be defined as a surface that is uniform within 5 wavelengths of light per inch of surface, as measured for the wavelength of light that the imaging device is used with and compared to either a flat surface or a desired optical curve.
  • Optically flat surfaces including optical films as described in the present disclosure can be included in display systems including: projectors, projection televisions, near eye displays, head mounted displays, see -thru displays, and the like.
  • FIG. 140 shows an example of a display system with an optically flat reflective surface that is a beam splitter comprised of an optical film on a substrate wherein the display system is a near eye display 14000.
  • the image source 14010 includes a projection system (not shown) to provide image light with an optical layout that includes a folded optical axis 14014 located in the near eye display 14000.
  • the optics along the optical axis 14014 can include lenses to focus the image light to provide a focused image from the image source 14010 to the user's eye 14002.
  • a beam splitter 14004 folds the optical axis 14014 from the image source 14010 to a spherical or aspherical reflector 14008.
  • the beam splitter 14004 can be a partially reflecting mirror or a polarizing beam splitter layer.
  • the beam splitter 14004 in the near eye display 14000 is oriented at an angle to redirect at least a portion of the image light from the image source 14010 to the reflector 14008. From the reflector 14008, at least a further portion of the image light is reflected back to the user's eye 14002. The reflected further portion of the image light passes back through the beam splitter 14004 and is focused at the user's eye 14002.
  • the reflector 14008 can be a mirror or a partial mirror.
  • scene light from the scene in front of the near eye display 14000 can be combined with the image light and thereby present combined image light 14018 comprised of image light along axis 14014 and scene light along axis 14012 to the user's eye 14002.
  • the combined image light 14018 presents a combined image of the scene with an overlaid image from the image source to the user's eye.
  • FIG. 141 shows an illustration of a near eye display module 14100.
  • the module 14100 is comprised of a reflector 14104, an image source module 14108 and a beam splitter 14102.
  • the module can be open at the sides with attachments between at least some of the joining edges between the reflector 14104, the image source module 14108 and the beam splitter 14102.
  • the module 14100 can be closed at the sides by sidewalls to provide an enclosed module to prevent dust, dirt and water from reaching the inner surfaces of the module 14100.
  • the reflector 14104, the image source module 14108 and the beam splitter 14102 can be manufactured separately and then joined together, or at least some of the pieces can be manufactured together in joined subassemblies.
  • optical films can be used on the beam splitter 14102 or the reflector.
  • the beam splitter 14102 is shown as a flat surface while the reflector 14104 is shown as a spherical surface.
  • both the reflector 14104 and the beam splitter 14102 are used to provide an image to the user's eye as shown in FIG. 140 and as such it is important that the surfaces be optically flat or optically uniform.
  • FIG. 142 shows a schematic drawing of an embodiment of the disclosure, a pellicle style film assembly 14200.
  • the pellicle style film assembly 14200 includes a frame 14202 comprised of upper and lower frame members 14202a and 14202b.
  • the optical film 14204 is held between the frame members 14202a and 14202b with an adhesive or fasteners.
  • the optical film 14204 can be stretched in one or more directions while the adhesive is applied and the frame members 14202a and 14202b are bonded to the optical film 14204. After the optical film 14204 is bonded to the frame 14202, the edges of the optical film can be trimmed to provide a smooth surface to the outer edges of the frame 14202.
  • the optical film 14204 is a folded film comprised of a series of optically flat surfaces and the interface of the frame members 14202a and 14202b have a matching folded shape. The folded film is then stretched along the direction of the folds and bonded into position so that the frame members 14202a and 14202b hold the optical film 14204 in the folded shape and each of the series of optically flat surfaces is held in place.
  • the resulting pellicle style film assembly 14200 is a rigid assembly that can be placed into an optical device such as the near eye display module 14100 to form the beam splitter 14102.
  • the pellicle style film assembly 14200 is a replaceable beam splitter 14102 assembly in the near eye display module 14100.
  • Sidewalls in the near eye display module 14100 can have grooves that the frame 14202 fits into, or alternately a flat surface can be provided that connects the sidewalls and the frame 14202 can sit on top of the flat surface.
  • FIG. 143 shows an illustration of an insert molded assembly 14300 which includes an optical film 14302.
  • the optical film 14302 is placed into a mold and a viscous plastic material is injected into the mold through a molding gate 14308 so that the plastic fills the mold cavity and forms a molded structure 14304 adjacent to the optical film 14302 and behind the optical film 14302.
  • the mold is opened along the parting line 14310 and the insert molded assembly 14300 is removed from the mold.
  • the optical film 14302 is then embedded into and attached to the insert molded assembly 14300.
  • the inner surface of the mold that the optical film 14302 is placed against is an optically flat surface.
  • the viscous plastic material forces the optical film 14302 against the optically flat surface of the mold during the molding process.
  • This process can be used to provide optically flat surfaces as described above that are flat or have a desired optical curve.
  • the optical film 14302 can be provided with an adhesive layer or a tie layer to increase the adhesion between the optical film 14302 and the molded structure 14304.
  • the optical film 14302 is placed into the mold with a protective film between the mold surface and the optical film 14302.
  • the protective film can be attached to the optical film 14302 or the mold.
  • the protective film can be smoother or flatter than the mold surface to provide a smoother or flatter surface for the optical film 14302 to be molded against.
  • the protective film can be any material such as for example plastic or metal.
  • FIG. 144 shows an illustration of a laminating process for making a laminated plate with an optical film 14400.
  • upper and lower press plates 14408a and 14408b are used to laminate an optical film 14400 onto a substrate 14404.
  • An adhesive 14402 can be optionally used to bond the substrate 14404 to the optical film 14400.
  • one or more of the press plates 14408a and 14408b can be heated or the substrate 14404 can be heated to provide a higher level of adhesion between the substrate 14404 and the optical film 14400.
  • Heating of the substrate or one or more of the press plates 14408a and 14408b can also be used to soften the substrate 14404 and thereby provide a more uniform pressure behind the optical film 14400 to improve the smoothness or flatness of the optical film 14400 in the laminated plate.
  • the laminated plate with an optical film 14400 of this embodiment can be used as a replaceable beam splitter in a near eye optical module 14100 as previously described for the pellicle style film assembly 14200.
  • FIG. 145 A-C shows an illustration of an application process for making a molded structure 14502 with an optical surface including an optical film 14500.
  • the optical film 14500 is applied to an optically flat surface 14504 in a molded structure 14502 with a rubber applicator 14508.
  • An adhesive layer may be applied to either the optically flat surface 14504 of the molded structure 14502 or the bottom surface of the optical film 14500 to adhere the optical film 14500 to the molded structure 14502.
  • the rubber applicator 14508 may be a relatively soft and rubbery material with a curved surface so that the center portion of the optical film 14500 is forced to contact the optically flat surface 14504 of the molded structure 14502 first.
  • the contact area between the optical film 14500 and the optically flat surface 14504 of the molded structure 14502 grows in size as shown in FIGs 145 A, 145B and 145C.
  • This progressive application process provides a very uniform application of pressure that allows the air at the interface to be expelled during the application process.
  • the progressive application process along with the optically flat surface 14504 of the molded structure 14502 provides an optically flat optical film 14500 attached to the interior surface of the molded structure 14502 as shown in FIG. 145C.
  • the adhesive layer used to bond the optical film 14500 to the molded structure 14502 can be attached to the optical film 14500 or the optically flat surface 14504 on the interior of the molded structure 14502.
  • the optically flat surface can be a flat surface or a surface with a desired optical curve, or a series of optically flat surfaces wherein the rubber applicator is shaped to provide a progressive application of pressure as the optical film is applied.
  • an image display system may include an optically flat optical film comprising a display module housing, wherein the housing comprises a substrate to hold the optical film optically flat, an image source and a viewing location wherein the image provided by the image source is reflected from the optical film to the viewing location.
  • the optical film of the image display system may be molded into the display module. The optical film may be applied to the display module in embodiments. Further, in embodiments, the optical film of the display system may be a wire grid polarizer, a mirror, a partial mirror, holographic film, and the like. In embodiments, the image display system may be a near eye display.
  • the optical film may be held against an optically flat surface when the optical film is molded into the display module.
  • the optical film of the image display system may comprise an optical flatness of 5 wavelengths of light per inch.
  • an image display system including an optically flat optical film may comprise a substrate to hold the optical film optically flat, a display module housing, an image source, and a viewing location wherein the image provided by the image source may be reflected from the optical film to the viewing location and the substrate with the optical film may be replaceable within the display module housing.
  • the substrate of the image display system may be a frame and the optical film may be held under tension by the frame, the substrate may be a plate molded behind the file, and/or the substrate may be a laminated plate.
  • the optical film of the image display system may be a beam splitter, a polarizing beam splitter, a wire grid polarizer, a mirror, a partial mirror, a holographic film, and the like.
  • the image display system may be a near eye display.
  • the optical film of the image display system may be held against an optically flat surface when the plate is molded behind the optical film. Further, in embodiments, the optical film of the image display system may be held against an optically flat surface when the plate is laminated to the optical film.
  • the optical film of the image display system may comprise an optical flatness of 5 wavelengths of light per inch.
  • the components in Fig. 102A collectively form an electro-optic module.
  • the angle of the optical axis associated with the display may be 10 degrees or more forward of vertical. This degree of tilt refers to how the upper part of the optics module leans forward. This allows the beamsplitter angle to be reduced which makes the optics module thinner.
  • the ratio of the height of the curved polarizing film to the width of the reflective image display is less than 1 : 1.
  • the curve on the polarizing film determines the width of the illuminated area on the reflective display, and the tilt of the curved area determines the positioning of the illuminated area on the reflective display.
  • the curved polarizing film reflects illumination light of a first polarization state onto the reflective display, which changes the polarization of the illumination light and generates image light, and the curved polarizing film passes reflected image light.
  • the curved polarizing film includes a portion that is parallel to the reflective display over the light source.
  • the height of the image source may be at least 80% of the display active area width, at least 3.5 mm, or less than 4 mm.
  • Portable display systems it is important to provide a display that is bright, compact and light in weight.
  • Portable display systems include cellphones, laptop computers, tablet computers, near eye displays and head mounted displays.
  • the disclosure provides a compact and lightweight frontlight for a portable display system comprised of a partially reflective film to redirect light from an edge light source to illuminate a reflective image source.
  • the partially reflective film can be a partial mirror beam splitter film or a polarizing beam splitter film.
  • the polarizing beam splitter film can be a multi-layer dielectric film or a wire grid polarizer film.
  • Polarizing beam splitter films are known to provide efficient reflection of one polarization state while simultaneously allowing the other polarization state to pass through. Multi-layer dielectric films are available from 3M in Minneapolis, Minnesota under the name DBEF. Wire grid polarizing films are available from Asahi- asei E-Materials in Tokyo, Japan under the name WGF.
  • An edge light provides a compact light source for a display, but since it is located at the edge of the image source, the light must be redirected by 90 degrees to illuminate the image source.
  • the image source is a reflective image source such as a liquid crystal on silicon (LCOS) image source
  • the illuminating light must be polarized. The polarized light is reflected by the surface of the image source and the polarization state of the light is changed in correspondence with the image content being displayed. The reflected light then passes back through the frontlight.
  • LCOS liquid crystal on silicon
  • FIG. 187 shows a schematic illustration of a prior art display assembly 18700 with a solid beam splitter cube 18718 as a frontlight.
  • a display assembly includes a frontlight, one or more light sources and an image source.
  • one or more light sources 18702 are included to provide light shown as light rays 18712.
  • the light source can be LEDs, fluorescent lights, OLEDs, incandescent lights or solid state lights.
  • the light rays 18712 pass through a diffuser 18704 to spread the light laterally for more uniform illumination. If the diffused light is polarized, the diffuser includes a linear polarizer.
  • the diffused light rays 18714 are emitted through the solid beam splitter cube 18718 toward the partially reflective layer 18708 where they are partially reflected toward the reflective image source 18720.
  • the diffused light rays 18714 are then reflected by the reflective image source 18720 thereby forming image light 18710 which is transmitted by the partially reflective layer 18708.
  • the image light 18710 can then pass into associated imaging optics (not shown) to present an image to a viewer.
  • the height of the lighted area of the light source herein shown as the diffuser 18704 is the same as the width of the reflective image source 18720 that is illuminated.
  • the partially reflective layer 18708 is positioned at a 45 degree included angle to provide image light rays 18710 that proceed straight or vertically into the associated imaging optics.
  • the frontlight shown in FIG. 187 is relatively large in size.
  • the image light 18710 must proceed perpendicularly from the reflective image source 18720 to provide a uniform wavefront to the associated imaging optics for a high quality image to be provided to a viewer, as is known by those skilled in the art.
  • the diffused light rays 18714 must be redirected by the partially reflective film 18708 to be perpendicular to the reflective image source 18720 so they can be reflected and pass vertically (as shown in FIGs 187-198) into the associated imaging optics.
  • FIG. 188 shows another prior art display assembly 18802, which includes a partially reflective film 18804, which is supported at the edges and is free-standing over the reflective image source 18720.
  • This display assembly works in a similar fashion to the display assembly shown in FIG. 187 with the difference being that display assembly 18802 is lighter in weight than display assembly 18700 due to the lack of solid beam splitter cube 18718.
  • the height of the diffuser 18704 is again the same as the width of the reflective image source 18720 to provide image light 18808 which when reflected by the reflective image source 18720 proceeds vertically into the associated imaging optics.
  • FIG. 189 shows a schematic illustration of what happens to the light in a display assembly 18902 if the partially reflective film 18804 is positioned at an included angle of less than 45 degrees.
  • portions of the reflective image source 18720 are not illuminated uniformly.
  • Light rays that illuminate the portion of the reflective image source that are farthest away from the diffuser either do not proceed straight to the associated imaging optics (as in the case of rays 18904) or have previously reflected from the surface of the reflective image source (as in the case of rays 18908) which changes the polarization state and the light rays then pass through the partially reflective film if the film is a polarizing beam splitter film (also known as a reflective polarizer film).
  • a polarizing beam splitter film also known as a reflective polarizer film
  • the associated imaging optics can only use image light that proceeds straight from the reflective image source 18720, when the partially reflective film 18804 is positioned at an angle of less than 45 degrees, the area of the reflective image source 18720 that is illuminated is reduced and correspondingly dark portions of the image are produced.
  • a curved partially reflective surface 19004 is provided to redirect the diffused light 19010 provided by the light source 18702 downward to illuminate the reflective image source 18720.
  • the curved partially reflective surface 19004 can be a polarizing beam splitter film, which is thin and flexible.
  • the diffuser 18704 includes a linear polarizer so that the light 18712 is diffused and then linearly polarized, so the diffused light 19010 is polarized.
  • the linear polarizer in the diffuser 18704 and the polarizing beam splitter film 19004 are oriented such that light passing through the linear polarizer is reflected by the polarizing beam splitter film.
  • the polarization of the reflected image light 19008 is the opposite polarization state compared to the diffused light 19010.
  • the reflected image light 19008 then passes through the partially reflective film 19004 and continues to the display optics.
  • the partially reflective surface 19004 can be curved and lightweight.
  • the polarizing beam splitter film performs the dual role of being a reflector for the diffused light 19010 that illuminates the reflective image source 18720 and a transparent member for the reflected image light 19008.
  • polarizing beam splitter films as is known by those skilled in the art is that they can receive light over a wide range of incident angles so that a curve doesn't interfere with light passing through to the film.
  • polarizing beam splitter film is thin (e.g. less than 200 micron)
  • the curved shape doesn't noticeably distort the image light 19008 as it passes through the film to the display optics.
  • the polarizing beam splitter films have a low tendency to scatter light so high image contrast can be maintained.
  • polarizing beam splitter films allow them to be formed into curved shapes that redirect and focus light from the diffuser onto the reflective image source.
  • the shape of the curve of the polarizing beam splitter film can be selected based on the light distribution provided by the diffuser to provide uniform illumination of the reflective image source.
  • FIG. 190 shows a curved partially reflective film 19004 with a parabolic shape, but radiused curves, complex splined curves, relatively flat curves, flats or segmented planes are possible as well to uniformly redirect and focus the diffused light 19010 onto the reflective image source 18720 depending on the nature of the light source 18702 and the effectiveness of the diffuser 18704.
  • curved surfaces on the partially reflective surface 19004 tend to concentrate the diffused light 19010 into the center of the reflective image source 18720 so that curved surfaces are best used when the diffuser 18704 provides a distribution of light that is brighter at the edges.
  • a relatively flat surface on the partially reflective surface 19004 is best used when the diffuser 18704 provides a distribution of light that is brighter at the center.
  • the shape of the partially reflective surface 19004 when it is comprised of a flexible film can be maintained with side frames that have slots of the appropriate curve to hold the flexible film in place as shown in FIG. 190 as a free standing film. Two side frames are used to support the curved shape on either side of the display assembly 19002 along with the other components.
  • the display assembly 19002 is comprised of air and the partially reflective surface 19004 is thin film, weight is substantially lower compared to the prior art display assembly 18700 shown in FIG. 187.
  • the width of the reflective image source 18720 that is illuminated is greater than the height of the diffuser 18704 so that the display assembly 19002 is more compact than the prior art display assembly shown in FIG. 188.
  • FIG. 191 shows another embodiment of the disclosure in which dual light sources 19104 are used in display assembly 19102 with two relatively flat partially reflective surfaces positioned back to back.
  • the arrangement shown in FIG. 191 provides a solid film holder 19120 in the frontlight with two sides, so that the display assembly 19102 is similar to using two display assemblies 18700 as shown in FIG. 187 positioned back to back.
  • the light rays are only shown for one side, but the parts and the light rays in the other side are symmetrical with the side shown.
  • the solid film holder 19120 is a partially reflective film 19110 that extends continuously between the two sides.
  • the solid film holder 19120 is also continuous between the two sides so that the image light 191 12 is not interrupted or deflected by a seam line between the two sides of the display assembly 19102.
  • the solid film holder 19120 and the partially reflective film 191 10 together present a constant optical thickness so the image light is not deflected or distorted.
  • image light 191 12 with continuous image quality can be provided while being illuminated by light from two light sources 19104.
  • Each light source 19104 provides light 19114 to a diffuser 19108 which spreads the light 19114 laterally to provide diffused light 19118 to illuminate one half of the reflective image source 18720.
  • the solid film holder 19120 holds the partially reflective film 191 10 in the desired shape.
  • the height of the diffuser 19108 is reduced to half of the prior art diffuser 18704 shown in FIG. 187 for display assembly 18700 when compared to the illuminated width of the reflective image source 18720.
  • FIG. 192 shows a schematic illustration of a display assembly 19202 with dual light sources 19104 and a freestanding partially reflecting film 19204 that is supported only at the edges.
  • the light rays are only shown for one side, but the parts and the light rays for the other side are symmetrical with the side shown.
  • the functions of the various components of the display assembly 19202 are the same as those shown in FIG. 191 , but with the added benefit that the display assembly 19202 is lighter in weight than the display assembly 19102 since the major portion of the display assembly 19202 is comprised of air.
  • FIG. 193 shows a display assembly 19302 with dual light sources 19104 and a freestanding partially reflective film 19308 where the film is supported at the edges such that two curved surfaces are provided.
  • the partially reflective film 19308 is continuous across both sides with similar curves on both sides. The curves are chosen to reflect and focus the diffused light 19312 provided by the diffuser onto the reflective image source 18720.
  • the reflective image source 18720 reflects the diffused light 19312 thereby forming image light 19310.
  • the height of the diffuser 19304 is less than half of the prior art diffuser 18704 shown in FIG. 187 so that the frontlight and display assembly 19302 is very compact.
  • FIG. 194 shows a schematic illustration of a display assembly 19402 with a continuous partially reflective film 19308 inside a solid film holder 19404 that is otherwise similar to display assembly 19302 shown in FIG. 193.
  • the solid film holder 19404 is used on either side of the partially reflective film 19308 to hold the film into a prescribed two sided curve and also to protect the partially reflective film 19308.
  • the two sides of the solid film holder 19404 are connected by a relatively thin section in the middle of the bottom portion of the solid film holder 19404 to further avoid presenting a seam line that would disrupt the image light 19310 in the center of the image.
  • the partially reflective films in the display assemblies shown in FIGs. 191 -194 are polarizing beam splitting films.
  • the diffusers include linear polarizers so that the diffused light is polarized.
  • the linear polarizer is aligned to the polarizing beam splitter film so that the diffused light has the polarization state that is reflected by the polarizing beam splitter film.
  • the polarizing beam splitter film also acts as an analyzer to the image light.
  • the advantage of using polarized diffused light with a polarizing beam splitter film in the frontlight is that stray light is reduced in the display assemblies since all of the polarized diffused light is reflected by the polarizing beam splitter film toward the reflective image source, where it is converted into image light. If the diffused light were not polarized, the polarization state of the diffused light that was not reflected would be transmitted through the polarizing beam splitter film and if this light were not controlled, it would contribute scattered light to the image light, which would reduce contrast in the image presented to the viewer.
  • FIG. 195 shows a schematic illustration of a display assembly 19502 with a single light source 19104 on one side and polarization control to effectively illuminate the reflective image source 18720 from both sides.
  • the light source 19104 provides unpolarized light 19114 and unpolarized diffused light 19508.
  • the partially reflective film is a polarizing beam splitter film 19504 in a solid film holder 19514.
  • the polarizing beam splitter film 19504 reflects one polarization state of the diffused light (shown as ray 19510) while transmitting the other polarization state (shown as ray 19518).
  • the polarizing beam splitter film 19504 is folded and continuous so that the light with the other polarization state 19518 passes through both sides of the folded polarizing beam splitter film 19504.
  • This light 19518 then passes through a quarter wave retarder film 19524, which changes the polarization state from linear to circular.
  • the circularly polarized light is then reflected by a mirror 19528 and passes back through the quarter wave retardation film 19524 which changes the polarization state from circular polarization to linear polarization but of the one polarization state (shown as ray 19520) so that the light 19520 is then reflected toward the reflective image source 18720 by the polarizing beam splitter film 19504.
  • the light provided by the light source 19104 in display assembly 19502 illuminates the reflective image source 18720 on both sides with light of the same polarization state. Since the diffused light 19508 is unpolarized, and both polarization states (19510, 19518) are used to illuminate the reflective image source 18720, essentially all of the light provided by the light source is converted into image light (19512, 19522). The image light (19512, 19522) is provided straight to the associated imaging optics. Again, the height of diffuser 19108 is half of the diffuser 18704 shown in FIG. 187 thereby providing a frontlight and display assembly that is compact and efficient.
  • FIG. 196 shows a display assembly 19602 with similar geometry to that shown in FIG. 195, but the polarizing beam slitter film 19604 is free standing and supported only at the edges to reduce the weight of the frontlight while still providing a low height of the diffuser relative to the width of the reflective image source that is illuminated.
  • FIG. 197 shows yet another embodiment of the disclosure including display assembly 19702 with dual light sources 19704 and 19708 and a folded polarizing beam splitter film 19714 wherein the two sides of the folded polarizing beam splitter film 19714 are curved.
  • the light 19718, 19720 from the light sources 19704, 19708 is unpolarized and the diffusers 19710, 19712 do not include polarizers so that the diffuse light 19722, 19724 is unpolarized as well.
  • the curved and angled sides of the polarizing beam splitter film 19714 redirect one polarization state of the diffuse light (shown as rays 19728, 19730) toward the reflective image source 18720 while also concentrating the light 19728, 19730 onto the imaging area of the reflective image source 18720.
  • the dual light sources 19704, 19708 and the folded polarizing beam splitter 19714 work in a complimentary fashion since the polarizing beam splitter film 19714 is continuous.
  • unpolarized diffused light 19722, 19724 is provided respectively on each side of the display assembly 19702 and a first polarization state (typically S) is redirected toward the reflective image source 18720 by the polarizing beam splitter film 19714 while light 19740, 19738 with the other polarization state (typically P) is transmitted by the polarizing beam splitter film 19714.
  • the transmitted light 19740, 19738 with the other polarization state passes through both sides of the folded polarizing beam splitter film 19714 so that it reaches diffusers 19712, 19710 respectively on the opposite side.
  • the light 19740, 19738 impacts the diffuser 19712, 19710 respectively on the opposite side, it is diffusely reflected by the diffuser and in the process it becomes unpolarized.
  • a reflector can be added to the light sources 19704, 19708 and the surrounding area to increase the reflection of the light 19740, 19738.
  • This diffusely reflected unpolarized light then mixes with the diffuse light 19722, 19724 provided by the light source 19704, 19708 on the respective side and then passes back toward the polarizing beam splitter film 19714 where the light 19730, 19728 with the first polarization state is reflected toward the reflective image source, the light 19738, 19740 while the other polarization state is transmitted and the process continuously repeats.
  • the light of the other polarization state is continuously recycled thereby increasing the efficiency of the display assembly 19702 since both polarization states of the light 19718, 19720 supplied by the dual light sources 19704, 19708 is utilized to illuminate the reflective image source 18720.
  • the increased diffuse reflection of the recycled light also improves the uniformity of the illuminating light provided to the reflective image source 18720.
  • the image light (19732, 19734) may be provided straight to the associated imaging optics.
  • a similar approach to that presented in FIG. 197 and described above can be used in another embodiment with a display assembly that has flat surfaces in the sides of the folded polarizing beam splitter film.
  • the sides of the reflective polarizing film are flat, the light from the sidelights retains the illumination uniformity provided by the diffuser.
  • a solid film holder can be used wherein the light of the other polarization state is recycled to improved efficiency.
  • the sides of the folded polarizing beam splitter film can be flat or curved in this embodiment.
  • FIG. 198 shows a schematic illustration of a method for making a frontlight 19902 such as that shown in FIG. 199 with a folded reflective beam splitter film 19808 and dual light sources on the sides.
  • the dual light sources are not shown, as they can be part of another assembly step or in a surrounding module.
  • a flowchart of the assembly method is provided in FIG. 204.
  • top 19810 and bottom 19812 film holders are provided in Step 20402.
  • the top and bottom film holders 19810, 19812 can be made from any transparent material by diamond turning, injection molding, compression molding or grinding. The combination of material and manufacturing technique are chosen to provide top 19810 and bottom 19812 film holders with low birefringence.
  • Suitable low birefringence materials for the films holders 19810, 19812 include glass materials or plastics such as Zeonex F52 from Zeon Chemicals, APL5514 from Mitsui or O P4 from Osaka Gas.
  • the surfaces in the top and bottom film holders that will contact the folded polarizing beam splitter film 19808, are matched to hold the film 19808 in place with the desired shape and angle without introducing significant airgap, so the image light can pass through the frontlight 19902 without being substantially deflected.
  • the bottom film holder 19812 is attached to the reflective image source 18720 either by adhesive binding or by providing a surrounding structure that holds the bottom film holder 19812 in relationship (either in contact or at a specified distance) to the reflective image source 18720.
  • the polarizing beam splitter film is folded in Step 20408. Then in Step 20410, the folded polarizing beam splitter film 19808 is placed into the lower film holder 19812 and the upper film holder 19810 is placed on top, thereby forcing the polarizing beam splitter film 19808 to conform with the matched surfaces of the top 19810 and bottom 19812 film holders.
  • an adhesive is applied to the surface of the top 19810 or bottom 19812 film holder so that the polarizing beam splitter film 19808 is bonded to the top 19810 or bottom 19812 film holder.
  • the diffusers 19802, 19804 are attached to the sides of the lower 19812 film holder in Step 20412.
  • a schematic illustration of the assembled frontlight 19902 is shown in FIG. 199. Similar methods can be used to make the frontlights shown in FIGs. 191, 194 and 195. The order of assembly can be changed within the scope of the disclosure.
  • the film holders 19810, 19812 are assembled with the folded polarizing beam splitter film 19808 prior to being attached to the diffusers 19802, 19804 or the reflective image source 18720 or any other pieces.
  • Steps 20402, 20408 and 20410 are then done in sequence to make a solid film holder with the folded polarizing beam splitter film 19808 inside as shown similarly in FIGs. 191 , 194 and 195.
  • the reflective image source 18720 and the diffusers 19802, 19804 are attached at a later time (Steps 20404, 20412).
  • Various methods can be used to hold the reflective beam splitter film in place between the top and bottom film holders.
  • the film can be bonded in place to the top or bottom film holder.
  • the top or bottom film holder can be bonded to a surrounding structural piece (not shown) or to associated imaging optics (not shown).
  • the reflective beam splitter film is a polarizing beam splitter film with a wire grid polarizer
  • the performance of the wire grid polarizer can be compromised if adhesive is used on the side of the wire grid structure.
  • the polarizing beam splitter film can be bonded on the opposite side to the wire grid structure to either the top or bottom film holder depending on which is adjacent the wire grid structure.
  • Adhesives used to bond the polarizing beam splitter film to the film holder must be transparent and low birefringence. Examples of suitable adhesives include UV curing adhesives or pressure sensitive adhesives.
  • FIGs. 200-203 show a series of schematic illustrations of another method for making a frontlight with dual sidelights.
  • FIG. 205 is a flowchart that lists the steps of the method. In this method, the top and bottom film holders are cast in place around the folded reflective beam splitter film.
  • Step 20502 the polarizing beam splitter film 20008 is folded.
  • Step 20504 the folded polarizing beam splitter film 20008 is inserted into side frames, which have slots or matching pieces to hold the polarizing beam splitter film 20008 in the desired shape for the frontlight (see the dual curved shape shown in FIG. 200).
  • the side frames are then attached to the reflective image source 18720 in Step 20508.
  • the diffusers 20002, 20004 are attached to the sides of the side frames in Step 20510.
  • the folded polarizing beam splitter film 20008 is surrounded on the sides by the side frames and the diffusers 20002, 20004 and on the bottom by the reflective image source 18720.
  • FIG. 200 shows a schematic illustration of the reflective image source 18720 with attached diffusers 20002, 20004 and a free standing reflective beam splitter film 20008 that is supported at the edges so that the desired shape is imparted to the reflective beam splitter film 20008.
  • FIG. 201 shows holes in the side frames or surrounding structure, which are used to introduce the transparent casting material under the folded reflective beam splitter film.
  • the larger hole 20102 near the reflective image source 18720 is used to introduce the transparent casting material, while the smaller holes 20104 are used to allow the air to escape from under the folded reflective beam splitter film 20008.
  • the folded reflective beam splitter film 20008 forms an enclosed cavity over the reflective image source 18720 and contained by the diffusers 20002, 20004 and the side frames or surrounding structure. As the transparent casting resin is slowly injected into hole 20102, the air from the enclosed cavity passes out the smaller holes 20104.
  • Step 20512 transparent liquid casting material 20202 is poured on top of the polarizing beam splitter film 20008 as shown in FIG. 202.
  • a transparent top sheet or plate 20302 is then applied in Step 20514 to provide a flat top surface to material 20202 as shown in FIG. 203.
  • Care must be taken to prevent air from being entrapped under the flat sheet of transparent material when it is applied to the transparent casting material. Stops can be provided in the surrounding structure to hold the flat sheet of transparent material parallel to the reflective image source.
  • the transparent liquid casting material can be any transparent liquid casting material such as epoxy, acrylic or urethane.
  • the same transparent liquid casting material should be used for the top film holder as the bottom film holder so the image light is exposed to a uniform optical thickness solid block and the image light is not deflected by the surfaces of the folded polarizing beam splitter film.
  • the transparent liquid casting material can be cured after casting by allowing a cure time, exposing to UV or exposing to heat. Curing of the transparent casting material can be done in a single step or in multiple steps. Curing of the lower portion as shown in FIG. 201 can be done prior to the casting of the upper portion shown in FIG. 202. Alternately, curing of the entire cast frontlight can be done after the step shown in FIG.
  • FIGs. 200-203 The advantage of the method shown in FIGs. 200-203 is that intimate contact is obtained between the transparent casting material and the reflective beam splitter film so that light can pass unimpeded through the portions of the frontlight.
  • the casting method can also be used with a solid top or bottom film holder so that only the top or bottom film holder is cast. While FIGs. 200-203 show a frontlight being made with curved surfaces, the method can be used to make a frontlight with flat surfaces as well.
  • one of the film holders is made as a solid piece and the other film holder is cast with the folded polarizing beam splitter film in place.
  • the folded polarizing beam splitter film can be bonded to the solid piece prior to casting the other film holder in place. In this way, the cast film holder will have intimate contact with the surfaces of the polarizing beam splitter film.
  • the materials used for the solid film holder should have the same refractive index as the cast film holder to avoid deflecting the image light as it passes through from the reflective image source to the associated imaging optics.
  • An example of suitably matched materials is APEC 2000 from Bayer which has a refractive index of 1.56 and is injection moldable with EpoxAcast 690 from Smooth-On which has an refractive index of 1.565 and is castable.
  • a solid film holder is made using a multi-step molding process as shown in the flowchart of FIG. 206.
  • the bottom film holder is molded. Suitable molding techniques include injection molding, compression molding or casting.
  • the polarizing beam splitter film is folded.
  • the folded polarizing beam splitter film is placed on the molded bottom film holder and then placed as an insert into a mold for the top film holder.
  • the top film holder is then molded over the folded polarizing beam splitter film and the bottom film holder.
  • the end result is a solid film holder with the folded polarizing beam splitter film inside such as is shown in FIGs 191 , 194 and 195.
  • the advantage of this multi-step molding technique is that the folded polarizing beam splitter film is forced to conform to the surface of the bottom film holder and the top and bottom film holders are in intimate contact with the folded polarizing beam splitter film.
  • the refractive index of the top and bottom film holders is the same within 0.03.
  • the glass transition point of the material for the bottom film holder is higher than the glass transition point for the material of the top film holder or the material for the bottom film holder is crosslinked so that the bottom film holder doesn't deform when the top film holder is molded over the folded polarizing beam splitter film and the bottom film holder.
  • a suitable combination of injection moldable materials are cyclic olefin materials such as Zeonex E48R from Zeon Chemicals with a Tg of 139C and refractive index of 1.53 and Topas 6017 from Topas Advanced Polymers with a Tg of 177C and refractive index of 1.53.
  • the AR eyepieces of the present disclosure have high modulation transfer functions that permit combinations of resolution levels and device size, e.g., eyeframe thickness, that have been unachievable heretofore.
  • the virtual image pixel resolution levels presented to the user may be in the range of from about 28 to about 46 pixels per degree.
  • the angle of the curved wire grid polarizer controls the direction of the image light.
  • the curve of the curved wire grid polarizer controls the width of the image light. The curve enables use of a narrow light source because it spreads the light when the light strikes it and then folds it/reflects it to uniformly illuminate an image display. Image light passing back through the wire grid polarizer is unperturbed. Thus, the curve also enables the miniaturization of the optical assembly.
  • augmented reality eyepiece 2100 includes a frame 2102 and left and right earpieces or temple pieces 2104.
  • Protective lenses 2106 such as ballistic lenses, are mounted on the front of the frame 2102 to protect the eyes of the user or to correct the user's view of the surrounding environment if they are prescription lenses.
  • the front portion of the frame may also be used to mount a camera or image sensor 2130 and one or more microphones 2132.
  • waveguides are mounted in the frame 2102 behind the protective lenses 2106, one on each side of the center or adjustable nose bridge 2138.
  • the front cover 2106 may be interchangeable, so that tints or prescriptions may be changed readily for the particular user of the augmented reality device.
  • each lens is quickly interchangeable, allowing for a different prescription for each eye.
  • the lenses are quickly interchangeable with snap-fits as discussed elsewhere herein.
  • Certain embodiments may only have a projector and waveguide combination on one side of the eyepiece while the other side may be filled with a regular lens, reading lens, prescription lens, or the like.
  • the left and right ear pieces 2104 may each vertically mount a projector or microprojector 21 14 or other image source atop a spring-loaded hinge 2128 for easier assembly and vibration/ shock protection.
  • Each temple piece also includes a temple housing 21 16 for mounting associated electronics for the eyepiece, and each may also include an elastomeric head grip pad 2120, for better retention on the user.
  • Each temple piece also includes extending, wrap-around ear buds 21 12 and an orifice 2126 for mounting a headstrap 2142.
  • the temple housing 21 16 contains electronics associated with the augmented reality eyepiece.
  • the electronics may include several circuit boards, as shown, such as for the microprocessor and radios 2122, the communications system on a chip (SOC) 2124, and the open multimedia applications processor (OMAP) processor board 2140.
  • the communications system on a chip (SOC) may include electronics for one or more communications capabilities, including a wide local area network (WLAN), BlueToothTM communications, frequency modulation (FM) radio, a global positioning system (GPS), a 3 -axis accelerometer, one or more gyroscopes, and the like.
  • the right temple piece may include an optical trackpad (not shown) on the outside of the temple piece for user control of the eyepiece and one or more applications.
  • a digital signal processor may be programmed and/or configured to receive video feed information and configure the video feed to drive whatever type of image source is being used with the optical display.
  • the DSP may include a bus or other communication mechanism for communicating information, and an internal processor coupled with the bus for processing the information.
  • the DSP may include a memory, such as a random access memory (RAM) or other dynamic storage device (e.g., dynamic RAM (DRAM), static RAM (SRAM), and synchronous DRAM (SDRAM)), coupled to the bus for storing information and instructions to be executed.
  • RAM random access memory
  • DRAM dynamic RAM
  • SRAM static RAM
  • SDRAM synchronous DRAM
  • the DSP can include a non-volatile memory such as for example a read only memory (ROM) or other static storage device (e.g., programmable ROM (PROM), erasable PROM (EPROM), and electrically erasable PROM (EEPROM)) coupled to the bus for storing static information and instructions for the internal processor.
  • ROM read only memory
  • PROM programmable ROM
  • EPROM erasable PROM
  • EEPROM electrically erasable PROM
  • the DSP may include special purpose logic devices (e.g., application specific integrated circuits (ASICs)) or configurable logic devices (e.g., simple programmable logic devices (SPLDs), complex programmable logic devices (CPLDs), and field programmable gate arrays (FPGAs)).
  • SPLDs simple programmable logic devices
  • CPLDs complex programmable logic devices
  • FPGAs field programmable gate arrays
  • the DSP may include at least one computer readable medium or memory for holding instructions programmed and for containing data structures, tables, records, or other data necessary to drive the optical display.
  • Examples of computer readable media suitable for applications of the present disclosure may be compact discs, hard disks, floppy disks, tape, magneto-optical disks, PROMs (EPROM, EEPROM, flash EPROM), DRAM, SRAM, SDRAM, or any other magnetic medium, compact discs (e.g., CD-ROM), or any other optical medium, punch cards, paper tape, or other physical medium with patterns of holes, a carrier wave (described below), or any other medium from which a computer can read.
  • the DSP may also include a communication interface to provide a data communication coupling to a network link that can be connected to, for example, a local area network (LAN), or to another communications network such as the Internet. Wireless links may also be implemented.
  • LAN local area network
  • Wireless links may also be implemented.
  • an appropriate communication interface can send and receive electrical, electromagnetic or optical signals that carry digital data streams representing various types of information (such as the video information) to the optical display.
  • the eyepiece may be able to do context-aware capture of video that adjusts video capture parameters based on the motion of the viewer, where a parameter may be image resolution, video compression, frames per second rate, and the like.
  • the eyepiece may be used for a plurality of video applications, such as recording video taken through an integrated camera or as transmitted from an external video device, playing back video to the wearer through the eyepiece (by methods and systems as described herein), streaming live video either from an external source (e.g. a conference call, a live news feed, a video stream from another eyepiece) or from an integrated camera (e.g. from an integrated non-line-of-sight camera), and the like.
  • an external source e.g. a conference call, a live news feed, a video stream from another eyepiece
  • an integrated camera e.g. from an integrated non-line-of-sight camera
  • the eyepiece may accommodate multiple video applications being presented to the wearer at once, such as for example viewing a streamed external video link concurrent with a playback of a video file stored on the eyepiece.
  • the eyepiece may provide for a 3D viewing experience, such as through providing images to either eyes, or alternately, a reduced 3D experience, such as providing a reduced amount of content to one of two eyes.
  • the eyepiece may provide for text- enhanced video, such as when audio conditions are too loud to hear the included audio, the audio is in a language foreign to the user, the user wants to record a transcription of the audio, and the like.
  • the eyepiece may provide for context-aware video applications, such as adjusting at least one parameter of video capture and/or viewing as a function of the environment of the wearer.
  • a wearer of the eyepiece may be presented video through the eyepiece in the context of an external environment that requires the wearer to concentrate on the external environment more than the video, where the at least one parameter adjusts the presented video in a manner that makes the presentation less distracting (e.g. adjustment of spatial resolution; adjustment of frames per second; replacement of the video presentation with a static image representative of the content of the video, such as a stored picture of the person, a single frame from the video); and the like.
  • video may be captured by an integrated camera on the eyepiece in the context of the wearer being in motion (e.g. walking, running, biking, driving) where the at least one parameter adjusts the video being captured to help accommodate for the motion (e.g. making adjustments during periods where the eyepiece senses rapid motion where the video would be blurred, making adjustments during periods where the wearer is walking or moving slowly).
  • motion e.g. walking, running, biking, driving
  • the at least one parameter adjusts the video being captured to help accommodate for the motion (e.g. making adjustments during periods where the eyepiece senses rapid motion where the video would be blurred, making adjustments during periods where the wearer is walking or moving slowly).
  • the at least one parameter may be a spatial resolution parameter (e.g. pixels per area, specific color pixels per area, limiting to only a single ('black and white') pixel per area), field-of-view, frames recorded per time, frames presented per time, data compression, periods of time not recorded/presented, and the like.
  • a spatial resolution parameter e.g. pixels per area, specific color pixels per area, limiting to only a single ('black and white') pixel per area
  • field-of-view e.g. pixels per area, specific color pixels per area, limiting to only a single ('black and white') pixel per area
  • the at least one parameter may be adjusted based on a sensed input by the eyepiece, such as from a motion detection input (as described herein) for determining head motion (e.g. to determine rapid head motion, slow head motion), motion of the surrounding video-captured environment or within the environment through processing of images received through the integrated camera for determining relative motion between the wearer and the environment, eye motion of the wearer (as described herein) to determine whether the wearer is being distracted by video being presented to the wearer, ambient light and/or sound conditions, and the like.
  • a motion detection input as described herein
  • head motion e.g. to determine rapid head motion, slow head motion
  • motion of the surrounding video-captured environment or within the environment through processing of images received through the integrated camera for determining relative motion between the wearer and the environment
  • eye motion of the wearer as described herein to determine whether the wearer is being distracted by video being presented to the wearer, ambient light and/or sound conditions, and the like.
  • the eyepiece may provide image processing with respect to reducing the effects of motion or the environment on the quality of a video experience by the wearer or as stored when capturing video, such as for the compensation for gentle movements, bouncing, rapid motion; adjustment of background lighting and/or sound environment, such as by adjusting the color mixture, brightness; and the like.
  • Selection of processing may be a function of sensed inputs, environmental conditions, video content, and the like. For instance, a high quality image may be preferred in some instances, such that under certain circumstances a reduction in quality is not acceptable, and so video may be paused under those circumstances.
  • video and/or audio compression may be applied where it is determined that circumstances preclude the capture of an acceptable level of quality, but where some continuity of capture is still desired.
  • Processing may also be applied differently to each eye of the eyepiece, such as with respect to a wearer's dominant eye, to varying environmental conditions experienced in one eye verses the other, and the like. Processing may compensate for a bright environment, where an embedded sensor is used to check ambient light levels for possible adjustments to the display of content, such as to determine what color channel compression and/or manipulation to perform based on the environment, modifying a color curve/palette to be more or less visible relative to the ambient environment, to vary color depth, color curve, vary how the color is compressed, and the like.
  • the eyepiece may initiate an action as a result of a sensed condition, such as going to a screen-shot mode while continuing the audio portion of the video when a condition is exceeded, such as exceeding a predetermined amount of movement by the eyepiece, stop taking video if the motion is such as would degrade a predetermined quality level, trigger a change in the video presentation as the motion level is exceeded in the received video, and the like.
  • a condition such as going to a screen-shot mode while continuing the audio portion of the video when a condition is exceeded, such as exceeding a predetermined amount of movement by the eyepiece, stop taking video if the motion is such as would degrade a predetermined quality level, trigger a change in the video presentation as the motion level is exceeded in the received video, and the like.
  • the eyepiece may initiate an action as a result of the receipt of a control signal.
  • the control signal could be based on the location of the eyepiece, on what is currently being viewed by the eyepiece or a user gesture.
  • the action could be the upload or download of the video being captured by the eyepiece from a storage location.
  • the action may be initiated solely upon receipt of the control signal itself or by the receipt of the control signal and a confirmation control signal initiated by the user.
  • the action could be the initiation of a process to move to a specific position within the video being displayed by the glasses, bookmark a specific position within the video being displayed by the glasses, and the like.
  • adjustments made as a result of sensed conditions may be controlled through user preferences, an organizations policy, state or federal regulations, and the like. For instance, it may be a preference to always provide a certain quality, resolution, compression, and the like, no matter what the sensed inputs indicate.
  • the wearer of the eyepiece may be in an environment where their head, and thus the integrated camera of the eyepiece, is rapidly shaking while the eyepiece is recording video.
  • the eyepiece may adjust at least one parameter to reduce the extent to which the shaky video is captured, such as increasing the compression being applied to the video, reducing the number of frames being captured per period of time (e.g. capturing a frame every few seconds), discarding frames that have a large change in the image from frame to frame, reducing the spatial resolution, and the like.
  • the wearer of the eyepiece may be using video conferencing through the eyepiece where the eyepiece senses through a motion sensor that the wearer is moving.
  • static images may replace the participant's video feed during this motion, such as for the image of one of the other participants or the user's image as transmitted to the other members.
  • the distracting effects of the motion of the wearer may be reduced for the wearer and/or the other participants in the videoconference.
  • the wearer may be viewing a video and then begin driving a car, where it may become a safety issue if the wearer continues to view the video as currently displayed.
  • the eyepiece may be able to detect the motion of the environment as indicative of being in a car, and alter the viewing experience to be less distracting, such as if the eye movement of the wearer indicates that the user is quickly alternating between the line-of-sight (driving direction) or the field of view directly behind the car, and the displayed video.
  • the eyepiece may for instance halt the video, and present the viewer with options to continue.
  • the eyepiece may further be able to sense the motion of the environment as differentiated between being in a car, a bike, walking, and the like, and adjust accordingly.
  • the wearer may need assistance in navigating to a location, whether in a car, on a bike, walking, or the like.
  • the eyepiece would display a video navigation application to the user.
  • the navigation instructions that are displayed by the eyepiece to the user could be selected by a control signal.
  • the control signal could be generated by a location specified by the wearer, by what is currently being displayed in the glasses or on a destination spoken by wearer.
  • the location may be one of an eating/drinking, education, event, exercise, home, outdoors, retail, transportation location, or the like.
  • the wearer may be capturing video where the ambient environment is distracting or lowers the quality of the video in some regard, such as because of color contrast, mixture, depth, resolution, brightness, and the like.
  • the eyepiece may adjust for conditions where the wearer is outside verses inside, under different lighting conditions, under unfavorable sound conditions, and the like. In this case, the eyepiece may adjust the image and sound as recorded so as to create a video product that is a more effective representation of the content being captured.
  • the eyepiece may provide an external interface to computer peripheral devices, such as a monitor, display, TV, keyboards, mice, memory storage (e.g. external hard drive, optical drive, solid state memory), network interface (e.g. to the Internet), and the like.
  • computer peripheral devices such as a monitor, display, TV, keyboards, mice, memory storage (e.g. external hard drive, optical drive, solid state memory), network interface (e.g. to the Internet), and the like.
  • the external interface may provide direct connectivity to external computer peripheral devices (e.g. connect directly to a monitor), indirect connectivity to external computer peripheral devices (e.g. through a central external peripheral interface device), through a wired connection, though a wireless connection, and the like.
  • the eyepiece may be able to connect to a central external peripheral interface device that provides connectivity to external peripheral devices, where the external peripheral interface device may include computer interface facilities, such as a computer processor, memory, operating system, peripheral drivers and interfaces, USB port, external display interface, network port, speaker interface, microphone interface, and the like.
  • the eyepiece may be connected to the central external peripheral interface by a wired connection, wireless connection, directly in a cradle, and the like, and when connected may provide the eyepiece with computational facilities similar to or identical to a personal computer.
  • the device selected to be controlled by the eyepiece may be chosen the user looking at the eyepiece, pointing at the eyepiece, selecting from a user interface displayed on the eyepiece, and the like.
  • the eyepiece may display the user interface of the device when a user looks or points at the device.
  • the frame 2102 is in a general shape of a pair of wrap-around sunglasses.
  • the sides of the glasses include shape-memory alloy straps 2134, such as nitinol straps.
  • the nitinol or other shape-memory alloy straps are fitted for the user of the augmented reality eyepiece.
  • the straps are tailored so that they assume their trained or preferred shape when worn by the user and warmed to near body temperature.
  • the fit of the eyepiece may provide user eye width alignment techniques and measurements.
  • the position and/or alignment of the projected display to the wearer of the eyepiece may be adjustable in position to accommodate the various eye widths of the different wearers.
  • the positioning and/or alignment may be automatic, such as though detection of the position of the wearer's eyes through the optical system (e.g. iris or pupil detection), or manual, such as by the wearer, and the like.
  • the earbuds are intended for connection to the controls of the augmented reality eyepiece for delivering sounds to ears of the user.
  • the sounds may include inputs from the wireless internet or telecommunications capability of the augmented reality eyepiece.
  • the earbuds also include soft, deformable plastic or foam portions, so that the inner ears of the user are protected in a manner similar to earplugs.
  • the earbuds limit inputs to the user's ears to about 85 dB. This allows for normal hearing by the wearer, while providing protection from gunshot noise or other explosive noises and listening in high background noise environments.
  • the controls of the noise-cancelling earbuds have an automatic gain control for very fast adjustment of the cancelling feature in protecting the wearer's ears.
  • Fig. 23 depicts a layout of the vertically arranged projector 21 14 in an eyepiece 2300, where the illumination light passes from bottom to top through one side of the PBS on its way to the display and imager board, which may be silicon backed, and being refracted as image light where it hits the internal interfaces of the triangular prisms which constitute the polarizing beam splitter, and is reflected out of the projector and into the waveguide lens.
  • the dimensions of the projector are shown with the width of the imager board being 1 1 mm, the distance from the end of the imager board to the image centerline being 10.6 mm, and the distance from the image centerline to the end of the LED board being about 1 1.8 mm.
  • FIG. 25 A detailed and assembled view of the components of the projector discussed above may be seen in Fig. 25.
  • This view depicts how compact the micro -projector 2500 is when assembled, for example, near a hinge of the augmented reality eyepiece.
  • Microprojector 2500 includes a housing and a holder 2508 for mounting certain of the optical pieces. As each color field is imaged by the optical display 2510, the corresponding LED color is turned on.
  • the RGB LED light engine 2502 is depicted near the bottom, mounted on heat sink 2504.
  • the holder 2508 is mounted atop the LED light engine 2502, the holder mounting light tunnel 2520, diffuser lens 2512 (to eliminate hotspots) and condenser lens 2514.
  • Light passes from the condenser lens into the polarizing beam splitter 2518 and then to the field lens 2516.
  • the light then refracts onto the LCoS (liquid crystal on silicon) chip 2510, where an image is formed.
  • the light for the image then reflects back through the field lens 2516 and is polarized and reflected 90° through the polarizing beam splitter 2518.
  • the light then leaves the microprojector for transmission to the optical display of the glasses.
  • Fig. 26 depicts an exemplary RGB LED module 2600.
  • the LED is a 2x2 array with 1 red, 1 blue and 2 green die and the LED array has 4 cathodes and a common anode.
  • the maximum current may be 0.5 A per die and the maximum voltage ( ⁇ 4V) may be needed for the green and blue die.
  • the system may utilize an optical system that is able to generate a monochrome display to the wearer, which may provide advantages to image clarity, image resolution, frame rate, and the like.
  • the frame rate may triple (over an RGB system) and this may be useful in a night vision and the like situation where the camera is imaging the surroundings, where those images may be processed and displayed as content.
  • the image may be brighter, such as be three times brighter if three LEDs are used, or provide a space savings with only one LED. If multiple LEDs are used, they may be the same color or they could be different (RGB).
  • the system may be a switchable monochrome/color system where RGB is used but when the wearer wants monochrome they could either choose an individual LED or a number of them. All three LEDs may be used at the same time, as opposed to sequencing, to create white light. Using three LEDs without sequencing may be like any other white light where the frame rate goes up by a factor of three.
  • the "switching" between monochrome and color may be done "manually" (e.g. a physical button, a GUI interface selection) or it may be done automatically depending on the application that is running. For instance, a wearer may go into a night vision mode or fog clearing mode, and the processing portion of the system automatically determines that the eyepiece needs to go into a monochrome high refresh rate mode.
  • Fig. 3 depicts an embodiment of a horizontally disposed projector in use.
  • the projector 300 may be disposed in an arm portion of an eyepiece frame.
  • the LED module 302, under processor control 304, may emit a single color at a time in rapid sequence.
  • the emitted light may travel down a light tunnel 308 and through at least one homogenizing lenslet 310 before encountering a polarizing beam splitter 312 and being deflected towards an LCoS display 314 where a full color image is displayed.
  • the LCoS display may have a resolution of 1280 x 720p.
  • the image may then be reflected back up through the polarizing beam splitter, reflected off a fold mirror 318 and travel through a collimator on its way out of the projector and into a waveguide.
  • the projector may include a diffractive element to eliminate aberrations.
  • the interactive head-mounted eyepiece includes an optical assembly through which a user views a surrounding environment and displayed content, wherein the optical assembly includes a corrective element that corrects the user's view of the surrounding environment, a freeform optical waveguide enabling internal reflections, and a coupling lens positioned to direct an image from an optical display, such as an LCoS display, to the optical waveguide.
  • the eyepiece further includes one or more integrated processors for handling content for display to the user and an integrated image source, such as a projector facility, for introducing the content to the optical assembly.
  • the image source is a projector
  • the projector facility includes a light source and the optical display.
  • Light from the light source is emitted under control of the processor and traverses a polarizing beam splitter where it is polarized before being reflected off the optical display, such as the LCoS display or LCD display in certain other embodiments, and into the optical waveguide.
  • a surface of the polarizing beam splitter may reflect the color image from the optical display into the optical waveguide.
  • the RGB LED module may emit light sequentially to form a color image that is reflected off the optical display.
  • the corrective element may be a see-through correction lens that is attached to the optical waveguide to enable proper viewing of the surrounding environment whether the image source is on or off. This corrective element may be a wedge-shaped correction lens, and may be prescription, tinted, coated, or the like.
  • the freeform optical waveguide which may be described by a higher order polynomial, may include dual freeform surfaces that enable a curvature and a sizing of the waveguide.
  • the curvature and the sizing of the waveguide enable its placement in a frame of the interactive head-mounted eyepiece. This frame may be sized to fit a user's head in a similar fashion to sunglasses or eyeglasses.
  • Other elements of the optical assembly of the eyepiece include a homogenizer through which light from the light source is propagated to ensure that the beam of light is uniform and a collimator that improves the resolution of the light entering the optical waveguide.
  • the prescription lens may be mounted on the inside of the eyepiece lens or on the outside.
  • the prescription power may be divided into prescription lenses mounted on the outside and inside of the eyepiece lens.
  • the prescription correction is provided by corrective optics that cling to eyepiece lens or a component of the optical assembly, such as the beamsplitter, such as through surface tension.
  • the corrective optics may be provided in part in one location in the optical path, and in part in another location in the optical path. For example, half of the corrective optics may be provided on the outside of the converging surface of the beamsplitter and the other half on the inside of the converging surface.
  • the optical assembly associated with the beamsplitter may be a sealed assembly, such as to make the assembly water proof, dust proof, and the like, where an inner surface of the sealed optical assembly has one portion of the corrective optics and the outside surface of the sealed optical assembly has another portion of the corrective optics.
  • Suitable optics may be provided by 3M's Press-On Optics, which are available at least as Prisms (a.k.a. Fresnel Prisms), Aspheric Minus Lenses, Aspheric Plus Lenses, and Bifocal Lenses.
  • the corrective optics may be a user removable and replaceable diopter correction facility adapted to be removably attached in a position between the user's eye and the displayed content such that the diopter correction facility corrects the user's eyesight with respect to the displayed content and the surrounding environment.
  • the diopter correction facility may be adapted to mount to the optical assembly.
  • the diopter correction facility may be adapted to mount to the head-mounted eyepiece.
  • the diopter correction facility may mount using a friction fit.
  • the diopter correction facility may mount using a magnetic attachment facility. The user may select from a plurality of different diopter correction facilities depending on the user's eyesight.
  • the present disclosure may provide for corrective optics that 'snap on' to the eyepiece, such as where a user removable and replaceable diopter correction facility is adapted to be removably attached in a position between the user's eye and the displayed content such that the diopter correction facility corrects the users eyesight with respect to the displayed content and the surrounding environment.
  • the diopter correction facility may be adapted to mount to the optical assembly, to the head-mounted eyepiece, and the like.
  • the diopter correction facility may be mounted using a friction fit, a magnetic attachment facility, and the like. The user may be able to select from a plurality of different diopter correction facilities depending on the user's eyesight.
  • the image light which may be polarized and collimated, may optionally traverse a display coupling lens 412, which may or may not be the collimator itself or in addition to the collimator, and enter the waveguide 414.
  • the waveguide 414 may be a freeform waveguide, where the surfaces of the waveguide are described by a polynomial equation.
  • the waveguide may be rectilinear.
  • the waveguide 414 may include two reflective surfaces. When the image light enters the waveguide 414, it may strike a first surface with an angle of incidence greater than the critical angle above which total internal reflection (TIR) occurs.
  • TIR total internal reflection
  • the image light may engage in TIR bounces between the first surface and a second facing surface, eventually reaching the active viewing area 418 of the composite lens.
  • light may engage in at least three TIR bounces. Since the waveguide 414 tapers to enable the TIR bounces to eventually exit the waveguide, the thickness of the composite lens 420 may not be uniform. Distortion through the viewing area of the composite lens 420 may be minimized by disposing a wedge-shaped correction lens 410 along a length of the freeform waveguide 414 in order to provide a uniform thickness across at least the viewing area of the lens 420.
  • the correction lens 410 may be a prescription lens, a tinted lens, a polarized lens, a ballistic lens, and the like, mounted on the inside or outside of the eyepiece lens, or in some embodiments, mounted on both the inside and outside of the eyepiece lens.
  • the optical waveguide may have a first surface and a second surface enabling total internal reflections of the light entering the waveguide, the light may not actually enter the waveguide at an internal angle of incidence that would result in total internal reflection.
  • the eyepiece may include a mirrored surface on the first surface of the optical waveguide to reflect the displayed content towards the second surface of the optical waveguide.
  • the mirrored surface enables a total reflection of the light entering the optical waveguide or a reflection of at least a portion of the light entering the optical waveguide.
  • the surface may be 100% mirrored or mirrored to a lower percentage.
  • an air gap between the waveguide and the corrective element may cause a reflection of the light that enters the waveguide at an angle of incidence that would not result in TI .
  • the eyepiece includes an integrated image source, such as a projector, that introduces content for display to the optical assembly from a side of the optical waveguide adjacent to an arm of the eyepiece.
  • an integrated image source such as a projector
  • the present disclosure provides image injection to the waveguide from a side of the waveguide.
  • the displayed content aspect ratio is between approximately square to approximately rectangular with the long axis approximately horizontal. In embodiments, the displayed content aspect ratio is 16:9. In embodiments, achieving a rectangular aspect ratio for the displayed content where the long axis is approximately horizontal may be done via rotation of the injected image. In other embodiments, it may be done by stretching the image until it reaches the desired aspect ratio.
  • Fig. 5 depicts a design for a waveguide eyepiece showing sample dimensions.
  • the width of the coupling lens 504 may be 13 ⁇ 15 mm, with the optical display 502 optically coupled in series. These elements may be disposed in an arm or redundantly in both arms of an eyepiece. Image light from the optical display 502 is projected through the coupling lens 504 into the freeform waveguide 508.
  • the thickness of the composite lens 520, including waveguide 508 and correction lens 510, may be 9 mm.
  • the waveguide 502 enables an exit pupil diameter of 8 mm with an eye clearance of 20 mm.
  • the resultant see-through view 512 may be about 60 - 70 mm.
  • the distance from the pupil to the image light path as it enters the waveguide 502 may be about 50 - 60 mm, which can accommodate a large % of human head breadths.
  • the field of view may be larger than the pupil. In embodiments, the field of view may not fill the lens. It should be understood that these dimensions are for a particular illustrative embodiment and should not be construed as limiting.
  • the waveguide, snap-on optics, and/or the corrective lens may comprise optical plastic.
  • the waveguide snap-on optics, and/or the corrective lens may comprise glass, marginal glass, bulk glass, metallic glass, palladium-enriched glass, or other suitable glass.
  • the waveguide 508 and correction lens 510 may be made from different materials selected to result in little to no chromatic aberrations. The materials may include a diffraction grating, a holographic grating, and the like.
  • the projected image may be a stereo image when two projectors 108 are used for the left and right images.
  • the projectors 108 may be disposed at an adjustable distance from one another that enables adjustment based on the inter-pupillary distance for individual wearers of the eyepiece.
  • a single optical assembly may include two independent electro- optic modules with individual adjustments for horizontal, vertical and tilt positioning.
  • the optical assembly may include only a single electro-optic module.
  • FIGS. 146 through 149 schematically show an embodiment of an augmented reality (AR) eyepiece 14600 (without its temple pieces) in which the placement of the images may be adjusted.
  • FIGS. 146 and 147 show, respectively, front and rear perspective views of the AR eyepiece 14600.
  • the electronics and portions of the projection systems (collectively 14602) are located above the lenses 14604a, 14604b.
  • the AR eyepiece 14600 has two projection screens 14608a, 14608b which are adjustably suspended from an adjustment platform 14610 on the wearer-side of the lenses 14604a, 14604b.
  • the adjustment platform 14610 has mounted on it mechanisms for independently adjusting the lateral position relative to the bridge 14612 of the AR eyepiece 14600 and tilt of each of the projection screens 14608a, 14608b.
  • the mechanisms for adjusting the positions of one or both of the display screens may be controlled by manually-activated (e.g., by way of buttons) or software-activated motors, by manual control devices (such as thumbwheels, lever arms, etc.) or a combination of both motorized and manual devices.
  • the A eyepiece 14600 employs manual devices, which will now be described. Those skilled in the art will understand that the adjustment mechanism is designed to decouple lateral adjustments from tilt adjustments.
  • FIGS. 148 shows a perspective rear view of a portion of wearer's left side of the AR eyepiece 14600 in which the adjustment mechanism 14614 on adjustment platform 14610 for projection screen 14608a is shown more clearly.
  • the projection screen 14608a is mounted on a frame 14618 which is fixedly attached to (or is part of) a movable carriage 14620.
  • the carriage 14620 On its bridge 14612 side, the carriage 14620 is rotatably and slidably supported by the carriage shaft 14622 in an arcuate groove of first block 14624, which is attached to adjustment platform
  • the carriage 14620 is rotatably and slidably supported by a yoke 14628.
  • the yoke 14628 has a shaft portion 14630 that is fixedly attached to the carriage 14620 and coaxial with carriage shaft 14622 to provide the carriage 14620 with an axis of rotation.
  • the yoke 14628 is slidably and rotatably supported in an arcuate groove of a second support block 14632, which is attached to adjustment platform 14610 (see FIG. 151).
  • the yoke 14628 also has two parallel arms 14634a, 14634b extending radially outward from the shaft portion 14630.
  • the free end of each of the arms 14634a, 14634b has a hole, e.g., hole 14638 of arm
  • the arm 14634a has an anchor portion 14640 where it attaches to the shaft portion 14630 of the yoke 14628.
  • the anchor portion 14640 has a through-hole 14642 for slidably capturing a pin 14660, as is discussed below (see FIG. 152).
  • the adjustment mechanism has a first thumbwheel 14644 for controlling the lateral position of the projection screen 14608a and a second thumbwheel 14648 for controlling the tilt of the projection screen 14608a.
  • the first thumbwheel 14644 extends partially through a slot 14650 in the adjustment platform 14610 and is threadably engaged and supported by the first threaded shaft 14652.
  • the first threaded shaft 14652 is slidably supported in through-holes in third and fourth support blocks 14654, 14658 (see FIG. 151).
  • the third and fourth blocks 14654, 14658 and/or the sides of the slot 14650 act to prevent the first thumbwheel 14644 from moving laterally.
  • the thumbwheel 14644 rotates around its axis (indicated by arrow A) causes the first threaded shaft 14652 to move laterally (indicated by arrow B).
  • the first threaded shaft 14652 has a pin 14660 extending radially outward from its bridge-side end. (Note that the threads of the first threaded shaft 14652 are not depicted in the drawings, but may be single or multiple pitch threads.)
  • the pin 14660 is slidably captured by the vertically-oriented through-hole 14642 of the anchor portion 14640 of arm 14634a of yoke 14628.
  • the second thumbwheel 14648 is used to control the tilt of the first projection screen 14608a around the axis defined by the carriage shaft 14622 and the yoke shaft portion 14630. Referring now to FIG. 153, the second thumbwheel 14648 is fixedly attached to the narrow portion 14662 of a hollow flanged shaft 14664. The flange portion 14668 of the flanged shaft 14664 threadably receives a threaded shaft portion 14670 of an eyehook 14672.
  • the narrow portion 14662 of the flanged shaft 14664 rotatably passes through a countersunk hole 14674 in the adjustment platform 14610 (see FIG. 151) so that the thumbwheel 14648 is on the bottom side of the adjustment platform 14610 and the eyehook 14672 is on the top side and the flange portion 14668 of the flanged shaft 14664 is captured within the countersunk portion of the countersunk hole 14674.
  • the eye of the eyehook 14672 is slidably engaged around the shaft 14678 which is captured within the holes at the free ends of the yoke arms 14634a, 14634b.
  • the second thumbwheel 14644 around its axis (as indicated by arrow D) causes the flanged shaft 14664 to turn with it which causes the threaded shaft portion 14670 of the eyehook 14672 to move vertically in or out of the flange portion 14668 (as indicated by arrow E) which cause the eye of the eyehook 14672 to push against the shaft 14678 which, in turn, causes the yoke 14628 to move around its axis thus causing the first projection screen 14608a to tilt away from or towards the wearer (as indicated by arrow F).
  • the electronics and portions of the projection system 14602a are located on a platform 14680 that is fixed to the top of the carriage 14620.
  • the spatial relationship between the projection screen 14608a and its associated electronics and portion of its projection system 14602a remains substantially unchanged by any lateral or tilt adjustment that is made to the projection screen
  • the AR eyeglass 14600 also includes a similar adjustment mechanism to the adjustment mechanism 14614 just described for laterally positioning and tilting the second projection screen 14608b which is located on the wearer's right side of the AR eyepiece 14600.
  • the eyepiece may include a slanted or curved guide rail for IPD adjustment that keeps the optics module more in the curved frame.
  • a display is operably connected to such a slanted or curved guide rail.
  • the display screen or screens of the AR eyepieces are arranged so as to be parallel to the line connecting the user's eyes.
  • the display screen or screens are rotated about their vertical axis so that their ends which are near the nose are rotated inward toward the eye, that is "toed-in", at an angle that is in the range of about 0.1 to about 5 degrees from being parallel to the line connecting the user's eyes.
  • the toe-in angle is permanently fixed, while in other embodiments, the toe-in angle is user-adjustable.
  • the adjustability is limited to two or more preset positions, e.g., those representing near convergence, medium distance convergence, and distant convergence. In other embodiments, the adjustability is continuous.
  • the amount of toe-in is taken into consideration in the vergence corrections.
  • the toe-in amount may be included directly in the automatic vergence corrections without the need for a position sensor, but in the user-adjustable embodiments, a position sensor is preferably used to communicate to the processor the amount of toe-in present to use in the vergence correction calculations.
  • the adjustment may be made either manually, e.g., by use of a turnwheel that directly or indirectly, e.g., through a drive train, selectably rotates one or both display screens about their vertical axes, or may be motorized to accomplish the selectable rotation when activated by the user through a user interface or a control switch.
  • the toe-in feature may be used to relax the user's eyes during lengthy sessions of activity during which the user's eyes are kept at a particular focus distance, e.g., while reading, watching a monitor, a ball game, or a horizon.
  • the toe-in feature described above may be used in order to adjust for the user's interpupillary distance by effectively rotating the display screens to be better aligned with the user's eyes.
  • the present disclosure may provide for a mechanical pupil distance adjustment, such as where the optical assembly of the eyepiece is adapted to be user position adjustable within a glasses frame such that the user has the ability to change the position of the optical assembly with respect to the user's eye.
  • the position adjustment may control the horizontal position, the vertical position, the tilt, and the like, of the optical assembly within the glasses frame.
  • the present disclosure may provide for digital pupil distance adjustment, such as where an integrated processor executes a pupil alignment procedure that enables the user to adjust the position of the placement of the displayed content within a field of view presented on the eyepiece optical assembly to set a pupil alignment calibration factor to be used in the placement of other display content.
  • the calibration factor may comprise horizontal and/or vertical adjustments of the displayed content within the field of view.
  • the calibration factor may comprise a plurality of calibration factors, each representing a distance to a real-world object distance calibration factor to be used when positioning content within the field of view based on a distance to real -world object calculation.
  • the calibration factor may comprise a calibration process based on a plurality of calibration factors, each representing a distance to a real-world object distance calibration factor to be used when positioning content within the field of view based on a distance to real-world object calculation.
  • the positioning of the image can be adjusted on the display to move it within the field of view. Moving the two images further apart will make it appear that the imaged object is getting further away, while moving the images closer together will make the object appear to be closer.
  • the difference in the position of an object within the field of view for each eye is known as the disparity.
  • the disparity relates to the perceived distance that the object is away from the user.
  • the electronics 17302 are in the front frame of the glasses above the eyes, including the CPU, display drivers, camera, radios, processor, user interfaces, and the like.
  • the optics modules 17308 are attached to the frame with lenses 17304, which may be optional, covering them.
  • the lenses 17304 may be tinted or tintable.
  • a stereo embodiment is shown here, but it should be understood that a single optics module 17308 may also be used.
  • the electronics 17302 are sealed with a cover 17314 that includes a physical user interface 17310, which may be a button, touch interface, roUerball, switch, or any other physical user interface.
  • the physical user interface 17310 may control various aspects of the glasses, such as functions of the glasses, applications running on the glasses, or applications controlling an external device.
  • the user can easily utilize this control feature by grasping the lower part of the frame to stabilize it while touching the control feature/UI on the top of the frame.
  • the arms 17312 rest on the ears and may include straps for securing the glasses, audio/ear phone functionality or jacks for external audio devices, battery 17318 or power functionality, and the like.
  • Batteries 17318, options for which are disclosed herein but also include any available battery types, may be placed in either arm.
  • the straps may be ear bands made from Nitinol or other shape memory alloy. The ear bands may be in a band format or, as in Fig.
  • the ear bands 17702 may be in a bent wire format to thin it down, lighten it up, and lower the cost.
  • the frame may be in any color
  • the lenses may be in any color
  • the eyepiece arms, or at least the tips of the arms, may be colored.
  • the nitinol forming the tip of the arm may be colored.
  • the batteries are enabled to power the electronics in the front frame, even through an operable hinge 17408, using a wiring design that uses a minimal number of wires and passes through the hinge in a wire guide 17404.
  • the wiring design may include wires 17402 running from the front frame electronics to earbuds located on the arms.
  • Fig. 175 depicts an enlarged version of Fig, 174 with a focus on the wires 17402 traversing the wire guide 17404.
  • Fig. 176 A - C depict the wire guide with various portions of the frame and internal glasses workings cutaway. The view is from the user's side of the frame looking at the hinge.
  • Fig. 176A shows the most material cutaway, Fig.
  • Fig. 6 depicts an embodiment of the eyepiece 600 with a see-through or translucent lens 602.
  • a projected image 618 can be seen on the lens 602.
  • the image 618 that is being projected onto the lens 602 happens to be an augmented reality version of the scene that the wearer is seeing, wherein tagged points of interest (POI) in the field of view are displayed to the wearer.
  • the augmented reality version may be enabled by a forward facing camera embedded in the eyepiece (not shown in Fig. 6) that images what the wearer is looking and identifies the location / POI.
  • the output of the camera or optical transmitter may be sent to the eyepiece controller or memory for storage, for transmission to a remote location, or for viewing by the person wearing the eyepiece or glasses.
  • the video output may be streamed to the virtual screen seen by the user.
  • the video output may thus be used to help determine the user's location, or may be sent remotely to others to assist in helping to locate the location of the wearer, or for any other purpose.
  • Other detection technologies such as GPS, RFID, manual input, and the like, may be used to determine a wearer's location.
  • a database may be accessed by the eyepiece for information that may be overlaid, projected or otherwise displayed with what is being seen. Augmented reality applications and technology will be further described herein.
  • FIG. 7 an embodiment of the eyepiece 700 is depicted with a translucent lens 702 on which is being displayed streaming media (an e-mail application) and an incoming call notification 704.
  • the media obscures a portion of the viewing area, however, it should be understood that the displayed image may be positioned anywhere in the field of view. In embodiments, the media may be made to be more or less transparent.
  • the eyepiece may receive input from any external source, such as an external converter box.
  • the source may be depicted in the lens of eyepiece.
  • the eyepiece may use the phone's location capabilities to display location-based augmented reality, including marker overlay from marker-based A applications.
  • a VNC client running on the eyepiece's processor or an associated device may be used to connect to and control a computer, where the computer's display is seen in the eyepiece by the wearer.
  • content from any source may be streamed to the eyepiece, such as a display from a panoramic camera riding atop a vehicle, a user interface for a device, imagery from a drone or helicopter, and the like.
  • a gun-mounted camera may enable shooting a target not in direct line of sight when the camera feed is directed to the eyepiece.
  • the lenses may be chromic, such as photochromic or electrochromic.
  • the electrochromic lens may include integral chromic material or a chromic coating which changes the opacity of at least a portion of the lens in response to a burst of charge applied by the processor across the chromic material.
  • a chromic portion 902 of the lens 904 is shown darkened, such as for providing greater viewability by the wearer of the eyepiece when that portion is showing displayed content to the wearer.
  • chromic areas on the lens may be controlled independently, such as large portions of the lens, sub-portions of the projected area, programmable areas of the lens and/or projected area, controlled to the pixel level, and the like.
  • Activation of the chromic material may be controlled via the control techniques further described herein or automatically enabled with certain applications (e.g. a streaming video application, a sun tracking application, an ambient brightness sensor, a camera tracking brightness in the field of view) or in response to a frame-embedded UV sensor.
  • an electrochromic layer may be located between optical elements and/or on the surface of an optical element on the eyepiece, such as on a corrective lens, on a ballistic lens, and the like.
  • the electrochromic layer may consist of a stack, such as an Indium Tin Oxide (ITO) coated PET/PC film with two layers of electrochromic (EC) between, which may eliminate another layer of PET/PC, thereby reducing reflections (e.g. a layer stack may comprise a PET/PC - EC - PET/PC - EC - PET/PC).
  • the electrically controllable optical layer may be provided as a liquid crystal based solution with a binary state of tint.
  • multiple layers of liquid crystal or an alternative e-tint forming the optical layer may be used to provide variable tint such that certain layers or segments of the optical layer may be turned on or off in stages.
  • Electro chromic layers may be used generically for any of the electrically controlled transparencies in the eyepiece, including SPD, LCD, electrowetting, and the like.
  • the lens may have an angular sensitive coating which enables transmitting light-waves with low incident angles and reflecting light, such as s-polarized light, with high incident angles.
  • the chromic coating may be controlled in portions or in its entirely, such as by the control technologies described herein.
  • the lenses may be variable contrast and the contrast may be under the control of a push button or any other control technique described herein.
  • the user may wear the interactive head-mounted eyepiece, where the eyepiece includes an optical assembly through which the user views a surrounding environment and displayed content.
  • the optical assembly may include a corrective element that corrects the user's view of the surrounding environment, an integrated processor for handling content for display to the user, and an integrated image source for introducing the content to the optical assembly.
  • the optical assembly may include an electrochromic layer that provides a display characteristic adjustment that is dependent on displayed content requirements and surrounding environmental conditions.
  • the display characteristic may be brightness, contrast, and the like.
  • the surrounding environmental condition may be a level of brightness that without the display characteristic adjustment would make the displayed content difficult to visualize by the wearer of the eyepiece, where the display characteristic adjustment may be applied to an area of the optical assembly where content is being displayed.
  • the eyepiece may have brightness, contrast, spatial, resolution, and the like control over the eyepiece projected area, such as to alter and improve the user's view of the projected content against a bright or dark surrounding environment.
  • a user may be using the eyepiece under bright daylight conditions, and in order for the user to clearly see the displayed content the display area my need to be altered in brightness and/or contrast.
  • the viewing area surrounding the display area may be altered.
  • the area altered, whether within the display area or not, may be spatially oriented or controlled per the application being implemented.
  • portions of the lens may be altered in brightness, contrast, spatial extent, resolution, and the like, such as fixed to include the entire display area, adjusted to only a portion of the lens, adaptable and dynamic to changes in lighting conditions of the surrounding environment and/or the brightness-contrast of the displayed content, and the like.
  • Spatial extent e.g. the area affected by the alteration
  • resolution e.g.
  • display optical resolution may vary over different portions of the lens, including high resolution segments, low resolution segments, single pixel segments, and the like, where differing segments may be combined to achieve the viewing objectives of the application(s) being executed.
  • technologies for implementing alterations of brightness, contrast, spatial extent, resolution, and the like may include electrochromic materials, LCD technologies, embedded beads in the optics, flexible displays, suspension particle device (SPD) technologies, colloid technologies, and the like.
  • electrochromic layer there may be various modes of activation of the electrochromic layer.
  • the user may enter sunglass mode where the composite lenses appear only somewhat darkened or the user may enter "Blackout" mode, where the composite lenses appear completely blackened.
  • the composite lenses appear completely blackened.
  • electrochromic materials may be electrochromic materials, films, inks, and the like. Electrochromism is the phenomenon displayed by some materials of reversibly changing appearance when electric charge is applied. Various types of materials and structures can be used to construct electrochromic devices, depending on the specific applications.
  • electrochromic materials include tungsten oxide (W0 3 ), which is the main chemical used in the production of electrochromic windows or smart glass.
  • electrochromic coatings may be used on the lens of the eyepiece in implementing alterations.
  • electrochromic displays may be used in implementing 'electronic paper', which is designed to mimic the appearance of ordinary paper, where the electronic paper displays reflected light like ordinary paper.
  • electrochromism may be implemented in a wide variety of applications and materials, including gyricon (consisting of polyethylene spheres embedded in a transparent silicone sheet, with each sphere suspended in a bubble of oil so that they can rotate freely), electro-phoretic displays (forming images by rearranging charged pigment particles using an applied electric field), E-Ink technology, electro-wetting, electro-fluidic, interferometric modulator, organic transistors embedded into flexible substrates, nano-chromics displays (NCD), and the like.
  • gyricon consisting of polyethylene spheres embedded in a transparent silicone sheet, with each sphere suspended in a bubble of oil so that they can rotate freely
  • electro-phoretic displays forming images by rearranging charged pigment particles using an applied electric field
  • E-Ink technology electro-wetting
  • electro-fluidic electro-fluidic
  • interferometric modulator organic transistors embedded into flexible substrates
  • NCD nano-chromics displays
  • SPD suspended particle devices
  • SPD technology may be an emulsion applied on a plastic substrate creating the active film. This plastic film may be laminated (as a single glass pane), suspended between two sheets of glass, plastic or other transparent materials, and the like.
  • the electro-optics may be mounted in a monocular or binocular flip-up/ flip-down arrangement in two parts: 1) electro-optics; and 2) correction lens.
  • Fig. 8A depicts a two part eyepiece where the electro-optics are contained within a module 802 that may be electrically connected to the eyepiece 804 via an electrical connector 810, such as a plug, pin, socket, wiring, and the like.
  • the lens 818 in the frame 814 may be a correction lens entirely.
  • the interpupillary distance (IPD) between the two halves of the electro-optic module 802 may be adjusted at the bridge 808 to accommodate various IPDs.
  • Fig. 8B depicts the binocular electro-optics module 802 where one half is flipped up and the other half is flipped down.
  • the nose bridge may be fully adjustable and elastomeric. This enables 3 -point mounting on nose bridge and ears with a head strap to assure the stability of images in the user's eyes, unlike the instability of helmet-mounted optics, that shift on the scalp.
  • the lens 818 may be ANSI-compliant, hard-coat scratch-resistant polycarbonate ballistic lenses, may be chromic, may have an angular sensitive coating, may include a UV-sensitive material, and the like.
  • the electro-optics module may include a CMOS-based VIS/NIR/SWIR black silicon sensor for night vision capability.
  • the electro-optics module 802 may feature quick disconnect capability for user flexibility, field replacement and upgrade.
  • the electro-optics module 802 may feature an integrated power dock.
  • the flip-up/flip-down lens 7910 may include a light block 7908.
  • Removable, elastomeric night adapters/light dams/light blocks 7908 may be used to shield the flip-up/flip-down lens 7910, such as for night operations.
  • the exploded top view of the eyepiece also depicts a headstrap 7900, frame 7904, and adjustable nose bridge 7902.
  • Fig. 80 depicts an exploded view of the electro-optic assembly in a front (A) and side angle (B) view.
  • a holder 8012 holds the see-through optic with corrective lens 7910.
  • An O-ring 8020 and screw 8022 secures the holder to the shaft 8024.
  • a spring 8028 provides a spring-loaded connection between the holder 8012 and shaft 8024.
  • the shaft 8024 connects to the attachment bracket 8014, which secures to the eyepiece using the thumbscrew 8018.
  • the shaft 8024 serves as a pivot and an IPD adjustment tool using the IPD adjustment knob 8030. As seen in Fig. 81 , the knob 8030 rotates along adjustment threads 8134.
  • the shaft 8024 also features two set screw grooves 8132.
  • a photochromic layer may be included as part of the optics of the eyepiece.
  • Photochromism is the reversible transformation of a chemical species between two forms by the absorption of electromagnetic radiation, where the two forms have different absorption spectra, such as a reversible change of color, darkness, and the like, upon exposure to a given frequency of light
  • a photochromic layer may be included between the waveguide and corrective optics of the eyepiece, on the outside of the corrective optic, and the like.
  • a photochromic layer (such as used as a darkening layer) may be activated with a UV diode, or other photochromic responsive wavelength known in the art.
  • the eyepiece optics may also include a UV coating outside the photochromic layer to prevent UV light from the Sun from accidentally activating it.
  • Photochromies are presently fast to change from light to dark and slow to change from dark to light. This due to the molecular changes that are involved with the photochromic material changing from clear to dark. Photochromic molecules are vibrating back to clear after the UV light, such as UV light from the sun, is removed. By increasing the vibration of the molecules, such as by exposure to heat, the optic will clear quicker. The speed at which the photochromic layer goes from dark to light may be temperature-dependent. Rapid changing from dark to light is particularly important for military applications where users of sunglasses often go from a bright outside environment to a dark inside environment and it is important to be able to see quickly in the inside environment.
  • This disclosure provides a photochromic film device with an attached heater that is used to accelerate the transition from dark to clear in the photochromic material.
  • This method relies on the relationship between the speed of transition of photochromic materials from dark to clear wherein the transition is faster at higher temperatures.
  • the photochromic material is provided as a thin layer with a thin heater.
  • the heater only has to provide a small amount of heat to rapidly produce a large temperature change in the photochromic material. Since the photochromic material only needs to be at a higher temperature during the transition from dark to clear, the heater only needs to be used for short periods of time so the power requirement is low.
  • the heater may be a thin and transparent heater element, such as an ITO heater or any other transparent and electrically conductive film material.
  • ITO heater any other transparent and electrically conductive film material.
  • the heater element may be used to calibrate the photochromic element to compensate for cold ambient conditions when the lenses might go dark on their own.
  • a thin coat of photochromic material may be deposited on a thick substrate with the heater element layered on top.
  • the cover sunglass lens may comprise an accelerated photochromic solution and still have a separate electrochromic patch over the display area that may optionally be controlled with or without UV light.
  • Fig. 94A depicts a photochromic film device with a serpentine heater pattern
  • Fig. 94B depicts a side view of a photochromic film device wherein the device is a lens for sunglasses. The photochromic film device is shown above and not contacting a protective cover lens to reduce the thermal mass of the device.
  • United States Patent 3, 152,215 describes a heater layer combined with a photochromic layer to heat the photochromic material for the purpose of reducing the time to transition from dark to clear.
  • the photochromic layer is positioned in a wedge which would greatly increase the thermal mass of the device and thereby decrease the rate that the heater could change the temperature of the photochromic material or alternately greatly increase the power required to change the temperature of the photochromic material.
  • This disclosure includes the use of a thin carrier layer that the photochromic material is applied to.
  • the carrier layer can be glass or plastic.
  • the photochromic material can be applied by vacuum coating, by dipping or by thermal diffusion into the carrier layer as is well known in the art.
  • the thickness of the carrier layer can be 150 microns or less. The selection of the thickness of the carrier layer is selected based on the desired darkness of the photochromic film device in the dark state and the desired speed of transition between the dark state and the clear state. Thicker carrier layers can be darker in the dark state while being slower to heat to an elevated temperature due to having more thermal mass. Conversely, thinner carrier layers can be less dark in the dark state while being faster to heat to an elevated temperature due to having less thermal mass.
  • the protective layer shown in Fig. 94 is separated from the photochromic film device to keep the thermal mass of the photochromic film device low. In this way, the protective layer can be made thicker to provide higher impact strength.
  • the protective layer can be glass or plastic, for example the protective layer can be polycarbonate.
  • the heater can be a transparent conductor that is patterned into a conductive path that is relatively uniform so that the heat generated over the length of the patterned heater is relatively uniform.
  • An example of a transparent conductor that can be patterned is titanium dioxide.
  • a larger area is provided at the ends of the heater pattern for electrical contacts such as is shown in Fig. 94.
  • the augmented reality glasses may include a lens 818 for each eye of the wearer.
  • the lenses 818 may be made to fit readily into the frame 814, so that each lens may be tailored for the person for whom the glasses are intended.
  • the lenses may be corrective lenses, and may also be tinted for use as sunglasses, or have other qualities suitable for the intended environment.
  • the lenses may be tinted yellow, dark or other suitable color, or may be photochromic, so that the transparency of the lens decreases when exposed to brighter light.
  • the lenses may also be designed for snap fitting into or onto the frames, i.e., snap on lenses are one embodiment.
  • the lenses may be made from high-quality Schott optical glass and may include a polarizing filter.
  • the lenses need not be corrective lenses; they may simply serve as sunglasses or as protection for the optical system within the frame.
  • the outer lenses are important for helping to protect the rather expensive waveguides, viewing systems and electronics within the augmented reality glasses.
  • the outer lenses offer protection from scratching by the environment of the user, whether sand, brambles, thorns and the like, in one environment, and flying debris, bullets and shrapnel, in another environment.
  • the outer lenses may be decorative, acting to change a look of the composite lens, perhaps to appeal to the individuality or fashion sense of a user.
  • the outer lenses may also help one individual user to distinguish his or her glasses from others, for example, when many users are gathered together.
  • the lenses and the frames meet ANSI Standard Z87.1 -2010 for ballistic resistance.
  • the lenses also meet ballistic standard CE EN166B.
  • the lenses and frames may meet the standards of MIL-PRF-31013, standards 3.5.1.1 or 4.4.1.1. Each of these standards has slightly different requirements for ballistic resistance and each is intended to protect the eyes of the user from impact by high-speed projectiles or debris. While no particular material is specified, polycarbonate, such as certain Lexan® grades, usually is sufficient to pass tests specified in the appropriate standard.
  • replaceable lens 819 has a plurality of snap-fit arms 819a which fit into recesses 820a of frame 820.
  • the engagement angle 819b of the arm is greater than 90°, while the engagement angle 820b of the recess is also greater than 90°. Making the angles greater than right angles has the practical effect of allowing removal of lens 819 from the frame 820.
  • the lens 819 may need to be removed if the person's vision has changed or if a different lens is desired for any reason.
  • the design of the snap fit is such that there is a slight compression or bearing load between the lens and the frame. That is, the lens may be held firmly within the frame, such as by a slight interference fit of the lens within the frame.
  • the cantilever snap fit of Fig. 8D is not the only possible way to removably snap-fit the lenses and the frame.
  • an annular snap fit may be used, in which a continuous sealing lip of the frame engages an enlarged edge of the lens, which then snap-fits into the lip, or possibly over the lip.
  • Such a snap fit is typically used to join a cap to an ink pen.
  • This configuration may have an advantage of a sturdier joint with fewer chances for admission of very small dust and dirt particles.
  • Possible disadvantages include the fairly tight tolerances required around the entire periphery of both the lens and frame, and the requirement for dimensional integrity in all three dimensions over time.
  • a groove may be molded into an outer surface of the frame, with the lens having a protruding surface, which may be considered a tongue that fits into the groove. If the groove is semi-cylindrical, such as from about 270° to about 300°, the tongue will snap into the groove and be firmly retained, with removal still possible through the gap that remains in the groove.
  • a lens or replacement lens or cover 826 with a tongue 828 may be inserted into a groove 827 in a frame 825, even though the lens or cover is not snap-fit into the frame. Because the fit is a close one, it will act as a snap-fit and securely retain the lens in the frame.
  • the frame may be made in two pieces, such as a lower portion and an upper portion, with a conventional tongue-and-groove fit.
  • this design may also use standard fasteners to ensure a tight grip of the lens by the frame.
  • the design should not require disassembly of anything on the inside of the frame.
  • the snap-on or other lens or cover should be assembled onto the frame, or removed from the frame, without having to go inside the frame.
  • the augmented reality glasses have many component parts. Some of the assemblies and subassemblies may require careful alignment. Moving and jarring these assemblies may be detrimental to their function, as will moving and jarring the frame and the outer or snap -on lens or cover.
  • the flip-up / flip-down arrangement enables a modular design for the eyepiece.
  • the eyepiece be equipped with a monocular or binocular module 802, but the lens 818 may also be swapped.
  • additional features may be included with the module 802, either associated with one or both displays 812.
  • either monocular or binocular versions of the module 802 may be display only 852 (monocular), 854 (binocular) or may be equipped with a forward-looking camera 858 (monocular), and 860 & 862 (binocular).
  • the module may have additional integrated electronics, such as a GPS, a laser range finder, and the like.
  • a binocular electro-optic module 862 is equipped with stereo forward-looking cameras 870, GPS, and a laser range finder 868. These features may enable the Ultra- Vis embodiment to have panoramic night vision, and panoramic night vision with laser range finder and geo location.
  • the electro-optics characteristics may be, but not limited to, as follows:
  • the Projector Characteristics may be as follows:
  • an augmented reality eyepiece may include electrically-controlled lenses as part of the microprojector or as part of the optics between the microprojector and the waveguide.
  • Fig. 21 depicts an embodiment with such liquid lenses 2152.
  • the glasses may also include at least one camera or optical sensor 2130 that may furnish an image or images for viewing by the user.
  • the images are formed by a microprojector 21 14 on each side of the glasses for conveyance to the waveguide 2108 on that side.
  • an additional optical element, a variable focus lens 2152 may also be furnished.
  • the lens may be electrically adjustable by the user so that the image seen in the waveguides 2108 are focused for the user.
  • the camera may be a multi-lens camera, such as an 'array camera', where the eyepiece processor may combine the data from the multiple lenses and multiple viewpoints of the lenses to build a single high-quality image. This technology may be referred to as computational imaging, since software is used to process the image.
  • Computational imaging may provide image-processing advantages, such as allowing processing of the composite image as a function of individual lens images.
  • the processor may provide image processing to create images with special focusing, such as foveal imaging, where the focus from one of the lens images is clear, higher resolution, and the like, and where the rest of the image is defocused, lower resolution, and the like.
  • the processor may also select portions of the composite image to store in memory, while deleting the rest, such as when memory storage is limited and only portions of the composite image are critical to save.
  • use of the array camera may provide the ability to alter the focus of an image after the image has been taken.
  • the array camera may provide a thinner mechanical profile than a traditional single-lens assembly, thus making it easier to integrate into the eyepiece.
  • Variable lenses may include the so-called liquid lenses furnished by Varioptic, S.A., Lyons, France, or by LensVector, Inc., Mountain View, CA, U.S.A. Such lenses may include a central portion with two immiscible liquids. Typically, in these lenses, the path of light through the lens, i.e., the focal length of the lens is altered or focused by applying an electric potential between electrodes immersed in the liquids. At least one of the liquids is affected by the resulting electric or magnetic field potential. Thus, electrowetting may occur, as described in U.S. Pat. Appl. Publ. 2010/0007807, assigned to LensVector, Inc. Other techniques are described in LensVector Pat. Appl. Pubis. 2009/021331 and 2009/0316097. All three of these disclosures are incorporated herein by reference, as though each page and figures were set forth verbatim herein.
  • the electrically-adjustable lenses may be controlled by the controls of the glasses.
  • a focus adjustment is made by calling up a menu from the controls and adjusting the focus of the lens.
  • the lenses may be controlled separately or may be controlled together.
  • the adjustment is made by physically turning a control knob, by indicating with a gesture, or by voice command.
  • the augmented reality glasses may also include a rangefinder, and focus of the electrically-adjustable lenses may be controlled automatically by pointing the rangefinder, such as a laser rangefinder, to a target or object a desired distance away from the user.
  • variable lenses may also be applied to the outer lenses of the augmented reality glasses or eyepiece.
  • the lenses may simply take the place of a corrective lens.
  • the variable lenses with their electric-adjustable control may be used instead of or in addition to the image source- or projector-mounted lenses.
  • the corrective lens inserts provide corrective optics for the user's environment, the outside world, whether the waveguide displays are active or not.
  • the view or images presented travel from one or two digital cameras or sensors mounted on the eyepiece, to digital circuitry, where the images are processed and, if desired, stored as digital data before they appear in the display of the glasses.
  • the digital data is then used to form an image, such as by using an LCOS display and a series of RGB light emitting diodes.
  • the light images are processed using a series of lenses, a polarizing beam splitter, an electrically-powered liquid corrective lens and at least one transition lens from the projector to the waveguide.
  • the process of gathering and presenting images includes several mechanical and optical linkages between components of the augmented reality glasses. It seems clear, therefore, that some form of stabilization will be required. This may include optical stabilization of the most immediate cause, the camera itself, since it is mounted on a mobile platform, the glasses, which themselves are movably mounted on a mobile user. Accordingly, camera stabilization or correction may be required. In addition, at least some stabilization or correction should be used for the liquid variable lens. Ideally, a stabilization circuit at that point could correct not only for the liquid lens, but also for any aberration and vibration from many parts of the circuit upstream from the liquid lens, including the image source.
  • One advantage of the present system is that many commercial off-the-shelf cameras are very advanced and typically have at least one image-stabilization feature or option. Thus, there may be many embodiments of the present disclosure, each with a same or a different method of stabilizing an image or a very fast stream of images, as discussed below.
  • optical stabilization is typically used herein with the meaning of physically stabilizing the camera, camera platform, or other physical object, while image stabilization refers to data manipulation and processing.
  • One technique of image stabilization is performed on digital images as they are formed. This technique may use pixels outside the border of the visible frame as a buffer for the undesired motion. Alternatively, the technique may use another relatively steady area or basis in succeeding frames. This technique is applicable to video cameras, shifting the electronic image from frame to frame of the video in a manner sufficient to counteract the motion. This technique does not depend on sensors and directly stabilizes the images by reducing vibrations and other distracting motion from the moving camera. In some techniques, the speed of the images may be slowed in order to add the stabilization process to the remainder of the digital process, and requiring more time per image. These techniques may use a global motion vector calculated from frame -to -frame motion differences to determine the direction of the stabilization.
  • Optical stabilization for images uses a gravity- or electronically-driven mechanism to move or adjust an optical element or imaging sensor such that it counteracts the ambient vibrations.
  • Another way to optically stabilize the displayed content is to provide gyroscopic correction or sensing of the platform housing the augmented reality glasses, e.g., the user.
  • the sensors available and used on the augmented reality glasses or eyepiece include MEMS gyroscopic sensors. These sensors capture movement and motion in three dimensions in very small increments and can be used as feedback to correct the images sent from the camera in real time. It is clear that at least a large part of the undesired and undesirable movement probably is caused by movement of the user and the camera itself.
  • These larger movements may include gross movements of the user, e.g., walking or running, riding in a vehicle. Smaller vibrations may also result within the augmented reality eyeglasses, that is, vibrations in the components in the electrical and mechanical linkages that form the path from the camera (input) to the image in the waveguide (output). These gross movements may be more important to correct or to account for, rather than, for instance, independent and small movements in the linkages of components downstream from the projector.
  • the gyroscopic stabilization may stabilize the image when it is subject to a periodic motion. For such periodic motion, the gyroscope may determine the periodicity of the user's motion and transmit the information to a processor to correct for the placement of content in the user's view.
  • the gyroscope may utilize a rolling average of two or three or more cycles of periodic motion in determining the periodicity.
  • Other sensors may also be used to stabilize the image or correctly place the image in the user's field of view, such as an accelerometer, a position sensor, a distance sensor, a rangefinder, a biological sensor, a geodetic sensor, an optical sensor, a video sensor, a camera, an infrared sensor, a light sensor, a photocell sensor, or an F sensor.
  • a sensor detects user head or eye movement, the sensor provides an output to a processor which may determine the direction, speed, amount, and rate of the user's head or eye movement.
  • the processor may convert this information into a suitable data structure for further processing by the processor controlling the optical assembly (which may be the same processor).
  • the data structure may be one or more vector quantities.
  • the direction of the vector may define the orientation of the movement, and the length of the vector may define the rate of the movement.
  • the display of content is adjusted accordingly.
  • Motion sensing may thus be used to sense the motion and correct for it, as in optical stabilization, or to sense the motion and then correct the images that are being taken and processed, as in image stabilization.
  • An apparatus for sensing motion and correcting the images or the data is depicted in Fig. 34A.
  • one or more kinds of motion sensors may be used, including accelerometers, angular position sensors or gyroscopes, such as MEMS gyroscopes. Data from the sensors is fed back to the appropriate sensor interfaces, such as analog to digital converters (ADCs) or other suitable interface, such as digital signal processors (DSPs).
  • a microprocessor then processes this information, as discussed above, and sends image-stabilized frames to the display driver and then to the see-through display or waveguide discussed above.
  • the display begins with the RGB display in the microprojector of the augmented reality eyepiece.
  • a video sensor or augmented reality glasses, or other device with a video sensor may be mounted on a vehicle.
  • the video stream may be communicated through a telecommunication capability or an Internet capability to personnel in the vehicle.
  • One application could be sightseeing or touring of an area.
  • Another embodiment could be exploring or reconnaissance, or even patrolling, of an area.
  • gyroscopic stabilization of the image sensor would be helpful, rather than applying a gyroscopic correction to the images or digital data representing the images.
  • An embodiment of this technique is depicted in Fig. 34B. In this technique, a camera or image sensor 3407 is mounted on a vehicle 3401.
  • One or more motion sensors 3406 are mounted in the camera assembly 3405.
  • a stabilizing platform 3403 receives information from the motion sensors and stabilizes the camera assembly 3405, so that jitter and wobble are minimized while the camera operates. This is true optical stabilization.
  • the motion sensors or gyroscopes may be mounted on or within the stabilizing platform itself. This technique would actually provide optical stabilization, stabilizing the camera or image sensor, in contrast to digital stabilization, correcting the image afterwards by computer processing of the data taken by the camera.
  • the key to optical stabilization is to apply the stabilization or correction before an image sensor converts the image into digital information.
  • feedback from sensors such as gyroscopes or angular velocity sensors, is encoded and sent to an actuator that moves the image sensor, much as an autofocus mechanism adjusts a focus of a lens.
  • the image sensor is moved in such a way as to maintain the projection of the image onto the image plane, which is a function of the focal length of the lens being used.
  • Autoranging and focal length information perhaps from a range finder of the interactive head-mounted eyepiece, may be acquired through the lens itself.
  • angular velocity sensors sometimes also called gyroscopic sensors, can be used to detect, respectively, horizontal and vertical movements. The motion detected may then be fed back to electromagnets to move a floating lens of the camera.
  • This optical stabilization technique would have to be applied to each lens contemplated, making the result rather expensive.
  • a control scheme with feedback would then apply a voltage and determine the effect of the applied voltage on the result, i.e., a focus or an astigmatism of the image.
  • the voltages may be applied in patterns, for example, equal and opposite + and - voltages, both positive voltages of differing magnitude, both negative voltages of differing magnitude, and so forth.
  • Such lenses are known as electrically variable optic lenses or electro-optic lenses.
  • Voltages may be applied to the electrodes in patterns for a short period of time and a check on the focus or astigmatism made. The check may be made, for instance, by an image sensor.
  • sensors on the camera or in this case the lens may detect motion of the camera or lens. Motion sensors would include accelerometers, gyroscopes, angular velocity sensors or piezoelectric sensors mounted on the liquid lens or a portion of the optic train very near the liquid lens.
  • a table such as a calibration table, is then constructed of voltages applied and the degree of correction or voltages needed for given levels of movement.
  • More sophistication may also be added, for example, by using segmented electrodes in different portions of the liquid so that four voltages may be applied rather than two.
  • four electrodes may be applied, in many more patterns than with only two electrodes. These patterns may include equal and opposite positive and negative voltages to opposite segments, and so forth.
  • An example is depicted in Fig. 34C.
  • Four electrodes 3409 are mounted within a liquid lens housing (not shown). Two electrodes are mounted in or near the non-conducting liquid and two are mounted in or near the conducting liquid. Each electrode is independent in terms of the possible voltage that may be applied.
  • Look-up or calibration tables may be constructed and placed in the memory of the augmented reality glasses.
  • the accelerometer or other motion sensor will sense the motion of the glasses, i.e., the camera on the glasses or the lens itself.
  • a motion sensor such as an accelerometer will sense in particular, small vibration- type motions that interfere with smooth delivery of images to the waveguide.
  • the image stabilization techniques described here can be applied to the electrically-controllable liquid lens so that the image from the projector is corrected immediately. This will stabilize the output of the projector, at least partially correcting for the vibration and movement of the augmented reality eyepiece, as well as at least some movement by the user.
  • Another variable focus element uses tunable liquid crystal cells to focus an image. These are disclosed, for example, in U.S. Pat. Appl. Publ. Nos. 2009/0213321, 2009/0316097 and 2010/0007807, which are hereby incorporated by reference in their entirety and relied on.
  • a liquid crystal material is contained within a transparent cell, preferably with a matching index of refraction.
  • the cell includes transparent electrodes, such as those made from indium tin oxide (ITO).
  • ITO indium tin oxide
  • the shape of the magnetic field determines the rotation of molecules in the liquid crystal cell to achieve a change in refractive index and thus a focus of the lens.
  • the liquid crystals can thus be electromagnetically manipulated to change their index of refraction, making the tunable liquid crystal cell act as a lens.
  • a tunable liquid crystal cell 3420 is depicted in Fig. 34D.
  • the cell includes an inner layer of liquid crystal 3421 and thin layers 3423 of orienting material such as polyimide. This material helps to orient the liquid crystals in a preferred direction.
  • Transparent electrodes 3425 are on each side of the orienting material.
  • An electrode may be planar, or may be spiral shaped as shown on the right in Fig. 34D.
  • Transparent glass substrates 3427 contain the materials within the cell. The electrodes are formed so that they will lend shape to the magnetic field. As noted, a spiral shaped electrode on one or both sides, such that the two are not symmetrical, is used in one embodiment.
  • a second embodiment is depicted in Fig. 34E.
  • Tunable liquid crystal cell 3430 includes central liquid crystal material 3431 , transparent glass substrate walls 3433, and transparent electrodes. Bottom electrode 3435 is planar, while top electrode 3437 is in the shape of a spiral. Transparent electrodes may be made of indium tin oxide (ITO).
  • ITO indium tin oxide
  • Additional electrodes may be used for quick reversion of the liquid crystal to a non-shaped or natural state.
  • a small control voltage is thus used to dynamically change the refractive index of the material the light passes through.
  • the voltage generates a spatially non-uniform magnetic field of a desired shape, allowing the liquid crystal to function as a lens.
  • the camera includes the black silicon, short wave infrared (SWI ) CMOS sensor described elsewhere in this patent.
  • the camera is a 5 megapixel (MP) optically- stabilized video sensor.
  • the controls include a 3 GHz microprocessor or microcontroller, and may also include a 633 MHz digital signal processor with a 30 M polygon/second graphic accelerator for real-time image processing for images from the camera or video sensor.
  • the augmented reality glasses may include a wireless internet, radio or telecommunications capability for wideband, personal area network (PAN), local area network (LAN), a wide local area network, WLAN, conforming to IEEE 802.1 1 , or reach-back communications.
  • the equipment furnished in one embodiment includes a Bluetooth capability, conforming to IEEE 802.15.
  • the augmented reality glasses include an encryption system, such as a 256-bit Advanced Encryption System (AES) encryption system or other suitable encryption program, for secure communications.
  • AES Advanced Encryption System
  • the wireless telecommunications may include a capability for a 3G or 4G network and may also include a wireless internet capability.
  • the augmented reality eyepiece or glasses may also include at least one lithium-ion battery, and as discussed above, a recharging capability.
  • the recharging plug may comprise an AC/DC power converter and may be capable of using multiple input voltages, such as 120 or 240 VAC.
  • the controls for adjusting the focus of the adjustable focus lenses in one embodiment comprises a 2D or 3D wireless air mouse or other non-contact control responsive to gestures or movements of the user.
  • a 2D mouse is available from Logitech, Fremont, CA, USA.
  • a 3D mouse is described herein, or others such as the Cideko AV 05 available from Cideko, Taiwan, .O.C, may be used.
  • the eyepiece may comprise electronics suitable for controlling the optics, and associated systems, including a central processing unit, non-volatile memory, digital signal processors, 3-D graphics accelerators, and the like.
  • the eyepiece may provide additional electronic elements or features, including inertial navigation systems, cameras, microphones, audio output, power, communication systems, sensors, stopwatch or chronometer functions, thermometer, vibratory temple motors, motion sensor, a microphone to enable audio control of the system, a UV sensor to enable contrast and dimming with photochromic materials, and the like.
  • the central processing unit (CPU) of the eyepiece may be an OMAP 4, with dual 1 GHz processor cores.
  • the CPU may include a 633 MHz DSP, giving a capability for the CPU of 30 million polygons/second.
  • the system may also provide dual micro-SD (secure digital) slots for provisioning of additional removable non-volatile memory.
  • An on-board camera may provide 1.3 MP color and record up to 60 minutes of video footage.
  • the recorded video may be transferred wirelessly or using a mini-USB transfer device to off-load footage.
  • the communications system-on-a-chip may be capable of operating with wide local area networks (WLAN), Bluetooth version 3.0, a GPS receiver, an FM radio, and the like.
  • WLAN wide local area networks
  • Bluetooth version 3.0 Bluetooth version 3.0
  • GPS receiver GPS receiver
  • FM radio FM radio
  • the eyepiece may operate on a 3.6 VDC lithium-ion rechargeable battery for long battery life and ease of use.
  • An additional power source may be provided through solar cells on the exterior of the frame of the system. These solar cells may supply power and may also be capable of recharging the lithium-ion battery.
  • the total power consumption of the eyepiece may be approximately 400 mW, but is variable depending on features and applications used. For example, processor-intensive applications with significant video graphics demand more power, and will be closer to 400 mW. Simpler, less video-intensive applications will use less power.
  • the operation time on a charge also may vary with application and feature usage.
  • the micro-projector illumination engine also known herein as the projector, may include multiple light emitting diodes (LEDs).
  • LEDs light emitting diodes
  • Osram red, Cree green, and Cree blue LEDs are used. These are die-based LEDs.
  • the RGB engine may provide an adjustable color output, allowing a user to optimize viewing for various programs and applications.
  • illumination may be added to the glasses or controlled through various means.
  • LED lights or other lights may be embedded in the frame of the eyepiece, such as in the nose bridge, around the composite lens, or at the temples.
  • the intensity of the illumination and or the color of illumination may be modulated.
  • Modulation may be accomplished through the various control technologies described herein, through various applications, filtering and magnification.
  • illumination may be modulated through various control technologies described herein such as through the adjustment of a control knob, a gesture, eye movement, or voice command.
  • a user desires to increase the intensity of illumination, the user may adjust a control knob on the glasses or he may adjust a control knob in the user interface displayed on the lens or by other means.
  • the user may use eye movements to control the knob displayed on the lens or he may control the knob by other means.
  • the user may adjust illumination through a movement of the hand or other body movement such that the intensity or color of illumination changes based on the movement made by the user.
  • the user may adjust the illumination through a voice command such as by speaking a phrase requesting increased or decreased illumination or requesting other colors to be displayed.
  • illumination modulation may be achieved through any control technology described herein or by other means.
  • the illumination may be modulated per the particular application being executed.
  • an application may automatically adjust the intensity of illumination or color of illumination based on the optimal settings for that application. If the current levels of illumination are not at the optimal levels for the application being executed, a message or command may be sent to provide for illumination adjustment.
  • illumination modulation may be accomplished through filtering and or through magnification.
  • filtering techniques may be employed that allow the intensity and or color of the light to be changed such that the optimal or desired illumination is achieved.
  • the intensity of the illumination may be modulated by applying greater or less magnification to reach the desired illumination intensity.
  • the projector may be connected to the display to output the video and other display elements to the user.
  • the display used may be an SVGA 800 x 600 dots/inch SYNDIANT liquid crystal on silicon (LCoS) display.
  • the target MPE dimensions for the system may be 24 mm x 12 mm x 6 mm.
  • the focus may be adjustable, allowing a user to refine the projector output to suit their needs.
  • the optics system may be contained within a housing fabricated for 6061 -T6 aluminum and glass-filled ABS/PC.
  • the weight of the system in an embodiment, is estimated to be 3.75 ounces, or 95 grams.
  • the eyepiece and associated electronics provide night vision capability.
  • This night vision capability may be enabled by a black silicon SWIR sensor.
  • Black silicon is a complementary metal-oxide silicon (CMOS) processing technique that enhances the photo response of silicon over 100 times.
  • the spectral range is expanded deep into the short wave infra-red (SWIR) wavelength range.
  • SWIR short wave infra-red
  • a 300 nm deep absorbing and anti-reflective layer is added to the glasses.
  • This layer offers improved responsivity as shown in Fig. 1 1 , where the responsivity of black silicon is much greater than silicon's over the visible and NIR ranges and extends well into the SWIR range.
  • This technology is an improvement over current technology, which suffers from extremely high cost, performance issues, as well as high volume manufacturability problems. Incorporating this technology into night vision optics brings the economic advantages of CMOS technology into the design.
  • SWIR sensors pick up individual photons and convert light in the SWIR spectrum to electrical signals, similar to digital photography.
  • the photons can be produced from the natural recombination of oxygen and hydrogen atoms in the atmosphere at night, also referred to as "Night Glow.”
  • Shortwave infrared devices see objects at night by detecting the invisible, shortwave infrared radiation within reflected star light, city lights or the moon. They also work in daylight, or through fog, haze or smoke, whereas the current NVG Image Intensifier infrared sensors would be overwhelmed by heat or brightness.
  • SWIR images look like the images produced by visible light with the same shadows and contrast and facial details, only in black and white, dramatically enhancing recognition so people look like people; they don't look like blobs often seen with thermal Imagers.
  • One of the important SWIR capabilities is of providing views of targeting lasers on the battlefield. Targeting lasers (1.064um) are not visible with current night -vision goggles. With SWIR Electro-optics, soldiers will be able to view every targeting laser in use, including those used by the enemy. Unlike Thermal Imagers, which do not penetrate windows on vehicles or buildings, the Visible/Near Infrared/Short Wave Infrared Sensor can see through them- day or night, giving users an important tactical advantage.
  • Certain advantages include using active illumination only when needed. In some instances there may be sufficient natural illumination at night, such as during a full moon. When such is the case, artificial night vision using active illumination may not be necessary. With black silicon CMOS-based SWIR sensors, active illumination may not be needed during these conditions, and is not provided, thus improving battery life.
  • a black silicon image sensor may have over eight times the signal to noise ratio found in costly indium-gallium arsenide image sensors under night sky conditions. Better resolution is also provided by this technology, offering much higher resolution than available using current technology for night vision.
  • CMOS-based SWIR have been difficult to interpret, having good heat detection, but poor resolution. This problem is solved with a black image silicon SWIR sensor, which relies on much shorter wavelengths. SWIR is highly desirable for battlefield night vision glasses for these reasons.
  • Fig. 12 illustrates the effectiveness of black silicon night vision technology, providing both before and after images of seeing through a) dust; b) fog, and c) smoke. The images in FIG. 12 demonstrate the performance of the new
  • the image sensor may be able to distinguish between changes in the natural environment, such as disturbed vegetation, disturbed ground, and the like.
  • an enemy combatant may have recently placed an explosive device in the ground, and so the ground over the explosive will be 'disturbed ground', and the image sensor (along with processing facilities internal or external to the eyepiece) may be able to distinguish the recently disturbed ground from the surrounding ground.
  • an underground explosive device e.g. an improvised explosive device (IED)
  • FIG. 17 shows the difference in image quality between A) a flexible platform of uncooled CMOS image sensors capable of VIS/NIR/SWIR imaging and B) an image intensified night vision system.
  • FIG. 13 depicts the difference in structure between current or incumbent vision enhancement technology 1300 and uncooled CMOS image sensors 1307.
  • the incumbent platform (Fig. 13A) limits deployment because of cost, weight, power consumption, spectral range, and reliability issues.
  • Incumbent systems are typically comprised of a front lens 1301 , photocathode 1302, micro channel plate 1303, high voltage power supply 1304, phosphorous screen 1305, and eyepiece 1306. This is in contrast to a flexible platform (Fig. 13B) of uncooled CMOS image sensors 1307 capable of VIS/NIR/SWIR imaging at a fraction of the cost, power consumption, and weight.
  • These much simpler sensors include a front lens 1308 and an image sensor 1309 with a digital image output.
  • CMOS compatible processing technique that enhances the photo response of silicon over 100 times and extends the spectral range deep into the short wave infrared region.
  • the difference in responsivity is illustrated in FIG. 13C. While typical night vision goggles are limited to the UV, visible and near infrared (NIR) ranges, to about 1100 nm (1.1 micrometers) the newer CMOS image sensor ranges also include the short wave infrared (SWIR) spectrum, out to as much as 2000 nm (2 micrometers).
  • NIR visible and near infrared
  • SWIR short wave infrared
  • the black silicon core technology may offer significant improvement over current night vision glasses. Femtosecond laser doping may enhance the light detection properties of silicon across a broad spectrum. Additionally, optical response may be improved by a factor of 100 to 10,000.
  • the black silicon technology is a fast, scalable, and CMOS compatible technology at a very low cost, compared to current night vision systems. Black silicon technology may also provide a low operation bias, with 3.3 V typical. In addition, uncooled performance may be possible up to 50°C. Cooling requirements of current technology increase both weight and power consumption, and also create discomfort in users.
  • the black silicon core technology offers a high-resolution replacement for current image intensifier technology. Black silicon core technology may provide high speed electronic shuttering at speeds up to 1000 frames/second with minimal cross talk. In certain embodiments of the night vision eyepiece, an OLED display may be preferred over other optical displays, such as the LCoS display.
  • the eyepiece incorporating the VIS/NIR/SWIR black silicon sensor may provide for better situational awareness (SAAS) surveillance and real-time image enhancement.
  • SAAS situational awareness
  • the VIS/NIR/SWIR black silicon sensor may be incorporated into a form factor suitable for night vision only, such as a night vision goggle or a night vision helmet.
  • the night vision goggle may include features that make it suitable for the military market, such as ruggedization and alternative power supplies, while other form factors may be suitable for the consumer or toy market.
  • the night vision goggles may have extended range, such as 500 - 1200 nm, and may also useable as a camera.
  • the VIS/NIR/SWIR black silicon sensor as well as other outboard sensors may be incorporated into a mounted camera that may be mounted on transport or combat vehicles so that the real-time feed can be sent to the driver or other occupants of the vehicle by superimposing the video on the forward view without obstructing it.
  • the driver can better see where he or she is going, the gunner can better see threats or targets of opportunity, and the navigator can better sense situational awareness (SAAS) while also looking for threats.
  • SAAS situational awareness
  • the feed could also be sent to off-site locations as desired, such as higher headquarters of memory/ storage locations for later use in targeting, navigation, surveillance, data mining, and the like.
  • the eyepiece may include robust connectivity.
  • This connectivity enables download and transmission using Bluetooth, Wi-Fi/Internet, cellular, satellite, 3G, FM/AM, TV, and UVB transceiver for sending/receiving vast amounts of data quickly.
  • the UWB transceiver may be used to create a very high data rate, low-probability-of-intercept/low-probability-of-detection (LPI/LPD), Wireless Personal Area Network (WPAN) to connect weapons sights, weapons-mounted mouse/controller, E/O sensors, medical sensors, audio/video displays, and the like.
  • the WPAN may be created using other communications protocols.
  • a WPAN transceiver may be a COTS-compliant module front end to make the power management of a combat radio highly responsive and to avoid jeopardizing the robustness of the radio.
  • UWB ultra wideband
  • the WPAN transceivers create a low power, encrypted, wireless personal area network (WPAN) between soldier worn devices.
  • the WPAN transceivers can be attached or embedded into nearly any fielded military device with a network interface (handheld computers, combat displays, etc.).
  • the system is capable of supporting many users, AES encryption, robust against jamming and RF interference as well as being ideal for combat providing low probabilities of interception and detection (LPI/ LPD).
  • the WPAN transceivers eliminate the bulk, weight and "snagability" of data cables on the soldier.
  • Interfaces include USB 1.1 , USB 2.0 OTG, Ethernet 10-, 100 Base-T and RS232 9-pin D-Sub.
  • the power output may be -10, -20 dBm outputs for a variable range of up to 2 meters.
  • the data capacity may be 768 Mbps and greater.
  • the bandwidth may be 1.7 GHz.
  • Encryption may be 128-bit, 192-bit or 256-bit AES.
  • the WPAN transceiver may include Optimized Message Authentication Code (MAC) generation.
  • the WPAN transceiver may comply to MIL-STD-461F.
  • the WPAN transceiver may be in the form of a connector dust cap and may attach to any fielded military device.
  • the WPAN transceiver allows simultaneous video, voice, stills, text and chat, eliminates the need for data cables between electronic devices, allows hands-free control of multiple devices without distraction, features an adjustable connectivity range, interfaces with Ethernet and USB 2.0, features an adjustable frequency 3.1 to 10.6 GHz and 200mw peak draw and nominal standby.
  • the WPAN transceiver may enable creating a WPAN between the eyepiece 100 in the form of a GSE stereo heads-up combat display glasses, a computer, a remote computer controller, and biometric enrollment devices like that seen in Fig. 58.
  • the WPAN transceiver may enable creating a WPAN between the eyepiece in the form of flip-up/-down heads-up display combat glasses, the HUD CPU (if it is external), a weapon fore-grip controller, and a forearm computer similar to that seen in Fig. 58.
  • the eyepiece may provide its own cellular connectivity, such as though a personal wireless connection with a cellular system.
  • the personal wireless connection may be available for only the wearer of the eyepiece, or it may be available to a plurality of proximate users, such as in a Wi-Fi hot spot (e.g. WiFi), where the eyepiece provides a local hotspot for others to utilize.
  • proximate users may be other wearers of an eyepiece, or users of some other wireless computing device, such as a mobile communications facility (e.g. mobile phone).
  • a mobile communications facility e.g. mobile phone
  • the wearer may have to find a WiFi connection point or tether to their mobile communications facility in order to establish a wireless connection.
  • the eyepiece may be able to replace the need for having a separate mobile communications device, such as a mobile phone, mobile computer, and the like, by integrating these functions and user interfaces into the eyepiece.
  • the eyepiece may have an integrated WiFi connection or hotspot, a real or virtual keyboard interface, a USB hub, speakers (e.g. to stream music to) or speaker input connections, integrated camera, external camera, and the like.
  • an external device in connectivity with the eyepiece, may provide a single unit with a personal network connection (e.g. WiFi, cellular connection), keyboard, control pad (e.g. a touch pad), and the like.
  • Communications from the eyepiece may include communication links for special purposes.
  • an ultra-wide bandwidth communications link may be utilized when sending and/or receiving large volumes of data in a short amount of time.
  • a near-field communications (NFC) link may be used with very limited transmission range in order to post information to transmit to personnel when they are very near, such as for tactical reasons, for local directions, for warnings, and the like.
  • NFC near-field communications
  • a soldier may be able to post/hold information securely, and transmit only to people very nearby with a need-to-know or need-to-use the information.
  • a wireless personal area network may be utilized, such as to connect weapons sights, weapons-mounted mouse/controller, electro-optic sensors, medical sensors, audio-visual displays, and the like.
  • the eyepiece may include MEMS-based inertial navigation systems, such as a GPS processor, an accelerometer (e.g. for enabling head control of the system and other functions), a gyroscope, an altimeter, an inclinometer, a speedometer/odometer, a laser rangefinder, and a magnetometer, which also enables image stabilization.
  • the eyepiece may include integrated headphones, such as the articulating earbud 120, that provide audio output to the user or wearer.
  • a forward facing camera integrated with the eyepiece may enable basic augmented reality.
  • augmented reality a viewer can image what is being viewed and then layer an augmented, edited, tagged, or analyzed version on top of the basic view.
  • associated data may be displayed with or over the basic image. If two cameras are provided and are mounted at the correct interpupillary distance for the user, stereo video imagery may be created. This capability may be useful for persons requiring vision assistance. Many people suffer from deficiencies in their vision, such as near-sightedness, far-sightedness, and so forth.
  • a camera and a very close, virtual screen as described herein provides a "video" for such persons, the video adjustable in terms of focal point, nearer or farther, and fully in control by the person via voice or other command.
  • This capability may also be useful for persons suffering diseases of the eye, such as cataracts, retinitis pigmentosa, and the like. So long as some organic vision capability remains, an augmented reality eyepiece can help a person see more clearly.
  • Embodiments of the eyepiece may feature one or more of magnification, increased brightness, and ability to map content to the areas of the eye that are still healthy.
  • Embodiments of the eyepiece may be used as bifocals or a magnifying glass.
  • the wearer may be able to increase zoom in the field of view or increase zoom within a partial field of view.
  • an associated camera may make an image of the object and then present the user with a zoomed picture.
  • a user interface may allow a wearer to point at the area that he wants zoomed, such as with the control techniques described herein, so the image processing can stay on task as opposed to just zooming in on everything in the camera's field of view.
  • a rear-facing camera (not shown) may also be incorporated into the eyepiece in a further embodiment.
  • the rear-facing camera may enable eye control of the eyepiece, with the user making application or feature selection by directing his or her eyes to a specific item displayed on the eyepiece.
  • a further embodiment of a device for capturing biometric data about individuals may incorporate a microcassegrain telescoping folded optic camera into the device.
  • the microcassegrain telescoping folded optic camera may be mounted on a handheld device, such as the bio-print device, the bio-phone, and could also be mounted on glasses used as part of a bio-kit to collect biometric data.
  • a cassegrain reflector is a combination of a primary concave mirror and a secondary convex mirror. These reflectors are often used in optical telescopes and radio antennas because they deliver good light (or sound) collecting capability in a shorter, smaller package.
  • both mirrors are aligned about the optical axis, and the primary mirror usually has a hole in the center, allowing light to reach the eyepiece or a camera chip or light detection device, such as a CCD chip.
  • An alternate design often used in radio telescopes, places the final focus in front of the primary reflector.
  • a further alternate design may tilt the mirrors to avoid obstructing the primary or secondary mirror and may eliminate the need for a hole in the primary mirror or secondary mirror.
  • the microcassegrain telescoping folded optic camera may use any of the above variations, with the final selection determined by the desired size of the optic device.
  • the classic cassegrain configuration 3500 uses a parabolic reflector as the primary mirror and a hyperbolic mirror as the secondary mirror. Further embodiments of the microcassegrain telescoping folded optic camera may use a hyperbolic primary mirror and/or a spherical or elliptical secondary mirror. In operation the classic cassegrain with a parabolic primary mirror and a hyperbolic secondary mirror reflects the light back down through a hole in the primary, as shown in Fig. 35. Folding the optical path makes the design more compact, and in a "micro" size, suitable for use with the bio-print sensor and bio-print kit described herein.
  • the beam is bent to make the optical path much longer than the physical length of the system.
  • folded optics is prismatic binoculars.
  • the secondary mirror may be mounted on an optically flat, optically clear glass plate that closes the lens tube. This support eliminates "star-shaped" diffraction effects that are caused by a straight-vaned support spider. This allows for a sealed closed tube and protects the primary mirror, albeit at some loss of light collecting power.
  • the cassegrain design also makes use of the special properties of parabolic and hyperbolic reflectors.
  • a concave parabolic reflector will reflect all incoming light rays parallel to its axis of symmetry to a single focus point.
  • a convex hyperbolic reflector has two foci and reflects all light rays directed at one focus point toward the other focus point.
  • Mirrors in this type of lens are designed and positioned to share one focus, placing the second focus of the hyperbolic mirror at the same point as where the image is observed, usually just outside the eyepiece.
  • the parabolic mirror reflects parallel light rays entering the lens to its focus, which is coincident with the focus of the hyperbolic mirror.
  • the hyperbolic mirror then reflects those light rays to the other focus point, where the camera records the image.
  • Fig. 36 shows the configuration of the microcassegrain telescoping folded optic camera.
  • the camera may be mounted on augmented reality glasses, a bio-phone, or other biometric collection device.
  • the assembly, 3600 has multiple telescoping segments that allow the camera to extend with cassegrain optics providing for a longer optical path.
  • Threads 3602 allow the camera to be mounted on a device, such as augmented reality glasses or other biometric collection device. While the embodiment depicted in Fig. 36 uses threads, other mounting schemes such as bayonet mount, knobs, or press-fit, may also be used.
  • a first telescoping section 3604 also acts as an external housing when the lens is in the fully retracted position.
  • the camera may also incorporate a motor to drive the extension and retraction of the camera.
  • a second telescoping section 3606 may also be included. Other embodiments may incorporate varying numbers of telescoping sections, depending on the length of optical path needed for the selected task or data to be collected.
  • a third telescoping section 3608 includes the lens and a reflecting mirror. The reflecting mirror may be a primary reflector if the camera is designed following classic cassegrain design. The secondary mirror may be contained in first telescoping section 3604.
  • FIG. 10 Further embodiments may utilize microscopic mirrors to form the camera, while still providing for a longer optical path through the use of folded optics.
  • the same principles of cassegrain design are used.
  • Lens 3610 provides optics for use in conjunction with the folded optics of the cassegrain design.
  • the lens 3610 may be selected from a variety of types, and may vary depending on the application.
  • the threads 3602 permit a variety of cameras to be interchanged depending on the needs of the user.
  • Eye control of feature and option selection may be controlled and activated by object recognition software loaded on the system processor.
  • Object recognition software may enable augmented reality, combine the recognition output with querying a database, combine the recognition output with a computational tool to determine dependencies / likelihoods, and the like.
  • CMOS Sensors with redundant micros and DSPs for each sensor array and projector detect visible, near infrared, and short wave infrared light to enable passive day and night operations, such as real-time image enhancement 1002, real-time keystone correction 1004, and real-time virtual perspective correction 1008.
  • the eyepiece may utilize digital CMOS image sensors and directional microphones (e.g. microphone arrays) as described herein, such as for visible imaging for monitoring the visible scene (e.g.
  • each of these sensor inputs may be fed to a digital signal processor (DSP) for processing, such as internal to the eyepiece or as interfaced to external processing facilities.
  • DSP digital signal processor
  • the outputs of the DSP processing of each sensor input stream may then be algorithmically combined in a manner to generate useful intelligence data.
  • this system may be useful for a combination of real-time facial recognition, real time voice detection, and analysis through links to a database, especially with distortion corrections and contemporaneous GPS location for soldiers, service personnel, and the like, such as in monitoring remote areas of interest, e.g., known paths or trails, or high-security areas.
  • the sound direction sensor input to the DSP may be processed to produce one or more of a visible, auditory or vibration queue to a user of the eyepiece to indicate a direction of the sound.
  • a visible, auditory or vibration queue to the operator may be used to indicate the direction of the original threat.
  • the augmented reality eyepiece or glasses may be powered by any stored energy system, such as battery power, solar power, line power, and the like.
  • a solar energy collector may be placed on the frame, on a belt clip, and the like. Battery charging may occur using a wall charger, car charger, on a belt clip, in a glasses case, and the like.
  • the eyepiece may be rechargeable and be equipped with a mini-USB connector for recharging.
  • the eyepiece may be equipped for remote inductive recharging by one or more remote inductive power conversion technologies, such as those provided by Powercast, Ligonier, PA, USA; and Fulton Int'l. Inc., Ada, MI, USA, which also owns another provider, Splashpower, Inc., Cambridge, UK.
  • the augmented reality eyepiece also includes a camera and any interface necessary to connect the camera to the circuit.
  • the output of the camera may be stored in memory and may also be displayed on the display available to the wearer of the glasses.
  • a display driver may also be used to control the display.
  • the augmented reality device also includes a power supply, such as a battery, as shown, power management circuits and a circuit for recharging the power supply. As noted elsewhere, recharging may take place via a hard connection, e.g., a mini-USB connector, or by means of an inductor, a solar panel input, and so forth.
  • the control system for the eyepiece or glasses may include a control algorithm for conserving power when the power source, such as a battery, indicates low power.
  • This conservation algorithm may include shutting power down to applications that are energy intensive, such as lighting, a camera, or sensors that require high levels of energy, such as any sensor requiring a heater, for example.
  • Other conservation steps may include slowing down the power used for a sensor or for a camera, e.g., slowing the sampling or frame rates, going to a slower sampling or frame rate when the power is low; or shutting down the sensor or camera at an even lower level.
  • Applications of the present disclosure may be controlled through movements and direct actions of the wearer, such as movement of his or her hand, finger, feet, head, eyes, and the like, enabled through facilities of the eyepiece (e.g. accelerometers, gyros, cameras, optical sensors, GPS sensors, and the like) and/or through facilities worn or mounted on the wearer (e.g. body mounted sensor control facilities).
  • the wearer may directly control the eyepiece through movements and/or actions of their body without the use of a traditional hand-held remote controller.
  • the wearer may have a sense device, such as a position sense device, mounted on one or both hands, such as on at least one finger, on the palm, on the back of the hand, and the like, where the position sense device provides position data of the hand, and provides wireless communications of position data as command information to the eyepiece.
  • the sense device of the present disclosure may include a gyroscopic device (e.g.
  • a wearer may have a position sense device mounted on their right index finger, where the device is able to sense motion of the finger.
  • the user may activate the eyepiece either through some switching mechanism on the eyepiece or through some predetermined motion sequence of the finger, such as moving the finger quickly, tapping the finger against a hard surface, and the like.
  • tapping against a hard surface may be interpreted through sensing by accelerometers, force sensors, pressure sensors, and the like.
  • the position sense device may then transmit motions of the finger as command information, such as moving the finger in the air to move a cursor across the displayed or projected image, moving in quick motion to indicate a selection, and the like.
  • the position sense device may send sensed command information directly to the eyepiece for command processing, or the command processing circuitry may be co-located with the position sense device, such as in this example, mounted on the finger as part of an assembly including the sensors of the position sense device.
  • Command information may be accompanied by a visual indicator.
  • the cursor may change color when interacting with different content.
  • a visual indication of the command information may be displayed in the glasses.
  • the wearer may have a plurality of position sense devices mounted on their body.
  • the wearer may have position sense devices mounted on a plurality of points on the hand, such as with individual sensors on different fingers, or as a collection of devices, such as in a glove.
  • the aggregate sense command information from the collection of sensors at different locations on the hand may be used to provide more complex command information.
  • the wearer may use a sensor device glove to play a game, where the glove senses the grasp and motion of the user's hands on a ball, bat, racket, and the like, in the use of the present disclosure in the simulation and play of a simulated game.
  • the plurality of position sense devices may be mounted on different parts of the body, allowing the wearer to transmit complex motions of the body to the eyepiece for use by an application.
  • the sense device may have a force sensor, pressure sensor, and the like, such as for detecting when the sense device comes in contact with an object.
  • a sense device may include a force sensor at the tip of a wearer's finger.
  • the wearer may tap, multiple tap, sequence taps, swipe, touch, and the like to generate a command to the eyepiece.
  • Force sensors may also be used to indicate degrees of touch, grip, push, and the like, where predetermined or learned thresholds determine different command information. In this way, commands may be delivered as a series of continuous commands that constantly update the command information being used in an application through the eyepiece.
  • a wearer may be running a simulation, such as a game application, military application, commercial application, and the like, where the movements and contact with objects, such as through at least one of a plurality of sense devices, are fed to the eyepiece as commands that influence the simulation displayed through the eyepiece.
  • a sense device may be included in a pen controller, where the pen controller may have a force sensor, pressure sensor, inertial measurement unit, and the like, and where the pen controller may be used to produce virtual writing, control a cursor associated with the eyepiece's display, act as a computer mouse, provide control commands though physical motion and/or contact, and the like.
  • the sense device may include an optical sensor or optical transmitter as a way for movement to be interpreted as a command.
  • a sense device may include an optical sensor mounted on the hand of the wearer, and the eyepiece housing may include an optical transmitter, such that when a user moves their hand past the optical transmitter on the eyepiece, the motions may be interpreted as commands.
  • a motion detected through an optical sensor may include swiping past at different speeds, with repeated motions, combinations of dwelling and movement, and the like.
  • optical sensors and/or transmitters may be located on the eyepiece, mounted on the wearer (e.g. on the hand, foot, in a glove, piece of clothing), or used in combinations between different areas on the wearer and the eyepiece, and the like.
  • a number of sensors useful for monitoring the condition of the wearer or a person in proximity to the wearer are mounted within the augmented reality glasses. Sensors have become much smaller, thanks to advances in electronics technology. Signal transducing and signal processing technologies have also made great progress in the direction of size reduction and digitization. Accordingly, it is possible to have not merely a temperature sensor in the A glasses, but an entire sensor array.
  • These sensors may include, as noted, a temperature sensor, and also sensor to detect: pulse rate; beat-to-beat heart variability; EKG or ECG; respiration rate; core body temperature; heat flow from the body; galvanic skin response or GSR; EMG; EEG; EOG; blood pressure; body fat; hydration level; activity level; oxygen consumption; glucose or blood sugar level; body position; and UV radiation exposure or absorption.
  • a retinal sensor and a blood oxygenation sensor such as an Sp0 2 sensor
  • Such sensors are available from a variety of manufacturers, including Vermed, Bellows Falls, VT, USA; VTI, Ventaa, Finland; and ServoFlow, Lexington, MA, USA.
  • sensors mounted on the person or on equipment of the person rather than on the glasses themselves.
  • accelerometers, motion sensors and vibration sensors may be usefully mounted on the person, on clothing of the person, or on equipment worn by the person. These sensors may maintain continuous or periodic contact with the controller of the AR glasses through a Bluetooth® radio transmitter or other radio device adhering to IEEE 802.1 1 specifications.
  • the sensors may be more useful if they are mounted directly on the person's skin, or even on a T-shirt worn by the person, rather than mounted on the glasses. In these cases, a more accurate reading may be obtained by a sensor placed on the person or on the clothing rather than on the glasses.
  • Such sensors need not be as tiny as the sensors which would be suitable for mounting on the glasses themselves, and be more useful, as seen.
  • the AR glasses or goggles may also include environmental sensors or sensor arrays. These sensors are mounted on the glasses and sample the atmosphere or air in the vicinity of the wearer. These sensors or sensor array may be sensitive to certain substances or concentrations of substances. For example, sensors and arrays are available to measure concentrations of carbon monoxide, oxides of nitrogen (“NO x "), temperature, relative humidity, noise level, volatile organic chemicals (VOC), ozone, particulates, hydrogen sulfide, barometric pressure and ultraviolet light and its intensity.
  • OOC volatile organic chemicals
  • Vendors and manufacturers include: Sensares, Crolles, FR; Cairpol, Ales, FR; Critical Environmental Technologies of Canada, Delta, B.C., Canada; Apollo Electronics Co., Shenzhen, China; and AV Technology Ltd., Stockport, Cheshire, UK.
  • Many other sensors are well known. If such sensors are mounted on the person or on clothing or equipment of the person, they may also be useful. These environmental sensors may include radiation sensors, chemical sensors, poisonous gas sensors, and the like.
  • environmental sensors, health monitoring sensors, or both are mounted on the frames of the augmented reality glasses.
  • the sensors may be mounted on the person or on clothing or equipment of the person.
  • a sensor for measuring electrical activity of a heart of the wearer may be implanted, with suitable accessories for transducing and transmitting a signal indicative of the person's heart activity.
  • the signal may be transmitted a very short distance via a Bluetooth® radio transmitter or other radio device adhering to IEEE 802.15.1 specifications. Other frequencies or protocols may be used instead.
  • the signal may then be processed by the signal-monitoring and processing equipment of the augmented reality glasses, and recorded and displayed on the virtual screen available to the wearer.
  • the signal may also be sent via the A glasses to a friend or squad leader of the wearer.
  • the health and well-being of the person may be monitored by the person and by others, and may also be tracked over time.
  • environmental sensors may be mounted on the person or on equipment of the person.
  • radiation or chemical sensors may be more useful if worn on outer clothing or a web-belt of the person, rather than mounted directly on the glasses.
  • signals from the sensors may be monitored locally by the person through the AR glasses.
  • the sensor readings may also be transmitted elsewhere, either on demand or automatically, perhaps at set intervals, such as every quarter-hour or half-hour.
  • a history of sensor readings whether of the person's body readings or of the environment, may be made for tracking or trending purposes.
  • an RF/micropower impulse radio (MIR) sensor may be associated with the eyepiece and serve as a short-range medical radar.
  • the sensor may operate on an ultra-wide band.
  • the sensor may include an RF/impulse generator, receiver, and signal processor, and may be useful for detecting and measuring cardiac signals by measuring ion flow in cardiac cells within 3 mm of the skin.
  • the receiver may be a phased array antenna to enable determining a location of the signal in a region of space.
  • the sensor may be used to detect and identify cardiac signals through blockages, such as walls, water, concrete, dirt, metal, wood, and the like. For example, a user may be able to use the sensor to determine how many people are located in a concrete structure by how many heart rates are detected.
  • a detected heart rate may serve as a unique identifier for a person so that they may be recognized in the future.
  • the RF/impulse generator may be embedded in one device, such as the eyepiece or some other device, while the receiver is embedded in a different device, such as another eyepiece or device. In this way, a virtual "tripwire" may be created when a heart rate is detected between the transmitter and receiver.
  • the sensor may be used as an in-field diagnostic or self-diagnosis tool. EKG's may be analyzed and stored for future use as a biometric identifier. A user may receive alerts of sensed heart rate signals and how many heart rates are present as displayed content in the eyepiece.
  • Fig. 29 depicts an embodiment 2900 of an augmented reality eyepiece or glasses with a variety of sensors and communication equipment.
  • One or more than one environmental or health sensors are connected to a sensor interface locally or remotely through a short range radio circuit and an antenna, as shown.
  • the sensor interface circuit includes all devices for detecting, amplifying, processing and sending on or transmitting the signals detected by the sensor(s).
  • the remote sensors may include, for example, an implanted heart rate monitor or other body sensor (not shown).
  • the other sensors may include an accelerometer, an inclinometer, a temperature sensor, a sensor suitable for detecting one or more chemicals or gasses, or any of the other health or environmental sensors discussed in this disclosure.
  • the sensor interface is connected to the microprocessor or microcontroller of the augmented reality device, from which point the information gathered may be recorded in memory, such as random access memory (RAM) or permanent memory, read only memory (ROM), as shown.
  • RAM random access memory
  • ROM read only memory
  • a sense device enables simultaneous electric field sensing through the eyepiece.
  • Electric field (EF) sensing is a method of proximity sensing that allows computers to detect, evaluate and work with objects in their vicinity.
  • Physical contact with the skin such as a handshake with another person or some other physical contact with a conductive or a non-conductive device or object, may be sensed as a change in an electric field and either enable data transfer to or from the eyepiece or terminate data transfer.
  • videos captured by the eyepiece may be stored on the eyepiece until a wearer of the eyepiece with an embedded electric field sensing transceiver touches an object and initiates data transfer from the eyepiece to a receiver.
  • the transceiver may include a transmitter that includes a transmitter circuit that induces electric fields toward the body and a data sense circuit, which distinguishes transmitting and receiving modes by detecting both transmission and reception data and outputs control signals corresponding to the two modes to enable two-way communication.
  • An instantaneous private network between two people may be generated with a contact, such as a handshake.
  • Data may be transferred between an eyepiece of a user and a data receiver or eyepiece of the second user. Additional security measures may be used to enhance the private network, such as facial or audio recognition, detection of eye contact, fingerprint detection, biometric entry, iris or retina tracking, and the like.
  • an authentication facility associated with accessing functionality of the eyepiece, such as access to displayed or projected content, access to restricted projected content, enabling functionality of the eyepiece itself (e.g. as through a login to access functionality of the eyepiece) either in whole or in part, and the like.
  • Authentication may be provided through recognition of the wearer's voice, iris, retina, fingerprint, and the like, or other biometric identifier.
  • the eyepiece or an associated controller may have an IR, ultrasonic or capacitive tactile sensor for receiving control input related to authentication or other eyepiece functions.
  • a capacitance sensor can detect a fingerprint and launch an application or otherwise control an eyepiece function.
  • Each finger has a different fingerprint so each finger can be used to control different eyepiece functions or quick launch different applications or provide various levels of authentication. Capacitance does not work with gloves but an ultrasonic sensor does and can be used in the same way to provide biometric authentication or control. Ultrasonic sensors useful in the eyepiece or associated controller include Sonavation's SonicTouchTM technology used in Sonavation's SonicSlideTM sensors, which works by acoustically measuring the ridges and valleys of the fingerprint to image the fingerprint in 256 shades of gray in order to discern the slightest fingerprint detail.
  • the key imaging component of the SonicSlideTM sensor is the ceramic Micro-Electro Mechanical
  • MEMS Microwave System
  • the authentication system may provide for a database of biometric inputs for a plurality of users such that access control may be provided for use of the eyepiece based on policies and associated access privileges for each of the users entered into the database.
  • the eyepiece may provide for an authentication process. For instance, the authentication facility may sense when a user has taken the eyepiece off, and require re- authentication when the user puts it back on. This better ensures that the eyepiece only provides access to those users that are authorized, and for only those privileges that the wearer is authorized for.
  • the authentication facility may be able to detect the presence of a user's eye or head as the eyepiece is put on. In a first level of access, the user may only be able to access low-sensitivity items until authentication is complete.
  • the authentication facility may identify the user, and look up their access privileges. Once these privileges have been determined, the authentication facility may then provide the appropriate access to the user. In the case of an unauthorized user being detected, the eyepiece may maintain access to low-sensitivity items, further restrict access, deny access entirely, and the like.
  • a receiver may be associated with an object to enable control of that object via touch by a wearer of the eyepiece, wherein touch enables transmission or execution of a command signal in the object.
  • a receiver may be associated with a car door lock. When a wearer of the eyepiece touches the car, the car door may unlock.
  • a receiver may be embedded in a medicine bottle. When the wearer of the eyepiece touches the medicine bottle, an alarm signal may be initiated.
  • a receiver may be associated with a wall along a sidewalk. As the wearer of the eyepiece passes the wall or touches the wall, advertising may be launched either in the eyepiece or on a video panel of the wall.
  • a WiFi exchange of information with a receiver may provide an indication that the wearer is connected to an online activity such as a game or may provide verification of identity in an online environment.
  • a representation of the person could change color or undergo some other visual indication in response to the contact.
  • the eyepiece may include a tactile interface as in Fig. 14, such as to enable haptic control of the eyepiece, such as with a swipe, tap, touch, press, click, roll of a rollerball, and the like.
  • the tactile interface 1402 may be mounted on the frame of the eyepiece 1400, such as on an arm, both arms, the nosepiece, the top of the frame, the bottom of the frame, and the like.
  • the tactile interface 1402 may include controls and functionality similar to a computer mouse, with left and right buttons, a 2D position control pad such as described herein, and the like.
  • the tactile interface may be mounted on the eyepiece near the user's temple and act as a 'temple mouse' controller for the eyepiece projected content to the user and may include a temple-mounted rotary selector and enter button.
  • the tactile interface may be one or more vibratory temple motors which may vibrate to alert or notify the user, such as to danger left, danger right, a medical condition, and the like.
  • the tactile interface may be mounted on a controller separate from the eyepiece, such as a worn controller hand-carried controller, and the like. If there is an accelerometer in the controller then it may sense the user tapping, such as on a keyboard, on their hand (either on the hand with the controller or tapping with the hand that has the controller), and the like.
  • the wearer may then touch the tactile interface in a plurality of ways to be interpreted by the eyepiece as commands, such as by tapping one or multiple times on the interface, by brushing a finger across the interface, by pressing and holding, by pressing more than one interface at a time, and the like.
  • the tactile interface may be attached to the wearer's body (e.g. their hand, arm, leg, torso, neck), their clothing, as an attachment to their clothing, as a ring 1500, as a bracelet, as a necklace, and the like.
  • the interface may be attached on the body, such as on the back of the wrist, where touching different parts of the interface provides different command information (e.g.
  • the tactile interface may incorporate resistive touch technologies, capacitive touch technologies, proportional pressure touch technologies, and the like.
  • the tactile interface may utilize discrete resistive touch technologies where the application requires the interface to be simple, rugged, low power, and the like.
  • the tactile interface may utilize capacitive tough technologies where more functionality is required through the interface, such as though movement, swiping, multi-point contacts, and the like.
  • the tactile interface may utilize pressure touch technologies, such as when variable pressure commanding is required.
  • a hand held accessory may be used to control a virtual keyboard for input to the glasses.
  • the user may interact with the touch screen that either presents an on-screen keyboard or is adapted to allow users to interact with the device which coordinates with a virtual keyboard to provide input to the glasses.
  • the virtual keyboard may be presented in the glasses, but instead of selecting items in the air, the user can adapt the touch screen device to accept input corresponding to the virtual keyboard.
  • the device may track fingers as they slide across the capacitive module, and a click of the device would give a key strike sensation.
  • the device may have a touch surface on the front and one or more action buttons on the back or top that allow the user to click to select without lifting their fingers off the touch surface.
  • the letters the user has selected may be highlighted.
  • the user could still do swipe texting, lift their fingers to end a word, insert a space, double tap to insert a period, and the like.
  • Fig. 159 depicts a virtual keyboard 15902 presented in a user's field of view. On the keyboard, two keys are highlighted, 'D' and 'Enter'.
  • a touchscreen accessory device 15904 is being used in the figure to provide this input to the keyboard, which is then transmitted to the glasses as input.
  • a visual indicator indicating of having executed input or control commands using a virtual interface or actual touch screen on an external device.
  • the eyepiece may include a haptic communication interface that utilizes magnetic fields to transmit and/or receive a command, telemetry, information, and the like, between the eyepiece and an external device or directly to/from the user.
  • a user may have a patterned magnetic material applied directly to some part of their body (e.g., skin, finger nail, internal to the body, and the like), where the patterned magnetic material physically responds (e.g. vibration, forces, motion, and the like) to an oscillating magnetic field generated by the haptic communication interface.
  • the oscillating magnetic field may convey information through modulations of the field, such as through the amplitude of the signal, a time-wise variance of the signal, frequencies of the signal, and the like.
  • the information conveyed may be an alert, an indication of an incoming call, for entertainment, for communication, an indication associated with a eyepiece application, to indicate the proximity of the user to the eyepiece, to provide haptic feedback to the user from the eyepiece, and the like.
  • Different commands may induce different stimulus effects to the patterned magnetic material for different commands or indicators.
  • the different stimulus effects may be implemented with different frequencies and/or sequence patterns for incoming calls from different people in a user's contact list, different intensities for different alert levels, interesting patterns for purposes of entertainment, and the like.
  • the haptic communication interface may include coils that transmit and/or receive oscillating magnetic signals.
  • the magnetic material may be a ferromagnetic material, a paramagnetic material, and the like, and may be applied as a power, ink, a tattoo, a decal, tape, a rub-on, sprayed-on, and the like.
  • the magnetic material may have the ability to be demagnetized when the user is not using the eyepiece, un-magnetized when the magnetic material is not in the presence of the magnetic field from the eyepiece, and the like.
  • the applied magnetic material may be applied in a spatial pattern that is functional, such as to respond to specific communication signal modulations, have a specific impedance, respond to specific frequencies, and the like.
  • the applied magnetic material may be a visible image, invisible image, tattoo, marking, label, symbol, and the like.
  • the applied magnetic material may include a pattern that utilizes the incoming magnetic signal to generate a transmitted signal back to the eyepiece haptic communication interface, such as with an identifier for the user, as a signal to indicate proximity between the eyepiece and the magnetic material, and the like.
  • an identifier could be a user ID that is compared to a stored ID on the eyepiece to confirm that the user is an authorized user of the eyepiece.
  • the magnetic material may only be able to generate a transmitted signal back to the eyepiece if the magnetic material is close to the eyepiece.
  • the user may have the magnetic material applied to a fingernail, and the user may provide a command indicator to the eyepiece by bringing their finger close to a user tactile interface.
  • the wearer may have an interface mounted in a ring as shown in Fig. 15, a hand piece, and the like, where the interface may have at least one of a plurality of command interface types, such as a tactile interface, a position sensor device, and the like with wireless command connection to the eyepiece.
  • the ring 1500 may have controls that mirror a computer mouse, such as buttons 1504 (e.g. functioning as a one-button, multi -button, and like mouse functions), a 2D position control 1502, scroll wheel, and the like.
  • the buttons 1504 and 2D position control 1502 may be as shown in Fig. 15, where the buttons are on the side facing the thumb and the 2D position controller is on the top.
  • buttons and 2D position control may be in other configurations, such as all facing the thumb side, all on the top surface, or any other combination.
  • the 2D position control 1502 may be a 2D button position controller (e.g. such as the TrackPoint pointing device embedded in some laptop keyboards to control the position of the mouse), a pointing stick, joystick, an optical track pad, an opto touch wheel, a touch screen, touch pad, track pad, scrolling track pad, trackball, any other position or pointing controller, and the like.
  • control signals from the tactile interface may be provided with a wired or wireless interface to the eyepiece, where the user is able to conveniently supply control inputs, such as with their hand, thumb, finger, and the like.
  • the ring may be able to expand to fit any finger, or contract for a better fit.
  • the ring may have a customizable strap or a spring-mounted hinge.
  • the user may be able to articulate the controls with their thumb, where the ring is worn on the user's index finger.
  • a method or system may provide an interactive head-mounted eyepiece worn by a user, wherein the eyepiece includes an optical assembly through which the user views a surrounding environment and displayed content, a processor for handling content for display to the user, and an integrated projector facility for projecting the content to the optical assembly, and a control device worn on the body of the user, such as a hand of the user, including at least one control component actuated by the user, and providing a control command from the actuation of the at least one control component to the processor as a command instruction.
  • the command instruction may be directed to the manipulation of content for display to the user.
  • the control device may be worn on a first digit of the hand of the user, and the at least one control component may be actuated by a second digit of a hand of the user.
  • the first digit may be the index finger, the second digit the thumb, and the first and second digit on the same hand of the user.
  • the control device may have at least one control component mounted on the index finger side facing the thumb.
  • the at least one control component may be a button.
  • the at least one control component may be a 2D position controller.
  • the control device may have at least one button actuated control component mounted on the index finger side facing the thumb, and a 2D position controller actuated control component mounted on the top facing side of the index finger.
  • the control components may be mounted on at least two digits of the user's hand.
  • the control device may be worn as a glove on the hand of the user.
  • the control device may be worn on the wrist of the user.
  • the at least one control component may be worn on at least one digit of the hand, and a transmission facility may be worn separately on the hand.
  • the transmission facility may be worn on the wrist.
  • the transmission facility may be worn on the back of the hand.
  • the control component may be at least one of a plurality of buttons.
  • the at least one button may provide a function substantially similar to a conventional computer mouse button. Two of the plurality of buttons may function substantially similar to primary buttons of a conventional two-button computer mouse.
  • the control component may be a scrolling wheel.
  • the control component may be a 2D position control component.
  • the 2D position control component may be a button position controller, pointing stick, joystick, optical track pad, opto-touch wheel, touch screen, touch pad, track pad, scrolling track pad, trackball, capacitive touch screen, and the like.
  • the 2D position control component may be controlled with the user's thumb.
  • the control component may be a touch-screen capable of implementing touch controls including button-like functions and 2D manipulation functions.
  • the control component may be actuated when the user puts on the projected processor content pointing and control device.
  • the ring controller may be powered by an on-board battery that may be disposable, rechargeable, solar, and the like.
  • the wearer may have an interface mounted in a ring 1500AA that includes a camera 1502AA, such as shown in Fig. 15AA.
  • the ring controller 1502AA may have control interface types as described herein, such as through buttons 1504, 2D position control 1502, 3D position control (e.g. utilizing accelerometers, gyros), and the like.
  • the ring controller 1500AA may then be used to control functions within the eyepiece, such as controlling the manipulation of the projected display content to the wearer.
  • the control interfaces 1502, 1504 may provide control aspects to the embedded camera 1502AA, such as on/off, zoom, pan, focus, recording a still image picture, recording a video, and the like.
  • the functions may be controlled through other control aspects of the eyepiece, such as through voice control, other tactile control interfaces, eye gaze detection as described herein, and the like.
  • the camera may also have automatic control functions enabled, such as auto-focus, timed functions, face detection and/or tracking, auto-zoom, and the like.
  • the ring controller 1500AA with integrated camera 1502AA may be used to view the wearer 1508AA during a videoconference enabled through the eyepiece, where the wearer 1508AA may hold the ring controller (e.g. as mounted on their finger) out in order to allow the camera 1502AA a view of their face for transmission to at least one other participant on the videoconference.
  • the wearer may take the ring controller 1500AA off and place it down on a surface 1510AA (e.g. a table top) such that the camera 1502AA has a view of the wearer.
  • An image of the wearer 1512AA may then be displayed on the display area 1518 AA of the eyepiece and transmitted to others on the videoconference, such as along with the images 1514AA of other participants on the videoconference call.
  • the camera 1502AA may provide for manual or automatic FOV 1504AA adjustment.
  • the wearer may set the ring controller 1500AA down on a surface 1510AA for use in a video conference call, and the FOV 1504AA may be controlled either manually (e.g.
  • the FOV 1504AA may be enabled to change as the wearer moves, such as by tracking by face recognition.
  • the FOV 1504AA may also zoomed in/out to adjust to changes in the position of the wearer's face.
  • the camera 1502AA may be used for a plurality of still and/or video applications, where the view of the camera is provided to the wearer on the display area 1518AA of the eyepiece, and where storage may be available in the eyepiece for storing the images / videos, which may be transferred, communicated, and the like, from the eyepiece to some external storage facility, user, web-application, and the like.
  • a camera may be incorporated in a plurality of different mobile devices, such as worn on the arm, hand, wrist, finger, and the like, such as the watch 3202 with embedded camera 3200 as shown in Figs. 32-33.
  • any of these mobile devices may include manual and/or automatic functions as described for the ring controller 1502AA.
  • the ring controller 1502AA may have additional sensors, embedded functions, control features, and the like, such as a fingerprint scanner, tactile feedback, and LCD screen, an accelerometer, Bluetooth, and the like.
  • the ring controller may provide for synchronized monitoring between the eyepiece and other control components, such as described herein.
  • the eyepiece may provide a system and method for providing an image of the wearer to videoconference participants through the use of an external mirror, where the wearer views themselves in the mirror and an image of themselves is captured through an integrated camera of the eyepiece.
  • the captured image may be used directly, or the image may be flipped to correct for the image reversal of the mirror.
  • the wearer may enter into a videoconference with a plurality of other people, where the wearer may be able to view live video images of the others though the eyepiece.
  • the user may be able to view themselves in the mirror, have the image captured by the integrated camera, and provide the other people with an image of themselves for purposes of the videoconference.
  • This image may also be available to the wearer as a projected image to the eyepiece, such as in addition to the images of the other people involved in the videoconference.
  • a control component may provide a surface-sensing component in the control device for detecting motion across a surface may also be provided.
  • the surface sensing component may be disposed on the palmar side of the user's hand.
  • the surface may be at least one of a hard surface, a soft surface, surface of the user's skin, surface of the user's clothing, and the like.
  • Providing control commands may be transmitted wirelessly, through a wired connection, and the like.
  • the control device may control a pointing function associated with the displayed processor content.
  • the pointing function may be control of a cursor position; selection of displayed content, selecting and moving displayed content; control of zoom, pan, field of view, size, position of displayed content; and the like.
  • the control device may control a pointing function associated with the viewed surrounding environment.
  • the pointing function may be placing a cursor on a viewed object in the surrounding environment.
  • the viewed object's location position may be determined by the processor in association with a camera integrated with the eyepiece.
  • the viewed object's identification may be determined by the processor in association with a camera integrated with the eyepiece.
  • the control device may control a function of the eyepiece.
  • the function may be associated with the displayed content.
  • the function may be a mode control of the eyepiece.
  • the control device may be foldable for ease of storage when not worn by the user.
  • the control device may be used with external devices, such as to control the external device in association with the eyepiece. External devices may be entertainment equipment, audio equipment, portable electronic devices, navigation devices, weapons, automotive controls, and the like.
  • a body worn control device may provide 3D position sensor information to the eyepiece.
  • the control device may act as an 'air mouse', where 3D position sensors (e.g. accelerometers, gyros, and the like) provide position information when a user commands so, such as with the click of a button, a voice command, a visually detected gesture, and the like.
  • 3D position sensors e.g. accelerometers, gyros, and the like
  • the user may be able to use this feature to navigate either a 2D or 3D image being projected to the user via the eyepiece projection system.
  • the eyepiece may provide an external relay of the image for display or projection to others, such as in the case of a presentation.
  • the user may be able to change the mode of the control device between 2D and 3D, in order to accommodate different functions, applications, user interfaces, and the like.
  • multiple 3D control devices may be utilized for certain applications, such as in simulation applications.
  • a system may comprise an interactive head-mounted eyepiece worn by a user, wherein the eyepiece includes an optical assembly through which the user views a surrounding environment and displayed content, wherein the optical assembly comprises a corrective element that corrects the user's view of the surrounding environment, an integrated processor for handling content for display to the user, and an integrated image source for introducing the content to the optical assembly; and a tactile control interface mounted on the eyepiece that accepts control inputs from the user through at least one of a user touching the interface and the user being proximate to the interface.
  • control of the eyepiece, and especially control of a cursor associated with displayed content to the user may be enabled through hand control, such as with a worn device 1500 as in Fig. 15, as a virtual computer mouse 1500A as in Fig. 15A, and the like.
  • the worn device 1500 may transmit commands through physical interfaces (e.g. a button 1502, scroll wheel 1504), and the virtual computer mouse 1500A may be able interpret commands though detecting motion and actions of the user's thumb, fist, hand, and the like.
  • a physical mouse is a pointing device that functions by detecting two-dimensional motion relative to its supporting surface.
  • a physical mouse traditionally consists of an object held under one of the user's hands, with one or more buttons.
  • a virtual mouse may involve one or more sensors attached to the user's hand, such as on the thumb 1502A, finger 1504A, palm 1508A, wrist 1510A, and the like, where the eyepiece receives signals from the sensors and translates the received signals into motion of a cursor on the eyepiece display to the user.
  • the signals may be received through an exterior interface, such as the tactile interface 1402, through a receiver on the interior of the eyepiece, at a secondary communications interface, on an associated physical mouse or worn interface, and the like.
  • the virtual mouse may also include actuators or other output type elements attached to the user's hand, such as for haptic feedback to the user through vibration, force, pressure, electrical impulse, temperature, and the like. Sensors and actuators may be attached to the user's hand by way of a wrap, ring, pad, glove, and the like.
  • the eyepiece virtual mouse may allow the user to translate motions of the hand into motion of the cursor on the eyepiece display, where 'motions' may include slow movements, rapid motions, jerky motions, position, change in position, and the like, and may allow users to work in three dimensions, without the need for a physical surface, and including some or all of the six degrees of freedom.
  • the 'virtual mouse' may be associated with multiple portions of the hand, the virtual mouse may be implemented as multiple 'virtual mouse' controllers, or as a distributed controller across multiple control members of the hand.
  • the eyepiece may provide for the use of a plurality of virtual mice, such as for one on each of the user's hands, one or more of the user's feet, and the like.
  • the eyepiece virtual mouse may need no physical surface to operate, and detect motion such as through sensors, such as one of a plurality of accelerometer types (e.g. tuning fork, piezoelectric, shear mode, strain mode, capacitive, thermal, resistive, electromechanical, resonant, magnetic, optical, acoustic, laser, three dimensional, and the like), and through the output signals of the sensor(s) determine the translational and angular displacement of the hand, or some portion of the hand.
  • accelerometers may produce output signals of magnitudes proportional to the translational acceleration of the hand in the three directions. Pairs of accelerometers may be configured to detect rotational accelerations of the hand or portions of the hand.
  • Translational velocity and displacement of the hand or portions of the hand may be determined by integrating the accelerometer output signals and the rotational velocity and displacement of the hand may be determined by integrating the difference between the output signals of the accelerometer pairs.
  • other sensors may be utilized, such as ultrasound sensors, imagers, IR/RF, magnetometer, gyro magnetometer, and the like.
  • accelerometers, or other sensors may be mounted on various portions of the hand, the eyepiece may be able to detect a plurality of movements of the hand, ranging from simple motions normally associated with computer mouse motion, to more highly complex motion, such as interpretation of complex hand motions in a simulation application.
  • the user may require only a small translational or rotational action to have these actions translated to motions associated with user intended actions on the eyepiece projection to the user.
  • the virtual mouse may have physical switches associated with it to control the device, such as an on/off switch mounted on the hand, the eyepiece, or other part of the body.
  • the virtual mouse may also have on/off control and the like through pre-defined motions or actions of the hand.
  • the operation of the virtual mouse may be enabled through a rapid back and forth motion of the hand.
  • the virtual mouse may be disabled through a motion of the hand past the eyepiece, such as in front of the eyepiece.
  • the virtual mouse for the eyepiece may provide for the interpretation of a plurality of motions to operations normally associated with physical mouse control, and as such, familiar to the user without training, such as single clicking with a finger, double clicking, triple clicking, right clicking, left clicking, click and drag, combination clicking, roller wheel motion, and the like.
  • the eyepiece may provide for gesture recognition, such as in interpreting hand gestures via mathematical algorithms.
  • gesture control recognition may be provided through technologies that utilize capacitive changes resulting from changes in the distance of a user's hand from a conductor element as part of the eyepiece's control system, and so would require no devices mounted on the user's hand.
  • the conductor may be mounted as part of the eyepiece, such as on the arm or other portion of the frame, or as some external interface mounted on the user's body or clothing.
  • the conductor may be an antenna, where the control system behaves in a similar fashion to the touch-less musical instrument known as the theremin.
  • the theremin uses the heterodyne principle to generate an audio signal, but in the case of the eyepiece, the signal may be used to generate a control input signal.
  • the control circuitry may include a number of radio frequency oscillators, such as where one oscillator operates at a fixed frequency and another controlled by the user's hand, where the distance from the hand varies the input at the control antenna.
  • the user's hand acts as a grounded plate (the user's body being the connection to ground) of a variable capacitor in an L-C (inductance-capacitance) circuit, which is part of the oscillator and determines its frequency.
  • the circuit may use a single oscillator, two pairs of heterodyne oscillators, and the like.
  • this type of control interface may be ideal for control inputs that vary across a range, such as a volume control, a zoom control, and the like. However, this type of control interface may also be used for more discrete control signals (e.g. on/off control) where a predetermined threshold determines the state change of the control input.
  • the eyepiece may interface with a physical remote control device, such as a wireless track pad mouse, hand held remote control, body mounted remote control, remote control mounted on the eyepiece, and the like.
  • the remote control device may be mounted on an external piece of equipment, such as for personal use, gaming, professional use, military use, and the like.
  • the remote control may be mounted on a weapon for a soldier, such as mounted on a pistol grip, on a muzzle shroud, on a fore grip, and the like, providing remote control to the soldier without the need to remove their hands from the weapon.
  • the remote control may be removably mounted to the eyepiece.
  • a remote control for the eyepiece may be activated and/or controlled through a proximity sensor.
  • a proximity sensor may be a sensor able to detect the presence of nearby objects without any physical contact.
  • a proximity sensor may emit an electromagnetic or electrostatic field, or a beam of electromagnetic radiation (infrared, for instance), and look for changes in the field or return signal.
  • the object being sensed is often referred to as the proximity sensor's target.
  • Different proximity sensor targets may demand different sensors. For example, a capacitive or photoelectric sensor might be suitable for a plastic target; an inductive proximity sensor requires a metal target.
  • proximity sensor technologies include capacitive displacement sensors, eddy-current, magnetic, photocell (reflective), laser, passive thermal infrared, passive optical, CCD, reflection of ionizing radiation, and the like.
  • the proximity sensor may be integral to any of the control embodiments described herein, including physical remote controls, virtual mouse, interfaces mounted on the eyepiece, controls mounted on an external piece of equipment (e.g. a game controller, a weapon), and the like.
  • sensors for measuring a user's body motion may be used to control the eyepiece, or as an external input, such as using an inertial measurement unit (IMU), a 3 -axis magnetometer, a 3 -axis gyro, a 3 -axis accelerometer, and the like.
  • IMU inertial measurement unit
  • sensors for measuring a user's body motion may be used to control the eyepiece, or as an external input, such as using an inertial measurement unit (IMU), a 3 -axis magnetometer, a 3 -axis gyro, a 3 -axis accelerometer, and the like.
  • IMU inertial measurement unit
  • 3 -axis magnetometer e.g., a 3 -axis magnetometer
  • 3 gyro e.gyro
  • 3 -axis accelerometer e.gyro accelerometer
  • sensors mounted on each leg and each arm of the user may provide signals to the eyepiece that allow the eyepiece to measure the gait of the user.
  • the gait of the user may then in turn be used to monitor the gait of the user over time, such as to monitor changes in physical behavior, improvement during physical therapy, changes due to a head trauma, and the like.
  • the eyepiece may initially determine a baseline gait profile for the user, and then monitor the user over time, such as before and after a physical event (e.g. a sports-related collision, an explosion, an vehicle accident, and the like).
  • a physical event e.g. a sports-related collision, an explosion, an vehicle accident, and the like
  • the eyepiece may be used periodically to measure the gait of the user, and maintain the measurements in a database for analysis.
  • a running gait time profile may be produced, such as to monitor the user's gait for indications of physical traumas, physical improvements, and the like.
  • control of the eyepiece may be enabled through the sensing of the motion of a facial feature, the tensing of a facial muscle, the clicking of the teeth, the motion of the jaw, and the like, of the user wearing the eyepiece through a facial actuation sensor 1502B.
  • the eyepiece may have a facial actuation sensor as an extension from the eyepiece earphone assembly 1504B, from the arm 1508B of the eyepiece, and the like, where the facial actuation sensor may sense a force, a vibration, and the like associated with the motion of a facial feature.
  • the facial actuation sensor may also be mounted separate from the eyepiece assembly, such as part of a standalone earpiece, where the sensor output of the earpiece and the facial actuation sensor may be either transferred to the eyepiece by either wired or wireless communication (e.g. Bluetooth or other communications protocol known to the art).
  • the facial actuation sensor may also be attached to around the ear, in the mouth, on the face, on the neck, and the like.
  • the facial actuation sensor may also be comprised of a plurality of sensors, such as to optimize the sensed motion of different facial or interior motions or actions. In embodiments, the facial actuation sensor may detect motions and interpret them as commands, or the raw signals may be sent to the eyepiece for interpretation.
  • Commands may be commands for the control of eyepiece functions, controls associated with a cursor or pointer as provided as part of the display of content to the user, and the like. For example, a user may click their teeth once or twice to indicate a single or double click, such as normally associated with the click of a computer mouse. In another example, the user may tense a facial muscle to indicate a command, such as a selection associated with the projected image.
  • the facial actuation sensor may utilize noise reduction processing to minimize the background motions of the face, the head, and the like, such as through adaptive signal processing technologies.
  • a voice activity sensor may also be utilized to reduce interference, such as from the user, from other individuals nearby, from surrounding environmental noise, and the like.
  • the facial actuation sensor may also improve communications and eliminate noise by detecting vibrations in the cheek of the user during speech, such as with multiple microphones to identify the background noise and eliminate it through noise cancellation, volume augmentation, and the like.
  • the user of the eyepiece may be able to obtain information on some environmental feature, location, object, and the like, viewed through the eyepiece by raising their hand into the field of view of the eyepiece and pointing at the object or position.
  • the pointing finger of the user may indicate an environmental feature, where the finger is not only in the view of the eyepiece but also in the view of an embedded camera. The system may now be able to correlate the position of the pointing finger with the location of the environmental feature as seen by the camera.
  • the eyepiece may have position and orientation sensors, such as GPS and a magnetometer, to allow the system to know the location and line of sight of the user. From this, the system may be able to extrapolate the position information of the environmental feature, such as to provide the location information to the user, to overlay the position of the environmental information onto a 2D or 3D map, to further associate the established position information to correlate that position information to secondary information about that location (e.g. address, names of individuals at the address, name of a business at that location, coordinates of the location), and the like.
  • position and orientation sensors such as GPS and a magnetometer
  • the system is able to determine the location of the house 1508C and provide location information 1514C and a 3D map superimposed onto the user's view of the environment.
  • the information associated with an environmental feature may be provided by an external facility, such as communicated with through a wireless communication connection, stored internal to the eyepiece, such as downloaded to the eyepiece for the current location, and the like.
  • information provided to the wearer of the eyepiece may include any of a plurality of information related to the scene as viewed by the wearer, such as geographic information, point of interest information, social networking information (e.g. Twitter, Facebook, and the like information related to a person standing in front of the wearer augmented around the person, such as 'floating' around the person), profile information (e.g. such as stored in the wearer's contact list), historical information, consumer information, product information, retail information, safety information, advertisements, commerce information, security information, game related information, humorous annotations, news related information, and the like.
  • social networking information e.g. Twitter, Facebook, and the like information related to a person standing in front of the wearer augmented around the person, such as 'floating' around the person
  • profile information e.g. such as stored in the wearer's contact list
  • historical information e.g. such as stored in the wearer's contact list
  • consumer information e.g., product information, retail information, safety information, advertisements, commerce information
  • the user may be able to control their view perspective relative to a 3D projected image, such as a 3D projected image associated with the external environment, a 3D projected image that has been stored and retrieved, a 3D displayed movie (such as downloaded for viewing), and the like.
  • a 3D projected image such as a 3D projected image associated with the external environment, a 3D projected image that has been stored and retrieved, a 3D displayed movie (such as downloaded for viewing), and the like.
  • the user may be able to change the view perspective of the 3D displayed image 1512C, such as by turning their head, and where the live external environment and the 3D displayed image stay together even as the user turns their head, moves their position, and the like.
  • the eyepiece may be able to provide an augmented reality by overlaying information onto the user's viewed external environment, such as the overlaid 3D displayed map 1512C, the location information 1514C, and the like, where the displayed map, information, and the like, may change as the user's view changes.
  • the perspective of the viewer may be changed to put the viewer 'into' the movie environment with some control of the viewing perspective, where the user may be able to move their head around and have the view change in correspondence to the changed head position, where the user may be able to 'walk into' the image when they physically walk forward, have the perspective change as the user moves the gazing view of their eyes, and the like.
  • additional image information may be provided, such as at the sides of the user's view that could be accessed by turning the head.
  • the user of one eyepiece may be able to synchronize their view of a projected image or video with at least the view of a second user of an eyepiece or other video display device.
  • two separate eyepiece users may wish to view the same 3D map, game projection, point-of-interest projection, video, and the like, where the two viewers are not only seeing the same projected content, but where the projected content's view is synchronized between them.
  • two users may want to jointly view a 3D map of a region, and the image is synchronized such that the one user may be able to point at a position on the 3D map that the other user is able to see and interact with.
  • the two users may be able to move around the 3D map and share a virtual-physical interaction between the two users and the 3D map, and the like. Further, a group of eyepiece wearers may be able to jointly interact with a projection as a group. In this way, two or more users may be able to have a unified augmented reality experience through the coordination-synchronization of their eyepieces. Synchronization of two or more eyepieces may be provided by communication of position information between the eyepieces, such as absolute position information, relative position information, translation and rotational position information, and the like, such as from position sensors as described herein (e.g. gyroscopes, IMU, GPS, and the like).
  • position information between the eyepieces such as absolute position information, relative position information, translation and rotational position information, and the like, such as from position sensors as described herein (e.g. gyroscopes, IMU, GPS, and the like).
  • Communications between the eyepieces may be direct, through an Internet network, through the cell-network, through a satellite network, and the like.
  • Processing of position information contributing to the synchronization may be executed in a master processor in a single eyepiece, collectively amongst a group of eyepieces, in remote server system, and the like, or any combination thereof.
  • the coordinated, synchronized view of projected content between multiple eyepieces may provide an extended augmented reality experience from the individual to a plurality of individuals, where the plurality of individuals benefit from the group augmented reality experience.
  • a group of concertgoers may synchronize their eyepieces with a feed from the concert producers such that visual effects or audio may be pushed to people with eyepieces by the concert producer, performers, other audience members, and the like.
  • the performer may have a master eyepiece and may control sending content to audience members.
  • the content may be the performer's view of the surrounding environment.
  • the performer may be using the master eyepiece for applications as well, such as controlling an external lighting system, interacting with an augmented reality drum kit or sampling board, calling up song lyrics, and the like.
  • the image or video displayed on the eyepiece can be synchronized with images or video displayed on or captured by a connected device that has a communication link to the eyepiece or directly from the feed of a remote camera.
  • the feed could be selected or another action could be initiated by a sensor input or control signal received from one of the connected devices, metadata sent by one of the other connected devices, or the like.
  • Other video display devices may be other eyepieces, desktop computers, laptop computers, smartphones, tablet computers, televisions, or the like.
  • the eyepieces, devices, and remote cameras could be connected by wide area, local area, metropolitan area, personal area, and cloud network communication links.
  • the sensor input could be an audio sensor input, video sensor input, or the like.
  • actions that could be initiated by receipt of the sensor input or control signal could include the initiating of an action such as tracking a target, sending a message, or initiating video synchronization as described elsewhere in this disclosure, and the like.
  • the video captured by the eyepiece of a guard at a remote checkpoint or screening location could automatically be selected for display on the eyepiece of a supervisor, when a facial recognition application recognizes a person of interest in the video feed from the guard's eyepiece.
  • the eyepiece may utilize sound projection techniques to realize a direction of sound for the wearer of the eyepiece, such as with surround sound techniques.
  • Realization of a direction of sound for a wearer may include the reproduction of the sound from the direction of origin, either in real-time or as a playback. It may include a visual or audible indicator to provide a direction for the source of sound.
  • Sound projection techniques may be useful to an individual that has their hearing impaired or blocked, such as due to the user experiencing hearing loss, a user wearing headphones, a user wearing hearing protection, and the like.
  • the eyepiece may provide enhanced 3D audible reproduction.
  • the wearer may have headphones on, and a gunshot has been fired.
  • the eyepiece may be able to reproduce the 3D sound profile for the sound of the gunshot, thus allowing the wearer to respond to the gunshot knowing where the sound came from.
  • a wearer with headphones, hearing loss, in a loud environment, and the like may not otherwise be able to tell what's being said and/or the direction of the person speaking, but is provided with a 3D sound enhancement from the eyepiece (e.g. the wearer is listening to other proximate individuals through headphones and so does not have directionality information).
  • a wearer may be in a loud ambient environment, or in an environment where periodic loud noises can occur.
  • the eyepiece may have the ability to cut off the loud sound to protect the wearer's hearing, or the sound could be so loud that the wearer can't tell where the sound came from, and further, now their ears could be ringing so loud they can't hear anything.
  • the eyepiece may provide visible, auditory, vibration, and the like queues to the wearer to indicate the direction of the sound source.
  • the eyepiece may provide "augmented" hearing where the wearer's ears are plugged to protect their ears from loud noises, but using the ear buds to generate a reproduction of sound to replace what's missing from the natural world. This artificial sound may then be used to give directionality to wirelessly transmitted communication that the operator could't hear naturally.
  • an example of a configuration for establishing directionality of a source sound may be point different microphones in different directions.
  • at least one microphone may be used for the voice of the wearer, at least one microphone for the surrounding environment, at least one pointing down at the ground, and potentially in a plurality of different discrete directions.
  • the microphone pointing down may be subtracted to isolate other sounds, which may be combined with 3D sound surround, and augmented hearing techniques, as described herein.
  • a sound augmented system as part of the eyepiece, there are a number of users with eyepieces, such as in a noisy environment where all the users have 'plugged ears' as implemented through artificial noise blockage through the eyepiece ear buds.
  • One of wearers may yell out that they need some piece of equipment. Because of all the ambient noise and the hearing protection the eyepiece creates, no one can hear the request for equipment.
  • the wearer making the verbal request has a filtered microphone close to their mouth, and they could wirelessly transmit the request to the others, where their eyepiece could relay a sound signal to the other user's eyepieces, and to the ear on the correct side, and the others would know to look to the right or left to see who has made the request.
  • This system could be further enhanced with geo-locations of all the wearers, and a "virtual" surround sound system that uses the two ear buds to give the perception of 3D space (such as the S S True Surround Technology).
  • auditory queues could also be computer generated so the communicating user doesn't need to verbalize their communication but can select it from a list of common commands, the computer generates the communication based on preconfigured conditions, and the like.
  • the wearers may be in a situation where they don't want a display in front of their eyes but want to have ear buds in their ears. In this case, if they wanted to notify someone in a group to get up and follow them, they could just click a controller a certain number of times, or provide a visual hand gesturer with a camera, an IMU, and the like.
  • the system may choose the 'follow me' command and transmit it to the other users with the communicating user's location for the 3D system to trick them into hearing from where they are actually sitting out of sight of them.
  • directional information may be determined and/or provided through position information from the users of eyepieces.
  • the eyepiece may include facilities for providing a vibration sensation to the user, such as through vibration actuators in the frame or arms of the eyepiece structure, such as through mechanical vibration motors, piezoelectric vibration actuator, ultrasonic vibration actuator, and the like.
  • the vibration may be provided to indicate a message indication to the user, as an indicator to a user that is sight-impaired (e.g. because of darkness, smoke, clouds, blindness), as part of a game, part of a simulation, and the like.
  • Vibration actuators may be used separately or in conjunction with speakers in side-arms of the eyepiece to help create a 3D visual-sound- vibration virtual reality environment, such as for games, simulations, and the like.
  • vibration actuators may be mounted in each side arm of the eyepiece such that when an application presents a projectile flying past the user's left side of their head, the left side vibration actuator is set to vibrate in such a way as to simulate the sensation of the projectile actually flying past the user.
  • the speaker on that side arm may synchronously apply a sound that mimics the sound the projectile would make as it flies past the user's head.
  • Vibration and/or speakers may be mounted on the eyepiece in such a way as to provide a 3D vibrational-audio experience to the user to augment the visual experience provided through the visually displayed content, such as in 3D visually displayed content. In this way, the user may be enveloped in a multi-sensory virtual 3D environment.
  • the present disclosure may comprise an interactive head-mounted eyepiece worn by a user, wherein the eyepiece comprises an optical assembly through which the user views a surrounding environment and displayed content, an integrated image source adapted to introduce the content to the optical assembly, and an processing facility adapted to manage the functionality of the eyepiece, wherein the head-mounted eyepiece has a structure comprising a frame through which the user views the surrounding environment and a left and right side arm for supporting the frame on the head of the user, and a vibration actuator in each of the left and right side arm, each vibration actuator independently responsive to vibration commands from the processing facility.
  • the vibration command may initiate a vibration in one of the vibration actuators in response to a virtual projectile as part of the displayed content, a virtual explosion, a message indication, a visual cue, a warning, and the like.
  • the displayed content may be provided as part of the user playing a simulation, a game application, a utility application, and the like.
  • the application calling the vibration command may be running locally on the eyepiece, in part or in whole through an external platform where the eyepiece has a communicative interconnection with the external platform, and the like.
  • the eyepiece may include an integrated speaker as described herein, such as in each of the left and right side arm, where the vibration command initiates a vibration in one of the vibration actuators in time synchronization with an auditory command to initiate a sound in the speaker on the same side arm as receiving the vibration command.
  • the eyepiece may provide aspects of signals intelligence (SIGINT), such as in the use of existing WiFi, 3G, Bluetooth, and the like communications signals to gather signals intelligence for devices and users in proximity to the wearer of the eyepiece.
  • SIGINT signals intelligence
  • These signals may be from other eyepieces, such as to gather information about other known friendly users; other eyepieces that have been picked up by an unauthorized individual, such as through a signal that is generated when an unauthorized user tries to use the eyepiece; other communications devices (e.g. radios, cell phones, pagers, walky-talkies, and the like); electronic signals emanating from devices that may not be directly used for communications; and the like.
  • Information gathered by the eyepiece may be direction information, position information, motion information, number of and/or rate of communications, and the like. Further, information may be gathered through the coordinated operations of multiple eyepieces, such as in the triangulation of a signal for determination of the signal's location.
  • the user of the eyepiece 1502D may be able to use multiple hand/finger points from their hand 1504D to define the field of view (FOV) 1508D of the camera 1510D relative to the see-thru view, such as for augmented reality applications.
  • FOV field of view
  • the user is utilizing their first finger and thumb to adjust the FOV 1508D of the camera 1510D of the eyepiece 1502D.
  • the user may utilize other combinations to adjust the FOV 1508D, such as with combinations of fingers, fingers and thumb, combinations of fingers and thumbs from both hands, use of the palm(s), cupped hand(s), and the like.
  • the use of multiple hand/finger points may enable the user to alter the FOV 1508 of the camera 1510D in much the same way as users of touch screens, where different points of the hand/ finger establish points of the FOV to establish the desired view. In this instance however, there is no physical contact made between the user's hand(s) and the eyepiece.
  • the camera may be commanded to associate portions of the user's hand(s) to the establishing or changing of the FOV of the camera.
  • the command may be any command type described herein, including and not limited to hand motions in the FOV of the camera, commands associated with physical interfaces on the eyepiece, commands associated with sensed motions near the eyepiece, commands received from a command interface on some portion of the user, and the like.
  • the eyepiece may be able to recognize the finger/hand motions as the command, such as in some repetitive motion.
  • the user may also utilize this technique to adjust some portion of the projected image, where the eyepiece relates the viewed image by the camera to some aspect of the projected image, such as the hand/finger points in view to the projected image of the user.
  • the user may be simultaneously viewing the external environment and a projected image, and the user utilizes this technique to change the projected viewing area, region, magnification, and the like.
  • the user may perform a change of FOV for a plurality of reasons, including zooming in or out from a viewed scene in the live environment, zoom in or out from a viewed portion of the projected image, to change the viewing area allocated to the projected image, to change the perspective view of the environment or projected image, and the like.
  • the eyepiece may enable simultaneous FOVs.
  • simultaneous wide, medium, and narrow camera FOVs may be used, where the user can have different FOVs up simultaneously in view (i.e. wide to show the entire field, perhaps static, and narrow to focus on a particular target, perhaps moving with the eye or with a cursor).
  • the eyepiece may be able to determine where the user is gazing, or the motion of the user's eye, by tracking the eye through reflected light off the user's eye. This information may then be used to help correlate the user's line of sight with respect to the projected image, a camera view, the external environment, and the like, and used in control techniques as described herein. For instance, the user may gaze at a location on the projected image and make a selection, such as with an external remote control or with some detected eye movement (e.g. blinking). In an example of this technique, and referring to Fig.
  • transmitted light 1508E such as infrared light
  • the optical display 502 e.g. with a camera or other optical sensor
  • the information may then be analyzed to extract eye rotation from changes in reflections.
  • an eye tracking facility may use the corneal reflection and the center of the pupil as features to track over time; use reflections from the front of the cornea and the back of the lens as features to track; image features from inside the eye, such as the retinal blood vessels, and follow these features as the eye rotates; and the like.
  • the eyepiece may use other techniques to track the motions of the eye, such as with components surrounding the eye, mounted in contact lenses on the eye, and the like.
  • a special contact lens may be provided to the user with an embedded optical component, such as a mirror, magnetic field sensor, and the like, for measuring the motion of the eye.
  • electric potentials may be measured and monitored with electrodes placed around the eyes, utilizing the steady electric potential field from the eye as a dipole, such as with its positive pole at the cornea and its negative pole at the retina.
  • the electric signal may be derived using contact electrodes placed on the skin around the eye, on the frame of the eyepiece, and the like. If the eye moves from the centre position towards the periphery, the retina approaches one electrode while the cornea approaches the opposing one. This change in the orientation of the dipole and consequently the electric potential field results in a change in the measured signal. By analyzing these changes eye movement may be tracked.
  • eye gaze direction of the user and associated control involves placement (by the eyepiece) and optional selection (by the user) of a visual indicator in the user's peripheral vision, such as in order to reduce clutter in the narrow portion of the user's visual field around the gaze direction where the eye's highest visual input resides.
  • the eyepiece may provide projected visual indicators in the periphery of vision as cues to the user. This way the brain may only have to process the detection of the indicator, and not the information associated with the indicator, thus decrease the potential for overloading the user with information.
  • the indicator may be an icon, a picture, a color, symbol, a blinking object, and the like, and indicate an alert, an email arriving, an incoming phone call, a calendar event, an internal or external processing facility that requires attention from the user, and the like.
  • the visual indicator in the periphery, the user may become aware of it without being distracted by it. The user may then optionally decide to elevate the content associated with the visual cue in order to see more information, such as gazing over to the visual indicator, and by doing so, opening up its content.
  • an icon representing an incoming email may indicate an email being received. The user may notice the icon, and choose to ignore it (such as the icon disappearing after a period of time if not activated, such as by a gaze or some other control facility).
  • the user may notice the visual indicator and choose to 'active' it by gazing in the direction of the visual indicator.
  • the eyepiece may open up the email and reveal its content. In this way the user maintains control over what information is being paid attention to, and as a result, minimize distractions and maximize content usage efficiency.
  • feedback between the two or more displays may ensure that the displays have the same brightness and contrast.
  • cameras in each display may be employed.
  • the current to the LEDs may be controlled and color balance may be obtained, such as by selecting LED's of similar quality, output, and or color (e.g. from similar bins), right and left pulse width modulation (PWM) values may be provided, and periodic calibration may be carried out.
  • PWM pulse width modulation
  • calibration of the power spectrum may be achieved. If the display is turned down because of high outside brightness, the user may know the calibration for each display.
  • equal brightness, color saturation, color balance, hue and the like between the two displays may be created. This may prevent the user's brain from ignoring one display.
  • a feedback system from the displays may be created that allows the user or another to regulate brightness and the like such that each display has a constant and or consistent brightness, color saturation, balance, hue and the like.
  • there may be a brightness sensor on each display that may be color, RGB, white sensor, sensor for overall light, and the like.
  • the sensor may be a power sensor that monitors or checks the power delivered to or consumed by the LED. The user or another may regulate one or more displays by turning the power to the LED up or down. This may be done during manufacturing and or may be done during the life of the eyepiece and or periodically.
  • adjustments of brightness, color saturation, color balance, hue and the like may be performed by a user, manufacturer, and or automatically performed by the eyepiece based on feedback, various program algorithms, and the like.
  • sensor feedback may cause an automatic and or manual adjustment in at least one of brightness, color saturation, color balance, hue and the like.
  • a system may comprise an interactive head-mounted eyepiece worn by a user, wherein the eyepiece includes an optical assembly through which the user views a surrounding environment and displayed content, and an integrated image source for introducing the content to the optical assembly wherein the optical assembly comprises two or more displays, and wherein at least one of brightness, color saturation, color balance, and hue is regulated for at least one of the displays such that at least one of brightness, color saturation, color balance, and hue of the two or more displays is balanced relative to one another within a predetermined range.
  • the regulation may comprise making at least one of brightness, color saturation, color balance, hue, and the like of the two or more displays relative to one another within a predetermined range.
  • an adjustment of at least one of brightness, color saturation, color balance, hue, and the like may be made based on the detection of power delivered to the integrated image source.
  • the adjustment may be based on a power algorithm so that at least on of brightness, color saturation, color balance, hue, and the like is consistent between the two or more displays.
  • the adjustment may be based on a sensor of total optic sensor feedback.
  • at least one of brightness, color saturation, color balance, hue, and the like may be regulated at least one of during manufacturing, during a dynamic range of output produced by the integrated image source, and the like.
  • the system may be adapted to automatically check at least one of brightness, color saturation, color balance, hue, and the like of the two or more displays relative to one another periodically over the lifetime of the eyepiece. In embodiments, the system may be adapted to automatically check the at least one of brightness, color saturation, color balance, hue, and the like of the two more displays relative to one another and selectively set the at least one of brightness, color saturation, color balance, hue, and the like of the two more displays to a predetermined value.
  • an embodiment of the system may be adapted to automatically check the at least one of brightness, color saturation, color balance, hue, and the like of the two or more displays relative to one another and selectively set the at least one of brightness, color saturation, color balance, hue, and the like of the two more displays to a predetermined value based on sensor feedback measurements.
  • the contrast between the two or more displays may be adjusted to be equal, or equal as perceived by the user.
  • contrast may be checked on each display and adjusted accordingly and may be regulated during the manufacturing process to calibrate and adjust the displays, and it may be measured in the manufacturing process, over a dynamic range, during the life of the glasses and the like.
  • the contrast of the system may be automatically calibrated between the two displays as well as in comparison to the outside world.
  • the user may compensate for the differences between his eyes. The contrast may be adjusted as necessary to compensate for a sight and or perception deficit of the user.
  • the contrast ratio may be a function of how the optics module is assembled. Reducing stray light, as described herein, may address techniques for assembling to provide a high contrast ratio.
  • various types of single pixel brightness and or multi pixel color detectors may be inserted into the optical train to sample some or all of the light that is not making it all the way to the eye box of the display.
  • the system may be provided with real time feedback to compensate for assembly tolerances, LED and LCoS panel yield, binning tolerances, Hot and Cold panel compensation and or maintain individual user calibrations.
  • brightness and contrast of the displays may be managed through good manufacturing practices.
  • quality analysis may be done to test and, as necessary, calibrate the displays and compensate as necessary. Additionally, over the life of the system as components wear out, or the system heats and cools during use, one may modify calibration with a look up table for compensation values.
  • adjustments of brightness, color saturation, color balance, hue, contrast and the like may be performed by a user, manufacturer, and or automatically performed by the eyepiece based on feedback, various program algorithms, and the like.
  • sensor feedback may cause an automatic and or manual adjustment in at least one of brightness, color saturation, color balance, hue, contrast, and the like.
  • a system may comprise an interactive head-mounted eyepiece worn by a user, wherein the eyepiece includes an optical assembly through which the user views a surrounding environment and displayed content, and an integrated image source for introducing the content to the optical assembly wherein the optical assembly comprises two or more displays, and wherein the contrast is regulated for at least one of the displays such that the contrast of the two or more displays is balanced relative to one another within a predetermined range.
  • the contrast may be regulated such that it is equal between the two or more displays.
  • contrast may be regulated during the manufacturing process, during a dynamic range of output produced by the integrated image source, and the like.
  • the system may be adapted to automatically check the contrast of the two or more displays relative to one another periodically over the lifetime of the eyepiece. In embodiments, the system may be adapted to automatically check the contrast of the two or more displays relative to one another and selectively set the contrast of the two or more displays to a predetermined value. In embodiments, the system may be adapted to automatically check the contrast of the two or more displays relative to one another and selectively set the contrast of the two or more displays to a predetermined value based on sensor feedback measurements. In embodiments, the contrast may be regulated to compensate for a deficit of the user. In embodiments, the contrast may be regulated as a function of at least one of stray light and light produced by the integrated image source.
  • the contrast may be regulated based on feedback from detectors in the optical path of the system.
  • the detectors may comprise at least one of a single pixel brightness and multi pixel color detectors.
  • the system may be provided with real time feedback to compensate for at least one of assembly tolerances, LED, and LCoS panel yield, binning tolerances, Hot and cold panel compensation, and to maintain individual user calibrations.
  • the calibration of contrast may be regulated based off of a look up table for one or more compensation values.
  • certain optical configurations described herein such as the frontlight LCoS, enable insertion of a camera in many locations along the optical train to put the camera directly on axis with the eye.
  • a camera sensor may be placed adjacent to the LCoS, such as the camera 10232 in Fig. 102B. This in turn enables measurement of the location, diameter, velocity and direction of the pupil and imaging of the iris directly.
  • Such measurements and imaging may be used for secure login or loading user settings, detecting health conditions by measuring the size and/or thickness of capillaries, setting a placeholder/bookmark based on last gazed area in book, and the like.
  • Data collected by the camera about the various components of the eye can be used to control user interfaces, determine stress levels, monitor alertness, detect reactions to external or projected stimulus and the like. Since the frontlit optics are sharp and compact, a camera with extremely small pixels may be placed in the optical train retaining the small overall size of the optics and ensuring a high resolution image. In embodiments, the camera may be placed in many parts of the optical path by inserting a beam splitter as in Fig. 185 but it could also enable placement of the camera on the LCoS PCB, embedded directly into the LCoS silicone substrate, or other optical train placement.
  • the camera may be able to see or detect the eye or directly into the eye.
  • the system can track eye movement, detect pupil dilation, measure location, diameter, velocity and direction of the pupil and mage the iris directly.
  • the camera may determine if the user is looking around the environment or if the user is controlling the eyepiece. For example only, the camera may sense patterns of eye movement that cause it to send a signal to track eye movement such that it senses predetermined control commands that the user may perform with his eye. By way of example, the camera may recognize that the user's eyes are reading something on the user interface based on a pattern of the user's eye movement.
  • the camera initiate detection of a particular set of eye commands to transmit to the eye piece to carry out a particular function such as opening email and the like.
  • the camera may detect that a user may focus on an object in a predetermined manner to control the eyepiece, such as by focusing on an item for a prolonged period of time, focusing on an item, moving the eye quickly and then re- focusing on the item, and the like.
  • the camera may signal to the eye piece to perform a particular function. For example only, focusing, looking away and re-focusing may cause the camera to signal to the eye piece that the user intends to "double -click" on an item in the display.
  • any such patterns and or algorithms may be used for controlling the device via user's eye movement.
  • the camera may detect a particular pattern of movement and when such movement is detected when particular application is in use, the camera may send a particular signal to the eyepiece based on such combination.
  • the camera may signal to the eye piece to open a particular email on which the user's eyes are focused.
  • commands for controlling the eyepiece may be initiated based on the detection of the camera.
  • the camera's detection of location, diameter, velocity and direction of the pupil, imaging of the retina and or iris directly, and the like may allow for security measures.
  • the camera may perform a retina scan which identifies the user against a database either onboard the eyepiece or stored remotely therefrom.
  • the user may open up the applications, and provide access to the user. If their glasses do not recognize the user, they may lock or prevent all or partial functionality. I embodiments the user may not need such a password, and the eyepiece may perform this function automatically.
  • the camera may take identifying information about the wearer in the event the wearer has stolen the eyepiece.
  • the eyepiece may perform user diagnostics based on detection of eye movement, detection of location, diameter, velocity and direction of the pupil, imaging of the retina and or iris directly, and the like.
  • diagnostics may be based on pupil dilation. If, for instance, the user's pupil dilates in a manner consistent with one who is lying, the camera and or eyepiece may detect that the user is lying. Further, if the user has a concussion, the pupil may change size despite a given amount of light entering the eye. The eyepiece may alert the user if he has a concussion.
  • the eyepiece may be given to a soldier, athlete and the like as they exit physical activity and the eye piece may be used to diagnose the user as, for instance, having a concussion.
  • the eyepiece may have a database of users on board or separate from the eye piece that may have information stored as related to various users.
  • a player may wear the glasses to perform a retina scan to identify the user via a database and then diagnose or examine the user by detecting the user's pupil size and comparing to the size of a pupil expected for the given light conditions. If the user's data falls outside of the expected ranger, the glasses may tell the user that his pupils are consistent with having a concussion. Similar uses may be employed such as detecting possible drug intoxication, detecting retina damage, detecting eye conditions and the like.
  • organic light emitting diodes may be used in applications for microdisplays and/or sensors herein, and may be used with a Fraunhofer system, such as OLEDCam, or otherwise in the detection of eye movement or otherwise used with the eyepiece for illuminating the user's eye and the like.
  • the device for detecting eye movements may be placed along the optical train on axis with a user's.
  • microscale optical emitters and receivers may be integrated into the same chip. They may be implemented in an array type structure as a bidirectional or unidirectional microdisplay. In embodiments, the device may present and/or capture images at the same time.
  • the microdisplay may be the basis for a system for personalized information and present information to the user and recognize interaction by the user.
  • the user may perceive the environment as usual, and additional information may be presented via the eyepiece equipped with the bidirectional display.
  • the visual information may be adapted to the context of operation of the system and the user may interact by movements or actions of the eyes.
  • a CMOS-Chip may include a microdisplay and a camera on one substrate with a center element of the being a nested active matrix consisting of OLED pixels and photo diodes.
  • the pixel cell may consist of red-green-blue-white and red-green-blue-photodiode pixel cells, and the like.
  • a system may comprise an interactive head-mounted eyepiece worn by the user, wherein the eyepiece includes an optical assembly through which the user views a surrounding environment and displayed content, an integrated image source adapted to introduce the displayed content to the optical assembly, and a camera disposed in the optical assembly along an optical axis such that the camera may view at least a portion of an eye of the user.
  • the camera may be adapted to capture an image of the eye, pupil, retina, eyelid, and or eyelashes.
  • commands for controlling the eyepiece may be initiated based on at least on image captured by the camera.
  • a diagnosis of the user may be based on at least on image captured by the camera.
  • Identification of the user may also be based on at least one image captured by the camera.
  • the diagnosis may include a diagnosis of a concussion.
  • the identification of the user may be deployed as security aspect of the eyepiece.
  • the integrated image source may illuminate the eye during an image capture by the camera. Further, the light from the image source may be modulated during an image capture by the camera.
  • the camera may comprise one or more organic light emitting diodes (OLED).
  • OLED organic light emitting diodes
  • the user's eye, and or other parts listed herein including the iris, pupil, eyelid, eyelash, and the like may be illuminate by various lights, LEDs, OLEDs, and the like.
  • illumination of the user's eye may be used for imaging techniques, capturing data of the eye, identification and the like.
  • the system may comprise an interactive head-mounted eyepiece worn by a user, wherein the eyepiece includes an optical assembly though which the user views a surrounding environment and displayed content, and integrated image source adapted to introduce the displayed content to the optical assembly, and a device for detecting eye movements.
  • the device for detecting eye movements may comprise microscale optical emitters and receivers integrated into the same chip.
  • the device may comprise a CMOS-Chip including a microdisplay and a camera on one substrate.
  • the device for detecting eye movements may be disposed along the optical train on axis with the user's eye.
  • a camera is disposed in the optical assembly along an optical axis such that the camera views at least a portion of an eye of the user and may image one or more of the eye, a pupil, a retina, an eyelid and eyelashes.
  • the integrated processor and the camera are adapted to track eye movements of the user; measure at least one of pupil dilation, pupil location, pupil diameter, pupil velocity and pupil direction; distinguish user eye movements intended as control or commands from user eye movements for reading or gazing; use eye movements of the user as commands for the processor for controlling a function of the integrated processor or the interactive head-mounted eyepiece; and use eye movements of the user as commands to control a device external to the user and external to the interactive head-mounted eyepiece.
  • a diagnosis or an identification of the user may be based on at least one image captured by the camera, such as concussion. Identification of the user may be deployed as a security aspect of the eyepiece.
  • the system may include a user input interface to control or signal an external device based on eye movements from the user.
  • the camera may be adapted to capture an image of both eyes, and wherein the images are compared to a database comprising other images of both eyes to indicate a diagnosis.
  • the optical axis of the integrated image source and the optical axis of the camera may be different. At least a portion of the optical axis of the integrated image source and the optical axis of the camera may be the same.
  • a device such as a camera, microscale optical emitters and receivers integrated into the same chip, or CMOS-Chip including a microdisplay and a camera on one substrate, in an augmented reality eyepiece may detect eye movements of the user.
  • An integrated image source may be adapted to at least one of modulate light from an image source and illuminate the eye, during an image capture by the camera.
  • the camera may include one or more organic light emitting diodes (OLED).
  • OLED organic light emitting diodes
  • the device for detecting eye movements may be along the optical train on axis with the user's eye or on a different axis from the user's eye.
  • An integrated processor may be adapted to interpret eye movements of the user as commands for operating a device within the interactive head-mounted eyepiece or an external device.
  • a method of detecting eye movements of a user may include wearing a head-mounted eyepiece, the head-mounted eyepiece including an optical assembly through which the user views a surrounding environment and displayed content, an integrated processor and an integrated image source adapted to introduce the displayed content to the optical assembly, and a camera, detecting eye movements of the user with the camera and the integrated processor, and controlling a device through the eye movements and the integrated processor, wherein the camera detects movements of at least one eye of the user and interprets the movements as commands.
  • the integrated processor may distinguish between eye movements as commands and eye movements intended for gazing.
  • the method may include interpreting predetermined eye movements as a command to perform a particular function.
  • the method may include scanning at least one eye of the user to determine an identification of the user.
  • the method may include scanning at least one eye of the user to diagnose a medical condition of the user.
  • the camera may include at least one organic light emitting diode (OLED).
  • Specific eye movements may be interpreted as specific commands. Eye movements may be selected from the group consisting of blinking, repetitive blinking, blink count, blink rate, eye open-closed (slow blink), gaze tracking, eye movements to the side, up and down, side to side, through a sequence of positions, to a specific position, dwell time in a position, gazing toward a fixed object, and gaze through a certain portion of a lens of the head mounted eyepiece.
  • the method may include controlling the device through eye movements and a user input interface.
  • the method may include capturing a view of the surrounding environment with the camera or a second camera for displaying to the user.
  • the eyepiece may utilize sub-conscious control aspects, such as images in the wearer's periphery, images presented to the user at rates below conscious perception, sub-conscious perceptions to a viewed scene by the viewer, and the like.
  • a wearer may be presented images through the eyepiece that are at a rate the wearer is unaware of, but is subconsciously made aware of as presented content, such as a reminder, an alert (e.g. an alert that calls on the wearer to increase a level of attention to something, but not so much so that the user needs a full conscious reminder), an indication related to the wearer's immediate environment (e.g.
  • the eyepiece has detected something in the wearer's field of view that may have some interest to the wearer, and to which the indication draws the wearer's attention), and the like.
  • the eyepiece may provide indicators to the wearer through a brain activity monitoring interface, where electrical signals within the brain fire before a person realizes they've recognized an image.
  • the brain activity-monitoring interface may include electroencephalogram (EEG) sensors (or the like) to monitor brain activity as the wearer is viewing the current environment.
  • EEG electroencephalogram
  • the eyepiece may provide conscious level feedback to the wearer to make the wearer more aware of the element.
  • a wearer may unconsciously become aware of seeing a familiar face in a crowd (e.g. a friend, a suspect, a celebrity), and the eyepiece provides a visual or audio indication to the wearer to bring the person more consciously to the attention of the wearer.
  • the wearer may view a product that arouses their attention at a subconscious level, and the eyepiece provides a conscious indication to the wearer, more information about the product, an enhanced view of the product, a link to more information about the product, and the like.
  • the ability for the eyepiece to extend the wearer's reality to a subconscious level may enable the eyepiece to provide the wearer with an augmented reality beyond their normal conscious experience with the world around them.
  • the eyepiece may have a plurality of modes of operation where control of the eyepiece is controlled at least in part by positions, shapes, motions of the hand, and the like.
  • the eyepiece may utilize hand recognition algorithms to detect the shape of the hand/fingers, and to then associate those hand configurations, possibly in combination with motions of the hand, as commands.
  • hand recognition algorithms to detect the shape of the hand/fingers, and to then associate those hand configurations, possibly in combination with motions of the hand, as commands.
  • these hand configurations may need to be reused depending upon the mode of operation of the eyepiece.
  • certain hand configurations or motions may be assigned for transitioning the eyepiece from one mode to the next, thereby allowing for the reuse of hand motions. For instance, and referring to Fig.
  • the user's hand 1504F may be moved in view of a camera on the eyepiece, and the movement may then be interpreted as a different command depending upon the mode, such as a circular motion 1508F, a motion across the field of view 1510F, a back and forth motion 1512F, and the like.
  • mode one for panning a view from the projected image
  • mode two for zooming the projected image.
  • the user may want to use a left-to-right finger-pointed hand motion to command a panning motion to the right.
  • the user may also want to use a left-to-right finger-pointed hand motion to command a zooming of the image to greater magnification.
  • the eyepiece may be configured to interpret the hand motion differently depending upon the mode the eyepiece is currently in, and where specific hand motions have been assigned for mode transitions. For instance, a clockwise rotational motion may indicate a transition from pan to zoom mode, and a counter-clockwise rotational motion may indicate a transition from zoom to pan mode.
  • a clockwise rotational motion may indicate a transition from pan to zoom mode
  • a counter-clockwise rotational motion may indicate a transition from zoom to pan mode.
  • a system may comprise an interactive head-mounted eyepiece worn by a user, wherein the eyepiece includes an optical assembly through which the user views a surrounding environment and displayed content, wherein the optical assembly comprises a corrective element that corrects the user's view of the surrounding environment, an integrated processor for handling content for display to the user, and an integrated image source for introducing the content to the optical assembly; and an integrated camera facility that images a gesture, wherein the integrated processor identifies and interprets the gesture as a command instruction.
  • the control instruction may provide manipulation of the content for display, a command communicated to an external device, and the like.
  • control of the eyepiece may be enabled through eye movement, an action of the eye, and the like.
  • eye movements or actions may be interpreted as command information, such as through blinking, repetitive blinking, blink count, blink rate, eye open-closed, gaze tracking, eye movements to the side, up and down, side to side, through a sequence of positions, to a specific position, dwell time in a position, gazing toward a fixed object (e.g. the corner of the lens of the eyepiece), through a certain portion of the lens, at a real-world object, and the like.
  • a fixed object e.g. the corner of the lens of the eyepiece
  • eye control may enable the viewer to focus on a certain point on the displayed image from the eyepiece, and because the camera may be able to correlate the viewing direction of the eye to a point on the display, the eyepiece may be able to interpret commands through a combination of where the wearer is looking and an action by the wearer (e.g. blinking, touching an interface device, movement of a position sense device, and the like). For example, the viewer may be able to look at an object on the display, and select that object through the motion of a finger enabled through a position sense device.
  • commands through a combination of where the wearer is looking and an action by the wearer (e.g. blinking, touching an interface device, movement of a position sense device, and the like).
  • the viewer may be able to look at an object on the display, and select that object through the motion of a finger enabled through a position sense device.
  • the glasses may be equipped with eye tracking devices for tracking movement of the user's eye, or preferably both eyes; alternatively, the glasses may be equipped with sensors for six- degree freedom of movement tracking, i.e., head movement tracking.
  • eye tracking devices for tracking movement of the user's eye, or preferably both eyes; alternatively, the glasses may be equipped with sensors for six- degree freedom of movement tracking, i.e., head movement tracking.
  • sensors for six- degree freedom of movement tracking, i.e., head movement tracking.
  • These devices or sensors are available, for example, from Chronos Vision GmbH, Berlin, Germany and ISCAN, Woburn, MA.
  • Retinal scanners are also available for tracking eye movement. Retinal scanners may also be mounted in the augmented reality glasses and are available from a variety of companies, such as Tobii, Sweden, and SMI, Teltow, Germany, and ISCAN.
  • the augmented reality eyepiece also includes a user input interface, as shown, to allow a user to control the device.
  • Inputs used to control the device may include any of the sensors discussed above, and may also include a trackpad, one or more function keys and any other suitable local or remote device.
  • an eye tracking device may be used to control another device, such as a video game or external tracking device.
  • Fig. 29A depicts a user with an augmented reality eyepiece equipped with an eye tracking device 2900A, discussed elsewhere in this document.
  • the eye tracking device allows the eyepiece to track the direction of the user's eye or preferably, eyes, and send the movements to the controller of the eyepiece.
  • Control system includes the augmented reality eyepiece and a control device for the weapon.
  • the movements may then be transmitted to the control device for a weapon controlled by the control device, which may be within sight of the user.
  • the movement of the user's eyes is then converted by suitable software to signals for controlling movement in the weapon, such as quadrant (range) and azimuth (direction). Additional controls may be used in conjunction with eye tracking, such as with the user's trackpad or function keys.
  • the weapon may be large caliber, such as a howitzer or mortar, or may small caliber, such as a machine gun.
  • control of the eyepiece may be enabled though gestures by the wearer.
  • the eyepiece may have a camera that views outward (e.g.
  • Hand signals may include passing the hand past the camera, hand positions or sign language in front of the camera, pointing to a real-world object (such as to activate augmentation of the object), and the like.
  • Hand motions may also be used to manipulate objects displayed on the inside of the translucent lens, such as moving an object, rotating an object, deleting an object, opening-closing a screen or window in the image, and the like.
  • head motion control may be used to send commands to the eyepiece, where motion sensors such as accelerometers, gyros, or any other sensor described herein, may be mounted on the wearer's head, on the eyepiece, in a hat, in a helmet, and the like.
  • head motions may include quick motions of the head, such as jerking the head in a forward and/or backward motion 1412, in an up and/or down motion 1410, in a side to side motion as a nod, dwelling in a position, such as to the side, moving and holding in position, and the like.
  • Motion sensors may be integrated into the eyepiece, mounted on the user's head or in a head covering (e.g.
  • the user may wear the interactive head-mounted eyepiece, where the eyepiece includes an optical assembly through which the user views a surrounding environment and displayed content.
  • the optical assembly may include a corrective element that corrects the user's view of the surrounding environment, an integrated processor for handling content for display to the user, and an integrated image source for introducing the content to the optical assembly.
  • At least one of a plurality of head motion sensing control devices may be integrated or in association with the eyepiece that provide control commands to the processor as command instructions based upon sensing a predefined head motion characteristic.
  • the head motion characteristic may be a nod of the user's head such that the nod is an overt motion dissimilar from ordinary head motions.
  • the overt motion may be a jerking motion of the head.
  • the control instructions may provide manipulation of the content for display, be communicated to control an external device, and the like.
  • Head motion control may be used in combination with other control mechanisms, such as using another control mechanism as discussed herein to activate a command and for the head motion to execute it. For example, a wearer may want to move an object to the right, and through eye control, as discussed herein, select the object and activate head motion control. Then, by tipping their head to the right, the object may be commanded to move to the right, and the command terminated through eye control.
  • the eyepiece may be controlled through audio, such as through a microphone.
  • Audio signals may include speech recognition, voice recognition, sound recognition, sound detection, and the like. Audio may be detected though a microphone on the eyepiece, a throat microphone, a jaw bone microphone, a boom microphone, a headphone, ear bud with microphone, and the like.
  • command inputs may provide for a plurality of control functions, such as turning on/off the eyepiece projector, turn on/off audio, turn on/off a camera, turn on/off augmented reality projection, turn on/off GPS, interaction with display (e.g. select / accept function displayed, replay of captured image or video, and the like), interaction with the real-world (e.g. capture image or video, turn a page of a displayed book, and the like), perform actions with an embedded or external mobile device (e.g. mobile phone, navigation device, music device, VoIP, and the like), browser controls for the Internet (e.g. submit, next result, and the like), email controls (e.g.
  • control functions such as turning on/off the eyepiece projector, turn on/off audio, turn on/off a camera, turn on/off augmented reality projection, turn on/off GPS, interaction with display (e.g. select / accept function displayed, replay of captured image or video, and the like), interaction with the real-world (e.g. capture image or video, turn
  • the eyepiece, or component portions thereof may be automatically turned on/off via a sensor indication, such as from an I sensor, an accelerometer, a force sensor, a micro-switch, a capacitive sensor, through an eye-tracking detection facility, and the like.
  • a sensor indication such as from an I sensor, an accelerometer, a force sensor, a micro-switch, a capacitive sensor, through an eye-tracking detection facility, and the like.
  • the eyepiece may be automatically turned off when the user takes the eyepiece off their head by way of a capacitive sensor that senses the eyepiece is no longer in physical contact with the user's skin, such as at the bridge of the user's nose.
  • the eyepiece may sense when detachable components are attached-detached from the eyepiece, and utilize this sensing to turn on/off aspects of the eyepiece. For example, a portion of the optics may be detachable, and when the optics portion is removed the power to that half of the eyepiece system is powered down to preserve power in the battery.
  • the present disclosure may include a power management facility, where the power management facility controls power provided to select components of the eyepiece in correspondence to the sensor.
  • the eyepiece may be mounted in a frame with a nose bridge and foldable arms, wherein hinges to the frame attach the foldable arms, and where the sensor may be mounted in the nose bridge of the frame, in the arm, in the hinge, and the like.
  • the select component may be the image source, the processor, and the like.
  • the power management facility may be in a sleep mode when the user is not wearing the eyepiece, where sleep mode may include a periodic reading of the sensor, where the power management facility transitions to a wake mode and powers on the eyepiece when it detects the user is wearing the eyepiece.
  • the power management facility may reduce power to components based on usage of eyepiece functions, power remaining in an integrated battery, network availability, power consumption rate, and the like. The reduction of power may be based on a user preference profile.
  • the user may override the reduction of power through a command.
  • the user may be provided an indication through a user interface of the eyepiece when power is being reduced.
  • the electrochromic density in the optical assembly may be increased if a brightness level of the image source is reduced as a result of reducing the power to the image source.
  • the eyepiece may provide 3D display imaging to the user, such as through conveying a stereoscopic, auto-stereoscopic, computer-generated holography, volumetric display image, stereograms / stereoscopes, view-sequential displays, electro-holographic displays, parallax "two view” displays and parallax panoramagrams, re-imaging systems, and the like, creating the perception of 3D depth to the viewer.
  • Display of 3D images to the user may employ different images presented to the user's left and right eyes, such as where the left and right optical paths have some optical component that differentiates the image, where the projector facility is projecting different images to the user's left and right eye's, and the like.
  • the optical path including from the projector facility through the optical path to the user's eye, may include a graphical display device that forms a visual representation of an object in three physical dimensions.
  • a processor such as the integrated processor in the eyepiece or one in an external facility, may provide 3D image processing as at least a step in the generation of the 3D image to the user.
  • holographic projection technologies may be employed in the presentation of a 3D imaging effect to the user, such as computer-generated holography (CGH), a method of digitally generating holographic interference patterns.
  • CGH computer-generated holography
  • a holographic image may be projected by a holographic 3D display, such as a display that operates on the basis of interference of coherent light.
  • Computer generated holograms have the advantage that the objects which one wants to show do not have to possess any physical reality at all, that is, they may be completely generated as a 'synthetic hologram'.
  • There are a plurality of different methods for calculating the interference pattern for a CGH including from the fields of holographic information and computational reduction as well as in computational and quantization techniques.
  • the Fourier transform method and point source holograms are two examples of computational techniques.
  • the Fourier transformation method may be used to simulate the propagation of each plane of depth of the object to the hologram plane, where the reconstruction of the image may occur in the far field.
  • there may be two steps where first the light field in the far observer plane is calculated, and then the field is Fourier transformed back to the lens plane, where the wavefront to be reconstructed by the hologram is the superposition of the Fourier transforms of each object plane in depth.
  • a target image may be multiplied by a phase pattern to which an inverse Fourier transform is applied.
  • Intermediate holograms may then be generated by shifting this image product, and combined to create a final set.
  • the final set of holograms may then be approximated to form kino forms for sequential display to the user, where the kinoform is a phase hologram in which the phase modulation of the object wavefront is recorded as a surface-relief profile.
  • the kinoform is a phase hologram in which the phase modulation of the object wavefront is recorded as a surface-relief profile.
  • the object is broken down in self-luminous points, where an elementary hologram is calculated for every point source and the final hologram is synthesized by superimposing all the elementary holograms.
  • 3-D or holographic imagery may be enabled by a dual projector system where two projectors are stacked on top of each other for a 3D image output.
  • Holographic projection mode may be entered by a control mechanism described herein or by capture of an image or signal, such as an outstretched hand with palm up, an S U, an RFID reading, and the like.
  • a wearer of the eyepiece may view a letter 'X' on a piece of cardboard which causes the eyepiece to enter holographic mode and turning on the second, stacked projector. Selecting what hologram to display may be done with a control technique.
  • the projector may project the hologram onto the cardboard over the letter 'X'.
  • Associated software may track the position of the letter 'X' and move the projected image along with the movement of the letter 'X'.
  • the eyepiece may scan a SKU, such as a SKU on a toy construction kit, and a 3-D image of the completed toy construction may be accessed from an online source or non-volatile memory. Interaction with the hologram, such as rotating it, zooming in/out, and the like, may be done using the control mechanisms described herein. Scanning may be enabled by associated bar code / SKU scanning software.
  • a keyboard may be projected in space or on a surface. The holographic keyboard may be used in or to control any of the associated applications / functions.
  • eyepiece facilities may provide for locking the position of a virtual keyboard down relative to a real environmental object (e.g. a table, a wall, a vehicle dashboard, and the like) where the virtual keyboard then does not move as the wearer moves their head.
  • a virtual keyboard e.g. a table, a wall, a vehicle dashboard, and the like
  • the user may be sitting at a table and wearing the eyepiece 2402, and wish to input text into an application, such as a word processing application, a web browser, a communications application, and the like.
  • the user may be able to bring up a virtual keyboard 2408, or other interactive control element (e.g. virtual mouse, calculator, touch screen, and the like), to use for input.
  • the user may provide a command for bringing up the virtual keyboard 2408, and use a hand gesture 2404 for indicating the fixed location of the virtual keyboard 2408.
  • the virtual keyboard 2408 may then remain fixed in space relative to the outside environment, such as fixed to a location on the table 2410, where the eyepiece facilities keep the location of the virtual keyboard 2408 on the table 2410 even when the user turns their head. That is, the eyepiece 2402 may compensate for the user's head motion in order to keep the user's view of the virtual keyboard 2408 located on the table 2410.
  • the user may wear the interactive head-mounted eyepiece, where the eyepiece includes an optical assembly through which the user views a surrounding environment and displayed content.
  • the optical assembly may include a corrective element that corrects the user's view of the surrounding environment, an integrated processor for handling content for display to the user, and an integrated image source for introducing the content to the optical assembly.
  • An integrated camera facility may be provided that images the surrounding environment, and identifies a user hand gesture as an interactive control element location command, such as a hand-finger configuration moved in a certain way, positioned in a certain way, and the like. The location of the interactive control element then may remain fixed in position with respect to an object in the surrounding environment, in response to the interactive control element location command, regardless of a change in the viewing direction of the user. In this way, the user may be able to utilize a virtual keyboard in much the same way they would a physical keyboard, where the virtual keyboard remains in the same location.
  • the virtual keyboard there are not 'physical limitations', such as gravity, to limit where the user may locate the keyboard. For instance, the user could be standing next to a wall, and place the keyboard location on the wall, and the like.
  • the 'virtual keyboard' technology may be applied to any controller, such as a virtual mouse, virtual touch pad, virtual game interface, virtual phone, virtual calculator, virtual paintbrush, virtual drawing pad, and the like.
  • a virtual touchpad may be visualized through the eyepiece to the user, and positioned by the user such as by use of hand gestures, and used in place of a physical touchpad.
  • eyepiece facilities may use visual techniques to render the projection of an object (e.g. virtual keyboard, keypad, calculator, notepad, joystick, control panel, book) onto a surface, such as by applying distortions like parallax, keystone, and the like.
  • an object e.g. virtual keyboard, keypad, calculator, notepad, joystick, control panel, book
  • eyepiece facilities may use visual techniques to render the projection of an object (e.g. virtual keyboard, keypad, calculator, notepad, joystick, control panel, book) onto a surface, such as by applying distortions like parallax, keystone, and the like.
  • an object e.g. virtual keyboard, keypad, calculator, notepad, joystick, control panel, book
  • these techniques may be applied dynamically, to provide the proper perspective even as the user moves around in relationship to the surface.
  • eyepiece facilities may provide for gesture recognition that may be used to provide a keyboard and mouse experience with the eyepiece. For instance, with images of a keyboard, mouse, and fingers overlaid on the lower part of the display, the system may be capable of tracking finger positions in real time to enable a virtual desktop. Through gesture recognition, tracking may be done without wires and external powered devices. In another instance, fingertip locations may be tracked through gesture recognition through the eyepiece without wires and external power, such as with gloves with passive RFID chips in each fingertip. In this instance, each RFID chip may have its own response characteristic, enabling a plurality of digits of the fingers to be read simultaneously. The RFID chips may be paired with the eyewear so that they are distinguishable from other RFID chips that may be operating nearby.
  • the eyewear may provide the signals to activate the RFID chips and have two or more receiving antennas.
  • Each receiving antenna may be connected to a phase-measurement circuit element that in turn provides input to a location-determining algorithm.
  • the location-determining algorithm may also provide velocity and acceleration information, and the algorithm that ultimately may provide keyboard and mouse information to the eyepiece operating system.
  • the azimuthal positions of each fingertip can be determined with the phase difference between the receiving antennas.
  • the relative phase difference between RFID chips may then be used to determine the radial positions of the fingertips.
  • eyepiece facilities may use visual techniques to render the projection of a previously taken medical scan onto the wearer's body, such as an x-ray, an ultrasound, an MRI, a PET scan, and the like.
  • a previously taken medical scan such as an x-ray, an ultrasound, an MRI, a PET scan, and the like.
  • the eyepiece may have access to an x-ray image taken of the wearer's hand.
  • the eyepiece may then utilize its integrated camera to view the wear's hand 2402A, and overlay a projected image 2404A of the x-ray onto the hand. Further, the eyepiece may be able to maintain the image overlay as the wearer moves their hand and gaze relative to one other.
  • this technique may also be implemented while the wearer is looking in the mirror, where the eyepiece transposes an image on top of the reflected image.
  • This technique may be used as part of a diagnostic procedure, for rehabilitation during physical therapy, to encourage exercise and diet, to explain to a patient a diagnosis or condition, and the like.
  • the images may be the images of the wearer, generic images from a database of images for medical conditions, and the like.
  • the generic overlay may show some type of internal issue that is typical of a physical condition, a projection of what the body will look like if a certain routine is followed for a period of time, and the like.
  • an external control device such as pointer controller, may enable the manipulation of the image.
  • the overlay of the image may be synchronized between multiple people, each wearing an eyepiece, as described herein.
  • a patient and a doctor may both project the image onto the patient's hand, where the doctor may now explain a physical ailment while the patient views the synchronized images of the projected scan and the doctor's explanation.
  • eyepiece facilities may provide for removing the portions of a virtual keyboard projection where intervening obstructions appear (e.g. the user's hand getting in the way, where it is not desired to project the keyboard onto the user's hand).
  • the eyepiece 3002 may provide a projected virtual keyboard 3008 to the wearer, such as onto a tabletop. The wearer may then reach Over' the virtual keyboard 3008 to type.
  • the keyboard is merely a projected virtual keyboard, rather than a physical keyboard, without some sort of compensation to the projected image the projected virtual computer would be projected Onto' the back of the user's hand.
  • the eyepiece may provide compensation to the projected image such that the portion of the wearer's hand 3004 that is obstructing the intended projection of the virtual keyboard onto the table may be removed from the projection. That is, it may not be desirable for portions of the keyboard projection 3008 to be visualized onto the user's hand, and so the eyepiece subtracts the portion of the virtual keyboard projection that is co-located with the wearer's hand 3004.
  • the user may wear the interactive head-mounted eyepiece, where the eyepiece includes an optical assembly through which the user views a surrounding environment and displayed content.
  • the optical assembly may include a corrective element that corrects the user's view of the surrounding environment, an integrated processor for handling content for display to the user, and an integrated image source for introducing the content to the optical assembly.
  • the displayed content may include an interactive control element (e.g. virtual keyboard, virtual mouse, calculator, touch screen, and the like).
  • An integrated camera facility may image a user's body part as it interacts with the interactive control element, wherein the processor removes a portion of the interactive control element by subtracting the portion of the interactive control element that is determined to be co-located with the imaged user body part based on the user's view.
  • this technique of partial projected image removal may be applied to other projected images and obstructions, and is not meant to be restricted to this example of a hand over a virtual keyboard.
  • eyepiece facilities may provide for intervening obstructions for any virtual content that is displayed over "real" world content. If some reference frame is determined that places the content at some distance, then any object that passes between the virtual image and the viewer may be subtracted from the displayed content so as not to create a discontinuity for the user that is expecting the displayed information to exist at a certain distance away.
  • variable focus techniques may also be used to increase the perception of a distance hierarchy amongst the viewed content.
  • eyepiece facilities may provide for the ability to determine an intended text input from a sequence of character contacts swiped across a virtual keypad, such as with the finger, a stylus, the entire hand, and the like.
  • a virtual keypad such as with the finger, a stylus, the entire hand, and the like.
  • the eyepiece may be projecting a virtual keyboard 3700, where the user wishes to input the word 'wind'.
  • the user would discretely press the key positions for 'w', then , then 'n', and finally 'd', and a facility (camera, accelerometer, and the like, such as described herein) associated with the eyepiece would interpret each position as being the letter for that position.
  • the system may also be able to monitor the movement, or swipe, of the user's finger or other pointing device across the virtual keyboard and determine best fit matches for the pointer movement.
  • the pointer has started at the character 'w' and swept a path 3704 though the characters e, r, t, y, u, i, k, n, b, v, f, and d where it stops.
  • the eyepiece may observe this sequence and determine the sequence, such as through an input path analyzer, feed the sensed sequence into a word matching search facility, and output a best fit word, in this case 'wind' as text 3708.
  • the eyepiece may monitor the motion of the pointing device across the keypad and determine the word more directly, such as though auto complete word matching, pattern recognition, object recognition, and the like, where some 'separator' indicates the space between words, such as a pause in the motion of the pointing device, a tap of the pointing device, a swirling motion of the pointing device, and the like.
  • the entire swipe path may be used with pattern or object recognition algorithms to associate whole words with the discrete patterns formed by the user's finger as they move through each character to form words, with a pause between the movements as demarcations between the words.
  • the eyepiece may provide the best-fit word, a listing of best-fit words, and the like.
  • the user may wear the interactive head-mounted eyepiece, where the eyepiece includes an optical assembly through which the user views a surrounding environment and displayed content.
  • the optical assembly may include a corrective element that corrects the user's view of the surrounding environment, an integrated processor for handling content for display to the user, and an integrated image source for introducing the content to the optical assembly.
  • the displayed content may comprise an interactive keyboard control element (e.g. a virtual keyboard, calculator, touch screen, and the like), and where the keyboard control element is associated with an input path analyzer, a word matching search facility, and a keyboard input interface.
  • the user may input text by sliding a pointing device (e.g.
  • the reference displayed content may be something other than a keyboard, such as a sketch pad for freehand text, or other interface references like a 4-way joystick pad for controlling a game or real robots and aircraft, and the like.
  • a virtual drum kit such as with colored pads the user "taps" to make a sound.
  • the eyepiece's ability to interpret patterns of motion across a surface may allow for projecting reference content in order to give the user something to point at and provide them with visual and/or audio feedback.
  • the 'motion' detected by the eyepiece may be the motion of the user's eye as they look at the surface.
  • the eyepiece may have facilities for tracking the eye movement of the user, and by having both the content display locations of a projected virtual keyboard and the gazing direction of the user's eye, the eyepiece may be able to detect the line-of- sight motion of the user's eye across the keyboard, and then interpret the motions as words as described herein.
  • the eyepiece may provide the capability to command the eyepiece via hand gesture 'air lettering', such as the wearer using their finger to air swipe out a letter, word, and the like in view of an embedded eyepiece camera, where the eyepiece interprets the finger motion as letters, words, symbols for commanding, signatures, writing, emailing, texting, and the like.
  • hand gesture 'air lettering' such as the wearer using their finger to air swipe out a letter, word, and the like in view of an embedded eyepiece camera
  • the eyepiece interprets the finger motion as letters, words, symbols for commanding, signatures, writing, emailing, texting, and the like.
  • the wearer may use this technique to sign a document utilizing an 'air signature'.
  • the wearer may use this technique to compose text, such as in an email, text, document, and the like.
  • the wearer eyepiece may recognize a symbol made through the hand motion as a control command.
  • the air lettering may be implemented through hand gesture recognition as interpreted by images captured through an eyepiece camera, or through other input control devices, such as via an inertial measurement unit (IMU) mounted in a device on the user's finger, hand, and the like, as described herein.
  • IMU inertial measurement unit
  • eyepiece facilities may provide for presenting displayed content corresponding to an identified marker indicative of the intention to display the content. That is, the eyepiece may be commanded to display certain content based upon sensing a predetermined external visual cue.
  • the visual cue may be an image, an icon, a picture, face recognition, a hand configuration, a body configuration, and the like.
  • the displayed content may be an interface device that is brought up for use, a navigation aid to help the user find a location once they get to some travel location, an advertisement when the eyepiece views a target image, an informational profile, and the like.
  • visual marker cues and their associated content for display may be stored in memory on the eyepiece, in an external computer storage facility and imported as needed (such as by geographic location, proximity to a trigger target, command by the user, and the like), generated by a third-party, and the like.
  • the user may wear the interactive head-mounted eyepiece, where the eyepiece includes an optical assembly through which the user views a surrounding environment and displayed content.
  • the optical assembly may include a corrective element that corrects the user's view of the surrounding environment, an integrated processor for handling content for display to the user, and an integrated image source for introducing the content to the optical assembly.
  • An integrated camera facility may be provided that images an external visual cue, wherein the integrated processor identifies and interprets the external visual cue as a command to display content associated with the visual cue.
  • the visual cue 3812 may be included in a sign 3814 in the surrounding environment, where the projected content is associated with an advertisement.
  • the sign may be a billboard, and the advertisement for a personalized advertisement based on a preferences profile of the user.
  • the visual cue 3802,3808 may be a hand gesture, and the projected content a projected virtual keyboard 3804, 3810.
  • the hand gesture may be a thumb and index finger gesture 3802 from a first user hand, and the virtual keyboard 3804 projected on the palm of the first user hand, and where the user is able to type on the virtual keyboard with a second user hand.
  • the hand gesture 3808 may be a thumb and index finger gesture combination of both user hands, and the virtual keyboard 3810 projected between the user hands as configured in the hand gesture, where the user is able to type on the virtual keyboard using the thumbs of the user's hands.
  • Visual cues may provide the wearer of the eyepiece with an automated resource for associating a predetermined external visual cue with a desired outcome in the way of projected content, thus freeing the wearer from searching for the cues themselves.
  • the eyepiece may include a visual recognition language translation facility for providing translations for visually presented content, such as for road signs, menus, billboards, store signs, books, magazines, and the like.
  • the visual recognition language translation facility may utilize optical character recognition to identify letters from the content, match the strings of letters to words and phrases through a database of translations. This capability may be completely contained within the eyepiece, such as in an offline mode, or at least in part in an external computing facility, such as on an external server. For instance, a user may be in a foreign country, where the signs, menus, and the like are not understood by the wearer of the eyepiece, but for which the eyepiece is able to provide translations.
  • a user of the eyepiece may be Italian, and coming to the United States they have the need to interpret the large number of road signs in order to drive around safely. Referring to Fig. 38 A, the Italian user of the eyepiece is viewing a U.S. stop sign 3802A.
  • the eyepiece may identify the letters on the sign, translate the word 'stop' in the Italian for stop, 'arresto', and make the stop sign 3804A appear to read the word 'arresto' rather than 'stop'.
  • the eyepiece may also provide simple translation messages to the wearer, provide audio translations, provide a translation dictionary to the wearer, and the like.
  • the present disclosure may comprise an interactive head-mounted eyepiece worn by a user, where the eyepiece includes an optical assembly through which the user views a surrounding environment and displayed content, and an integrated image source adapted to introduce the content to the optical assembly; an integrated camera for imaging text viewed within the surrounding environment; an optical character recognition facility to correlate one or more characters from the viewed text to one or more characters of a first language, and correlate the one or more characters of the first language to the one or more characters of the second language, wherein the integrated image source presents the one or more characters of the second language as displayed content, wherein the displayed content is locked in a position relative to the one or more characters from the viewed text.
  • the presentation of the one or more characters of the second language may appear as an annotation to the user and placed as displayed content in relative to the originally viewed text.
  • the presentation of the one or more characters of the second language may be superimposed onto the viewed location of the originally viewed text, such as the presentation of the one or more characters of the second language superimposed onto the originally viewed text matches the font characteristics of the originally viewed text.
  • the viewed text is on a sign, a printed document, book, a road sign, a billboard, a menu, and the like.
  • the optical character recognition facility may be incorporated in the eyepiece, provided external to the eyepiece, or provided in a combination of internally and externally.
  • the one or more characters may be words, phrases, strings of alphanumeric characters, and the like.
  • the one or more characters of the second language may be saved in an external facility and tagged so as to be made available to a second eyepiece viewing the same text, such as the tagging including a geographical location indication, an object identifier, and the like.
  • the presentation of the one or more characters of the second language may be stored such that when the view of the text moves outside the view of the eyepiece it is recalled for presentation when the text moves back within the view of the eyepiece.
  • the eyepiece may be used in an adaptive environment, such as for blind users.
  • the results of face recognition or object identification may be processed to obtain an audible result and can be presented as audio to a wearer of the glasses through associated earbuds/headphones.
  • the results of face recognition or object identification may be translated into haptic vibrations in the glasses or an associated controller.
  • a camera may image the person and transmit the image to the integrated processor for processing by face recognition software or to face recognition software operating on a server or in the cloud.
  • the results of the face recognition may be presented as written text in the display of the glasses for certain individuals, but for blind or poor vision users, the result may be processed to obtain audio.
  • object recognition may determine the user is approaching a curb, doorway, or other object and the glasses or controller would audibly or haptically warn the user.
  • the text on the display could be magnified or the contrast could be increased.
  • a GPS sensor may be used to determine a location of the user wearing the adaptive display.
  • the GPS sensor may be accessed by a navigation application to audibly announce various points of interest to the user as they are approached or reached.
  • the user may be audibly guided to an endpoint by the navigation application.
  • the eyepiece may be useful for various applications and markets. It should be understood that the control mechanisms described herein may be used to control the functions of the applications described herein.
  • the eyepiece may run a single application at a time or multiple applications may run at a time. Switching between applications may be done with the control mechanisms described herein.
  • the eyepiece may be used in military applications, gaming, image recognition applications, to view / order e-books, GPS Navigation (Position, Direction, Speed and ETA), Mobile TV, athletics (view pacing, ranking, and competition times; receive coaching), telemedicine, industrial inspection, aviation, shopping, inventory management tracking, firefighting (enabled by VIS/NIRSWIR sensor that sees through fog, haze, dark), outdoor / adventure, custom advertising, and the like.
  • the eyepiece may be used with e-mail, such as GMAIL in Fig. 7, the Internet, web browsing, viewing sports scores, video chat, and the like.
  • the eyepiece may be used for educational / training purposes, such as by displaying step by step guides, such as hands-free, wireless maintenance and repair instructions.
  • a video manual and/or instructions may be displayed in the field of view.
  • the eyepiece may be used in Fashion, Health, and Beauty.
  • potential outfits, hairstyles, or makeup may be projected onto a mirror image of a user.
  • the eyepiece may be used in Business Intelligence, Meetings, and Conferences.
  • a user's name tag can be scanned, their face run through a facial recognition system, or their spoken name searched in database to obtain biographical information. Scanned name tags, faces, and conversations may be recorded for subsequent viewing or filing.
  • a "Mode" may be entered by the eyepiece.
  • certain applications may be available.
  • a consumer version of the eyepiece may have a Tourist Mode, Educational Mode, Internet Mode, TV Mode, Gaming Mode, Exercise Mode, Stylist Mode, Personal Assistant Mode, and the like.
  • a user of the augmented reality glasses may wish to participate in video calling or video conferencing while wearing the glasses.
  • Many computers, both desktop and laptop have integrated cameras to facilitate using video calling and conferencing.
  • software applications are used to integrate use of the camera with calling or conferencing features.
  • the augmented reality glasses providing much of the functionality of laptops and other computing devices, many users may wish to utilize video calling and video conferencing while on the move wearing the augmented reality glasses.
  • a video calling or video conferencing application may work with a WiFi connection, or may be part of a 3G or 4G calling network associated with a user's cell phone.
  • the camera for video calling or conferencing is placed on a device controller, such as a watch or other separate electronic computing device. Placing the video calling or conferencing camera on the augmented reality glasses is not feasible, as such placement would provide the user with a view only of themselves, and would not display the other participants in the conference or call. However, the user may choose to use the forward-facing camera to display their surroundings or another individual in the video call.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Optics & Photonics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Hardware Design (AREA)
  • General Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • User Interface Of Digital Computer (AREA)
EP12837262.0A 2011-09-26 2012-09-26 Videoanzeigeänderung auf der basis einer sensoreingabe für durchsichtige augennahe anzeige Withdrawn EP2761362A2 (de)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201161539269P 2011-09-26 2011-09-26
PCT/US2012/057387 WO2013049248A2 (en) 2011-09-26 2012-09-26 Video display modification based on sensor input for a see-through near-to-eye display

Publications (2)

Publication Number Publication Date
EP2761362A4 EP2761362A4 (de) 2014-08-06
EP2761362A2 true EP2761362A2 (de) 2014-08-06

Family

ID=47996727

Family Applications (1)

Application Number Title Priority Date Filing Date
EP12837262.0A Withdrawn EP2761362A2 (de) 2011-09-26 2012-09-26 Videoanzeigeänderung auf der basis einer sensoreingabe für durchsichtige augennahe anzeige

Country Status (5)

Country Link
EP (1) EP2761362A2 (de)
JP (1) JP2015504616A (de)
KR (1) KR20140066258A (de)
CN (1) CN103946732B (de)
WO (1) WO2013049248A2 (de)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016037332A1 (zh) * 2014-09-11 2016-03-17 华为技术有限公司 一种移动终端
CN106239513A (zh) * 2016-08-29 2016-12-21 合肥凌翔信息科技有限公司 一种远程控制机器人系统
CN108205416A (zh) * 2016-12-20 2018-06-26 乐视汽车（北京）有限公司 利用车机激活终端屏幕的方法、车机及智能汽车
WO2020044198A1 (en) * 2018-08-26 2020-03-05 Lumus Ltd. Reflection suppression in near eye displays
US11150738B2 (en) 2014-07-31 2021-10-19 Samsung Electronics Co., Ltd. Wearable glasses and method of providing content using the same
US11631380B2 (en) 2018-03-14 2023-04-18 Sony Corporation Information processing apparatus, information processing method, and recording medium

Families Citing this family (609)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9158116B1 (en) 2014-04-25 2015-10-13 Osterhout Group, Inc. Temple and ear horn assembly for headworn computer
US20150205111A1 (en) 2014-01-21 2015-07-23 Osterhout Group, Inc. Optical configurations for head worn computing
US9952664B2 (en) 2014-01-21 2018-04-24 Osterhout Group, Inc. Eye imaging in head worn computing
US9298007B2 (en) 2014-01-21 2016-03-29 Osterhout Group, Inc. Eye imaging in head worn computing
US9715112B2 (en) 2014-01-21 2017-07-25 Osterhout Group, Inc. Suppression of stray light in head worn computing
US9400390B2 (en) 2014-01-24 2016-07-26 Osterhout Group, Inc. Peripheral lighting for head worn computing
US20150277120A1 (en) 2014-01-21 2015-10-01 Osterhout Group, Inc. Optical configurations for head worn computing
US9229233B2 (en) 2014-02-11 2016-01-05 Osterhout Group, Inc. Micro Doppler presentations in head worn computing
US9965681B2 (en) 2008-12-16 2018-05-08 Osterhout Group, Inc. Eye imaging in head worn computing
US9366867B2 (en) 2014-07-08 2016-06-14 Osterhout Group, Inc. Optical systems for see-through displays
US9285589B2 (en) 2010-02-28 2016-03-15 Microsoft Technology Licensing, Llc AR glasses with event and sensor triggered control of AR eyepiece applications
US9128281B2 (en) 2010-09-14 2015-09-08 Microsoft Technology Licensing, Llc Eyepiece with uniformly illuminated reflective display
US9097890B2 (en) 2010-02-28 2015-08-04 Microsoft Technology Licensing, Llc Grating in a light transmissive illumination system for see-through near-eye display glasses
US9759917B2 (en) 2010-02-28 2017-09-12 Microsoft Technology Licensing, Llc AR glasses with event and sensor triggered AR eyepiece interface to external devices
US9229227B2 (en) 2010-02-28 2016-01-05 Microsoft Technology Licensing, Llc See-through near-eye display glasses with a light transmissive wedge shaped illumination system
US10180572B2 (en) 2010-02-28 2019-01-15 Microsoft Technology Licensing, Llc AR glasses with event and user action control of external applications
US9182596B2 (en) 2010-02-28 2015-11-10 Microsoft Technology Licensing, Llc See-through near-eye display glasses with the optical assembly including absorptive polarizers or anti-reflective coatings to reduce stray light
US9366862B2 (en) 2010-02-28 2016-06-14 Microsoft Technology Licensing, Llc System and method for delivering content to a group of see-through near eye display eyepieces
US20150309316A1 (en) 2011-04-06 2015-10-29 Microsoft Technology Licensing, Llc Ar glasses with predictive control of external device based on event input
US9097891B2 (en) 2010-02-28 2015-08-04 Microsoft Technology Licensing, Llc See-through near-eye display glasses including an auto-brightness control for the display brightness based on the brightness in the environment
US9134534B2 (en) 2010-02-28 2015-09-15 Microsoft Technology Licensing, Llc See-through near-eye display glasses including a modular image source
US9091851B2 (en) 2010-02-28 2015-07-28 Microsoft Technology Licensing, Llc Light control in head mounted displays
US9341843B2 (en) 2010-02-28 2016-05-17 Microsoft Technology Licensing, Llc See-through near-eye display glasses with a small scale image source
US9129295B2 (en) 2010-02-28 2015-09-08 Microsoft Technology Licensing, Llc See-through near-eye display glasses with a fast response photochromic film system for quick transition from dark to clear
US9223134B2 (en) 2010-02-28 2015-12-29 Microsoft Technology Licensing, Llc Optical imperfections in a light transmissive illumination system for see-through near-eye display glasses
US20120249797A1 (en) 2010-02-28 2012-10-04 Osterhout Group, Inc. Head-worn adaptive display
WO2011106797A1 (en) 2010-02-28 2011-09-01 Osterhout Group, Inc. Projection triggering through an external marker in an augmented reality eyepiece
US9406166B2 (en) 2010-11-08 2016-08-02 Seereal Technologies S.A. Display device, in particular a head-mounted display, based on temporal and spatial multiplexing of hologram tiles
EP2914990B1 (de) * 2012-11-01 2020-02-19 Essilor International Thermisch beeinflusste veränderliche färbevorrichtung
US9933684B2 (en) 2012-11-16 2018-04-03 Rockwell Collins, Inc. Transparent waveguide display providing upper and lower fields of view having a specific light output aperture configuration
GB2515460B (en) 2013-04-12 2016-01-06 Two Trees Photonics Ltd Near-eye device
US9417471B2 (en) * 2013-04-30 2016-08-16 Research Frontiers Incorporated Method and device for protecting objects from degradation by light with suspended particle device light valves
EP3444667B1 (de) * 2013-05-09 2023-12-06 IMAX Theatres International Limited Verfahren und systeme zum vibrieren eines schirms
US9280972B2 (en) * 2013-05-10 2016-03-08 Microsoft Technology Licensing, Llc Speech to text conversion
US20140347736A1 (en) * 2013-05-23 2014-11-27 Omnivision Technologies, Inc. Systems And Methods For Aligning A Near-Eye Display Device
WO2014193326A1 (en) * 2013-05-29 2014-12-04 Baltaci Cetin Ozgur System for forming a virtual image
GB2527973B (en) * 2013-05-30 2020-06-10 Anthony Smith Charles HUD object design and display method
CN103336435B (zh) * 2013-06-19 2015-10-28 河海大学常州校区 微陀螺仪基于角速度估计的自适应模糊滑模控制方法
JP2015009630A (ja) * 2013-06-27 2015-01-19 庸 菊池 自動車点検記録装置
US9563331B2 (en) 2013-06-28 2017-02-07 Microsoft Technology Licensing, Llc Web-like hierarchical menu display configuration for a near-eye display
JP6205189B2 (ja) * 2013-06-28 2017-09-27 オリンパス株式会社 情報提示システム及び情報提示システムの制御方法
JP6252002B2 (ja) * 2013-07-11 2017-12-27 セイコーエプソン株式会社 頭部装着型表示装置および頭部装着型表示装置の制御方法
TW201502581A (zh) 2013-07-11 2015-01-16 Seiko Epson Corp 頭部配戴型顯示裝置及頭部配戴型顯示裝置之控制方法
ES2576489T3 (es) * 2013-08-02 2016-07-07 Essilor International (Compagnie Générale d'Optique) Un método para controlar un dispositivo de lente oftálmica programable
KR20150018264A (ko) 2013-08-09 2015-02-23 엘지전자 주식회사 안경형 단말기의 정보 제공 장치 및 그 방법
JP6111932B2 (ja) * 2013-08-26 2017-04-12 ソニー株式会社 行動支援装置、行動支援方法、プログラム、および記憶媒体
JP6337433B2 (ja) * 2013-09-13 2018-06-06 セイコーエプソン株式会社 頭部装着型表示装置および頭部装着型表示装置の制御方法
US9311545B2 (en) 2013-09-18 2016-04-12 Blackberry Limited Multicolor biometric scanning user interface
US9418273B2 (en) 2013-09-18 2016-08-16 Blackberry Limited Structure for multicolor biometric scanning user interface
JP5877824B2 (ja) * 2013-09-20 2016-03-08 ヤフー株式会社 情報処理システム、情報処理方法および情報処理プログラム
US20150088547A1 (en) * 2013-09-22 2015-03-26 Ricoh Company, Ltd. Mobile Information Gateway for Home Healthcare
US9763071B2 (en) * 2013-09-22 2017-09-12 Ricoh Company, Ltd. Mobile information gateway for use in emergency situations or with special equipment
KR102088020B1 (ko) 2013-09-26 2020-03-11 엘지전자 주식회사 헤드 마운트 디스플레이 및 제어 방법
CN114343672B (zh) * 2013-10-14 2025-12-16 诺罗维吉尔公司 生物信号局部收集、基于生物电信号的言语辅助接口光标控制和基于生物电信号的觉醒检测
EP3058418B1 (de) * 2013-10-16 2023-10-04 Magic Leap, Inc. Kopfhörer für virtuelle oder erweiterte realität mit einstellbarem zwischenpupillenabstand
CN103536279A (zh) * 2013-10-22 2014-01-29 德赛电子(惠州)有限公司 一种智能腕带及其自适应方法
US10258256B2 (en) 2014-12-09 2019-04-16 TechMah Medical Bone reconstruction and orthopedic implants
US9448621B2 (en) * 2013-12-20 2016-09-20 Nokia Technologies Oy Causation of display of information on a see through display
US9420178B2 (en) 2013-12-20 2016-08-16 Qualcomm Incorporated Thermal and power management
CA2935434C (en) * 2014-01-10 2020-10-27 Nokia Technologies Oy Display of a visual representation of a view
US9810906B2 (en) 2014-06-17 2017-11-07 Osterhout Group, Inc. External user interface for head worn computing
US9671613B2 (en) 2014-09-26 2017-06-06 Osterhout Group, Inc. See-through computer display systems
US10649220B2 (en) 2014-06-09 2020-05-12 Mentor Acquisition One, Llc Content presentation in head worn computing
US9939934B2 (en) 2014-01-17 2018-04-10 Osterhout Group, Inc. External user interface for head worn computing
US9366868B2 (en) 2014-09-26 2016-06-14 Osterhout Group, Inc. See-through computer display systems
US9529195B2 (en) 2014-01-21 2016-12-27 Osterhout Group, Inc. See-through computer display systems
US9841599B2 (en) 2014-06-05 2017-12-12 Osterhout Group, Inc. Optical configurations for head-worn see-through displays
US20150277118A1 (en) 2014-03-28 2015-10-01 Osterhout Group, Inc. Sensor dependent content position in head worn computing
US9746686B2 (en) 2014-05-19 2017-08-29 Osterhout Group, Inc. Content position calibration in head worn computing
US9829707B2 (en) 2014-08-12 2017-11-28 Osterhout Group, Inc. Measuring content brightness in head worn computing
US11103122B2 (en) 2014-07-15 2021-08-31 Mentor Acquisition One, Llc Content presentation in head worn computing
US10191279B2 (en) 2014-03-17 2019-01-29 Osterhout Group, Inc. Eye imaging in head worn computing
US20160019715A1 (en) 2014-07-15 2016-01-21 Osterhout Group, Inc. Content presentation in head worn computing
US9594246B2 (en) 2014-01-21 2017-03-14 Osterhout Group, Inc. See-through computer display systems
US11227294B2 (en) 2014-04-03 2022-01-18 Mentor Acquisition One, Llc Sight information collection in head worn computing
US10684687B2 (en) 2014-12-03 2020-06-16 Mentor Acquisition One, Llc See-through computer display systems
US9575321B2 (en) 2014-06-09 2017-02-21 Osterhout Group, Inc. Content presentation in head worn computing
US9448409B2 (en) 2014-11-26 2016-09-20 Osterhout Group, Inc. See-through computer display systems
US10254856B2 (en) 2014-01-17 2019-04-09 Osterhout Group, Inc. External user interface for head worn computing
US9299194B2 (en) 2014-02-14 2016-03-29 Osterhout Group, Inc. Secure sharing in head worn computing
US11487110B2 (en) 2014-01-21 2022-11-01 Mentor Acquisition One, Llc Eye imaging in head worn computing
US9746676B2 (en) 2014-01-21 2017-08-29 Osterhout Group, Inc. See-through computer display systems
US11737666B2 (en) 2014-01-21 2023-08-29 Mentor Acquisition One, Llc Eye imaging in head worn computing
US9310610B2 (en) 2014-01-21 2016-04-12 Osterhout Group, Inc. See-through computer display systems
US9753288B2 (en) 2014-01-21 2017-09-05 Osterhout Group, Inc. See-through computer display systems
US12105281B2 (en) 2014-01-21 2024-10-01 Mentor Acquisition One, Llc See-through computer display systems
US9836122B2 (en) 2014-01-21 2017-12-05 Osterhout Group, Inc. Eye glint imaging in see-through computer display systems
US9494800B2 (en) 2014-01-21 2016-11-15 Osterhout Group, Inc. See-through computer display systems
US20150206173A1 (en) 2014-01-21 2015-07-23 Osterhout Group, Inc. Eye imaging in head worn computing
US20150205135A1 (en) 2014-01-21 2015-07-23 Osterhout Group, Inc. See-through computer display systems
US11892644B2 (en) 2014-01-21 2024-02-06 Mentor Acquisition One, Llc See-through computer display systems
US9532715B2 (en) 2014-01-21 2017-01-03 Osterhout Group, Inc. Eye imaging in head worn computing
US11669163B2 (en) 2014-01-21 2023-06-06 Mentor Acquisition One, Llc Eye glint imaging in see-through computer display systems
US12093453B2 (en) 2014-01-21 2024-09-17 Mentor Acquisition One, Llc Eye glint imaging in see-through computer display systems
US9766463B2 (en) 2014-01-21 2017-09-19 Osterhout Group, Inc. See-through computer display systems
US9846308B2 (en) 2014-01-24 2017-12-19 Osterhout Group, Inc. Haptic systems for head-worn computers
JP6264542B2 (ja) 2014-01-30 2018-01-24 任天堂株式会社 情報処理装置、情報処理プログラム、情報処理システム、および情報処理方法
KR102177133B1 (ko) 2014-01-31 2020-11-10 매직 립, 인코포레이티드 멀티-포컬 디스플레이 시스템 및 방법
WO2015116183A2 (en) 2014-01-31 2015-08-06 Empire Technology Development, Llc Subject selected augmented reality skin
KR101827550B1 (ko) 2014-01-31 2018-02-08 엠파이어 테크놀로지 디벨롭먼트 엘엘씨 증강 현실 스킨 매니저
US9865088B2 (en) 2014-01-31 2018-01-09 Empire Technology Development Llc Evaluation of augmented reality skins
JP6334715B2 (ja) 2014-01-31 2018-05-30 エンパイア テクノロジー ディベロップメント エルエルシー 拡張現実スキンの評価
US20150241964A1 (en) 2014-02-11 2015-08-27 Osterhout Group, Inc. Eye imaging in head worn computing
US9401540B2 (en) 2014-02-11 2016-07-26 Osterhout Group, Inc. Spatial location presentation in head worn computing
WO2015127146A1 (en) 2014-02-19 2015-08-27 Evergaze, Inc. Apparatus and method for improving, augmenting or enhancing vision
JP2015166816A (ja) * 2014-03-04 2015-09-24 富士通株式会社 表示装置，表示制御プログラム及び表示制御方法
KR102539365B1 (ko) * 2014-03-05 2023-06-01 아리조나 보드 오브 리전츠 온 비해프 오브 더 유니버시티 오브 아리조나 가변 초점 및/또는 객체 인식 기능을 가진 웨어러블 3d 증강 현실 디스플레이
US11408699B2 (en) 2014-03-21 2022-08-09 Armaments Research Company Inc. Firearm usage monitoring system
WO2015145893A1 (ja) * 2014-03-26 2015-10-01 ソニー株式会社 体感導入装置、体感導入システム、及び体感導入方法
US20160187651A1 (en) 2014-03-28 2016-06-30 Osterhout Group, Inc. Safety for a vehicle operator with an hmd
US10354551B2 (en) 2014-04-09 2019-07-16 Lg Electronics Inc. Mobile terminal and method for controlling the same
EP3132379B1 (de) 2014-04-15 2018-11-07 Huntington Ingalls Incorporated System und verfahren für erweiterte realitätsanzeige von dynamischen umgebungsinformationen
DE102014207490B3 (de) 2014-04-17 2015-07-02 Carl Zeiss Ag Brillenglas für eine auf den Kopf eines Benutzers aufsetzbare und ein Bild erzeugende Anzeigevorrichtung und Anzeigevorrichtung mit einem solchen Brillenglas
US9651787B2 (en) 2014-04-25 2017-05-16 Osterhout Group, Inc. Speaker assembly for headworn computer
US9423842B2 (en) 2014-09-18 2016-08-23 Osterhout Group, Inc. Thermal management for head-worn computer
WO2015164755A1 (en) 2014-04-25 2015-10-29 Huntington Ingalls Incorporated Augmented reality display of dynamic target object information
US10853589B2 (en) 2014-04-25 2020-12-01 Mentor Acquisition One, Llc Language translation with head-worn computing
US9864909B2 (en) 2014-04-25 2018-01-09 Huntington Ingalls Incorporated System and method for using augmented reality display in surface treatment procedures
CN103941953B (zh) * 2014-04-28 2017-10-31 北京智谷睿拓技术服务有限公司 信息处理方法及装置
EP2939924A1 (de) * 2014-04-30 2015-11-04 Airbus Operations GmbH Digitale Besatzungsunterstützung
WO2015170555A1 (ja) * 2014-05-09 2015-11-12 アルプス電気株式会社 眼鏡型電子機器
US9635257B2 (en) 2014-05-12 2017-04-25 Gopro, Inc. Dual-microphone camera
CN103984413B (zh) * 2014-05-19 2017-12-08 北京智谷睿拓技术服务有限公司 信息交互方法及信息交互装置
US9600073B2 (en) 2014-05-21 2017-03-21 International Business Machines Corporation Automated adjustment of content composition rules based on evaluation of user feedback obtained through haptic interface
US9710151B2 (en) 2014-05-21 2017-07-18 International Business Machines Corporation Evaluation of digital content using non-intentional user feedback obtained through haptic interface
US9323331B2 (en) 2014-05-21 2016-04-26 International Business Machines Corporation Evaluation of digital content using intentional user feedback obtained through haptic interface
IL296027B2 (en) 2014-05-30 2024-08-01 Magic Leap Inc Methods and system for creating focal planes in virtual and augmented reality
CN111856755B (zh) 2014-05-30 2022-07-19 奇跃公司 用于显示虚拟和增强现实的立体视觉的方法和系统
CN103976715B (zh) * 2014-06-09 2016-01-20 江苏启润科技有限公司 多功能人体健康自检系统
US10504294B2 (en) 2014-06-09 2019-12-10 Huntington Ingalls Incorporated System and method for augmented reality discrepancy determination and reporting
US10663740B2 (en) 2014-06-09 2020-05-26 Mentor Acquisition One, Llc Content presentation in head worn computing
US10915754B2 (en) 2014-06-09 2021-02-09 Huntington Ingalls Incorporated System and method for use of augmented reality in outfitting a dynamic structural space
WO2015191346A1 (en) 2014-06-09 2015-12-17 Huntington Ingalls Incorporated System and method for augmented reality display of electrical system information
EP4206870A1 (de) * 2014-06-14 2023-07-05 Magic Leap, Inc. Verfahren zur aktualisierung einer virtuellen welt
JP6292478B2 (ja) * 2014-06-17 2018-03-14 コニカミノルタ株式会社 透過型ｈｍｄを有する情報表示システム及び表示制御プログラム
EP2957983A1 (de) * 2014-06-18 2015-12-23 Alcatel Lucent Tragbare elektronische Vorrichtung und System zur persönlichen Datenverarbeitung
KR102209512B1 (ko) * 2014-06-30 2021-01-29 엘지전자 주식회사 글래스 타입 단말기
US9814386B2 (en) 2014-07-02 2017-11-14 IDx, LLC Systems and methods for alignment of the eye for ocular imaging
KR102506455B1 (ko) * 2014-07-10 2023-03-07 모하메드 라쉬완 마푸즈 뼈 재건 및 정형외과용 임플란트
WO2016006949A1 (ko) * 2014-07-11 2016-01-14 넥시스 주식회사 웨어러블 디바이스를 이용한 정보처리 시스템 및 방법
KR101629758B1 (ko) * 2014-07-11 2016-06-24 넥시스 주식회사 글라스형 웨어러블 디바이스의 잠금해제 방법 및 프로그램
WO2016011149A1 (en) 2014-07-16 2016-01-21 Huntington Ingalls Incorporated System and method for augmented reality display of hoisting and rigging information
WO2016013692A1 (ko) * 2014-07-22 2016-01-28 엘지전자(주) 헤드 마운티드 디스플레이 및 그 제어방법
EP2977855B1 (de) * 2014-07-23 2019-08-28 Wincor Nixdorf International GmbH Virtuelle Tastatur und Eingabeverfahren für eine virtuelle Tastatur
CN104090385B (zh) * 2014-07-25 2015-11-18 金陵科技学院 一种防作弊用智能眼镜
EP3663849A1 (de) * 2014-07-31 2020-06-10 Vuzix Corporation Bild- und wellenfeldprojektion durch diffusive medien
US9965030B2 (en) * 2014-07-31 2018-05-08 Samsung Electronics Co., Ltd. Wearable glasses and method of displaying image via the wearable glasses
US9959591B2 (en) * 2014-07-31 2018-05-01 Seiko Epson Corporation Display apparatus, method for controlling display apparatus, and program
KR102433291B1 (ko) * 2014-07-31 2022-08-17 삼성전자주식회사 웨어러블 글래스 및 웨어러블 글래스의 컨텐트 제공 방법
DE102014215372A1 (de) * 2014-08-05 2016-02-11 Conti Temic Microelectronic Gmbh Fahrerassistenzsystem
KR101728408B1 (ko) * 2014-09-22 2017-04-19 (주)에프엑스기어 방향 예측을 이용한 저 레이턴시 시뮬레이션 장치 및 방법과, 이를 위한 컴퓨터 프로그램
JP6346537B2 (ja) * 2014-09-29 2018-06-20 株式会社Ｎｔｔドコモ 旅行プラン出力システム
WO2016060293A1 (ko) * 2014-10-15 2016-04-21 엘지전자 주식회사 화상 정보 표시 장치 및 그 장치의 제어 방법
US9283138B1 (en) 2014-10-24 2016-03-15 Keith Rosenblum Communication techniques and devices for massage therapy
EP3015975A1 (de) * 2014-10-30 2016-05-04 Speech Processing Solutions GmbH Steuerungsvorrichtung für eine Diktiermaschine
US10108256B2 (en) 2014-10-30 2018-10-23 Mediatek Inc. Systems and methods for processing incoming events while performing a virtual reality session
BR212016005938U2 (pt) * 2014-11-03 2018-02-06 Jose Evangelista Terrabuio Junior óculos de realidade virtual aumentada imersiva para uso com smartphones, tablets, phablets e ou cpu móvel com tela?
US10286308B2 (en) 2014-11-10 2019-05-14 Valve Corporation Controller visualization in virtual and augmented reality environments
US9462455B2 (en) * 2014-11-11 2016-10-04 Sony Corporation Dynamic user recommendations for ban enabled media experiences
US9366883B2 (en) 2014-11-13 2016-06-14 International Business Machines Corporation Using google glass to project a red overlay that enhances night vision
CN104394317A (zh) * 2014-11-20 2015-03-04 段然 一种处理头戴式摄录设备摄录图像的方法
CN104702911A (zh) * 2014-11-24 2015-06-10 段然 穿戴式摄录设备实时无线传输方法
US9811954B2 (en) 2014-12-02 2017-11-07 Honeywell International, Inc. Near-to-eye display systems and methods for verifying aircraft components
US9684172B2 (en) 2014-12-03 2017-06-20 Osterhout Group, Inc. Head worn computer display systems
CN104483753A (zh) * 2014-12-04 2015-04-01 上海交通大学 自配准透射式头戴显示设备
JP6554631B2 (ja) * 2014-12-18 2019-08-07 フェイスブック・テクノロジーズ・リミテッド・ライアビリティ・カンパニーＦａｃｅｂｏｏｋ Ｔｅｃｈｎｏｌｏｇｉｅｓ， Ｌｌｃ 仮想現実環境においてナビゲートする方法、システム、および装置
KR102362727B1 (ko) 2014-12-18 2022-02-15 엘지이노텍 주식회사 맥박 측정 장치 및 이를 이용한 컴퓨팅 장치
USD743963S1 (en) 2014-12-22 2015-11-24 Osterhout Group, Inc. Air mouse
US10108832B2 (en) * 2014-12-30 2018-10-23 Hand Held Products, Inc. Augmented reality vision barcode scanning system and method
USD751552S1 (en) 2014-12-31 2016-03-15 Osterhout Group, Inc. Computer glasses
USD753114S1 (en) 2015-01-05 2016-04-05 Osterhout Group, Inc. Air mouse
JP6451322B2 (ja) * 2015-01-06 2019-01-16 セイコーエプソン株式会社 画像表示装置
WO2016110831A1 (en) * 2015-01-08 2016-07-14 Ashkelon Eyewear Technologies Ltd An apparatus and method for displaying content
KR102320737B1 (ko) 2015-01-14 2021-11-03 삼성디스플레이 주식회사 헤드-장착 전자장치
KR102282394B1 (ko) 2015-01-26 2021-07-26 매직 립, 인코포레이티드 개선된 회절 그레이팅 구조들을 갖는 가상 및 증강 현실 시스템들 및 방법들
KR101765838B1 (ko) 2015-01-29 2017-08-10 유퍼스트(주) 시각 장애인을 위한 착용형 장치
CN104576709B (zh) * 2015-02-03 2017-07-04 京东方科技集团股份有限公司 Oled显示基板及其制备方法、可穿戴设备
US9830001B2 (en) * 2015-02-03 2017-11-28 Sony Mobile Communications Inc. Method, device and system for collecting writing pattern using ban
EP3054371A1 (de) * 2015-02-06 2016-08-10 Nokia Technologies OY Vorrichtung, Verfahren und Computerprogramm zur Anzeige von augmentierte Information
CN105988562A (zh) * 2015-02-06 2016-10-05 刘小洋 智能穿戴设备及基于智能穿戴设备实现手势输入的方法
US9632226B2 (en) 2015-02-12 2017-04-25 Digilens Inc. Waveguide grating device
KR102309451B1 (ko) * 2015-02-13 2021-10-07 주식회사 엘지유플러스 웨어러블 디바이스 및 웨어러블 디바이스 디스플레이 제어 방법
US20160239985A1 (en) 2015-02-17 2016-08-18 Osterhout Group, Inc. See-through computer display systems
JP6704921B2 (ja) * 2015-02-27 2020-06-03 バルブ コーポレーション バーチャル及びオーグメンテッドリアリティ環境におけるコントローラ可視化
JP2017009573A (ja) * 2015-03-06 2017-01-12 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ 装着端末、及び、装着端末の制御方法
NZ773822A (en) 2015-03-16 2022-07-29 Magic Leap Inc Methods and systems for diagnosing and treating health ailments
CN104657103B (zh) * 2015-03-16 2017-06-16 哈尔滨工业大学 基于深度摄像机的手持cave投影系统
JP2018508909A (ja) * 2015-03-20 2018-03-29 華為技術有限公司Ｈｕａｗｅｉ Ｔｅｃｈｎｏｌｏｇｉｅｓ Ｃｏ．，Ｌｔｄ． インテリジェントなインタラクション方法、装置、および、システム
WO2016158624A1 (ja) 2015-03-30 2016-10-06 国立大学法人東北大学 生体情報計測装置、生体情報計測方法、生体情報表示装置及び生体情報表示方法
JP6683367B2 (ja) * 2015-03-30 2020-04-22 国立大学法人東北大学 生体情報計測装置、生体情報計測方法及び生体情報計測プログラム
JP2016192122A (ja) 2015-03-31 2016-11-10 ソニー株式会社 情報処理装置、情報処理方法、およびプログラム
CN104731338B (zh) * 2015-03-31 2017-11-14 深圳市虚拟现实科技有限公司 一种基于封闭式的增强虚拟现实系统及方法
US10592521B2 (en) * 2015-04-03 2020-03-17 Oracle International Corporation Method and system for implementing target model configuration metadata for a log analytics system
CN104765456A (zh) * 2015-04-08 2015-07-08 成都爱瑞斯文化传播有限责任公司 一种虚拟空间系统及搭建方法
JP6426525B2 (ja) 2015-04-20 2018-11-21 ファナック株式会社 表示システム
WO2016170765A1 (ja) * 2015-04-20 2016-10-27 日本電気株式会社 対象特定システム、対象特定方法およびプログラム記録媒体
KR102365492B1 (ko) * 2015-04-22 2022-02-18 삼성전자주식회사 웨어러블 기기
JP6646361B2 (ja) * 2015-04-27 2020-02-14 ソニーセミコンダクタソリューションズ株式会社 画像処理装置、撮像装置、画像処理方法およびプログラム
IL244255A (en) 2016-02-23 2017-04-30 Vertical Optics Llc Wearable vision redirecting devices
US9690119B2 (en) 2015-05-15 2017-06-27 Vertical Optics, LLC Wearable vision redirecting devices
CN112882233B (zh) * 2015-05-19 2023-08-01 奇跃公司 双复合光场装置
JP6288372B2 (ja) * 2015-05-21 2018-03-07 日本電気株式会社 インタフェース制御システム、インタフェース制御装置、インタフェース制御方法、及びプログラム
IL239191A0 (en) * 2015-06-03 2015-11-30 Amir B Geva Image sorting system
CN104883543A (zh) * 2015-06-04 2015-09-02 段然 一种未经压缩图像传输的数据传输系统
CN104967887B (zh) * 2015-06-06 2018-03-30 深圳市虚拟现实科技有限公司 基于nfc的信息交互方法和虚拟现实眼镜
KR102196507B1 (ko) 2015-06-09 2020-12-30 한국전자통신연구원 전기적 절환 가능한 유리를 이용한 가시광 통신 장치 및 방법
HK1254860A1 (zh) * 2015-06-24 2019-07-26 Magic Leap, Inc. 用於购买的增强现实设备、系统和方法
US9530426B1 (en) 2015-06-24 2016-12-27 Microsoft Technology Licensing, Llc Filtering sounds for conferencing applications
CN106326813B (zh) * 2015-06-30 2023-04-07 深圳指芯智能科技有限公司 一种智能变频3d指纹传感器
JP7074478B2 (ja) 2015-07-03 2022-05-24 エシロール アンテルナショナル 拡張現実のための方法とシステム
CN105093555B (zh) 2015-07-13 2018-08-14 深圳多新哆技术有限责任公司 短距离光学放大模组及使用其的近眼显示光学模组
CN105070204A (zh) * 2015-07-24 2015-11-18 江苏天晟永创电子科技有限公司 一种微型amoled光学显示器
CN105022980B (zh) * 2015-07-28 2017-11-14 福建新大陆电脑股份有限公司 一种条码图像识读设备
KR20170014028A (ko) 2015-07-28 2017-02-08 현대자동차주식회사 핸즈프리 부품 검사 장치 및 그 제어방법
KR102689919B1 (ko) * 2015-08-18 2024-07-30 매직 립, 인코포레이티드 가상 및 증강 현실 시스템들 및 방법들
KR102260483B1 (ko) * 2015-08-25 2021-06-04 한국전자기술연구원 비행 가이드 정보 표시 가능한 스마트 안경
CN105100745B (zh) * 2015-08-31 2018-03-23 国网浙江省电力公司湖州供电公司 一种变电站作业监控装置
EP3138478B1 (de) * 2015-09-01 2023-11-01 Essilor International Tragbare herzfrequenzmessvorrichtung
JP2017049762A (ja) 2015-09-01 2017-03-09 株式会社東芝 システム及び方法
CN105091948A (zh) * 2015-09-02 2015-11-25 徐艺斌 一种用于防近视眼架的多功能传感器模块
KR101716326B1 (ko) * 2015-09-08 2017-03-14 클릭트 주식회사 가상현실영상 전송방법, 재생방법 및 이를 이용한 프로그램
CN105259655A (zh) * 2015-09-10 2016-01-20 上海理鑫光学科技有限公司 提高虚实叠加真实性的3d视频系统
EP3145168A1 (de) * 2015-09-17 2017-03-22 Thomson Licensing Vorrichtung und verfahren zur erzeugung von daten, die einen pixelstrahl repräsentieren
CN105117111B (zh) * 2015-09-23 2019-11-15 小米科技有限责任公司 虚拟现实交互画面的渲染方法和装置
US11262762B2 (en) 2015-09-25 2022-03-01 Apple Inc. Non-solid object monitoring
CN108027656B (zh) 2015-09-28 2021-07-06 日本电气株式会社 输入设备、输入方法和程序
US10234955B2 (en) 2015-09-28 2019-03-19 Nec Corporation Input recognition apparatus, input recognition method using maker location, and non-transitory computer-readable storage program
WO2017060665A1 (en) * 2015-10-05 2017-04-13 Milan Momcilo Popovich Waveguide display
JP6662599B2 (ja) * 2015-10-05 2020-03-11 ミツミ電機株式会社 表示装置
CN108139804A (zh) * 2015-10-15 2018-06-08 索尼公司 信息处理装置与信息处理方法
US10338677B2 (en) * 2015-10-28 2019-07-02 Microsoft Technology Licensing, Llc Adjusting image frames based on tracking motion of eyes
CN106814844A (zh) * 2015-12-01 2017-06-09 深圳市掌网科技股份有限公司 一种虚拟现实交互系统及方法
CN105976424A (zh) * 2015-12-04 2016-09-28 乐视致新电子科技（天津）有限公司 一种图像渲染处理的方法及装置
CN105487229B (zh) * 2015-12-18 2018-05-04 济南中景电子科技有限公司 多通道交互虚拟现实眼镜
CN105455792B (zh) * 2015-12-18 2018-09-25 济南中景电子科技有限公司 用于虚拟现实眼镜的头带
JP7180873B2 (ja) 2015-12-22 2022-11-30 イー－ビジョン スマート オプティックス， インク． 動的集束ヘッドマウントディスプレイ
CN105608436B (zh) * 2015-12-23 2021-10-22 联想(北京)有限公司 一种功耗控制方法及电子设备
US9742492B2 (en) * 2015-12-30 2017-08-22 Surefire Llc Systems and methods for ad-hoc networking in an optical narrowcasting system
US10713760B2 (en) * 2015-12-31 2020-07-14 Thomson Licensing Configuration for rendering virtual reality with an adaptive focal plane
CN105455285B (zh) 2015-12-31 2019-02-12 北京小鸟看看科技有限公司 一种虚拟现实头盔适配方法
KR102439768B1 (ko) 2016-01-07 2022-09-01 매직 립, 인코포레이티드 심도 평면들에 걸쳐 분포된 동일하지 않은 수의 컴포넌트 컬러 이미지들을 갖는 가상 및 증강 현실 시스템들 및 방법들
CN118605029A (zh) * 2016-01-19 2024-09-06 奇跃公司 利用映像的增强现实系统和方法
KR102610120B1 (ko) * 2016-01-20 2023-12-06 삼성전자주식회사 Hmd 디바이스 및 그 제어 방법
CN105739851A (zh) * 2016-01-21 2016-07-06 陈佩珊 一种基于智能眼镜语音识别的图标迁移实现方法及系统
CN105718167A (zh) * 2016-01-21 2016-06-29 陈佩珊 一种基于智能眼镜镜腿触摸的图标迁移实现方法及系统
US10908694B2 (en) * 2016-02-01 2021-02-02 Microsoft Technology Licensing, Llc Object motion tracking with remote device
CN105704501B (zh) * 2016-02-06 2020-04-21 普宙飞行器科技（深圳）有限公司 一种基于无人机全景视频的虚拟现实直播系统
JP6341343B2 (ja) 2016-02-08 2018-06-13 日本電気株式会社 情報処理システム、情報処理装置、制御方法、及びプログラム
CN108027655A (zh) 2016-02-25 2018-05-11 日本电气株式会社 信息处理系统、信息处理设备、控制方法和程序
CN205582205U (zh) * 2016-03-02 2016-09-14 福州领头虎软件有限公司 人体状况及行为监控报警系统
CN105720347A (zh) * 2016-03-16 2016-06-29 昆山联滔电子有限公司 表链式窗体天线
JP6493264B2 (ja) 2016-03-23 2019-04-03 横河電機株式会社 保全情報共有装置、保全情報共有方法、保全情報共有プログラム及び記録媒体
US10838502B2 (en) 2016-03-29 2020-11-17 Microsoft Technology Licensing, Llc Sharing across environments
WO2017176861A1 (en) 2016-04-07 2017-10-12 Magic Leap, Inc. Systems and methods for augmented reality
US9910284B1 (en) 2016-09-08 2018-03-06 Osterhout Group, Inc. Optical systems for head-worn computers
EP3440497B1 (de) * 2016-04-08 2023-08-16 Magic Leap, Inc. Systeme der erweiterten realität und verfahren mit linsenelementen mit veränderlicher brennweite
US10134198B2 (en) 2016-04-19 2018-11-20 Adobe Systems Incorporated Image compensation for an occluding direct-view augmented reality system
CN105975060A (zh) * 2016-04-26 2016-09-28 乐视控股（北京）有限公司 虚拟现实终端及其控制方法和装置
US11017257B2 (en) * 2016-04-26 2021-05-25 Sony Corporation Information processing device, information processing method, and program
JP6968800B2 (ja) * 2016-04-27 2021-11-17 ロヴィ ガイズ， インコーポレイテッド 仮想現実環境を表示するヘッドアップディスプレイ上に付加的コンテンツを表示するための方法およびシステム
AU2017264695B2 (en) 2016-05-09 2022-03-31 Magic Leap, Inc. Augmented reality systems and methods for user health analysis
US11327475B2 (en) * 2016-05-09 2022-05-10 Strong Force Iot Portfolio 2016, Llc Methods and systems for intelligent collection and analysis of vehicle data
US20170329440A1 (en) * 2016-05-12 2017-11-16 Cirque Corporation Controller premonition using capacitive sensing
CN107402378A (zh) * 2016-05-19 2017-11-28 财团法人金属工业研究发展中心 调频雷达收发机
US10482668B2 (en) * 2016-06-02 2019-11-19 Thales Visionix, Inc. Miniature vision-inertial navigation system with extended dynamic range
KR101859909B1 (ko) 2016-06-07 2018-05-21 에스아이에스 주식회사 드론을 이용한 적조 예찰 및 추적 시스템 및 방법
JP6843530B2 (ja) 2016-06-15 2021-03-17 任天堂株式会社 ゲームシステム、方法、およびゲームプログラム
CN106094203A (zh) 2016-06-16 2016-11-09 捷开通讯(深圳)有限公司 Vr系统、用于控制vr设备的穿戴设备及其方法
US10332315B2 (en) 2016-06-20 2019-06-25 Magic Leap, Inc. Augmented reality display system for evaluation and modification of neurological conditions, including visual processing and perception conditions
KR101817952B1 (ko) * 2016-06-23 2018-01-12 주식회사 맥스트 투과형 헤드 마운티드 디스플레이 장치 및 상기 장치에서의 화면 심도 제어 방법
CN107544661B (zh) * 2016-06-24 2020-06-23 联想(北京)有限公司 一种信息处理方法及电子设备
JP6685397B2 (ja) * 2016-07-12 2020-04-22 三菱電機株式会社 機器制御システム
CN106200972A (zh) * 2016-07-14 2016-12-07 乐视控股（北京）有限公司 一种调整虚拟现实场景参数的方法及装置
CN109791391B (zh) * 2016-07-24 2021-02-02 光场实验室公司 用于全息能量引导系统的校准方法
CN106267552B (zh) 2016-07-25 2020-03-10 京东方科技集团股份有限公司 一种穿戴设备、虚拟现实方法和终端系统
WO2018020853A1 (ja) 2016-07-29 2018-02-01 Ｎｅｃソリューションイノベータ株式会社 移動体操縦システム、操縦シグナル送信システム、移動体操縦方法、プログラム、および記録媒体
WO2018020744A1 (ja) 2016-07-29 2018-02-01 Ｎｅｃソリューションイノベータ株式会社 移動体操縦システム、操縦シグナル送信システム、移動体操縦方法、プログラム、および記録媒体
CN106162206A (zh) * 2016-08-03 2016-11-23 北京疯景科技有限公司 全景录制、播放方法及装置
CH712799A1 (fr) * 2016-08-10 2018-02-15 Derungs Louis Méthode de réalité virtuelle et système mettant en oeuvre une telle méthode.
EP3500911B1 (de) 2016-08-22 2023-09-27 Magic Leap, Inc. Anzeigevorrichtung mit erweiterter realität mit tiefenlernsensoren
US10557943B2 (en) * 2016-08-22 2020-02-11 Apple Inc. Optical systems
EP3511800A4 (de) * 2016-09-08 2019-08-14 Sony Corporation Informationsverarbeitungsvorrichtung
KR102746273B1 (ko) * 2016-09-08 2024-12-26 엘지전자 주식회사 헤드 마운티드 디스플레이 및 그 제어 방법
CN106203410B (zh) * 2016-09-21 2023-10-17 上海星寰投资有限公司 一种身份验证方法及系统
CN106408303A (zh) * 2016-09-21 2017-02-15 上海星寰投资有限公司 一种支付方法及系统
CN106251153A (zh) * 2016-09-21 2016-12-21 上海星寰投资有限公司 一种支付方法及系统
EP3508997B1 (de) 2016-09-24 2023-04-19 Huawei Technologies Co., Ltd. Offline-verwaltungsverfahren für die nutzungszeit einer anwendung und endgerätevorrichtung
CN107885311A (zh) * 2016-09-29 2018-04-06 深圳纬目信息技术有限公司 一种视觉交互的确认方法、系统和设备
KR102743204B1 (ko) * 2016-10-17 2024-12-17 엘지전자 주식회사 Hmd 디바이스
KR102662708B1 (ko) * 2016-10-17 2024-05-03 엘지전자 주식회사 Hmd 디바이스
IL311451A (en) 2016-10-21 2024-05-01 Magic Leap Inc System and method for displaying image content on multiple depth planes by providing multiple intrapupillary parallax fields of view
CN106507121A (zh) * 2016-10-31 2017-03-15 易瓦特科技股份公司 一种控制直播的方法、vr设备和无人机
CN106651355A (zh) * 2016-11-08 2017-05-10 北京小米移动软件有限公司 支付方法、装置及虚拟现实头盔
KR102650572B1 (ko) * 2016-11-16 2024-03-26 삼성전자주식회사 전자 장치 및 그의 제어 방법
EP3470976A1 (de) 2017-10-12 2019-04-17 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Verfahren und vorrichtung zur effizienten bereitstellung und nutzung von audionachrichten für eine hohe erlebnisqualität
US20180144554A1 (en) 2016-11-18 2018-05-24 Eyedaptic, LLC Systems for augmented reality visual aids and tools
US10466774B2 (en) * 2016-11-22 2019-11-05 Honeywell International Inc. NTE display systems and methods with optical trackers
EP3548939A4 (de) 2016-12-02 2020-11-25 DigiLens Inc. Wellenleitervorrichtung mit gleichmässiger ausgabebeleuchtung
US10055028B2 (en) * 2016-12-05 2018-08-21 Google Llc End of session detection in an augmented and/or virtual reality environment
US9906290B2 (en) * 2016-12-06 2018-02-27 Mediatek Singapore Pte. Ltd. Method for network merging and configuration sharing and associated apparatus
KR20180065515A (ko) 2016-12-08 2018-06-18 박순구 다기능 웨어러블 디스플레이 장치
CN106603107B (zh) * 2016-12-21 2019-10-29 Tcl移动通信科技（宁波）有限公司 一种头戴设备及其控制方法
JP6255470B1 (ja) * 2016-12-27 2017-12-27 株式会社Ｑｄレーザ 網膜走査型検眼装置、網膜走査型検眼システム、網膜走査型検眼方法、網膜走査型アイウェア提供システム、網膜走査型アイウェア提供方法及び網膜走査型アイウェア
JP6382928B2 (ja) * 2016-12-27 2018-08-29 株式会社コロプラ 仮想空間における画像の表示を制御するためにコンピュータによって実行される方法、当該方法をコンピュータに実現させるためのプログラム、および、コンピュータ装置
CN106790579B (zh) * 2016-12-28 2020-07-03 深圳市明瞳视光科技有限公司 一种基于智能眼镜的主动式信息传输方法及其系统
US10455165B2 (en) 2016-12-28 2019-10-22 Microsoft Technology Licensing, Llc Systems, methods, and computer-readable media for using a video capture device to alleviate motion sickness via an augmented display for a passenger
US10147460B2 (en) * 2016-12-28 2018-12-04 Immersion Corporation Haptic effect generation for space-dependent content
US10088911B2 (en) 2016-12-30 2018-10-02 Manuel Saez Programmable electronic helmet
CN115145023B (zh) * 2016-12-31 2024-02-09 鲁姆斯有限公司 用于导出人眼睛的注视方向的设备
CN106681955B (zh) * 2017-01-04 2023-05-09 四川埃姆克伺服科技有限公司 用于自伺服电机位置传感器接收信号的通用接口电路
US10545346B2 (en) 2017-01-05 2020-01-28 Digilens Inc. Wearable heads up displays
CN106864362A (zh) * 2017-01-18 2017-06-20 陈宗坤 一种带空气净化的警示牌
CN106846383B (zh) * 2017-01-23 2020-04-17 宁波诺丁汉大学 基于3d数字显微成像系统的高动态范围图像成像方法
WO2018139020A1 (ja) * 2017-01-24 2018-08-02 ソニー株式会社 ヒンジ機構、及びこのヒンジ機構を有するヘッドマウントディスプレイ
US20180212314A1 (en) * 2017-01-24 2018-07-26 Intel Corporation Wearable device sar reduction and antenna improvement
US11719496B2 (en) 2017-01-27 2023-08-08 Armaments Research Company Inc. Weapon usage monitoring system with unified video depiction of deployment location
US11293709B2 (en) 2017-01-27 2022-04-05 Armaments Research Company, Inc. Weapon usage monitoring system for initiating notifications and commands based on dashboard actions
US11125520B2 (en) * 2017-01-27 2021-09-21 Armaments Research Company, Inc. Firearm usage monitoring system providing alerts for ammunition resupply
WO2020077254A1 (en) 2018-10-12 2020-04-16 Armaments Research Company Inc. Firearm monitoring and remote support system
US11395628B2 (en) * 2017-02-16 2022-07-26 Samsung Electronics Co., Ltd. Method of providing service based on biometric information and wearable electronic device
JP6980209B2 (ja) 2017-02-22 2021-12-15 ルムス エルティーディー． 光ガイド光学アセンブリ
IL307602A (en) 2017-02-23 2023-12-01 Magic Leap Inc Variable focus virtual imagers based on polarization conversion
CN106597673B (zh) * 2017-02-28 2020-04-03 京东方科技集团股份有限公司 虚拟现实显示装置及其驱动方法和驱动模块
CN106932906A (zh) * 2017-03-04 2017-07-07 国家电网公司 混合现实显示装置
CN106934361B (zh) * 2017-03-06 2021-01-05 苏州佳世达光电有限公司 一种辨识方法以及电子设备
US11822078B2 (en) 2017-03-07 2023-11-21 Apple Inc. Head-mounted display system
EP3376279B1 (de) * 2017-03-13 2022-08-31 Essilor International Optische vorrichtung für eine kopfmontierte anzeige und kopfmontierte vorrichtung damit für erweiterte realität
US11030980B2 (en) 2017-03-14 2021-06-08 Nec Corporation Information processing apparatus, information processing system, control method, and program
JP7075942B2 (ja) * 2017-03-21 2022-05-26 マジック リープ， インコーポレイテッド 薄型ビームスプリッタ
CN110709772B (zh) 2017-03-21 2022-06-21 奇跃公司 用于照射空间光调制器的方法、设备和系统
CN117572644A (zh) 2017-03-22 2024-02-20 鲁姆斯有限公司 用于生产光导光学元件的方法和光学系统
CN106842576A (zh) * 2017-03-23 2017-06-13 核桃智能科技（常州）有限公司 一种具有移动通讯功能的头戴智能显示设备
JP2018170656A (ja) * 2017-03-30 2018-11-01 ソニーセミコンダクタソリューションズ株式会社 撮像装置、撮像モジュール、撮像システムおよび撮像装置の制御方法
CN107015655A (zh) * 2017-04-11 2017-08-04 苏州和云观博数字科技有限公司 博物馆虚拟场景ar体验眼镜装置及其实现方法
CN106897576B (zh) * 2017-04-17 2023-10-31 安徽咏鹅家纺股份有限公司 一种智能睡眠监测及助眠云服务系统
CN106871973A (zh) * 2017-04-21 2017-06-20 佛山市川东磁电股份有限公司 一种温湿度传感器
KR102432283B1 (ko) 2017-05-01 2022-08-11 매직 립, 인코포레이티드 콘텐츠를 공간 3d 환경에 매칭
KR20180123354A (ko) * 2017-05-08 2018-11-16 엘지전자 주식회사 차량용 사용자 인터페이스 장치 및 차량
US10613345B2 (en) * 2017-05-09 2020-04-07 Amtran Technology Co., Ltd. Mixed reality assembly and method of generating mixed reality
CN107221066A (zh) * 2017-05-16 2017-09-29 嘉兴市天篷农业休闲有限公司 一种旅游体验增强ar系统
CN107071285A (zh) * 2017-05-16 2017-08-18 广东交通职业技术学院 一种跟拍方法、存储器及无人机跟拍装置
GB2552872B (en) * 2017-05-17 2018-08-29 Vision Rt Ltd Patient monitoring system
CN108955396A (zh) * 2017-05-17 2018-12-07 广东建元和安科技发展有限公司 一种手持反狙击主动探测装置
CN108958461A (zh) * 2017-05-24 2018-12-07 宏碁股份有限公司 具自适性控制的虚拟实境系统及其控制方法
JP6947661B2 (ja) * 2017-05-26 2021-10-13 株式会社コロプラ ヘッドマウントデバイスと通信可能なコンピュータによって実行されるプログラム、当該プログラムを実行するための情報処理装置、およびヘッドマウントデバイスと通信可能なコンピュータによって実行される方法
CN107193381A (zh) * 2017-05-31 2017-09-22 湖南工业大学 一种基于眼球追踪传感技术的智能眼镜及其显示方法
JP6613267B2 (ja) 2017-06-02 2019-11-27 任天堂株式会社 情報処理システム、情報処理プログラム、情報処理装置、および、情報処理方法
JP6837921B2 (ja) 2017-06-02 2021-03-03 任天堂株式会社 ゲームプログラム、情報処理装置、情報処理システム、および、情報処理方法
JP6653293B2 (ja) 2017-06-05 2020-02-26 任天堂株式会社 情報処理システム、情報処理プログラム、情報処理装置、および、情報処理方法
KR102482756B1 (ko) * 2017-06-14 2022-12-30 삼성전자주식회사 헤드 마운트 디스플레이 장치
CN107679380B (zh) * 2017-06-22 2020-08-11 国网浙江平湖市供电公司 一种基于身份识别的智能巡检装置及方法
CN118311774A (zh) 2017-06-26 2024-07-09 京东方科技集团股份有限公司 显示系统和图像显示方法
KR102347128B1 (ko) * 2017-06-29 2022-01-05 한국전자기술연구원 고시인성 마이크로디스플레이 장치 및 이를 포함하는 헤드 마운트 디스플레이
JP7086940B2 (ja) * 2017-06-29 2022-06-20 アップル インコーポレイテッド センサ及び触覚を用いた指装着デバイス
CN109215132A (zh) * 2017-06-30 2019-01-15 华为技术有限公司 一种增强现实业务的实现方法及设备
EP4328656B1 (de) * 2017-07-06 2025-12-17 Magic Leap, Inc. Speckle-reduktion in systemen und verfahren für virtuelle und erweiterte realität
US20190012841A1 (en) 2017-07-09 2019-01-10 Eyedaptic, Inc. Artificial intelligence enhanced system for adaptive control driven ar/vr visual aids
US10578869B2 (en) 2017-07-24 2020-03-03 Mentor Acquisition One, Llc See-through computer display systems with adjustable zoom cameras
US10422995B2 (en) 2017-07-24 2019-09-24 Mentor Acquisition One, Llc See-through computer display systems with stray light management
US11409105B2 (en) 2017-07-24 2022-08-09 Mentor Acquisition One, Llc See-through computer display systems
KR102026526B1 (ko) * 2017-08-03 2019-09-30 주식회사 에스지엠 생체정보를 사용하는 인증 시스템 및 이를 이용한 스크린 골프 시스템
CN107422480A (zh) * 2017-08-03 2017-12-01 深圳市汇龙天成科技有限公司 一种半透半反曲面透镜显示结构及显示方法
US10969584B2 (en) 2017-08-04 2021-04-06 Mentor Acquisition One, Llc Image expansion optic for head-worn computer
KR102485447B1 (ko) 2017-08-09 2023-01-05 삼성전자주식회사 광학 윈도우 시스템 및 이를 포함하는 투시형 디스플레이 장치
WO2019035600A1 (en) * 2017-08-15 2019-02-21 Samsung Electronics Co., Ltd. SYSTEM AND METHOD FOR REAL OR VIRTUAL SCENE DISPLAY
JP6958106B2 (ja) * 2017-08-21 2021-11-02 セイコーエプソン株式会社 偏向装置、表示装置および偏向装置の製造方法
US11607600B2 (en) 2017-08-24 2023-03-21 Vuzix Corporation Swim AR goggles
CN107609492B (zh) * 2017-08-25 2019-06-21 西安电子科技大学 基于脑电信号的失真图像质量感知评价方法
US11211030B2 (en) 2017-08-29 2021-12-28 Apple Inc. Electronic device with adaptive display
JP6458106B1 (ja) * 2017-09-13 2019-01-23 株式会社コロプラ 移動手段においてコンテンツを提供するためにコンピュータで実行される方法、当該方法をコンピュータに実行させるプログラム、コンテンツ提供装置、およびコンテンツ提供システム
JP6987737B2 (ja) * 2017-09-13 2022-01-05 株式会社コロプラ 移動手段においてコンテンツを提供するためにコンピュータで実行される方法、当該方法をコンピュータに実行させるプログラム、コンテンツ提供装置、およびコンテンツ提供システム
WO2019059044A1 (ja) 2017-09-20 2019-03-28 日本電気株式会社 情報処理装置、制御方法、及びプログラム
CN107657791A (zh) * 2017-09-29 2018-02-02 歌尔股份有限公司 一种vr/ar头戴设备
US11733516B2 (en) 2017-10-11 2023-08-22 Magic Leap, Inc. Augmented reality display comprising eyepiece having a transparent emissive display
FR3072468B1 (fr) * 2017-10-13 2020-02-14 Alessandro Manneschi Dispositif et procede de detection d'objets ou matieres non autorises portes par un individu dans une zone a acces protege
US11086315B2 (en) 2017-10-26 2021-08-10 2KR Systems, LLC Building rooftop intelligence gathering, decision-support and snow load removal system for protecting buildings from excessive snow load conditions, and automated methods for carrying out the same
US10984508B2 (en) 2017-10-31 2021-04-20 Eyedaptic, Inc. Demonstration devices and methods for enhancement for low vision users and systems improvements
KR102063780B1 (ko) * 2017-11-21 2020-01-08 고려대학교산학협력단 가상현실을 이용한 근시 억제 장치
IL255955B (en) * 2017-11-27 2019-06-30 Elbit Systems Ltd System and method for displaying synthetic information on a transparent device
KR102028997B1 (ko) * 2017-11-29 2019-10-07 엘지디스플레이 주식회사 헤드 마운트 디스플레이 장치
TWI660630B (zh) * 2017-12-06 2019-05-21 瑞昱半導體股份有限公司 視頻掃描方式偵測方法與系統
CN109918975B (zh) * 2017-12-13 2022-10-21 腾讯科技（深圳）有限公司 一种增强现实的处理方法、对象识别的方法及终端
EP3729243A4 (de) * 2017-12-19 2021-09-15 Datalogic IP Tech S.r.l. Am körper eines benutzers tragbare systeme und verfahren zum sammeln von daten und zur bereitstellung von informationen
US11921289B2 (en) 2017-12-20 2024-03-05 Vuzix Corporation Augmented reality display system
CN108169901A (zh) * 2017-12-27 2018-06-15 北京传嘉科技有限公司 Vr眼镜
US10360454B1 (en) * 2017-12-28 2019-07-23 Rovi Guides, Inc. Systems and methods for presenting supplemental content in augmented reality
WO2019127223A1 (zh) * 2017-12-28 2019-07-04 深圳市柔宇科技有限公司 屈光度调节装置及电子设备
CN114721242B (zh) 2018-01-08 2025-08-15 迪吉伦斯公司 用于制造光学波导的方法
JP7456929B2 (ja) 2018-01-08 2024-03-27 ディジレンズ インコーポレイテッド 導波管セルを製造するためのシステムおよび方法
KR20190085368A (ko) 2018-01-10 2019-07-18 삼성전자주식회사 프로젝터에서 출력된 광을 투명 부재로 전달할 수 있는 광 전달 부재를 포함하는 접이형 웨어러블 전자 장치
CN108122248B (zh) * 2018-01-15 2020-04-24 武汉大学 基于视频测量的大坝自振频率识别方法
CN108459812B (zh) * 2018-01-22 2021-03-02 郑州升达经贸管理学院 一种美术轨迹显示追捕系统及方法
US20210055560A1 (en) * 2018-01-26 2021-02-25 Tesseland Llc Compact optics in crossed configuration for virtual and mixed reality
US10915271B2 (en) * 2018-01-29 2021-02-09 Micron Technology, Inc. Memory controller with programmable atomic operations
US11567627B2 (en) * 2018-01-30 2023-01-31 Magic Leap, Inc. Eclipse cursor for virtual content in mixed reality displays
CN108798360A (zh) * 2018-02-01 2018-11-13 李绍辉 基于通信技术的烟雾快速散发方法
US11543659B2 (en) 2018-02-09 2023-01-03 Vuzix Corporation Image light guide with circular polarizer
CN108427830A (zh) * 2018-02-09 2018-08-21 中建五局第三建设有限公司 一种利用混合现实技术指导构筑物空间放样的方法及装置
WO2019160698A2 (en) * 2018-02-16 2019-08-22 Valve Corporation Using detected pupil location to align optical components of a head-mounted display
US10735649B2 (en) 2018-02-22 2020-08-04 Magic Leap, Inc. Virtual and augmented reality systems and methods using display system control information embedded in image data
WO2019165055A1 (en) 2018-02-22 2019-08-29 Magic Leap, Inc. Browser for mixed reality systems
KR102836545B1 (ko) * 2018-02-22 2025-07-18 매직 립, 인코포레이티드 물리적 조작을 사용한 오브젝트 생성
KR102546994B1 (ko) * 2018-02-26 2023-06-22 엘지전자 주식회사 웨어러블 글래스 장치
CN108479056B (zh) * 2018-03-05 2021-12-31 江苏嘉尚环保科技有限公司 一种盲人用网上抓娃娃机
US11563885B2 (en) 2018-03-06 2023-01-24 Eyedaptic, Inc. Adaptive system for autonomous machine learning and control in wearable augmented reality and virtual reality visual aids
US10695667B2 (en) 2018-03-14 2020-06-30 Sony Interactive Entertainment LLC Pro gaming AR visor and method for parsing context specific HUD content from a video stream
KR102395445B1 (ko) * 2018-03-26 2022-05-11 한국전자통신연구원 음원의 위치를 추정하기 위한 전자 장치
CN108337573A (zh) * 2018-03-26 2018-07-27 京东方科技集团股份有限公司 一种赛事实时解说的实现方法和介质
US11218685B2 (en) 2018-03-28 2022-01-04 Nokia Technologies Oy Method, an apparatus and a computer program product for virtual reality
CN108398791B (zh) * 2018-03-29 2022-11-25 陈超平 一种基于偏光隐形眼镜的近眼显示装置
AT521130A1 (de) * 2018-04-04 2019-10-15 Peterseil Thomas Verfahren zum Einblenden eines virtuellen Objekts
JP6368881B1 (ja) * 2018-04-09 2018-08-01 チームラボ株式会社 表示制御システム，端末装置，コンピュータプログラム，及び表示制御方法
KR102063395B1 (ko) 2018-04-10 2020-01-07 (주)세이프인 가상 소방훈련 시뮬레이터
CN108363522B (zh) * 2018-04-24 2024-08-13 石家庄科达文教用品有限公司 同步书写系统及其方法
US11187906B2 (en) 2018-05-29 2021-11-30 Eyedaptic, Inc. Hybrid see through augmented reality systems and methods for low vision users
US11353951B2 (en) 2018-06-08 2022-06-07 Hewlett-Packard Development Company, L.P. Computing input devices with sensors concealed in articles of clothing
FR3081639B1 (fr) * 2018-06-11 2020-07-31 Orange Procede et systeme de transmission optiques de donnees pour des applications de realite virtuelle ou augmentee
CN108803877A (zh) 2018-06-11 2018-11-13 联想(北京)有限公司 切换方法、装置以及电子设备
CN108982062B (zh) * 2018-06-14 2020-04-21 上海卫星工程研究所 一种卫星杂散光测试中线阵成像光学载荷的视场对准方法
CN108983636B (zh) * 2018-06-20 2020-07-17 浙江大学 人机智能共生平台系统
JP7175664B2 (ja) * 2018-07-11 2022-11-21 克行 廣中 発光機能付き音声会話無線機
US10834986B2 (en) * 2018-07-12 2020-11-17 Sarah Nicole Ciccaglione Smart safety helmet with heads-up display
TWI797142B (zh) * 2018-07-12 2023-04-01 揚明光學股份有限公司 光學裝置及其製造方法
TWI841254B (zh) * 2018-07-12 2024-05-01 揚明光學股份有限公司 光學裝置
CN112424671B (zh) * 2018-07-13 2023-10-27 奇跃公司 用于显示双目变形补偿的系统和方法
CN110794644B (zh) * 2018-08-03 2023-02-24 扬明光学股份有限公司 光学装置及其制造方法
DE102018121258A1 (de) 2018-08-30 2020-03-05 Vr Coaster Gmbh & Co. Kg Head Mounted Display sowie Vergnügungseinrichtung mit einem solchen Head Mounted Display
US11174022B2 (en) * 2018-09-17 2021-11-16 International Business Machines Corporation Smart device for personalized temperature control
CN113348426A (zh) * 2018-09-18 2021-09-03 特兰斯罗博蒂克斯股份有限公司 基于对象检测来行动的技术
US12497671B2 (en) 2018-09-24 2025-12-16 Ecolab Usa Inc. Methods and compositions for pre-extractive beneficiation of ores
WO2020068819A1 (en) 2018-09-24 2020-04-02 Eyedaptic, Inc. Enhanced autonomous hands-free control in electronic visual aids
US12298519B2 (en) 2018-09-24 2025-05-13 Apple Inc. Display system with interchangeable lens
FR3087284B1 (fr) * 2018-10-15 2021-11-05 Amadeus Sas Procede et systeme de realite augmentee
JP7044034B2 (ja) * 2018-11-06 2022-03-30 トヨタ自動車株式会社 情報処理装置、情報処理方法およびプログラム
CN109559541B (zh) * 2018-11-20 2021-06-22 华东交通大学 一种无人驾驶交通工具路线管理系统
KR101942770B1 (ko) 2018-11-29 2019-01-28 네이버시스템(주) 지형지물의 영상이미지를 보정 후 합성처리하는 영상처리시스템
TWI687953B (zh) 2018-12-05 2020-03-11 宏碁股份有限公司 按鍵結構及其模式切換方法
EP3663904A1 (de) * 2018-12-07 2020-06-10 Iristick nv Tragbarer mobiler modus für kopfhörer
GB201820117D0 (en) * 2018-12-11 2019-01-23 Rolls Royce Plc Inspection system
CN111310530B (zh) * 2018-12-12 2023-06-30 百度在线网络技术（北京）有限公司 手语与语音转换的方法、装置、存储介质和终端设备
CN113196377B (zh) * 2018-12-20 2024-04-12 Ns西日本株式会社 显示光射出装置、平视显示装置、图像显示系统及头盔
CN109407325A (zh) * 2018-12-21 2019-03-01 周桂兵 一种多用途vr智能眼镜及其显示方法
CN109808711B (zh) * 2018-12-25 2020-07-07 南京师范大学 自动驾驶车辆控制方法及系统、自动驾驶车辆及视觉假体
TWI740083B (zh) * 2018-12-27 2021-09-21 雅得近顯股份有限公司 低光源環境顯示結構
CN109696747B (zh) * 2019-01-16 2022-04-12 京东方科技集团股份有限公司 一种vr显示装置及其控制方法
DE102019202512A1 (de) 2019-01-30 2020-07-30 Siemens Aktiengesellschaft Verfahren und Anordnung zur Ausgabe eines HUD auf einem HMD
CN109886170B (zh) * 2019-02-01 2019-12-17 河海大学 一种钉螺智能检测识别与统计系统
KR102185519B1 (ko) * 2019-02-13 2020-12-02 주식회사 싸이큐어 다이렉트 인코딩 방식의 씨스루 헤드 마운트 디스플레이를 위한 실세계 영상 왜곡 방법 및 실세계 영상 왜곡 기능을 가지는 다이렉트 인코딩 방식의 씨스루 헤드 마운트 디스플레이
KR20200099047A (ko) * 2019-02-13 2020-08-21 주식회사 싸이큐어 씨스루 헤드 마운트 디스플레이를 위한 실세계 영상 왜곡 방법 및 실세계 영상 왜곡 기능을 가지는 씨스루 헤드 마운트 디스플레이
US11803057B2 (en) 2019-03-06 2023-10-31 Ricoh Company, Ltd. Optical device, retinal projection display, head-mounted display, and optometric apparatus
TWI711005B (zh) * 2019-03-14 2020-11-21 宏碁股份有限公司 影像亮度調整方法及計算機程式產品
JP7462278B2 (ja) * 2019-03-27 2024-04-05 パナソニックＩｐマネジメント株式会社 ヘッドマウントディスプレイ
WO2020206313A1 (en) 2019-04-03 2020-10-08 Magic Leap, Inc. Managing and displaying webpages in a virtual three-dimensional space with a mixed reality system
CN110197601A (zh) * 2019-04-24 2019-09-03 薄涛 混合现实眼镜、移动终端以及教学系统、方法和介质
US11758702B2 (en) 2019-04-30 2023-09-12 Apple Inc. Noise mitigation for head-mounted device
KR20250142979A (ko) 2019-05-06 2025-09-30 루머스 리미티드 장면 및 근안 디스플레이를 관찰시키기 위한 투명 광 가이드
CN110110458B (zh) * 2019-05-14 2023-03-14 西安电子科技大学 基于高阶矩量法的形变共形阵列天线建模方法
CN110197142A (zh) * 2019-05-16 2019-09-03 谷东科技有限公司 微弱光线条件下的物体识别方法、装置、介质及终端设备
CN110175065A (zh) * 2019-05-29 2019-08-27 广州视源电子科技股份有限公司 一种用户界面的显示方法、装置、设备和存储介质
JP6641055B2 (ja) * 2019-05-29 2020-02-05 株式会社東芝 ウェアラブル端末、システム及び表示方法
CN110210390B (zh) * 2019-05-31 2021-08-31 维沃移动通信有限公司 指纹采集模组、指纹采集方法及终端
TWI870411B (zh) * 2019-06-04 2025-01-21 以色列商魯姆斯有限公司 具有能調節瞳距的機構的雙目型頭戴式顯示系統
US20220121283A1 (en) * 2019-06-12 2022-04-21 Hewlett-Packard Development Company, L.P. Finger clip biometric virtual reality controllers
CN110276578A (zh) * 2019-06-14 2019-09-24 武汉合创源科技有限公司 一种商品仓库安全监控系统及其方法
CN113692548B (zh) * 2019-06-21 2024-01-02 苹果公司 具有可移除透镜的显示和视力矫正系统
KR102897178B1 (ko) * 2019-06-23 2025-12-05 루머스 리미티드 포비티드 광학 보정에 의한 디스플레이
CN110363205B (zh) * 2019-06-25 2021-06-22 浙江大学 一种基于Talbot效应光学卷积的图像特征提取系统及方法
TWI807066B (zh) * 2019-07-08 2023-07-01 怡利電子工業股份有限公司 裸視３ｄ反射式擴散片抬頭顯示裝置
CN113316738B (zh) 2019-08-06 2024-05-17 松下知识产权经营株式会社 显示装置
CN110361707B (zh) * 2019-08-09 2023-03-14 成都玖锦科技有限公司 辐射源的运动状态动态模拟方法
US11419516B2 (en) * 2019-08-26 2022-08-23 GE Precision Healthcare LLC MRI system comprising patient motion sensor
WO2021040083A1 (ko) * 2019-08-28 2021-03-04 엘지전자 주식회사 머리에 착용할 수 있는 전자 디바이스
JP2022546413A (ja) 2019-08-29 2022-11-04 ディジレンズ インコーポレイテッド 真空回折格子および製造方法
KR20220058928A (ko) * 2019-09-05 2022-05-10 오픈 렌즈 프로젝트 리미티드 디지털 미디어 콘텐츠 관리 시스템 및 방법
CN112462932B (zh) * 2019-09-06 2025-01-10 苹果公司 带可穿戴或手持设备基于自混合干涉测量的手势输入系统
US11617504B2 (en) 2019-09-18 2023-04-04 Verily Life Sciences Llc Retinal camera with dynamic illuminator for expanding eyebox
US12153505B2 (en) * 2019-10-01 2024-11-26 Weiland Innovations Llc Automated system for generating properly tagged training data for and verifying the efficacy of artificial intelligence algorithms
KR102824477B1 (ko) * 2019-11-04 2025-06-24 엘지전자 주식회사 멀티미디어 디바이스 및 그 제어 방법
EP4546035A3 (de) * 2019-11-13 2025-06-18 Magic Leap, Inc. Umgebungslichtverwaltungssysteme und verfahren für wearable-vorrichtungen
KR102401854B1 (ko) * 2019-11-29 2022-06-08 주식회사 카이비전 다기능 증강현실 글라스
CN111160105A (zh) * 2019-12-03 2020-05-15 北京文香信息技术有限公司 一种视频图像的监测方法、装置、设备及存储介质
JP7170277B2 (ja) * 2019-12-09 2022-11-14 株式会社辰巳菱機 通報装置
CN111048215B (zh) * 2019-12-13 2023-08-18 北京纵横无双科技有限公司 一种基于crm的医疗视频制作方法及系统
CN110865461A (zh) * 2019-12-20 2020-03-06 西安睿雅赫工业科技合伙企业(普通合伙) 一种可内视化显示的智能眼镜
CN110908122A (zh) * 2019-12-20 2020-03-24 西安睿雅赫工业科技合伙企业(普通合伙) 一种分体式智能眼镜
CN111179301B (zh) * 2019-12-23 2023-06-30 北京中广上洋科技股份有限公司 一种基于计算机视频的运动趋势分析方法
US12256057B2 (en) 2019-12-31 2025-03-18 ResMed Asia Pte. Ltd. Positioning, stabilising, and interfacing structures and system incorporating same
US11983256B2 (en) * 2019-12-31 2024-05-14 Atlassian Pty Ltd. Illumination-based user authentication
CN112327313B (zh) * 2020-01-14 2024-03-29 必虎嘉骁光电技术(重庆)有限公司 一种双筒测距仪
US11157086B2 (en) * 2020-01-28 2021-10-26 Pison Technology, Inc. Determining a geographical location based on human gestures
IT202000001786A1 (it) * 2020-01-30 2021-07-30 Ncc Italy Soc Cooperativa Kit di assistenza e monitoraggio del servizio offerto dall’autista di un veicolo
WO2021154971A1 (en) * 2020-01-31 2021-08-05 Microchip Technology Incorporated Heads-up display using electrochromic elements
CN111317257B (zh) * 2020-03-25 2022-05-24 黑龙江工业学院 一种特殊儿童教育用多媒体讲桌
US12564236B2 (en) 2020-03-27 2026-03-03 ResMed Pty Ltd Positioning and stabilising structure and system incorporating same
US11598967B2 (en) 2020-03-27 2023-03-07 ResMed Pty Ltd Positioning and stabilising structure and system incorporating same
US11686948B2 (en) 2020-03-27 2023-06-27 ResMed Pty Ltd Positioning, stabilising, and interfacing structures and system incorporating same
US12178276B2 (en) 2020-03-27 2024-12-31 ResMed Pty Ltd Positioning and stabilising structure and system incorporating same
US12554140B2 (en) 2020-03-27 2026-02-17 ResMed Pty Ltd Positioning, stabilising, and interfacing structures and system incorporating same
KR102476287B1 (ko) * 2020-03-27 2022-12-09 레스메드 피티와이 엘티디 위치설정, 안정화 및 인터페이싱 구조물 및 이를 포함하는 시스템
CN111308715B (zh) 2020-03-31 2022-05-10 优奈柯恩(北京)科技有限公司 显示设备
JP2021163499A (ja) * 2020-03-31 2021-10-11 エイベックス・テクノロジーズ株式会社 拡張現実システム
JP2021163287A (ja) * 2020-03-31 2021-10-11 エイベックス・テクノロジーズ株式会社 拡張現実システム
CN111426283B (zh) * 2020-04-14 2022-12-06 昆山金智汇坤建筑科技有限公司 一种用于建筑现场测量的激光扫描设备
CA3176335A1 (en) * 2020-04-21 2021-10-28 Arjun Selvakumar Motion aware nodal seismic unit and related methods
US11915276B2 (en) 2020-04-28 2024-02-27 Cisco Technology, Inc. System, method, and computer readable storage media for millimeter wave radar detection of physical actions coupled with an access point off-load control center
KR20230004553A (ko) 2020-04-30 2023-01-06 루머스 리미티드 광학 샘플 특성화
WO2021240468A2 (en) * 2020-05-29 2021-12-02 Vrmedia S.R.L. System for augmented reality
KR102498191B1 (ko) * 2020-06-02 2023-02-10 주식회사 피앤씨솔루션 반사면을 포함하는 증강현실용 광학계 및 이를 이용한 머리 착용형 디스플레이 장치
CN111708170A (zh) * 2020-07-10 2020-09-25 温州明镜智能科技有限公司 一种新型vr眼镜镜片组合结构
US11513360B2 (en) 2020-07-17 2022-11-29 Toyota Research Institute, Inc. Enhanced contrast augmented reality (AR) tags for visual fiducial system
JP7442140B2 (ja) * 2020-09-10 2024-03-04 公益財団法人鉄道総合技術研究所 コンピュータシステムおよび制御方法
WO2022056327A1 (en) * 2020-09-11 2022-03-17 Fluke Corporation System and method for acoustic imaging with an accumulated-time view
CN112565720A (zh) * 2020-09-17 2021-03-26 苏州恒创文化传播有限公司 一种基于全息技术的3d投影系统
US12267585B2 (en) 2020-09-30 2025-04-01 Snap Inc. Ultra low power camera pipeline for CV in AR systems
EP4222951A1 (de) 2020-09-30 2023-08-09 Snap Inc. Mehrzweckkameras für anwendungen der erweiterten realität und des computersehens
JP7562061B2 (ja) * 2020-11-22 2024-10-07 斉 永岡 投影機能、ディスプレイ付きスマートグラス、及び出力端子
CN112370240A (zh) * 2020-12-01 2021-02-19 創啟社會科技有限公司 视障辅助智能眼镜、系统及其控制方法
IT202000028787A1 (it) * 2020-12-01 2022-06-01 Virtual Job Sistema e metodo di utilizzo di un software informatico e di componenti hardware per l’apprendimento delle procedure di sicurezza sui luoghi di lavoro caratterizzato dall’utilizzo della realtà virtuale
DE102020215285A1 (de) 2020-12-03 2022-06-09 Robert Bosch Gesellschaft mit beschränkter Haftung Verfahren zur Parallaxeregelung und binokulare Datenbrille mit einer Recheneinheit zu einem Durchführen des Verfahrens
CN112807654B (zh) * 2020-12-05 2021-12-17 淮北禾获人科技有限公司 竞走比赛电子化判决平台及方法
CA3202685A1 (en) * 2020-12-17 2022-06-23 Edo Waks Methods and systems for image correction and processing in high-magnification photography exploiting partial reflectors
EP4252048A4 (de) * 2020-12-21 2024-10-16 Digilens Inc. Augenglimmunterdrückung in wellenleiterbasierten anzeigen
CN112904803B (zh) * 2021-01-15 2022-05-03 西安电子科技大学 多拼接面形变及平面度精细调整系统、方法、设备及应用
JP2022113031A (ja) * 2021-01-22 2022-08-03 ソフトバンク株式会社 制御装置、プログラム、システム及び制御方法
TWI769815B (zh) * 2021-02-03 2022-07-01 大立光電股份有限公司 塑膠光轉折元件、成像鏡頭模組及電子裝置
CN112819590B (zh) * 2021-02-25 2023-03-10 紫光云技术有限公司 一种云产品服务交付过程中产品配置信息管理的方法
JP7540364B2 (ja) * 2021-02-26 2024-08-27 セイコーエプソン株式会社 光学モジュール及び頭部装着型表示装置
US11307825B1 (en) * 2021-02-28 2022-04-19 International Business Machines Corporation Recording a separated sound from a sound stream mixture on a personal device
WO2022207145A1 (en) * 2021-03-31 2022-10-06 Arm Limited Systems, devices, and/or processes for dynamic surface marking
US12073640B2 (en) 2021-03-31 2024-08-27 Arm Limited Systems, devices, and/or processes for dynamic surface marking
US11995904B2 (en) 2021-03-31 2024-05-28 Arm Limited Systems, devices, and/or processes for dynamic surface marking
US12073641B2 (en) 2021-03-31 2024-08-27 Arm Limited Systems, devices, and/or processes for dynamic surface marking
WO2022212072A1 (en) * 2021-03-31 2022-10-06 Snap Inc. Eyewear projector brightness control
CN113064280A (zh) * 2021-04-08 2021-07-02 恒玄科技(上海)股份有限公司 一种智能显示设备
US11892624B2 (en) * 2021-04-27 2024-02-06 Microsoft Technology Licensing, Llc Indicating an off-screen target
CN113240818A (zh) * 2021-04-29 2021-08-10 广东元一科技实业有限公司 一种模拟和显示假人模型服装的方法
US12003697B2 (en) 2021-05-06 2024-06-04 Samsung Electronics Co., Ltd. Wearable electronic device and method of outputting three-dimensional image
CN113112183B (zh) * 2021-05-06 2024-03-19 国家市场监督管理总局信息中心 一种出入境危险货物风险评估的方法、系统和可读存储介质
KR20220151420A (ko) * 2021-05-06 2022-11-15 삼성전자주식회사 웨어러블 전자 장치 및 3d 이미지 출력 방법
CN113115008B (zh) * 2021-05-17 2023-05-19 哈尔滨商业大学 一种管廊主从操作巡检系统及方法
KR102337907B1 (ko) * 2021-05-20 2021-12-09 주식회사 아진엑스텍 증강 현실 스마트 글래스 장치
GB2608186B (en) * 2021-06-25 2026-01-07 Thermoteknix Systems Ltd Augmented Reality System
CN113569645B (zh) * 2021-06-28 2024-03-22 广东技术师范大学 基于图像检测的轨迹生成方法、装置及系统
TR2021010513A1 (tr) * 2021-06-28 2023-01-23 Kaitek Yazilim Elektronik Bilg San Tic Ltd Sti Bir göz takip ve ivmeölçer özellikli karma gerçeklik gözlüğü ile seri üretim süreç analizi yapan sistem
CN113503867A (zh) * 2021-07-16 2021-10-15 吕国浩 一种新型测量放样工具
KR102321470B1 (ko) * 2021-07-28 2021-11-03 주식회사 셀리코 전기변색층 기반의 시력 보조 장치 및 이를 포함하는 시력 보조 안경
CN113576560B (zh) * 2021-08-19 2025-02-18 北京航天总医院 全息胸腔镜系统
HU231709B1 (hu) * 2021-08-31 2025-10-28 Pázmány Péter Katolikus Egyetem Kiterjesztett valóság alapú rendszer és eljárás
CN113867007A (zh) * 2021-09-01 2021-12-31 中联通服(北京)通讯技术有限公司 一种应用于智能眼镜的可前后调节式结构
CN113820862B (zh) 2021-09-10 2023-06-27 维沃移动通信有限公司 光学镜片和光学眼镜
US20230077780A1 (en) * 2021-09-16 2023-03-16 International Business Machines Corporation Audio command corroboration and approval
CN115967855B (zh) * 2021-10-08 2024-12-27 台中科技大学 整合实时录像与截图功能的同步直播教学装置
CN114115453B (zh) * 2021-10-21 2024-02-09 维沃移动通信有限公司 电子设备
WO2023076841A1 (en) * 2021-10-25 2023-05-04 Atieva, Inc. Contextual vehicle control with visual representation
KR102362038B1 (ko) * 2021-10-27 2022-02-14 김종찬 열차 차량용 영화상영 스크린 장치
CN114047829B (zh) * 2021-10-28 2024-11-22 西安微电子技术研究所 一种键盘鼠标设备共享方法
CN114030355A (zh) * 2021-11-15 2022-02-11 智己汽车科技有限公司 一种车辆控制方法、装置、车辆及介质
KR102631231B1 (ko) * 2021-11-17 2024-01-31 주식회사 피앤씨솔루션 보호 커버를 구비한 증강현실 글래스 장치 및 증강현실 글래스 장치용 보호 커버
GB202116754D0 (en) * 2021-11-19 2022-01-05 Sensivision Ltd Handheld guidance device for the visually-impaired
JP7818941B2 (ja) * 2021-11-30 2026-02-24 キヤノン株式会社 ウェアラブルデバイス、制御装置、システム、制御方法、プログラム
WO2023107251A1 (en) * 2021-12-06 2023-06-15 Lumileds Llc Optical filters compensating for changes in performance of next generation leds compared to legacy devices
US11914093B2 (en) * 2021-12-07 2024-02-27 Microsoft Technology Licensing, Llc RF antenna scanning for human movement classification
US11908356B2 (en) * 2021-12-15 2024-02-20 Motorola Mobility Llc Augmented reality display device having contextual adaptive brightness
CN114399993A (zh) * 2021-12-20 2022-04-26 南京模拟技术研究所 一种规范执法训练系统
US12337845B1 (en) * 2021-12-23 2025-06-24 United Services Automobile Association (Usaa) Method and system for automatically detecting a vehicle accident
US12088781B2 (en) * 2021-12-30 2024-09-10 Snap Inc. Hyper-connected and synchronized AR glasses
US20230222197A1 (en) * 2022-01-07 2023-07-13 Jumio Corporation Biometric Authentication Using Head-Mounted Devices
US20250069402A1 (en) * 2022-01-13 2025-02-27 Nec Corporation Information processing apparatus, information processing method, and non-transitory storage medium
US12313845B2 (en) * 2022-01-24 2025-05-27 Microsoft Technology Licensing, Llc Illuminating spatial light modulator with LED array
AU2022439107A1 (en) 2022-02-01 2024-09-19 Landscan Llc Systems and methods for multispectral landscape mapping
US12282963B1 (en) 2022-02-08 2025-04-22 United Services Automobile Association (Usaa) Automatedly generating and issuing accident data gathering recommendations following a vehicle accident
US12205456B1 (en) 2022-03-01 2025-01-21 United Services Automobile Association (Usaa) Automatic vehicle accident notifications within a distributed network of recipients
JP7758160B2 (ja) * 2022-03-18 2025-10-22 日本電気株式会社 消火活動支援装置、消火活動支援方法、及び、消火活動支援プログラム
CN118451367A (zh) * 2022-03-25 2024-08-06 华为技术有限公司 能够进行图像投影的电子通信设备
US20230306499A1 (en) * 2022-03-28 2023-09-28 Google Llc Vision-powered auto-scroll for lists
US11556010B1 (en) * 2022-04-01 2023-01-17 Wen-Tsun Wu Mini display device
CN114995856B (zh) * 2022-06-20 2024-08-16 中国航空工业集团公司沈阳飞机设计研究所 一种地面智能系统与机载智能系统的数据升级方法
US12092822B2 (en) 2022-06-30 2024-09-17 Vuzix Corporation Multi-antenna augmented reality display
CN115278021B (zh) * 2022-07-27 2024-11-19 唐山学院 一种物联网图像采集装置
US12105926B2 (en) * 2022-07-28 2024-10-01 Ntt Docomo, Inc. XR manipulation feature with smart watch
CN115049643A (zh) * 2022-08-11 2022-09-13 武汉精立电子技术有限公司 近眼显示模组夹层异物检测方法、装置、设备及存储介质
JP2024025272A (ja) * 2022-08-12 2024-02-26 キヤノン株式会社 情報処理装置、情報処理方法、プログラム
US20240064420A1 (en) * 2022-08-18 2024-02-22 Apple Inc. Cameras for multiple views
JPWO2024070729A1 (de) * 2022-09-28 2024-04-04
WO2024112017A1 (ko) * 2022-11-23 2024-05-30 삼성전자 주식회사 두부 착용형 전자 장치 및 이의 동작 방법
US12198641B2 (en) 2022-11-23 2025-01-14 Samsung Electronics Co., Ltd. Head-mounted electronic device and method for operating the same
US12229316B1 (en) 2022-12-22 2025-02-18 United Services Automobile Association (Usaa) Anonymized transfer of personally identifiable information
US12079071B2 (en) * 2023-01-12 2024-09-03 Qualcomm Incorporated Programmable initial packets rejection in a display system interface
WO2024162501A1 (ko) * 2023-02-02 2024-08-08 엘지전자 주식회사 전자 디바이스
DE112024000400T5 (de) * 2023-02-15 2025-10-09 Ams-Osram International Gmbh Eyetracker-modul, eyetracking-verfahren und eyetracker-system
JP2024116742A (ja) 2023-02-16 2024-08-28 キヤノン株式会社 情報処理システム
US12401738B2 (en) * 2023-02-22 2025-08-26 Szu Cheng Ma Wi-Fi hotspot translation mobile phone
CN116389674B (zh) * 2023-03-28 2024-04-26 射阳港海会议服务有限公司 一种远程会议视频装置
CN116186418B (zh) * 2023-04-27 2023-07-04 深圳市夜行人科技有限公司 一种微光成像系统推荐方法、系统及介质
CN116244238B (zh) * 2023-05-12 2023-07-18 中国船舶集团有限公司第七〇七研究所 光纤陀螺用rs422协议和rs232协议兼容的方法及线路
WO2024235768A1 (de) * 2023-05-16 2024-11-21 Volkswagen Aktiengesellschaft Verfahren und vorrichtung zur komfortoptimierten anpassungen einer helligkeit und/oder lautstärke bei einer nutzung einer vr-brille in einem fahrzeug
CN116704922B (zh) * 2023-06-25 2026-02-10 重庆长安汽车股份有限公司 车载抬头显示系统的调节方法、装置、设备及存储介质
JP2025011383A (ja) * 2023-07-11 2025-01-24 株式会社リコー 撮像装置、送信方法、プログラム
JPWO2025022246A1 (de) * 2023-07-25 2025-01-30
CN117195738B (zh) * 2023-09-27 2024-03-12 广东翼景信息科技有限公司 一种面向无人机走廊的基站天线设置与上倾角优化方法
WO2025082571A1 (de) * 2023-10-20 2025-04-24 Continental Automotive Technologies GmbH Gerät zum generieren eines virtuellen bildes mit specklingreduzierendem lichtmischstab
US12613576B2 (en) 2023-12-18 2026-04-28 Samsung Electronics Co., Ltd. Wearable device providing immersive experience and method of controlling same
GB2640264A (en) * 2024-04-09 2025-10-15 Envisics Ltd Light control device
US20250325219A1 (en) * 2024-04-17 2025-10-23 Natus Acquisition Ii, Llc Dynamic Posturography Apparatus with Tunable Optics
KR102772223B1 (ko) * 2024-08-30 2025-02-25 김상화 스마트 글라스 디스플레이 장치
CN119601169B (zh) * 2024-11-28 2025-06-10 扬中市人民医院 一种便于调整患者站姿的智能定位系统及其方法
CN120333540B (zh) * 2025-04-25 2026-04-21 深圳市时纬自动化有限公司 用于汽车门锁智能装配检测的动态质量监控系统
CN120235012B (zh) * 2025-05-29 2025-08-26 中国科学院长春光学精密机械与物理研究所 激光损伤阈值分析方法
CN120439523B (zh) * 2025-07-14 2025-10-17 深圳市博硕科技股份有限公司 一种fpc电路板植入注塑模具

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH09139927A (ja) * 1995-11-15 1997-05-27 Matsushita Electric Ind Co Ltd 多地点画像伝送装置
JP3921915B2 (ja) * 2000-03-22 2007-05-30 松下電器産業株式会社 ディスプレイ装置
CN1922651A (zh) * 2004-06-10 2007-02-28 松下电器产业株式会社 穿戴型信息提示装置
JP4635572B2 (ja) * 2004-11-09 2011-02-23 コニカミノルタホールディングス株式会社 映像表示装置
CN101243392A (zh) * 2005-08-15 2008-08-13 皇家飞利浦电子股份有限公司 用于终端用户编程的增强现实眼镜的系统、设备和方法
JP2008176681A (ja) * 2007-01-22 2008-07-31 Fujifilm Corp 眼鏡型コミュニケーション支援装置
JP5309448B2 (ja) * 2007-01-26 2013-10-09 ソニー株式会社 表示装置、表示方法
JP2009222774A (ja) * 2008-03-13 2009-10-01 Fujifilm Corp デジタルコンテンツ再生装置及びデジタルコンテンツの再生制御方法
KR101576567B1 (ko) * 2009-12-04 2015-12-10 한국전자통신연구원 제스처 입력 장치 및 이를 이용한 제스처 인식 방법 및 장치
WO2011106797A1 (en) * 2010-02-28 2011-09-01 Osterhout Group, Inc. Projection triggering through an external marker in an augmented reality eyepiece
US20110213664A1 (en) * 2010-02-28 2011-09-01 Osterhout Group, Inc. Local advertising content on an interactive head-mounted eyepiece
JP6211144B1 (ja) * 2016-07-04 2017-10-11 株式会社コロプラ 表示制御方法および当該表示制御方法をコンピュータに実行させるためのプログラム

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
No further relevant documents disclosed *
See also references of WO2013049248A2 *

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11150738B2 (en) 2014-07-31 2021-10-19 Samsung Electronics Co., Ltd. Wearable glasses and method of providing content using the same
WO2016037332A1 (zh) * 2014-09-11 2016-03-17 华为技术有限公司 一种移动终端
US10379338B2 (en) 2014-09-11 2019-08-13 Huawei Technologies Co., Ltd. Mobile terminal with a periscope optical zoom lens
CN106239513A (zh) * 2016-08-29 2016-12-21 合肥凌翔信息科技有限公司 一种远程控制机器人系统
CN108205416A (zh) * 2016-12-20 2018-06-26 乐视汽车（北京）有限公司 利用车机激活终端屏幕的方法、车机及智能汽车
US11631380B2 (en) 2018-03-14 2023-04-18 Sony Corporation Information processing apparatus, information processing method, and recording medium
WO2020044198A1 (en) * 2018-08-26 2020-03-05 Lumus Ltd. Reflection suppression in near eye displays
AU2019330119B2 (en) * 2018-08-26 2023-08-24 Lumus Ltd. Reflection suppression in near eye displays

Also Published As

Publication number Publication date
EP2761362A4 (de) 2014-08-06
CN103946732B (zh) 2019-06-14
JP2015504616A (ja) 2015-02-12
CN103946732A (zh) 2014-07-23
WO2013049248A2 (en) 2013-04-04
KR20140066258A (ko) 2014-05-30
WO2013049248A3 (en) 2013-07-04

Similar Documents

Publication Publication Date Title
US11275482B2 (en) Ar glasses with predictive control of external device based on event input
US10852540B2 (en) AR glasses with event and user action control of external applications
US8964298B2 (en) Video display modification based on sensor input for a see-through near-to-eye display
US20200192089A1 (en) Head-worn adaptive display
US8467133B2 (en) See-through display with an optical assembly including a wedge-shaped illumination system
US9341843B2 (en) See-through near-eye display glasses with a small scale image source
US9129295B2 (en) See-through near-eye display glasses with a fast response photochromic film system for quick transition from dark to clear
US9097891B2 (en) See-through near-eye display glasses including an auto-brightness control for the display brightness based on the brightness in the environment
US9223134B2 (en) Optical imperfections in a light transmissive illumination system for see-through near-eye display glasses
US9366862B2 (en) System and method for delivering content to a group of see-through near eye display eyepieces
US9097890B2 (en) Grating in a light transmissive illumination system for see-through near-eye display glasses
US9182596B2 (en) See-through near-eye display glasses with the optical assembly including absorptive polarizers or anti-reflective coatings to reduce stray light
US8482859B2 (en) See-through near-eye display glasses wherein image light is transmitted to and reflected from an optically flat film
US9229227B2 (en) See-through near-eye display glasses with a light transmissive wedge shaped illumination system
US8477425B2 (en) See-through near-eye display glasses including a partially reflective, partially transmitting optical element
US8472120B2 (en) See-through near-eye display glasses with a small scale image source
US9134534B2 (en) See-through near-eye display glasses including a modular image source
US8488246B2 (en) See-through near-eye display glasses including a curved polarizing film in the image source, a partially reflective, partially transmitting optical element and an optically flat film
US20130278631A1 (en) 3d positioning of augmented reality information
US20170344114A1 (en) Ar glasses with predictive control of external device based on event input
US20160187654A1 (en) See-through near-eye display glasses with a light transmissive wedge shaped illumination system
US20120212484A1 (en) System and method for display content placement using distance and location information
US20120212499A1 (en) System and method for display content control during glasses movement
US20120242698A1 (en) See-through near-eye display glasses with a multi-segment processor-controlled optical layer
US20120235887A1 (en) See-through near-eye display glasses including a partially reflective, partially transmitting optical element and an optically flat film

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20140325

A4 Supplementary search report drawn up and despatched

Effective date: 20140624

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

17Q First examination report despatched

Effective date: 20140815

DAX Request for extension of the european patent (deleted)
RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: MICROSOFT TECHNOLOGY LICENSING, LLC

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20150226