Login| Sign Up| Help| Contact|

Patent Searching and Data


Title:
SYSTEMS AND METHODS FOR MULTIPLYING THE IMAGE RESOLUTION OF A PIXELATED DISPLAY
Document Type and Number:
WIPO Patent Application WO/2019/079350
Kind Code:
A2
Abstract:
Systems integrating display resolution-multiplication solutions can be implemented in a variety of different ways. In many embodiments, the system includes an image projector for projecting image light, an image processor for computing a native image and at least one image shifted in a predefined direction, and at least one switchable grating capable of being switched between diffracting and non-diffracting states. In some embodiments, the switchable grating is optically coupled to the image projector. In a number of embodiments, the switchable gratings have a first configuration for propagating the native image light and at least one other configuration for propagating shifted image light having an angular displacement corresponding to the image shift in a predefined direction. By displaying the native and shifted images sequentially within a human eye integration period, the display resolution can be multiplied.

More Like This:
Inventors:
WALDERN JONATHAN (US)
GRANT ALASTAIR (US)
POPOVICH MILAN (GB)
Application Number:
PCT/US2018/056150
Publication Date:
April 25, 2019
Filing Date:
October 16, 2018
Export Citation:
Click for automatic bibliography generation   Help
Assignee:
DIGILENS INC (US)
International Classes:
G03B21/14; G06F3/01
Attorney, Agent or Firm:
HOANG, Loi, T. (US)
Download PDF:
Claims:
WHAT IS CLAIMED IS:

1 . An apparatus for multiplying display resolution, the apparatus comprising: an image projector for directing light from pixels of a pixelated image source into unique angular directions;

an image processor for computing a native image and at least one image shift in a predefined direction for sequential display by the image projector; and

at least one switchable grating switchable between diffracting and non- diffracting states optically coupled to the image projector, wherein the at least one switchable grating have a first configuration for propagating the light of the native image and at least one configuration for propagating the light of the shifted image with an angular displacement corresponding to the image shift in the predefined direction.

2. The apparatus of claim 1 , wherein the at least one switchable grating is disposed within at least one waveguide.

3. The apparatus of claim 1 , wherein the at least one switchable grating comprises first, second, third, fourth gratings, wherein the first grating overlaps the third grating and the second grating overlaps the fourth grating, wherein the first and third gratings act as input couplers and the second and fourth gratings act as output couplers, wherein the first configuration is provided by one of the first or third gratings and one of the second or fourth gratings in their diffracting states, and wherein the at least one configuration for propagating shifted image light are provided by at least one other combination of diffracting states of the first, second, third, and fourth gratings.

4. The apparatus of claim 3, wherein the first and second gratings are disposed in a first layer within a waveguide and the third and fourth gratings are disposed in a second layer within the waveguide.

5. The apparatus of claim 1 , wherein the at least one switchable grating comprises first and second gratings disposed in a first waveguide and third and fourth gratings disposed in a second waveguide, wherein the first grating overlaps the third grating and the second grating overlaps the fourth grating, wherein the first and third gratings act as input couplers and the second and fourth gratings act as output couplers, wherein the first configuration is provided when the first and second gratings are in their diffracting states, and wherein the second configuration is provided when the first and second gratings are in their non-diffracting states.

6. The apparatus of claim 1 , wherein the image shift is equal to N+1/2 times a pixel dimension, where N is an integer.

7. The apparatus of claim 1 , wherein the native and shifted images are sequentially displayed within a human eye integration period.

8. The apparatus of claim 1 , wherein the image shift is one of vertical or horizontal shifts.

9. The apparatus of claim 1 , wherein the at least one image shift comprises vertical and horizontal shifts.

10. The apparatus of claim 1 , wherein the switchable gratings are recorded in a holographic polymer dispersed, switchable Bragg grating.

1 1 . The apparatus of claim 1 , wherein the at least one switchable grating is disposed in a waveguide further comprising a non-switching grating.

12. The apparatus of claim 1 , wherein the at least one switchable grating is disposed in a waveguide further comprising a fold grating.

13. Apparatus of claim 1 wherein at least one switchable grating includes at least one grating multiplexing at least one of wavelength or angular bandwidth.

14. The apparatus of claim 1 , wherein the apparatus forms part of a HMD, a HUD, an eye-slaved display, a dynamic focus display, or a light field display.

15. The apparatus of claim 1 , wherein the image projector further comprises a microdisplay panel.

16. The apparatus of claim 1 , wherein the image projector is optically coupled to the first grating and the third grating by one of a prism or grating.

17. The apparatus of claim 1 , further comprising an illumination homogenizer.

18. The apparatus of claim 1 wherein at least one of the gratings is a rolled k- vector grating.

19. The apparatus of claim 1 , wherein the waveguide further comprises an input coupler, a fold grating, and an output coupler.

20. A method of multiplying the resolution of a waveguide display, the method comprising:

providing an image projector and an image processor;

providing a waveguide containing first, second, third and fourth switchable gratings with the first and third gratings substantially overlapping and the second and fourth gratings substantially overlapping, wherein each grating have an optical prescription for applying an angular shift to incident light;

selecting pixel shift (N+1/2) multiplied by P, where N is an integer greater than or equal to zero and P is a pixel dimension;

computing a shifted image using the image processor;

writing a shifted image to the image projector;

switching one of the first and third switchable gratings and one of the second and fourth switchable gratings into their diffracting states;

coupling shifted image light into the waveguide via the diffracting first or third switchable gratings;

coupling image light out of the waveguide via the diffracting second or fourth switchable gratings with a pixel shift determined by the prescriptions of the diffracting switchable gratings.

Description:
SYSTEMS AND METHODS FOR MULTIPLYING THE IMAGE RESOLUTION

OF A PIXELATED DISPLAY

FIELD OF THE INVENTION

[0001] The present invention generally relates to displays and, more specifically, to holographic devices for multiplying the resolution of pixelated displays.

BACKGROUND

[0002] Waveguides can be referred to as structures with the capability of confining and guiding waves (i.e., restricting the spatial region in which waves can propagate). One subclass includes optical waveguides, which are structures that can guide electromagnetic waves, typically those in the visible spectrum. Waveguide structures can be designed to control the propagation path of waves using a number of different mechanisms. For example, planar waveguides can be designed to utilize diffraction gratings to diffract and couple incident light into the waveguide structure such that the in- coupled light can proceed to travel within the planar structure via total internal reflection ("TIR").

[0003] Fabrication of waveguides can include the use of material systems that allow for the recording of holographic optical elements within the waveguides. One class of such material includes polymer dispersed liquid crystal ("PDLC") mixtures, which are mixtures containing photopolymerizable monomers and liquid crystals. A further subclass of such mixtures includes holographic polymer dispersed liquid crystal ("HPDLC") mixtures. Holographic optical elements, such as volume phase gratings, can be recorded in such a liquid mixture by illuminating the material with two mutually coherent laser beams. During the recording process, the monomers polymerize and the mixture undergoes a photopolymerization-induced phase separation, creating regions densely populated by liquid crystal micro-droplets, interspersed with regions of clear polymer. The alternating liquid crystal-rich and liquid crystal-depleted regions form the fringe planes of the grating. [0004] Waveguide optics, such as those described above, can be considered for a range of display and sensor applications. In many applications, waveguides containing one or more grating layers encoding multiple optical functions can be realized using various waveguide architectures and material systems, enabling new innovations in near- eye displays for augmented reality ("AR") and virtual reality ("VR"), compact heads-up displays ("HUDs") for aviation and road transport, and sensors for biometric and laser radar ("LIDAR") applications.

SUMMARY OF THE INVENTION

[0005] One embodiment includes an apparatus for multiplying display resolution, the apparatus including an image projector for directing light from pixels of a pixelated image source into unique angular directions, an image processor for computing a native image and at least one image shift in a predefined direction for sequential display by the image projector, and at least one switchable grating switchable between diffracting and non- diffracting states optically coupled to the image projector, wherein the at least one switchable grating have a first configuration for propagating the light of the native image and at least one configuration for propagating the light of the shifted image with an angular displacement corresponding to the image shift in the predefined direction.

[0006] In another embodiment, the at least one switchable grating is disposed within at least one waveguide.

[0007] In a further embodiment, the at least one switchable grating includes first, second, third, fourth gratings, wherein the first grating overlaps the third grating and the second grating overlaps the fourth grating, wherein the first and third gratings act as input couplers and the second and fourth gratings act as output couplers, wherein the first configuration is provided by one of the first or third gratings and one of the second or fourth gratings in their diffracting states, and wherein the at least one configuration for propagating shifted image light are provided by at least one other combination of diffracting states of the first, second, third, and fourth gratings.

[0008] In still another embodiment, the first and second gratings are disposed in a first layer within a waveguide and the third and fourth gratings are disposed in a second layer within the waveguide. [0009] In a still further embodiment, the at least one switchable grating includes first and second gratings disposed in a first waveguide and third and fourth gratings disposed in a second waveguide, wherein the first grating overlaps the third grating and the second grating overlaps the fourth grating, wherein the first and third gratings act as input couplers and the second and fourth gratings act as output couplers, wherein the first configuration is provided when the first and second gratings are in their diffracting states, and wherein the second configuration is provided when the first and second gratings are in their non-diffracting states.

[0010] In yet another embodiment, the image shift is equal to N+1/2 times a pixel dimension, where N is an integer.

[0011] In a yet further embodiment, the native and shifted images are sequentially displayed within a human eye integration period.

[0012] In another additional embodiment, the image shift is one of vertical or horizontal shifts.

[0013] In a further additional embodiment, the at least one image shift includes vertical and horizontal shifts.

[0014] In another embodiment again, the switchable gratings are recorded in a holographic polymer dispersed, switchable Bragg grating.

[0015] In a further embodiment again, the at least one switchable grating is disposed in a waveguide further including a non-switching grating.

[0016] In still yet another embodiment, the at least one switchable grating is disposed in a waveguide further including a fold grating.

[0017] In a still yet further embodiment, at least one switchable grating includes at least one grating multiplexing at least one of wavelength or angular bandwidth.

[0018] In still another additional embodiment, the apparatus forms part of a HMD, a

HUD, an eye-slaved display, a dynamic focus display, or a light field display.

[0019] In a still further additional embodiment, the image projector further includes a microdisplay panel.

[0020] In still another embodiment again, the image projector is optically coupled to the first grating and the third grating by one of a prism or grating. [0021] In a still further embodiment again, the apparatus further includes an illumination homogenizer.

[0022] In yet another additional embodiment, at least one of the gratings is a rolled k- vector grating.

[0023] In a yet further additional embodiment, the waveguide further includes an input coupler, a fold grating, and an output coupler.

[0024] Yet another embodiment again includes a method of multiplying the resolution of a waveguide display, the method including providing an image projector and an image processor, providing a waveguide containing first, second, third and fourth switchable gratings with the first and third gratings substantially overlapping and the second and fourth gratings substantially overlapping, wherein each grating have an optical prescription for applying an angular shift to incident light, selecting pixel shift (N+1/2) multiplied by P, where N is an integer greater than or equal to zero and P is a pixel dimension, computing a shifted image using the image processor, writing a shifted image to the image projector, switching one of the first and third switchable gratings and one of the second and fourth switchable gratings into their diffracting states, coupling shifted image light into the waveguide via the diffracting first or third switchable gratings, coupling image light out of the waveguide via the diffracting second or fourth switchable gratings with a pixel shift determined by the prescriptions of the diffracting switchable gratings.

[0025] Additional embodiments and features are set forth in part in the description that follows, and in part will become apparent to those skilled in the art upon examination of the specification or may be learned by the practice of the invention. A further understanding of the nature and advantages of the present invention may be realized by reference to the remaining portions of the specification and the drawings, which forms a part of this disclosure.

BRIEF DESCRIPTION OF THE DRAWINGS

[0026] The description will be more fully understood with reference to the following figures and data graphs, which are presented as exemplary embodiments of the invention and should not be construed as a complete recitation of the scope of the invention. [0027] FIGs. 1 A and 1 B conceptually illustrate schematic cross-sectional views of two operational states of a resolution-multiplication waveguide device in accordance with an embodiment of the invention.

[0028] FIG. 2 conceptually illustrates a schematic cross-sectional view of a resolution- multiplication waveguide device in accordance with an embodiment of the invention.

[0029] FIG. 3A conceptually illustrates a schematic cross-sectional view of a first operational state of a resolution-multiplication waveguide device optically interfaced to a waveguide display in accordance with an embodiment of the invention.

[0030] FIG. 3B conceptually illustrates a schematic cross-sectional view of a second operational state of a resolution-multiplication waveguide device optically interfaced to a waveguide display in accordance with an embodiment of the invention.

[0031] FIGs. 4A-4D conceptually illustrate front elevation views of four pixel-shifting steps used to provide resolution-quadrupling in some embodiments in accordance with an embodiment of the invention

[0032] FIGs. 5A-5D conceptually illustrate schematic cross-sectional views of four operational state of a resolution-quadrupling waveguide device in accordance with an embodiment of the invention.

[0033] FIG. 6 conceptually illustrates a flow chart illustrating a method of multiplying the resolution of a waveguide display in accordance with an embodiment of the invention.

DETAILED DESCRIPTION

[0034] For the purposes of describing embodiments, some well-known features of optical technology known to those skilled in the art of optical design and visual displays have been omitted or simplified in order to not obscure the basic principles of the invention. Unless otherwise stated the term "on-axis" in relation to a ray or a beam direction refers to propagation parallel to an axis normal to the surfaces of the optical components described in relation to the invention. In the following description the terms light, ray, beam, and direction may be used interchangeably and in association with each other to indicate the direction of propagation of electromagnetic radiation along rectilinear trajectories. The term light and illumination may be used in relation to the visible and infrared bands of the electromagnetic spectrum. Parts of the following description will be presented using terminology commonly employed by those skilled in the art of optical design. As used herein, the term grating may encompass a grating comprised of a set of gratings in some embodiments. For illustrative purposes, it is to be understood that the drawings are not drawn to scale unless stated otherwise.

[0035] Turning now to the drawings, systems and methods for multiplying display resolution relating to near-eye display or head up display systems in accordance with various embodiments of the invention are illustrated. Waveguide optics can be considered for a range of display and sensor applications, such as but not limited to AR, VR, HUDs, LIDAR applications. Different applications can have different requirements in terms of performance, form factor, and cost of manufacturing. There is a growing consensus that the prerequisite for a successful head mounted AR display is a small, low impact form factor, high brightness, and wide field of view ("FOV") display with high enough resolution to fill the FOV with image detail. In many cases, it can be desirable to have a 50-degree FOV display supported by a resolution of at least 1080p (1920 x 1080 pixels in 16:9 aspect ratio HD Widescreen standard). To meet certain wearable form factor demands, the microdisplay used to provide the input image should conform to certain dimensions. For many applications, the microdisplay should not be greater than 0.23-inches diagonal. However, current pixel sizes typically do not permit 1080p pixel resolution into such a small display area. One way of overcoming the FOV/resolution bottleneck includes the use of image resolution-multiplication. One well-established technique pioneered by Texas Instruments in their rear projection TVs combines a fast switching DLP technology with a high-speed mechanical mirror to enable pixel doubling in order to attain 1080p resolution. However, such solutions are unsuited for AR wearables, both in terms of form factor and industry resistance to mechanical complexity and cost. Alternative technologies such as organic LED are not mature enough to deliver 1080p resolution with high brightness cost-effectively. To address these issues, many embodiments of the invention are directed towards compact, optically efficient, and cost-effective solutions for display resolution-multiplication and the integration of such solutions within waveguide displays.

[0036] Systems integrating display resolution-multiplication solutions can be implemented in a variety of different ways. In many embodiments, the system includes an image projector for projecting image light, an image processor for computing a native image and at least one image shifted in a predefined direction, and at least one switchable grating capable of being switched between diffracting and non-diffracting states. In further embodiments, the switchable grating is a Switchable Bragg Grating ("SBG") implemented in a resolution-multiplication waveguide. SBGs can be implemented in waveguides to reduce the thickness and the number of layers in the system when compared to conventional systems. SBGs can also be implemented to increase the field of view by tiling images presented sequentially on a microdisplay. In some embodiments, the switchable grating is optically coupled to the image projector. In a number of embodiments, the switchable gratings have a first configuration for propagating the native image light and at least one other configuration for propagating shifted image light having an angular displacement corresponding to the image shift in a predefined direction. By displaying the native and shifted images sequentially within a human eye integration period, the display resolution can be multiplied. Holographic waveguide technologies and display resolution-multiplication solutions are discussed below in further detail.

Switchable Bragg Gratings

[0037] Holographic waveguide technology can be advantageously implemented in waveguides for helmet-mounted displays or head-mounted displays ("HMDs") and heads- up displays for many applications, including but not limited to military applications and consumer applications (e.g., augmented reality glasses, etc.). In a number of embodiments, a larger exit pupil can be created by using fold gratings in conjunction with conventional gratings to provide pupil expansion on a single waveguide in both the horizontal and vertical directions, allowing for the preservation of eye box size while reducing lens size. Using the systems and methods disclosed herein, a single optical waveguide substrate can generate a wider field of view compared to current waveguide systems. In such embodiments, diffraction gratings can be used to split and diffract light rays into several beams that travel in different directions, thereby dispersing the light rays.

[0038] Optical structures recorded in waveguides can include many different types of optical elements, such as but not limited to diffraction gratings. In many embodiments, the grating implemented is a Bragg grating (also referred to as a volume grating). Bragg gratings can have high efficiency with little light being diffracted into higher orders. The relative amount of light in the diffracted and zero order can be varied by controlling the refractive index modulation of the grating, a property that is can be used to make lossy waveguide gratings for extracting light over a large pupil. One class of gratings used in holographic waveguide devices is the Switchable Bragg Grating. SBGs can be fabricated by first placing a thin film of a mixture of photopolymerizable monomers and liquid crystal material between glass plates or substrates. In many cases, the glass plates are in a parallel configuration. One or both glass plates can support electrodes, typically transparent tin oxide films, for applying an electric field across the film. The grating structure in an SBG can be recorded in the liquid material (often referred to as the syrup) through photopolymerization-induced phase separation using interferential exposure with a spatially periodic intensity modulation. Factors such as but not limited to control of the irradiation intensity, component volume fractions of the materials in the mixture, and exposure temperature can determine the resulting grating morphology and performance. As can readily be appreciated, a wide variety of materials and mixtures can be used depending on the specific requirements of a given application. In many embodiments, HPDLC material is used. During the recording process, the monomers polymerize and the mixture undergoes a phase separation. The LC molecules aggregate to form discrete or coalesced droplets that are periodically distributed in polymer networks on the scale of optical wavelengths. The alternating liquid crystal-rich and liquid crystal-depleted regions form the fringe planes of the grating, which can produce Bragg diffraction with a strong optical polarization resulting from the orientation ordering of the LC molecules in the droplets.

[0039] The resulting volume phase grating can exhibit very high diffraction efficiency, which can be controlled by the magnitude of the electric field applied across the film. When an electric field is applied to the grating via transparent electrodes, the natural orientation of the LC droplets can change, causing the refractive index modulation of the fringes to lower and the hologram diffraction efficiency to drop to very low levels. Typically, the electrodes are configured such that the applied electric field will be perpendicular to the substrates. In a number of embodiments, the electrodes are fabricated from indium tin oxide ("ITO"). In the OFF state with no electric field applied, the extraordinary axis of the liquid crystals generally aligns normal to the fringes (i.e., parallel to the grating or K- vector). The grating thus exhibits high refractive index modulation and high diffraction efficiency for P-polarized light (i.e., light with a polarization vector in the plane of incidence), but have nearly zero diffraction efficiency for S polarized light (i.e. , light with the polarization vector normal to the plane of incidence). When an electric field is applied to the HPDLC, the grating switches to the ON state wherein the extraordinary axes of the liquid crystal molecules align parallel to the applied field and hence perpendicular to the substrate. In the ON state, the grating exhibits lower refractive index modulation and lower diffraction efficiency for both S- and P-polarized light. Thus, the grating region no longer diffracts light. Each grating region can be divided into a multiplicity of grating elements such as for example a pixel matrix according to the function of the HPDLC device. Typically, the electrode on one substrate surface is uniform and continuous, while electrodes on the opposing substrate surface are patterned in accordance to the multiplicity of selectively switchable grating elements.

[0040] Typically, the SBG elements are switched clear in 30 s with a longer relaxation time to switch ON. Note that the diffraction efficiency of the device can be adjusted, by means of the applied voltage, over a continuous range. In many cases, the device exhibits near 100% efficiency with no voltage applied and essentially zero efficiency with a sufficiently high voltage applied. In certain types of HPDLC devices, magnetic fields can be used to control the LC orientation. In some HPDLC applications, phase separation of the LC material from the polymer can be accomplished to such a degree that no discernible droplet structure results. An SBG can also be used as a passive grating. In this mode, its chief benefit is a uniquely high refractive index modulation. SBGs can be used to provide transmission or reflection gratings for free space applications. SBGs can be implemented as waveguide devices in which the HPDLC forms either the waveguide core or an evanescently coupled layer in proximity to the waveguide. The glass plates used to form the HPDLC cell provide a total internal reflection light guiding structure. Light can be coupled out of the SBG when the switchable grating diffracts the light at an angle beyond the TIR condition. HPDLC Material Systems

[0041] HPDLC mixtures in accordance with various embodiments of the invention generally include LC, monomers, photoinitiator dyes, and coinitiators. The mixture (often referred to as syrup) frequently also includes a surfactant. For the purposes of describing the invention, a surfactant is defined as any chemical agent that lowers the surface tension of the total liquid mixture. The use of surfactants in PDLC mixtures is known and dates back to the earliest investigations of PDLCs. For example, a paper by R.L Sutherland et al., SPIE Vol. 2689, 158-169, 1996, the disclosure of which is incorporated herein by reference, describes a PDLC mixture including a monomer, photoinitiator, coinitiator, chain extender, and LCs to which a surfactant can be added. Surfactants are also mentioned in a paper by Natarajan et al, Journal of Nonlinear Optical Physics and Materials, Vol. 5 No. I 89-98, 1996, the disclosure of which is incorporated herein by reference. Furthermore, U.S. Patent No. 7,018,563 by Sutherland; et al., discusses polymer-dispersed liquid crystal material for forming a polymer-dispersed liquid crystal optical element comprising: at least one acrylic acid monomer; at least one type of liquid crystal material; a photoinitiator dye; a coinitiator; and a surfactant. The disclosure of U.S. Patent No. 7,018,563 is hereby incorporated by reference in its entirety.

[0042] The patent and scientific literature contains many examples of material systems and processes that can be used to fabricate SBGs, including investigations into formulating such material systems for achieving high diffraction efficiency, fast response time, low drive voltage, and so forth. United States Patent No. 5,942, 157 by Sutherland and United States Patent No. 5,751 ,452 by Tanaka et al. both describe monomer and liquid crystal material combinations suitable for fabricating SBG devices. Examples of recipes can also be found in papers dating back to the early 1990s. Many of these materials use acrylate monomers, including:

• R. L. Sutherland et al., Chem. Mater. 5, 1533 (1993), the disclosure of which is incorporated herein by reference, describes the use of acrylate polymers and surfactants. Specifically, the recipe comprises a crosslinking multifunctional acrylate monomer; a chain extender N-vinyl pyrrolidinone, LC E7, photoinitiator rose Bengal, and coinitiator N-phenyl glycine. Surfactant octanoic acid was added in certain variants. • Fontecchio et al., SID 00 Digest 774-776, 2000, the disclosure of which is incorporated herein by reference, describes a UV curable HPDLC for reflective display applications including a multi-functional acrylate monomer, LC, a photoinitiator, a coinitiators, and a chain terminator.

• Y.H. Cho, et al., Polymer International, 48, 1085-1090, 1999, the disclosure of which is incorporated herein by reference, discloses HPDLC recipes including acrylates.

• Karasawa et al., Japanese Journal of Applied Physics, Vol. 36, 6388-6392, 1997, the disclosure of which is incorporated herein by reference, describes acrylates of various functional orders.

• T.J. Bunning et al., Polymer Science: Part B: Polymer Physics, Vol. 35, 2825- 2833, 1997, the disclosure of which is incorporated herein by reference, also describes multifunctional acrylate monomers.

• G.S. lannacchione et al., Europhysics Letters Vol. 36 (6). 425-430, 1996, the disclosure of which is incorporated herein by reference, describes a PDLC mixture including a penta-acrylate monomer, LC, chain extender, coinitiators, and photoinitiator.

[0043] Acrylates offer the benefits of fast kinetics, good mixing with other materials, and compatibility with film forming processes. Since acrylates are cross-linked, they tend to be mechanically robust and flexible. For example, urethane acrylates of functionality 2 (di) and 3 (tri) have been used extensively for HPDLC technology. Higher functionality materials such as penta and hex functional stems have also been used.

Systems for Multiplying Display Resolution

[0044] Systems integrating display resolution-multiplication solutions in accordance with various embodiments of the invention can be implemented in many different ways. In many embodiments, the system includes an image projector for projecting image light from a microdisplay, an image processor for computing a native image and at least one image shifted in a predefined direction for sequential display by the image projector, and at least one switchable grating capable of being switched between diffracting and non- diffracting states. In some embodiments, the switchable gratings are configured in free space. In several embodiments, the switchable gratings are disposed within at least one waveguide. Depending on the specific application, the system can include a combination of switchable and passive gratings. In a number of embodiments, the switchable grating can be optically coupled to the image projector. Light can be projected such that light from each pixel is mapped into a unique angular direction. In several embodiments, the switchable gratings have a first configuration for propagating the native image light and at least one other configuration for propagating shifted image light having an angular displacement corresponding to the image shift in a predefined direction. The native and shifted images can be displayed sequentially within a human eye integration period to provide display-resolution multiplication. In a number of embodiments, the display resolution can be doubled. In some embodiments, the display resolution is quadrupled. As can readily be appreciated, the specific characterizations of such systems can depend on the specific implementations, the design of which can depend on the specific requirements of a given application.

[0045] The image shift can be implemented in several different ways. In many embodiments, the image processor computes at least one image shift. In further applications, the image processor computes at least two image shifts for a given native image. In several embodiments, the image is shifted in a predetermined amount in a predetermined direction(s). In further embodiments, the image shift is equal to exactly half a pixel vertical or horizontal dimension. In some embodiments, the image shift is N+1/2 times a pixel dimension, where N is an integer (where 0 is assumed to be an integer). This may give more flexibility in the offset design, losing only N pixels in image size. In several embodiments, the native and shifted images are sequentially displayed within a human eye integration period. In some embodiments, the image shift is one of vertical or horizontal to provide resolution doubling. In a number of embodiments, the image shifts include vertical and horizontal shifts to provide doubling of both vertical and horizontal resolutions. In a variety of embodiments, integer vertical and half pixel horizontal offsets are provided. In other embodiments, integer horizontal and half pixel vertical offsets are provided. In some embodiments, vertical and horizontal offsets can have different integer multiples of the pixel dimension to compensate for image offsets arising from non-orthogonal input, fold, and output grating vector (K-vector components) in the plane of a waveguide. As can readily be appreciated, the specific image shift scheme can be chosen depending on the specific requirements of a given application.

[0046] FIGs. 1A and 1 B conceptually illustrate cross sectional views of a resolution- multiplication waveguide device in two different operational states in accordance with an embodiment of the invention. As shown in the schematic side elevation views of FIGs. 1A and 1 B, the device can have at least two different configurations 100A, 100B for propagating a native image and at least one shifted image. Utilizing such configurations, the device is capable of doubling the display resolution. In many embodiments, further resolution-multiplication operations, such as but not limited to resolution-quadrupling, can be enabled. In some embodiments, such operations are enabled by stacking further waveguides for deflecting light into different directions corresponding to pixel shifts in different directions. In the illustrative embodiment, the device includes an image projector 101 , an image processor 102, and a resolution-multiplication waveguide.

[0047] Referring to FIG. 1A, the image projector/generator 101 can include a microdisplay panel 101 A providing an array of pixels 101 B and a projection lens 101 C for projecting image light from the microdisplay such that light from each pixel is mapped into a unique angular direction. In some embodiments, the projection lens is a multi-element refractive lens system. In several embodiments, the projection lens can include diffractive elements or surfaces. Although FIG. 1A illustrates an image projector of this basic configuration, it should be apparent to those skilled in the art that any type of image projector can be implemented. For example, in a number of embodiments, the image projector uses a laser scanner to form a pixelated image. In many embodiments, the image projector includes more than one microdisplay or laser scanner for providing more than one pixelated image source.

[0048] The image processor 102, which can be electrically connected to the image projector 101 via a data communications and control link 102A, is capable of computing a native (unshifted) image and at least one image shifted in a predefined direction for sequential display by the image projector 101 . Image light from the image projector 101 can be optically coupled into the resolution-multiplication waveguide. In the illustrative embodiment, the image light is coupled into the resolution-multiplication waveguide by a prism 109. In other embodiments, the prism may be replaced by a grating. [0049] The resolution-multiplication waveguide can include an upper waveguide layer 103 containing an upper input grating 104 and an upper output grating 105 and a lower waveguide layer 106 containing a lower input grating 107 and a lower output grating 108. In many embodiments, the gratings are switchable gratings capable of switching states in response to an applied voltage. As shown, voltages can be applied to the gratings by electrical connections indicated by the symbol V and referenced by the numerals 1 14A- 1 14D. In the illustrative embodiment, the upper input grating 104 substantially overlaps the lower input grating 107 and the upper output grating 105 substantially overlaps the lower output grating 108. The first configuration, which is illustrated in FIG. 1 A, shows when the upper input and output gratings 104, 105 are in their diffracting states. The second configuration, which is illustrated in FIG. 1 B, shows when the upper input and output gratings 104, 105 are in their non-diffracting states.

[0050] When a native image frame is displayed on the microdisplay 101 A, the light can travel from the image projector 101 and into the upper waveguide layer 103. With the upper set of input and output gratings 104, 105 in their diffracting states, light can be extracted out of the waveguide layer 103. This light path is illustrated in FIG. 1 A by rays 1000-1004 with a native image frame pixel indicated by 1005. When a shifted image frame is displayed, the light can travel from the image projector 101 and into the lower waveguide layer 106. With the upper set of input and output gratings 104, 105 in their non-diffracting states and the lower set of input and output gratings 107, 108 in their diffracting states, the light can be extracted out. The light path for the shifted image is illustrated in FIG. 1 B by rays 1000, 101 1 -1015 with a shifted image frame pixel indicated by 1016. Rays 1009, 1017 indicate the zero-order light from the input gratings 104, 107 of the waveguide layers 103, 106. As shown, the zero-order light propagates substantially undeviated out of the waveguides onto a light trap 1 13. It should be apparent from the drawings that with minor modifications to the architecture shown in FIGs. 1 A and 1 B, either of the waveguide layers can be used to propagate the native image frame.

[0051] In many embodiments, the gratings 104, 105 of the upper waveguide layer 103 are configured to switch while the gratings 107, 108 of the lower waveguide layer 106 are configured to always be in their diffracting states. In some embodiments, the gratings of both waveguide layers are configured to switch. In further embodiments, the gratings of the lower waveguide layer are switched into their non-diffracting states when the gratings of the upper waveguide are switched into their diffracting states. Such a configuration is conceptually illustrated in FIG. 2. As shown, the configuration 100C can be implemented by controlling voltage sources 1 14A-1 14D to switch the gratings as described above. In such configurations, the risk of zero order light coupling back into the upper waveguide layer can be reduced.

[0052] The gratings can be switched in coordination with the frame update of the microdisplay such that when the gratings of the upper waveguide layer are in their diffracting states, the input image generator displays the native image and when the gratings of the upper waveguide layer are in their non-diffracting states, the image generator displays an image recomputed with a half pixel horizontal shift. In many embodiments, the switching of the native and shifted frames takes place within the human eye integration time, and the display viewer preserves a doubling of the displayed image resolution.

[0053] The gratings in the upper and lower waveguides can be similarly configured but have slightly different grating prescriptions designed to produce a relative angular shift, equivalent to half a pixel, to the native image. Such effects can be achieved in many different ways. In some embodiments, the required angular shift is produced by applying small tilts to the grating K-vectors. In several embodiments, the required angular shift is produced by small changes to the surface gratings formed by the input and output gratings. Since the angular separation of the native and shifted image frames is typically very small, when coupled into a display waveguide, the image frames image light is propagated with high efficiency before being extracted into the eye box of the waveguide display. In a number of embodiments, the upper and lower waveguides are designed such that only a few total internal reflection bounces take place before light extraction. This can reduce the beam expansion for efficient coupling into a separate waveguide device.

[0054] In many embodiments, the waveguide layers can be separated by a small air gap to ensure optical isolation. In a number of embodiments, a low index material such as a nanoporous material can be used for waveguide isolation. Waveguide layers can be configured for specific spectral bands. In some embodiments, separate waveguide layers are provided for red green and blue light. In several embodiments, separate waveguide layers are provided for red and blue/green light. The waveguide gratings can also be configured to multiplex more than one wavelength. In some embodiments, the waveguide gratings multiplex more than one angular bandwidth.

[0055] In many embodiments, a resolution-multiplication waveguide can be optically coupled to a waveguide display. FIGs. 3A and 3B conceptually illustrate schematic side elevation views showing two operational states 1 1 OA, 1 10B of one such embodiment. The resolution-multiplication waveguide can be implemented identically to those illustrated in FIGs. 1A, 1 B, and 2. Referring to FIG. 3A, the waveguide display 109 includes an input grating 1 1 1 and an output grating 1 12. In some embodiments, the waveguide display further includes a fold grating. In several embodiments, the waveguide display includes separate layers for propagating light of different colors. In the illustrative embodiment and similar to systems discussed previously, native image frame light 1004 emerging from the upper waveguide layer of the resolution-doubling waveguide can be coupled into the waveguide display along a TIR path represented by rays 1005-1006 before being coupled out of the waveguide as represented by ray 1007 to form an output image containing pixels such as the one indicated by 1008. As shown in FIG. 3B, shifted image frame light 1015 emerging from the second waveguide layer of the resolution- doubling waveguide can be coupled into the waveguide display along a TIR path represented by rays 1016-1017 before being coupled out of the waveguide as represented by ray 1018 to form an output image containing pixels such as the one indicated by 1008, which is shifted from the corresponding native pixel. In the illustrative embodiment, the output image is shifted by half a pixel width.

[0056] In many embodiments, further resolution-multiplication operations, such as but not limited to resolution quadrupling, can be enabled. For example, resolution quadrupling can be implemented by doubling both the vertical and horizontal resolutions. FIGs. 4A- 4D conceptually illustrate front elevation views of four different pixel-shifting steps used to provide resolution quadrupling in accordance with an embodiment of the invention. FIG. 4A shows a native image 120A, which is represented by a 4x4 pixel array containing pixels 121 separated by gaps 122. FIG. 4B illustrates a horizontally-shifted pixel array 120B in which each pixel 121 has undergone a first half pixel horizontal shift relative to its corresponding native pixel, resulting in pixels 123. FIG. 4D illustrates a shifted pixel array 120D in which each pixel 124 is horizontally and vertically shifted relative to its corresponding native pixel 121 . FIG. 4D illustrates a vertically-shifted pixel array 120D in which each pixel 125 has undergone a half pixel vertical shift relative to its corresponding native pixel 121.

[0057] In some embodiments, such as the one shown in the schematic side elevation views of FIGs. 5A-5B, the at least one switchable grating includes first, second, third, fourth gratings disposed in a waveguide. The first grating overlaps the third grating and the second grating overlaps the fourth grating. The first and third gratings act as input couplers and the second and further grating act as output couplers. The first configuration is provided by one of first or third gratings and one of second or fourth gratings in their diffracting states. The configurations for propagating shifted image light are provided by other combinations of one of the first or third gratings and one of the second or fourth gratings. In some embodiments, first and second gratings are disposed in a first layer within a waveguide and the third and fourth gratings are disposed in a second layer within the waveguide.

[0058] FIGs. 5A-5D conceptually illustrate the grating states of a waveguide display designed to propagate the four-pixel arrays configurations illustrated in FIGs. 4A-4D in accordance with an embodiment of the invention. In the illustrative embodiment, the waveguide display 131 includes an upper grating layer containing an upper input grating and an upper output grating, represented by diffracting states 132A, 133A and non- diffracting states 132B, 133B, where 132A and 132B describe the state of the upper input grating and 133A and 133B describe the state of the upper output grating. The waveguide display can also include a lower grating layer containing a lower input grating and a lower output grating, represented by diffracting states 134A, 135A and non-diffracting states 134B, 135B, where 134A and 134B describe the state of the lower input grating and 135A and 135B describe the state of the lower output grating. The input gratings can be configured for coupling light from the image projector 137 into a TIR path in the waveguide display 131 and the output gratings can be configured for coupling light out of the waveguide display 131 . In the illustrative embodiment, the waveguide display 131 further includes a common fold grating 133 disposed in the upper grating layer to provide two- dimensional beam expansion in association with the output gratings. The fold grating can be disposed in either of the two grating layers. In some embodiments, each grating layer contains a fold grating. In other embodiments, the waveguide display does not contain or require a fold grating. Voltages are applied to the gratings via electrical connections to a voltage source indicated by the symbol V and referenced by the numerals 138A-138D.

[0059] FIG. 5A conceptually illustrates the grating configuration 130A for propagating the pixel configuration of FIG. 4A (native image) in which the lower input grating and the lower output grating are in their diffracting states 134A, 135A respectively and the upper input grating and the upper input grating are in their non-diffracting states 132B, 133B respectively. The diffracted ray path is indicated by rays 1030A- 1033A. FIG. 5B conceptually illustrates the grating configuration 130B for propagating the pixel configuration of FIG. 4B in which the upper input grating and the lower output grating are in their diffracting states 132A, 135A respectively and the lower input grating and the upper output grating are in their non-diffracting states 134B, 133B respectively. The diffracted ray path is indicated by rays 1030B-1033B. FIG. 5C conceptually illustrates the grating configuration 130C for propagating the pixel configuration of FIG. 4C in which the upper input grating and the upper output grating are in their diffracting states 132A, 133A respectively and the lower input grating and the upper output grating are in their non- diffracting states 134B, 135B respectively. The diffracted ray path is indicated by rays 1030C-1033C. FIG. 5D illustrates the grating configuration 130D for propagating the pixel configuration of FIG. 4D in which the lower input grating and the upper output grating are in their diffracting states 134A, 133A respectively and the upper input grating and the lower output grating are in their non-diffracting states 132B, 135B respectively. The diffracted ray path is indicated by rays 1030A-1033A.

[0060] Achieving a 60Hz 1080p image frame rate using the apparatus of FIGs. 5A-5D can require four video sub-frames to be generated at 240Hz video frame rate. Each video sub-frame can further require red, green, blue sub-frames, increasing the frame rate to 720Hz. In many embodiments, the two-layer grating architecture illustrated in FIGs. 5A- 5D can be used to propagate monochromatic light with further similar waveguides being required for other colors. For example, in some embodiments, separate waveguides can be implemented for red, green, and blue. In several embodiments, color display is provided with one red waveguide and one blue/green waveguide. The switchable grating arrangement of FIGs. 5A-5D has several advantages including but not limited to: low cost and complexity; the input image from the projector passing through the minimum number of ITO layers; and the dual switchable grating offsets being switched separately thereby minimizing loss.

[0061] It should be apparent from consideration of FIGs. 5A-5D that, in some embodiments, one of the upper or lower input gratings can be eliminated to provide a waveguide that propagates the native image and a shifted image sequentially. Alternatively, by the same reasoning, one of the upper or lower output gratings can be eliminated to achieve the same effect. In some embodiments, one of the grating layers in FIGs. 5A-5D may be non-switching.

[0062] FIG. 6 shows a flow chart conceptually illustrating a method of multiplying the resolution of a waveguide display in accordance with an embodiment of the invention. As shown, the process 140 includes providing (141 ) an image projector and an image processor. A waveguide can be provided (142) in which the waveguide contains first, second, third and fourth switchable gratings with the first and third gratings substantially overlapping and the second and fourth gratings substantially overlapping. Each grating can have an optical prescription for applying an angular shift to incident light. A pixel shift can be selected (143). In many embodiments, the pixel shift satisfies (N+1/2) * P, where N is an integer greater than or equal to zero and P is a pixel dimension. A shifted image can then be computed (144) using the image processor. A shifted image can be written (145) to the image projector. For display, one of the first and third switchable gratings and one of the second and fourth switchable gratings can be switched (146) into their diffracting states. The shifted image light can be coupled (147) into the waveguide via the diffracting first or third switchable gratings and can be coupled (148) out of the waveguide via the diffracting second or fourth switchable gratings with a pixel shift determined by the prescriptions of the diffracting switchable gratings. The process 140 can repeat starting at step 143 until all required image pixel shifts have been completed. Although FIG. 6 illustrates a specific process for implementing resolution-multiplication of a waveguide display, any of a variety of processes and modifications of such can be practiced in accordance with various embodiments of the invention. [0063] In many embodiments, the switchable gratings are disposed in a waveguide that further includes a non-switching grating. In further embodiments the non-switching grating is a fold grating (sometimes referred to as a turning grating) used for beam expansion as described above. In such embodiments, the waveguide can implement resolution-multiplication and two-axis beam expansion. In several embodiments, at least one of the gratings used for resolution-multiplication is a rolled k-vector grating. The K- vector (more commonly referred to as the grating vector) can be referred to as a vector- aligned normal to the grating planes (or fringes), which determines the optical efficiency for a given range of input and diffracted angles. Rolling the K-vectors allows the angular bandwidth of the grating to be expanded without the need to increase the waveguide thickness. In some embodiments, the switchable gratings include at least one grating multiplexing at least one of wavelength or angular bandwidth. It is well established in the literature of holography that more than one holographic prescription can be recorded into a single holographic layer. As such, methods for recording such multiplexed holograms are well known to those skilled in the art. In some embodiments, at least one of the switching gratings and other gratings used in association can combine two or more angular diffraction prescriptions to expand the angular bandwidth or to expand the spectral bandwidth. For example, color multiplexed gratings can be used to diffract two or more of the primary colors.

[0064] In any of the above described embodiments, the image projector, which can be referred to as an input image node ("UN"), can integrate a microdisplay panel, a light source, and other optical components commonly used to illuminate the display panel, to separate the reflected light, and to collimate it into the required field of view. In many embodiments, the image projector can be based on the embodiments and teachings disclosed in U.S. Patent Application No.: 13/869,866 entitled HOLOGRAPHIC WIDE- ANGLE DISPLAY, and U.S. Patent Application No.: 13/844,456 entitled TRANSPARENT WAVEGUIDE DISPLAY, the disclosures of which are hereby incorporated by reference in their entireties for all purposes. In some embodiments, the image projector contains a beamsplitter for directing light onto the microdisplay and transmitting the reflected light towards the waveguide. In several embodiments, the beamsplitter is a grating recorded in HPDLC and uses the intrinsic polarization selectivity of such gratings to separate the light illuminating the display and the image modulated light reflected off the display. In a number of embodiments, the beam splitter is a polarizing beam splitter cube. In a variety of embodiments, the image projector incorporates an illumination homogenizer or a laser beam despeckler. The despeckler can be implemented based on the embodiments and teachings of U.S. Patent No.: 8,565,560 entitled LASER ILLUMINATION DEVICE, the disclosure of which is herein incorporated by reference in its entirety for all purposes.

[0065] In many embodiments, the light source is a laser. In some embodiments, the light source is an LED, which can provide better illumination and color uniformity than laser. In a number of embodiments, the image projector includes one or more lenses for modifying the illumination angular characteristics. If laser illumination is used, there can exist a risk of illumination banding occurring at the waveguide output. In several embodiments, laser illumination banding in waveguides can be overcome using the techniques and teachings disclosed in U.S. Patent Application No.: 15/512,500 entitled METHOD AND APPARATUS FOR GENERATING INPUT IMAGES FOR HOLOGRAPHIC WAVEGUIDE DISPLAYS, the disclosure of which is herein incorporated by reference in its entirety for all purposes. In some embodiments, the light from the light source is polarized. In a number of embodiments, the image source is a liquid crystal display ("LCD") micro display or liquid crystal on silicon ("LCoS") micro display. In a variety of embodiments, the image source is a micro-electro-mechanical system ("MEMs") device. In some embodiments, the image source is a display panel based on Texas Instruments' Digital Light Projector ("DLP") technology.

[0066] In many embodiments, any of the gratings used can encode optical power for adjusting the collimation of the output. In some embodiments, the output image is at infinity. In several embodiments, the output image can be formed at distances of several meters from the waveguide. In embodiments utilizing fold gratings, the fold grating angular bandwidth can be enhanced by designing the grating prescription to provide dual interaction of the guided light with the grating. Exemplary embodiments of dual interaction fold gratings are disclosed in U.S. Patent Application No.: 14/620,969 entitled WAVEGUIDE GRATING DEVICE, the disclosure of which is herein incorporated by reference in its entirety for all purposes. [0067] The waveguides used for resolution-multiplication in accordance with various embodiments of the invention can be formed by sandwiching the grating layers between glass or plastic substrates to form a stack within which total internal reflection occurs at the outer substrate and air interfaces. The stack can further include additional layers such as beam splitting coatings and environmental protection layers. In some embodiments, the cell substrates can be fabricated from glass. One type of glass substrate utilized is the standard Coming Willow glass substrate (index 1 .51 ), which is available in thicknesses down to 50 micrometers. In other embodiments, the cell substrates can be optical plastics. The gratings can be recorded in layers of material coated onto a transparent substrate and covered by a protective transparent layer after the holographic exposure process has been completed. In several embodiments, the grating layer can be broken up into separate layers. For example, in a number of embodiments, a first layer includes the fold grating while a second layer includes the output grating. In further embodiments, a third layer can include the input coupler or grating. The number of layers can then be laminated together into a single waveguide substrate. In some embodiments, the grating layer includes a number of pieces including the input coupler, the fold grating and the output grating (or portions thereof) that are laminated together to form a single substrate waveguide. The pieces can be separated by optical glue or other transparent material of refractive index matching that of the pieces.

[0068] The grating layer can be formed via a cell making process by creating cells of the desired grating thickness and vacuum filling each cell with holographic recording material for each of the input coupler, the fold grating, and the output grating. In many embodiments, the cell is formed by positioning multiple plates of glass with gaps between the plates of glass that define the desired grating thickness for the input coupler, the fold grating, and the output grating. In some embodiments, one cell can be made with multiple apertures such that the separate apertures are filled with different pockets of holographic recording material. Any intervening spaces can then be separated by a separating material such as glue or oil to define separate areas. In several embodiments, the holographic material can be spin-coated onto a substrate and then covered by a second substrate after curing of the material. By using a fold grating, the waveguide display can utilize fewer layers than previous systems and methods of displaying information. In addition, by using a fold grating, light can travel by total internal refection within the waveguide in a single rectangular prism defined by the waveguide outer surfaces while achieving dual pupil expansion. The input coupler, the fold grating, and the output grating can be created by interfering two waves of light at an angle within the substrate to create a holographic wave front, thereby creating light and dark fringes that are set in the waveguide substrate at a desired angle. In some embodiments, the grating in a given layer is recorded in stepwise fashion by scanning or stepping the recording laser beams across the grating area. In a number of embodiments, the gratings are recorded using mastering and contact copying process currently used in the holographic printing industry.

[0069] In many embodiments, the gratings are recorded in a holographic polymer dispersed liquid crystal ("HPDLC") (e.g., a matrix of liquid crystal droplets), although SBGs may also be recorded in other materials. In one embodiment, SBGs are recorded in a uniform modulation material, such as POLICRYPS or POLIPHEM having a matrix of solid liquid crystals dispersed in a liquid polymer. The SBGs can be switching or non- switching in nature. In its non-switching form, an SBG has the advantage over conventional holographic photopolymer materials of being capable of providing high refractive index modulation due to its liquid crystal component. Exemplary uniform modulation liquid crystal-polymer material systems are disclosed in U.S. Patent Publication No.: 2007/0019152 by Caputo et al. and PCT Application No.: PCT/EP2005/006950 by Stumpe et al., both of which are incorporated herein by reference in their entireties. Uniform modulation gratings are characterized by high refractive index modulation (and hence high diffraction efficiency) and low scatter.

[0070] In many embodiments, at least one of the gratings is recorded in a reverse mode HPDLC material. Reverse mode HPDLC differs from conventional HPDLC in that the grating is passive when no electric field is applied and becomes diffractive in the presence of an electric field. The reverse mode HPDLC can be based on any of the recipes and processes disclosed in PCT Application No.: PCT/GB2012/000680, entitled IMPROVEMENTS TO HOLOGRAPHIC POLYMER DISPERSED LIQUID CRYSTAL MATERIALS AND DEVICES, the disclosure of which is herein incorporated by reference in its entirety for all purposes. The grating can be recorded in any of the above material systems but used in a passive (non-switching) mode. In such embodiments, the fabrication process can be identical to that used for switched but with the electrode coating stage being omitted. LC polymer material systems are highly desirable in view of their high index modulation. In some embodiments, the gratings are recorded in HPDLC but are not switched.

[0071] The resolution-multiplication apparatuses in accordance with various embodiments of the invention can be used in combination with an eye tracker to form an eye tracker display. The eye tracker can be based on the embodiments and teachings of PCT Application No.: PCT/GB2014/000197 entitled HOLOGRAPHIC WAVEGUIDE EYE TRACKER, PCT/GB2015/000274 entitled HOLOGRAPHIC WAVEGUIDE OPTICAL TRACKER, and PCT/GB2013/000210 entitled APPARATUS FOR EYE TRACKING, the disclosures of which are herein incorporated by reference in their entireties for all purposes.

[0072] In many embodiments of the invention, the resolution-multiplication apparatus is used in a waveguide display that further includes a dynamic focusing element. The dynamic focusing element can be based on the embodiments and teachings of U.S. Patent Application No. : 15/553, 120 entitled ELECTRICALLY FOCUS TUNABLE LENS, the disclosure of which is herein incorporated by reference in its entirety for all purposes. In some embodiments, a dual expansion waveguide display that further includes a dynamic focusing element and an eye tracker can provide a light field display based on the embodiments and teachings disclosed U.S. Patent Application No.: 15/543,013 entitled HOLOGRAPHIC WAVEGUIDE LIGHT FIELD DISPLAYS, the disclosure of which is herein incorporated by reference in its entirety for all purposes.

[0073] In many embodiments, a resolution-multiplication apparatus according to the principles of the invention can be used in a waveguide display integrated within a window, such as but not limited to a windscreen-integrated HUD for road vehicle applications. In some embodiments, the resolution-multiplication apparatus can include gradient index ("GRIN") wave-guiding components for relaying image content between the image projector and the waveguide containing the resolution multiplication gratings. In several embodiments, a resolution-multiplication apparatus can be used in a dual expansion waveguide display incorporating a light pipe for providing beam expansion in one direction based on the embodiments disclosed in U.S. Patent Application No.: 15/558,409 entitled WAVEGUIDE DEVICE INCORPORATING A LIGHT PIPE, the disclosure of which is herein incorporated by reference in its entirety for all purposes. In a number of embodiments, the input image source in the image projector may be a laser scanner as disclosed in US Patent No. 9,075,184 entitled COMPACT EDGE ILLUMINATED DIFFRACTIVE DISPLAY, the disclosure of which is herein incorporated by reference in its entirety for all purposes.

[0074] In many embodiments, a resolution-multiplication apparatus according to the principles of the invention may be interfaced to an Augmented Reality waveguide display with a field of view of 50 degrees diagonal. Examples of waveguide displays that can be used in applications of the present invention are discussed in the reference documents. Applications of the invention are not necessarily confined to waveguide displays. In some embodiments, the resolution-doubling waveguide can provide a compact image generator for use in any type of wearable or projection display. In several embodiments, the resolution-multiplication apparatus can provide an image projector. In a number of embodiments, the apparatus is optically coupled to one of image display optics, an eyepiece, a projection lens, or a waveguide. In a variety of embodiments, the apparatus forms part of a HMD, a HUD, an eye-slaved display, a dynamic focus display or a light field display. Some of the embodiments and teachings of this disclosure can be applied in waveguide sensors, such as but not limited to eye trackers, fingerprint scanners, and LIDAR systems.

[0075] It should be emphasized that the drawings are exemplary and that the dimensions have been exaggerated. For example, thicknesses of the SBG layers have been greatly exaggerated. Optical devices based on any of the above-described embodiments can be implemented using the materials and processes disclosed in PCT Application No.: PCT/GB2012/000680, entitled IMPROVEMENTS TO HOLOGRAPHIC POLYMER DISPERSED LIQUID CRYSTAL MATERIALS AND DEVICES. In some embodiments, the waveguide embodiments can be curved.

[0076] Although specific systems and configurations are described above, various embodiments of the invention can be practiced in a wide variety of applications. For example, the following list of patents and patent applications describe many different types of waveguide applications and material systems that can be practiced along with various embodiments of the invention, the disclosures of which are incorporated by reference herein in their entireties for all purposes: U.S. Patent No. 8,233,204 entitled OPTICAL DISPLAYS, PCT Application No.: US2006/043938, entitled METHOD AND APPARATUS FOR PROVIDING A TRANSPARENT DISPLAY, PCT Application No.: GB2012/000677 entitled WEARABLE DATA DISPLAY, U.S. Patent Application No.: 13/317,468 entitled COMPACT EDGE ILLUMINATED EYEGLASS DISPLAY, U.S. Patent Application No.: 15/543,016 entitled ENVIRONMENTALLY ISOLATED WAVEGUIDE DISPLAY, U.S. Patent No. 8,224, 133 entitled LASER ILLUMINATION DEVICE, U.S. Patent No. 6, 1 15, 152 entitled HOLOGRAPHIC ILLUMINATION SYSTEM, PCT Application No.: PCT/GB2013/000005 entitled CONTACT IMAGE SENSOR USING SWITCHABLE BRAGG GRATINGS, U.S. Patent No. 8,903,207 entitled SYSTEM AND METHOD OF EXTENDING VERTICAL FIELD OF VIEW IN HEAD UP DISPLAY USING A WAVEGUIDE COMBINER, U.S. Patent No. 8,639,072 entitled COMPACT WEARABLE DISPLAY, U.S. Patent No. 8,885, 1 12 entitled COMPACT HOLOGRAPHIC EDGE ILLUMINATED EYEGLASS DISPLAY, PCT Application No.: PCT/GB2016/000181 , entitled WAVEGUIDE DISPLAY.

[0077] While the above description contains many specific embodiments of the invention, these should not be construed as limitations on the scope of the invention, but rather as an example of one embodiment thereof. The construction and arrangement of the systems and methods as shown in the various embodiments are illustrative only. It is therefore to be understood that the present invention may be practiced in ways other than specifically described, without departing from the scope and spirit of the present invention. Although only a few embodiments have been described in detail in this disclosure, many modifications are possible (for example, variations in sizes, dimensions, structures, shapes and proportions of the various elements, values of parameters, mounting arrangements, use of materials, colors, orientations, etc.). For example, the position of elements may be reversed or otherwise varied and the nature or number of discrete elements or positions may be altered or varied. Accordingly, all such modifications are intended to be included within the scope of the present disclosure. The order or sequence of any process or method steps may be varied or re-sequenced according to alternative embodiments. Other substitutions, modifications, changes, and omissions may be made in the design, operating conditions and arrangement of the embodiments without departing from the scope of the present disclosure. Thus, embodiments of the present invention should be considered in all respects as illustrative and not restrictive. Accordingly, the scope of the invention should be determined not by the embodiments illustrated, but by the appended claims and their equivalents.