EP4639286A1 - Système, appareil et procédé d'imagerie et d'holographie améliorées - Google Patents

Système, appareil et procédé d'imagerie et d'holographie améliorées

Info

Publication number
EP4639286A1
EP4639286A1 EP23908624.2A EP23908624A EP4639286A1 EP 4639286 A1 EP4639286 A1 EP 4639286A1 EP 23908624 A EP23908624 A EP 23908624A EP 4639286 A1 EP4639286 A1 EP 4639286A1
Authority
EP
European Patent Office
Prior art keywords
finch
waves
beams
optical
lens
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP23908624.2A
Other languages
German (de)
English (en)
Inventor
Nisan SIEGEL
Gary Brooker
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Celloptic Inc
Original Assignee
Celloptic Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Celloptic Inc filed Critical Celloptic Inc
Publication of EP4639286A1 publication Critical patent/EP4639286A1/fr
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/04—Processes or apparatus for producing holograms
    • G03H1/0443—Digital holography, i.e. recording holograms with digital recording means
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B13/00—Optical objectives specially designed for the purposes specified below
    • G02B13/22—Telecentric objectives or lens systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
    • G02B21/361—Optical details, e.g. image relay to the camera or image sensor
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B5/00—Optical elements other than lenses
    • G02B5/18—Diffraction gratings
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/02—Details of features involved during the holographic process; Replication of holograms without interference recording
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/04—Processes or apparatus for producing holograms
    • G03H1/0486—Improving or monitoring the quality of the record, e.g. by compensating distortions, aberrations
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/04—Processes or apparatus for producing holograms
    • G03H1/06—Processes or apparatus for producing holograms using incoherent light
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/04—Processes or apparatus for producing holograms
    • G03H1/08—Synthesising holograms, i.e. holograms synthesized from objects or objects from holograms
    • G03H1/0866—Digital holographic imaging, i.e. synthesizing holobjects from holograms
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/04—Processes or apparatus for producing holograms
    • G03H1/0443—Digital holography, i.e. recording holograms with digital recording means
    • G03H2001/0447—In-line recording arrangement
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/04—Processes or apparatus for producing holograms
    • G03H1/0443—Digital holography, i.e. recording holograms with digital recording means
    • G03H2001/0452—Digital holography, i.e. recording holograms with digital recording means arranged to record an image of the object
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H2223/00—Optical components
    • G03H2223/12—Amplitude mask, e.g. diaphragm, Louver filter
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H2223/00—Optical components
    • G03H2223/17—Element having optical power
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H2223/00—Optical components
    • G03H2223/19—Microoptic array, e.g. lens array
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H2223/00—Optical components
    • G03H2223/20—Birefringent optical element, e.g. wave plate
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H2223/00—Optical components
    • G03H2223/22—Polariser

Definitions

  • This disclosure relates generally to optical equipment, and more particularly to optical arrangements that generate holograms.
  • the inventors of the subject matter in this disclosure include an inventor of the Fresnel Incoherent Correlation Holography (FINCH) techniques and systems that are described in, for example, US Patent No. 8,179,578 Filed July 18, 2006.
  • the inventors of FINCH also published several papers describing the FINCH system and technique. See, for example, Joseph Rosen and Gary Brooker, "Digital spatially incoherent Fresnel holography", Optics Letters, Vol. 32, No. 8, April 15, 2007.
  • the contents of US Patent No. 8,179,578 and the publication "Digital spatially incoherent Fresnel holography” are each incorporated by reference in their respective entireties.
  • FINCH is a single beam interferometric method that can create an interference pattern (also referred to as a hologram or a recorded hologram or a raw hologram) from visible light or any kind of electromagnetic radiation, either incoherent or coherent.
  • an interference pattern also referred to as a hologram or a recorded hologram or a raw hologram
  • a plurality of holograms must be recorded.
  • This plurality of recorded holograms or interference patterns must include at least two "phase shifted" holograms, each with a unique phase factor.
  • the plurality of holograms is typically obtained in a serial manner or simultaneously in a parallel manner by a variety of beam-splitting techniques.
  • Figure 1 illustrates a generalized FINCH imaging system.
  • An object (also referred to as sample) 101 emits or reflects light toward the FINCH optical system 102, which receives the light through a lens or other aperture and produces (from any single received beam of light) two co-propagating beams denoted Beam 1 and Beam 2, or fdl and fd2, (e.g. 103, 104) with distinct phase curvatures.
  • the ability of 102 to produce two different co-propagating beams may be provided by incorporating a lens having multiple sections with different physical curvatures, or by incorporating a lens made of a birefringent material that has two different refractive indices, or by incorporating optical elements with lens properties due to geometric phase principles or other micro- or nano-structured patterns etched or deposited on a substrate.
  • the two beams may also be generated by use of spatial light modulators or spherical mirrors with different curvatures in different parts of the mirror, or similar methods.
  • the two co-propagating beams are directed to a recording device in a manner that allow them to produce an interference pattern 105, which is then recorded by an image recording device (not shown) and stored 106 for subsequent calculated reconstruction of the image 107 computed in a computing device 108.
  • an image recording device not shown
  • multiple phase-shifted interference patterns (raw holograms) are recorded and stored for use in creating a complex hologram and calculated reconstructed images. The method of formation of the complex hologram and the reconstruction process are described in detail in the incorporated documents and are thus saved from detailed reiteration here.
  • the complex hologram is then reconstructed into a 2D image s representing a single in-focus plane by one of a number of different computational operations.
  • One common method is Fresnel Propagation, exemplified in the following equation:
  • Equation 2 wherein the asterisk represents a 2D convolution operation, z rec is the desired distance of the in-focus plane at which the hologram is to be reconstructed, and the term after the convolution operator represents the impulse response function (IRF) that describes propagation in space by a distance of z rec .
  • IRF impulse response function
  • the Amplitude term is a system dependent amplitude that can be chosen to impose desired characteristics in its Fourier transform
  • the exponential term is a propagation phase function for optical propagation by a distance of z re c-
  • Other image reconstruction methods may be applied, including angular spectrum reconstruction, image inversion, compressive sensing and deep learning computations, amongst others.
  • F denotes the Fourier transform operation and F 1 denotes the inverse Fourier transform operation
  • OTF is the Fourier (frequency space) representation of the exponential term in equation 2, and has the following form: (equation 4)
  • k x and k y are frequency coordinates corresponding to the spatial coordinates of the hologram
  • AOTF is an amplitude envelope which is typically 1 for frequencies with support in the reconstructed image and 0 for frequencies higher than that limit.
  • equations 2 or 4 may be repeated many times for any different z rec as desired to create a three-dimensional collection of images.
  • FINCH imaging is also capable of optical super-resolution, in which objects that are close to each other may be resolved as separate objects in a FINCH image even though they are not resolved as separate objects in a standard (or "classical”) image.
  • classical optical imaging 110 simply requires a lens 112 to receive light from 111 and focus that light into an image 113, magnifying the object by the blurring function known as the pointspread function (PSF).
  • PSF pointspread function
  • the accepted light beam, with radius 114 Rbeam, along with the distance 115 d, to the image plane, may be thought of as a lens with an effective numerical aperture NAbeam - Rbeam/d,, and the classical image spot size A, of the object point is inversely proportional to this effective NA.
  • NAbeam - Rbeam/d an effective numerical aperture
  • A the classical image spot size A
  • the number and size of the fringes in the hologram 106 encode the depth of the object point being reconstructed, conferring on FINCH the ability to encode three-dimensional (3D) information.
  • the self-interference of the light confers a super-resolution factor of up to twice the normal optical limit at any given wavelength by incorporating sample information in both light beams that interfere. That is, there are two signal beams rather than the individual signal and reference beams that are characteristic of classical holography. The largest increase in resolution occurs at the plane in which the two differentially focused beams have the same diameter.
  • diagram 140 depicting a FINCH system 102 imaging the same pair of points 131
  • the recorded hologram 141 is processed by the computing device 108 to an image 142 that does resolve the pair of points as separate from each other, showing that FINCH does not adhere to the classical Lagrange invariant that describes lateral magnification in classical optical systems in which angular magnification and lateral magnification change equivalently to one another.
  • FINCH violates the classical Lagrange invariant and thus improves both single and two-point lateral resolution by a factor of up to 2 by allowing the lateral magnification to decrease by up to 50% while maintaining the same angular magnification.
  • FIG. 2 An example embodiment of a state-of-the-art FINCH optical system as in "Single shot holographic super-resolution microscopy" is illustrated in Figure 2.
  • incoming light 201 from an object is linearly polarized at an input polarizer 202 and passed through the birefringent lens assembly 203 such as, for example, in US patents 10,228,655, 10,289,070, 10,423,123, and 10,591,870 and patent application 20170185036, and "High-magnification super-resolution FINCH microscopy using birefringent crystal lens interferometers," Nature Photonics, 10(12), 802-808 2016..
  • the polarization orientations of 202 and 203 are arranged so that after passing through 202, the light is polarized at +45° and -45° relative to the ordinary and extraordinary refractive indices of the birefringent optics in 203.
  • the birefringent lens assembly 203 includes at least one birefringent lens as well as any other optics necessary to transform the beam, standard converging or diverging lenses, birefringent compensating optics, and any other optics necessary to achieve the interference of the beams.
  • the birefringent optical assembly thus separates the incoming beam into two outgoing beams, polarized along the ordinary and extraordinary refractive indices, each with its own phase curvature that is a function of the incoming phase curvature and the birefringent lens curvature and respective refractive index.
  • a quarter-wave plate 204 is placed in the beam path, with its slow axis aligned ⁇ 45 degrees to the ordinary and extraordinary axes of the birefringent lens. This has the effect of turning the linearly polarized light from the birefringent lens into circularly polarized light, one beam with right-handed circular polarization and one with left-handed circular polarization.
  • This waveplate may be a broadband waveplate that applies the same quarter-wave phase shift to every incoming wavelength over its range and does not need to be calibrated.
  • the two circularly polarized beams may be brought to interfere by passing them through an array 206 of differentially aligned micropolarizers of varying polarization orientations 207, 208, 209, 210 overlaying the image sensor at interference detection plane 205 wherein each micropolarizer is of the size of one of the detector pixels and is registered to a specific detector pixel.
  • the angles of the polarizer transmission axes of the micropolarizers with respect to the waveplate slow axis controls the phase of the interference between the two beams recorded at the detector pixel registered to each micropolarizer.
  • the micropolarizer array may contain micropolarizers with transmission axis orientation of 0°, 90°, 180°, and 270° (or -90°) with respect to the quarter wave plate, resulting in the collection of multiple phase shifted raw holograms with relative phase shifts of 0, n/2, n, and 3n/2 radians (or 0°, 90°, 180°, and 270°).
  • the micropolarizers may be of any convenient set of axis orientations to produce multiple holograms with any desired set of relative phase shifts.
  • the different phase shifted holograms may be separated from each other in the computing device. This results in a set of holograms, each of which has a quantity of blank pixels equal to (device pixel count)*(n-l)/n, where n is the number of phase shifts used.
  • Figure 3 illustrates an exemplary embodiment of separating multiple individual phases of a hologram from an interspersed hologram recorded on a micropolarizer camera.
  • the recorded hologram 301 which is the result of recording an interference pattern with the embodiment of Figure 2, possess a set of four holograms of different phases, each recorded by a quarter of the pixels overlaid with a particular micropolarizer orientation such as 0°, 90°, 180°, or 270° as discussed above, and interspersed with each other over the entire array of pixels.
  • the different phases are, in a computing device 302, de-interspersed from each other and thereby abstracted from the recorded hologram into independent holograms 303-306.
  • the computing device 302 may be identical with the computing device 108 that produces the reconstructed image of the object, or else 302 may be a separate computing device, including a computing device embedded in the camera that records the interspersed hologram.
  • each of the four holograms 303-306 possesses significant data on the % of its pixels that have one micropolarizer orientation, while possessing no data on the % of the pixels that have the other three micropolarizer orientation.
  • the pixels that have the 90°, 180°, or 270° micropolarizer orientations are assigned a value of zero since the 0° interference data was not recorded on those pixels.
  • the case is likewise for the 90°, 180°, and 270° orientations contained in 304-306.
  • the pixels in each de-interspersed hologram that are assigned a value of 0 are called blank pixels.
  • pixels, or the blank pixels of any similarly obtained set of interspersed holograms or images may be reassigned with values calculated by nearest neighbor or other interpolation methods, to maintain the sampling interval of the imaging device.
  • a recentering operation of single-pixel shifting the interpolated data may optionally be performed in order to improve the overlap of the raw holograms.
  • These pixels could be filled with interpolated data, or simply be removed, with a concomitant reassignment of the sampling pitch to 10 microns.
  • the resultant holograms from any of these methods are referred to as the "filled-in" holograms 307-310.
  • the individual filled-in phase shifted holograms may then be combined into a complex hologram with magnitude 311 and intensity 312 as described above and in the incorporated literature, and then processed further in a computing device 108 to produce the reconstructed image 107 of the object recorded in the hologram 301.
  • FINCH imaging technology One topic of intense interest for the application of FINCH imaging technology is microscopy, including research, clinical and metrology microscopy.
  • a microscope was constructed to incorporate the FINCH technology described earlier herein into a hybrid microscope that can record widefield, confocal, FINCH and confocal FINCH images or holograms under either fluorescence excitation, reflected light, or transmitted light illumination. The microscope can also create any of these types of images from luminescence light that occurs independent of an electromagnetic light source.
  • a microscope objective lens 402 is the first lens in the FINCH microscope that images a specimen (Sample) 401.
  • a 4F relay consisting of lenses 403 and 404 is placed to transfer the image of the back pupil of the objective 402 onto a birefringent lens (BRL) assembly 203 that produces the differentially focused beams necessary to achieve FINCH interference.
  • BRL birefringent lens
  • the space between lens 404 and the BRL assembly 203 is infinity space for insertion of standard microscope dichroic beam splitting filters 405 and any other optic such as emission filters 413 and polarization optics.
  • PBS linearly polarizing beam splitter
  • the rejected polarization from the PBS 406 is directed to a standard microscope tube lens 407 and focused onto a standard camera 408 such as CCD or CMOS to capture a widefield or confocal image for the purpose of comparison to the FINCH or CINCH image.
  • This comparison widefield or confocal image is not a strict requirement of FINCH imaging and is used here solely as a benchmark comparison so that an identical widefield or confocal image can be compared to the FINCH or CINCH (confocal FINCH) image.
  • a FINCH imaging system is attached to an emission port of a standard microscope and a camera attached to another camera port of the microscope to obtain a widefield image.
  • an achromatic quarter-wave-plate (QWP) 409 positioned after the birefringent lens assembly 203 is an achromatic quarter-wave-plate (QWP) 409 with its slow axis aligned midway between the birefringence axes of the BRL.
  • the QWP 409 converts the orthogonally linearly polarized light beams 103, 104 that it receives into orthogonally circularly polarized light beams, still with differing focal lengths, that are caused to interfere at the micro-polarizer camera 206.
  • the beams 103, 104 are both defocused beams of light from the microscopic sample.
  • the achromatic QWP is used to extend the useful working spectral range to cover most of the interesting biological fluorescence emission wavelengths.
  • Confocality of imaging is provided by a spinning Nipkow pinhole disk 410 (US Patent 11,029,646 issued June 8, 2021) that can be inserted into the optical path at the focal plane between 403 and 404, if desired.
  • Fluorescence and reflectance illumination light is provided from illumination lamp 411, while transmitted illumination light is provided by illumination lamp 412.
  • the operating procedure of the microscope is identical to that of a standard widefield or spinning disk confocal microscope.
  • the sample is brought into focus, the exposure time is metered to maximize the signal-to-noise ratio while avoiding saturation, and a single exposure is captured.
  • the recorded hologram is converted to a complex hologram as in Equation 1 and related discussion, reconstructed by Fresnel Propagation as in Equation 2 either directly to the focal plane of the objective, or alternately into a calculated stack of reconstructed images representing a through-focus series of planes.
  • the reconstructed focal plane image can be displayed live during image capture, if desired.
  • the absolute value of the reconstructed image was used for further analysis. Deconvolution of the reconstructed image or image stack was performed using a custom FINCH PSF and a blind deconvolution with entropy regularization.
  • Figure 1 illustrates a generalized FINCH imaging system according to some embodiments.
  • Figure 1A (Prior Art) llustrates example imaging of a single infinitesimally small object by classical optical imaging or by FINCH imaging according to some embodiments.
  • Figure 2 illustrates a FINCH optical system as in "Single shot holographic super-resolution microscopy" according to some embodiments.
  • Figure 3 illustrates separating multiple individual phases of a hologram from an interspersed hologram recorded on a micropolarizer camera according to some embodiments.
  • Figure 4 illustrates a generalized view of an example FINCH system, according to some embodiments.
  • Figure 5 illustrates an expanded set of idealized FINCH PSFs to exemplify the characteristics expected of a FINCH hologram PSF under idealized conditions in accordance with some embodiments.
  • Figure 5A illustrates a modified concept of FINCH hologram formation process with interference of two beams of non-identical intensity according to some embodiments.
  • Figure 5B illustrates a modified concept of FINCH hologram formation process with interference of two beams of non-identical intensity and imperfect centration according to some embodiments.
  • Figure 6 illustrates a sample of fluorescent beads imaged at an emission wavelength by FINCH microscopy on a microscope of the type shown in Figure 4, according to some embodiments.
  • Figure 7 illustrates FINCH images of the same beads as shown in Figure 6, on a microscope of the type shown in Figure 4, with a confocal spinning disk placed in and the optical path as shown in Figure 4.
  • Figure 8 illustrates a collimated laser beam being introduced to the microscope at a position that bypasses all the microscope optics other than the FINCH optics, according to some embodiments.
  • Figure 9 illustrates an optical arrangement used to test whether the image relay composed of two lenses causes any aberrations in the FINCH holograms, according to some embodiments.
  • Figure 10 illustrates an optical arrangement used to testthe performance of the remainder of optics (other than the objective) in a microscope incorporating FINCH optical system optics, according to some embodiments.
  • Figure 11 illustrates the point spread function (PSF) holograms taken with various versions of configurations shown in Figures 8, 9 and 10, from a collimated laser used to simulate a perfectly expected beam from an objective.
  • Figure 12 illustrates an optical arrangement in which a collimated laser is used to back-illuminate a pinhole at the focus of an objective to provide a pinhole back-illuminated with a perfect beam, according to some embodiments.
  • PSF point spread function
  • Figure 13 illustrates the results when the pinhole shown in Figure 12 is imaged with FINCH in widefield and spatially filtered mode in which a spinning disk was inserted at the intermediate image plane between relay lenses, but in which the illumination light did not pass through the spinning disk, according to some embodiments.
  • Figure 14 is a set of widefield and spatially filtered fluorescent images taken in an optical arrangement with a different objective lens, according to some embodiments.
  • Figure 15 illustrates that in general with FINCH optics, the birefringent lens produces two beams with different focal lengths and the hologram is recorded at a location in which the first beam is in a diverging defocus range, whereas the second beam is in a converging defocus range, at which location both beams are the same size so that the overlap of the beams is maximized.
  • Figure 16 illustrates the results of the FINCH imaging of 200 nm point spread function (PSF) beads with a 40x Zeiss objective on a Zeiss microscope, comparing the appearances of the interfering beams at a FINCH camera and the out-of-focus standard images taken by moving a widefield camera back and forth relative to the standard lens focal plane, according to some embodiments.
  • PSF point spread function
  • Figure 17 illustrates a similar data set as Figure 16 using the same microscope and methods that produced Figure 16 but obtained using a different objective, according to some embodiments.
  • Figure 18 illustrates in a consistent format the evolution of the idealized concept of FINCH microscope image formation through the observations of FINCH holography with a perfect laser beam as a real world model of an idealized depiction of FINCH images, and progresses through the introduction of a microscope objective that induces aberrations in the laser beam that are corrected by spatially filtering.
  • Figure 19 illustrates a continuation of the summary of Figure 18 by showing that it is possible for different objectives to produce markedly different beams that then are processed by the FINCH optics to produce either excellent holographic data or significantly aberrated holographic data.
  • Figure 20 illustrates widefield and FINCH data of a microtubule sample, in accordance with some embodiments.
  • Figure 21 illustrates widefield and FINCH images of a different microtubule cell from the same slide as used in Figure 20.
  • Figure 22 illustrates the two FINCH beams in a FINCH system, tracing them from the light received from the object through the creation of the beams that create independent images, in accordance with some embodiments.
  • Figure 23 illustrates an aberration may be introduced at the first lens in the system, the objective lens, according to some embodiments.
  • Figure 24 illustrates a scenario in which the primary lens is not aberrated but a tip/tilt aberration in the birefringent lens causes the two beams to propagate away from the birefringent lens with different wave vectors, in accordance with some embodiments.
  • Figure 25 illustrates a double-telecentric lens system including telecentric optics, according to some embodiments.
  • Figure 26 illustrates a birefringent lens that can be placed at the location of a telecentric stop, according to some embodiments.
  • Figure 27 illustrates through-focus spot diagrams of two objective lenses and also corresponding Seidel diagrams showing the Seidel coefficients of the spherical aberration of all the lens components in some example embodiments, in a graphical format.
  • Figure 28 illustrates the effect of one corrective strategy, adding an aspheric lens to fix the spherical aberration, according to some embodiments.
  • discrepancies Most prominent of the discrepancies are complex holograms with significantly highly contrasting structure in amplitude and deviations from spherical quadratic slope in the phase terms, which is associated with a reconstructed image PSF with significant side-lobes or shadows. In more complicated samples the discrepancies can manifest as large shadows around objects or even contrast reversal in which parts of the image that should be dark are bright and vice versa.
  • Figure 5 there is an expanded set of idealized FINCH PSFs to exemplify the characteristics expected of a FINCH hologram PSF under idealized conditions.
  • Figure 5 contains simulated images of ideal FINCH PSF components, along with line profiles taken through the center of the PSF images, as indicated by the lines drawn through the images (see images 501, 503, 505-508, 513, 515, 517).
  • the two separate beams that interfere (Beam 1 501 and Beam 2 503) are considered to have perfectly smooth Gaussian intensity profiles 502 and 504 that are identical to each other.
  • Each raw hologram has its own maximum and minimum at differing spatial locations, and the phases separated by 90 degrees are the inverse of each other as can be seen easily in profile plots 509-512.
  • Figures 5A and 5B contain modifications of Figure 5 to exemplify effects of discrepancies between Beams 1 and 2.
  • the beams 531 and 533 have significantly different intensity profiles 532 and 534.
  • the biggest difference is that Beam 2 has an intensity that falls toward zero much faster than Beam 1, so that even though the beams are still centered with respect to each other, the interference efficiency is no longer perfect.
  • the results of this shown in the raw holograms 535-538 and line profiles 539-542, show that the number of Fresnel rings in the raw hologram is reduced, and the relative intensities of the various rings in each raw hologram may be changed.
  • Figure 5B contains a further modification to Figure 5A, namely an offset in center position of Beam 2 by about 5% of its diameter, toward the bottom right corner of the image, as indicated by the white arrow 581.
  • This imperfect mutual centration means that the upper left section of Beam 1 and the lower right section of Beam 2, as indicated by the crescents 582, 583, no longer overlap any part of the other beam.
  • Figures 5A and 5B demonstrate the effects of discrepancies from the idealized concept.
  • a real imaging system such as a microscope
  • the effects of imperfect beam matching could be significant.
  • Images 601, 602 (corresponding to 501, 503 or 531, 533 or 561, 563) of each defocused isolated beam, Beam 1 and Beam 2, were recorded at the hologram plane, and then the four phase shifted holograms 603-606 (corresponding to 505-508 or 535- 538 or 565-568) were recorded and processed by equations 1 and 2.
  • a whole field of view corresponding to the hologram camera chip dimensions was recorded but only a small cropped section is shown for the sake of clarity. Note that the two beams produce defocused images 601, 602 that are quite dissimilar to each other. This difference suggests that the discrepancy discussed earlier is already present in the individual defocused beams before the FINCH interference process even begins.
  • the raw holograms 603-606 have extra undesired structure beyond an ideal Fresnel profile, including always having a small feature in the middle of the hologram.
  • These characteristics are carried forward into the complex hologram, which shows significant structure in the magnitude 607 (corresponding to 513 or 543 or 573) that differs from an ideal smooth profile, and in the complex phase 608 (corresponding to 515 or 545 or 575) in which transitions between wrapped portions of the phase are not sharp, and in which there is always a flat or soft feature in the middle.
  • an image spot PSF with a large halo (sidelobe) and shadow around it in which the halo intensity is about 10% of the intensity of the image peak as seen at the x-axis positions of ca. 20 and ca. 50 in the plot 610.
  • This halo which is a full or partial ring of intensity around the central intensity of an image point, is an exemplar of the type of discrepancy referred to earlier and which it is the goal of these teachings to eliminate.
  • the full or partial ring of darkness between the central intensity of an image point and a halo is referred to herein as a shadow.
  • the confocal images of the 200 nm bead PSF models show individual Beam 1 and Beam 2 images 701, 702 that are nearly featureless and which have a much more ideal intensity profile. All four phases 703-706 of the raw hologram also keep an ideal appearance and profile quite similar to the ideal ones 505-508 shown in Figure 5, with none of the extraneous features in the middle of the hologram seen in 603-606.
  • the complex magnitude 707 of any single bead is also featureless, smooth and ideal (with the minor exception of imaging noise); the complex phase 708 is an ideal spherical quadratic phase with sharp wrapping transitions and no softness or flatness in the middle.
  • the reconstructed image 709 does not show shadows or halos, which is confirmed by the plot profile 710 taken through the bead indicated by the line in image 709.
  • the linear interference structures in 707 top right and middle left
  • the objective 402 including its interface with the sample 401 is the most likely candidate for the source of the discrepancy; however it is necessary to confirm this and test the strength of the effect of the objective on aberrations in the hologram.
  • the pinholes in the disk are by design slightly larger than the Airy disk size of the beams at the location of the disk, which is the ideal size for performing spatial filtering.
  • the Airy disk is known to one skilled in the art as the size of the focal spot of a beam from its peak to the first intensity minimum.
  • the beam of light coming from the sample through the objective is considered as if it was a laser beam with aberrations and structure in it (such as those contained in non-TEM00 modes, as known to one skilled in the art), which is then focused down onto the spinning disk pinholes to spatially filter it and remove the aberrations and pass only the TEM00 mode.
  • this conceptualization does not require true confocality (i.e. the illumination does not need to pass through the disk, only the emitted light from the object does) so further demonstration of similar improvement in spatially filtered FINCH holography is required to confirm this understanding.
  • the version of 400 that served as the basis for 800, 900 and 1000 is a Nikon Eclipse microscope containing the objective 402 and first relay lens 403, with all items from the spinning disk until the cameras being part of a custom assembly with the following components: (410 CellOptic custom spinning disk with 50
  • im pinholes; 404 relay lens 2 150 mm 2" achromat from Thorlabs; 413 microscopy emission filters from Chroma or Semrock; 406 polarizing beamsplitter from Thorlabs; 203 custom Birefringent lens and compensating plate from CellOptic, BBO with -457 mm PCV curvature coupled with 200 mm achromatic lens from Thorlabs; 409 broadband QWP from Thorlabs; 206 polarization camera from FLIR).
  • Configuration 800 depicts the collimated laser beam 802 being introduced to the microscope at a position 801 that bypasses all the microscope optics except leaving the FINCH optics: the polarizing beam splitter, the birefringent lens, the quarter wave plate and the camera.
  • the components 404, 405, 413 were removed 804.
  • Four different beam widths were recorded with consistent results, but only the 12 mm beam width results will be presented later herein. This configuration is to test the isolated performance of the FINCH optics.
  • Configuration 900 ( Figure 9) was used to test whether the image relay composed of 403 and 404 causes any aberrations in the FINCH holograms.
  • the laser light was introduced to the FINCH optics by first going through a relay system similar to that in the FINCH microscope 400 (which reduces the beam width).
  • Configuration 900 depicts the collimated laser beam 802 being introduced to the microscope through an optical relay of the type shown in 400 with lenses 901 (an independent 200 mm focal length tube lens) standing in for 403 and 404 (a 2" 150 mm focal length achromat lens, reintroduced 902 in its standard location) but without using the built-in tube lens of the Nikon Eclipse microscope before passing to the FINCH optics: the polarizing beam splitter, the birefringent lens, the quarter wave plate and the camera.
  • the components 405, 413 were removed 903.
  • Configuration 1000 ( Figure 10) was used to test the performance of the remainder of optics incorporated in the Nikon Eclipse microscope based FINCH optical system optics (other than the objective) including the built-in Nikon tube lens as well as the confocal disk, and excitation/emission dichroic and emission filter.
  • Configuration 1000 depicts the collimated laser beam being introduced to the microscope through all of the optics of the Nikon Eclipse microscope based FINCH optical system except the objective 402.
  • the dichroic and emission filters (405, 413) and spinning disk (410) were alternately inserted into and removed from (1001, 1002) the optical path.
  • a common measure of beam quality is its intensity profile, which is the variation in intensity from the center of the beam to its outermost edge (radial extent).
  • a Gaussian beam may also be referred to as a TEM 00 mode beam, as known to one skilled in the art.
  • a perfect or ideal beam is one that possesses a smoothly and gradually varying and radially symmetric intensity profile, without strong or sharp variations of intensity which can collectively be referred to as "structure".
  • structure A further consideration for FINCH is that for ideal holograms to be formed, each of the defocused beams used to create the hologram should be ideal.
  • Ideal FINCH raw holograms of PSF objects have intensity profiles that are the magnitudes of Fresnel phase patterns as depicted in 505, 506, 507, 508 and as described in US Patent No.
  • the ideal complex hologram derived from ideal raw holograms should have a magnitude that is similar to the intensity profiles of the beams that were interfered term (similar to the relationship of 513 to 501 and 503), without large amounts of structure in the intensity, and should have a phase term that is closely approximated by a wrapped quadratic function as in 515.
  • a perfectly collimated Gaussian laser beam without defects or aberrations can be used with FINCH optics to create a FINCH hologram from the interference of two distinct beams created from the single laser beam received by the FINCH optics, at any plane after the creation of the two beams.
  • Defects and aberrations that are sometimes observed in defocused optical beams include but are not limited to uneven intensity profiles, the presence of optical speckle, other randomly located patterns or dark spots in the beam, and diffraction or other interference patterns in the beam.
  • Defects or aberrations in optical beams can be a result of the propagation of multiple wave modes propagating within the beam other than the Gaussian mode.
  • Defects and aberrations in focused images can include halo/shadow patterns as described previously herein, as well as all of the optical aberrations known to one skilled in the art as Defocus, Spherical Aberration, Coma, Astigmatism, Field Curvature, and Distortion.
  • Beams and images that are corrected in this way may be referred to as corrected images, or restored images, where the restoration is to a state that is as if the beams or images were perfect and non-aberrated. If an appropriate correction is applied to defective or aberrated light beams or other electromagnetic waves received from sample objects, it is possible to create holograms from said objects that are as perfect or ideal as if the waves from the object had actually originated form a perfectly collimated and non-aberrated laser beam.
  • the PSF holograms taken with various versions of configurations 800, 900 and 1000 from the collimated laser to simulate a perfectly expected beam from an objective are shown in Figure 11.
  • All of the PSF holograms shown are of excellent quality with no notable defects or aberrations when they were recorded.
  • the isolated Beam 1 and Beam 2 intensities are smooth, relatively featureless and similar to each other, with no random, asymmetric, or sharp intensity variations.
  • the raw holograms are all ideal in their appearance, being similar to 505, 506, 507, 508, and the Magnitude and Phase of the complex holograms are ideal by being similar to the intensities of the interfering beams and being approximated by a wrapped quadratic function, respectively.
  • the reconstructed images all show no halo or shadow.
  • a pinhole back-illuminated with a perfect beam is a good stand-in for a microscopic specimen emitting light and can be used to assess the PSF image quality of a microscope objective.
  • the pinhole was imaged with FINCH in widefield and spatially filtered mode, where spatially filtered mode means that the spinning disk was inserted at the intermediate image plane between 403 and 404, but the illumination light did not pass through it.
  • the results are shown in Figure 13.
  • the fdl and fd2 beams are both heavily aberrated and significantly different from each other. These factors cause significant aberrations in the raw holograms, and defects in the center of the complex hologram.
  • the reconstructed image shows significant halos of ca.
  • Figure 14 is a similar set of widefield and spatially filtered fluorescent images taken with the Nikon 60x TIRF objective and 200 nm fluorescent beads. Images of single beads were cropped and examined as representative PSFs. The results show that without spatial filtering Beams 1 and 2 are compromised and the holograms are defective. As in Figure 13, spatial filtering restored the holograms and provided good results. Thus spatial filtering works to correct, to a more ideal state, actual aberrated fluorescence images from objectives and not just on model objects such as the 1 um pinhole or a collimated laser beam.
  • a further instrument was used to test the effect of different objective lens types on FINCH performance:
  • a microscope of the general format of 400 was constructed using a Zeiss Axio Observer microscope to hold the objective lens and tube lens (since Zeiss infinity corrected microscope objectives are designed to work in Zeiss microscopes that have a 164.5 mm tube lens compared to Nikon objectives designed to work in Nikon microscopes with a 200 mm tube lens)(relay lens 1, 403) and a a 250 mm 2" achromat lens as relay lens 2 (404).
  • This microscope is otherwise similar in design to the FINCH microscope based on the Nikon microscope frame.
  • Two objectives were used: a Zeiss 40x Fluar 1.3 NA oil objective, and a Zeiss lOOx 1.3 NA Fluar oil objective.
  • the 40x objective has fewer optical elements and corrections than the 60x TIRF objective and thus is a way to interrogate whether FINCH microscopy might benefit from less-corrected objectives that create less structure in the beams they create from light received from the sample.
  • the lOOx objective is the same design class as the 40x but is of higher magnification, which necessarily requires more correction in the lens and is thus a test of differing levels of correction within a particular lens class. Similar to the imaging of 200 nm beads with the Nikon Eclipse based microscope, isolated images of Beams 1 and 2 were recorded through the FINCH optics as well as raw holograms that were processed into complex holograms and reconstructed images.
  • the hologram is recorded at a location in which Beam 1 is in a diverging defocus range, whereas Beam 2 is in a converging defocus range, at which location both Beams are the same size so that the overlap of the Beams is maximized.
  • a standard lens as in the unmodified microscope widefield optical path, on the other hand, only produces an image at a single focal length, and to approximate the position of the hologram camera relative to the focal lengths of FINCH Beams 1 and 2, it is necessary to move the camera to measure the defocused beams at diverging or converging positions. Moving the sample closer to and further away from the lens is a very similar operation but not identical.
  • the camera is moved further away from the standard microscope tube lens to record the defocus beam as it diverges from focus, and is moved closer to the tube lens to record the defocus beam as it is still converging toward focus.
  • the results of the FINCH imaging of 200 nm PSF beads with the 40x Zeiss objective on the Zeiss microscope and of moving a widefield camera back and forth relative to the standard lens focal plane are shown in Figure 16.
  • the widefield defocused images were collected on the unaltered trinocular port of the Zeiss Axio Observer microscope.
  • the top row of FINCH images shows the isolated Beam 1 and 2 recorded on the FINCH camera, while the bottom pair of images comes from moving the camera to defocus positions on the trinocular port approximately 5 mm to either side of the focal plane.
  • the sample was the same type of 200 nm fluorescent sample used for the FINCH images.
  • Figure 18 displays in a consistent format the evolution of the idealized concept of FINCH microscope image formation through the observations of FINCH holography with a perfect laser beam as an idealized real world model, and progresses through the introduction of a microscope objective that induces aberrations in the laser beam that are corrected by spatially filtering.
  • Figure 18 In the first row of Figure 18 is the ideal theoretical performance of FINCH imaging on an idealized Gaussian beam with no aberrations.
  • the individual Beams have identical intensities and none of the structure such as rings or intensity variations that comes from optical aberrations, and they produce Raw holograms with neat circular Fresnel fringes, leading to a complex hologram with structureless Gaussian intensity and quadratic phase with sharp phase wrapping regions and a Reconstructed image with no halo.
  • the second row shows a real FINCH optical system operating on a single mode laser that is as close as possible to a Gaussian intensity.
  • the individual Beams are very similar to each other with little structure, resulting in Raw holograms that nearly match those in the theoretical data from the top row, along with a complex hologram with intensity with little structure and a quadratic phase, and a reconstructed image with no halos.
  • the third row shows that the introduction of a microscope objective into the laser beam causes significant aberrations and structure in the individual Beams, which is carried forward into the raw and complex holograms as visible defects and significant halo in the reconstructed image. Removal of the defects by the spatial filtering procedure as in the bottom row is shown to remove the defects and return the hologram data to an ideal state with no obvious defects, little structure in the complex intensity, a quadratic phase and a reconstructed image without halo.
  • Figure 19 continues this summary by showing that it is possible for different objectives to produce markedly different beams that then are processed by the FINCH optics to produce either excellent holographic data or significantly aberrated holographic data.
  • the top two rows are identical to Figure 18 for reference.
  • Row 3 shows fluorescence holographic data of a 200 nm PSF bead imaged through an objective (Zeiss 40x fluar oil objective, 1.3 NA) with the ability to produce an unaberrated defocus beam that is used to form high quality raw and complex holograms and a reconstructed image without halo.
  • another objective Zeiss 63x plan-apo oil objective, 1.4 NA was able to perform similarly.
  • Row 4 shows data from a similar bead taken with an objective (Nikon 60x TIRF oil objective, 1.49 NA) that is not able to produce an unaberrated beam; the resultant Beams are quite dissimilar and structured, and the raw and complex holograms obviously aberrated, producing a reconstructed image with significant halo.
  • the aberrated fluorescence data can be cleaned up by spatial filtering as shown in Row 5 to produce high-quality Beams and FINCH holographic data including a reconstructed image with no halo.
  • Figure 20 shows widefield and FINCH data of a microtubule sample (GattaQuant 4C slide) taken with the Nikon TIRF objective discussed above.
  • the widefield data is a typical fluorescence image, while the FINCH reconstructed image is aberrated and unclear.
  • Figure 21 shows widefield and FINCH images of a different microtubule cell from the same slide as used in Figure 20, imaged with the 63x Zeiss objective discussed above.
  • the FINCH PSF in the upper left corner of the FINCH image is much better than that in Figure 20.
  • the widefield image is typical of widefield images of this type of sample, while the FINCH image is of improved contrast and resolution, demonstrating fulfillment of the promise of the idealized FINCH concept.
  • the use of a well-selected or designed objective dramatically increases the performance of FINCH microscopy and enables realization of the theoretical potential.
  • a limited number of Zemax files are available for microscope objectives from different manufacturers, (Zhang and Gross, "Systematic design of microscope objectives.
  • the beams are perfectly overlapped at the hologram recording plane and the interference efficiency and quality is maximized.
  • an aberration may be introduced at the first lens in the system, the objective lens.
  • the objective lens is the most high-tolerance part that is most likely to introduce large aberrations.
  • a tip/tilt aberration from the objective causes the wave vector of the light beam from the sample to propagate at a slight angle to the system optical axis, and as a result the two beams that are produced by the birefringent lens are no longer collinear - the new wave vector of each beam leaves the BRL at a different angle (ai and a 2 ) to the system optical axis, causing imperfect overlap of the two beams at the hologram recording plane. While the beams do still overlap partially, there is at every distance along the beam paths a part of one of the beams that does not overlap any part of the other beam, and this missing overlap leads to reduced interference efficiency and image quality.
  • the primary lens is not aberrated but a tip/tilt aberration in the BRL causes the two beams to propagate away from the BRL with different wave vectors, again causing imperfect beam overlap.
  • the aberration considered is tip/tilt that damages the colinear propagation of the two beams used to create the hologram.
  • the concept applies also to aberrations that do not affect collinearity but instead only damage the phase profile of at least one of the beams, such as coma, spherical aberration or astigmatism amongst others. Aberrations that do not affect overlap or collinearity may still degrade the FINCH hologram even though that is not depicted in Fig. 22-24.
  • an entire FINCH system may be designed all together, so that all components work together and any one component may perform some or all of the optical correction for one or more other components.
  • Such an approach could be the simplest way to design single-purpose optical systems that have maximum optimization for their specific purpose.
  • a metrology system designed only to image circuit boards at a wavelength of 350 nm could neglect chromatic aberrations in its design and instead be designed only for correction of the planatic and monochromatic aberrations such as spherical aberration, coma, astigmatism, and field curvature.
  • a biomedical screening instrument designed only to measure colocalization of two specific proteins with specific conjugated dyes could be designed with chromatic correction only for those two dye's specific wavelengths without requiring chromatic correction for any other wavelength.
  • Both of these examples reduce the manufacturing complexity required since they do not attempt to create a design that can readily be applied to any task.
  • a disadvantage is that individual systems must be designed for each purpose, even though each system that is made can have reduced complexity due to purpose-specific design.
  • Telecentric imaging is a type of imaging, well-known to one skilled in the art, in which light from all points in an object is used to create an image in which there is no change in lateral magnification throughout all the 3D spaces containing the object and image. This is always done by placing an aperture called the telecentric stop at the focal plane of at least one lens, which forces all the light beams from any part of the object to propagate along a direction parallel to the system optical axis, in at least the object space (between the object and the first lens in the system) or the image space (between the last lens of the system and the image).
  • Telecentric imaging is used advantageously in applications including amongst many others metrology and machine vision due to its low distortion, and constant magnification.
  • telecentric images do still have a limited depth of field/focus and do also lose three dimensional information about the object being imaged.
  • a purpose-built telecentric FINCH imaging system provides new advantageous features such as greater depth of field/focus, three-dimensional information, and higher lateral resolution to telecentric imaging.
  • Figure 25 To consider telecentric optics in general, consider a double-telecentric design as shown in Figure 25, that is telecentric in both object and image space.
  • a physical stop telecentric stop
  • Figure 25 shows two lenses arranged in double telecentric condition, wherein the lens pair is separated by the sum of their focal lengths, and a stop is placed at their mutual focal plane, centered on the optical axis. The result of this is that the chief rays of axial object points, shown by the solid gray lines in Figure 25, all are parallel to the optical axis between the object plane and Lens 1, and between Lens 2 and the image plane.
  • FINCH vignetting This characteristic will be referred to herein as the "radial problem", or “FINCH vignetting”. This is due to the fact that by the classical laws of optics, the chief rays of the beams originating from any given radial object point and impinging on a lens will leave the lens at an angle dependent on the focal length of the lens. Since the specialized FINCH birefringent lens essentially has two focal lengths, each of the beams in a given pair will have a different chief ray angle as it leaves the FINCH lens, which dictates that the two beams propagate along different wave vectors. As the rays propagate further away from the lens to the hologram plane, the two beams in each pair lose concentricity as a result of their different propagation directions, leading to reduced beam overlap and interference efficiency.
  • the issue of reduced beam overlap with radial displacement from the system optical axis constitutes an aberration in the FINCH system.
  • This may be solved by integrating a BRL into a telecentric optical system and designing the full system to eliminate the FINCH vignetting as well as any other aberrations.
  • the FINCH vignetting is solved as follows, while the remainder of the aberrations to be eliminated may be corrected by other standard lens design methods.
  • a birefringent lens (BRL) 2608 can be placed at the location of the telecentric stop 2602, so that all beams received from the object 2604 through lens 1 2606 are exactly centered on the BRL.
  • the BRL affects each beam differently, producing the pair of differentially focused beams 2610 and 2612 that is required for FINCH.
  • the beams were centered on the BRL as they passed it, their chief rays were not bent and their propagation direction was therefore unaltered, so each pair of beams remains perfectly concentric.
  • Lens 2 2607 then focuses each beam pair with both their chief rays parallel to the optical axis, ensuring perfect overlap for all radial points at the hologram recording plane 2614.
  • An optical setup was constructed as described in Figure 26, with Lens 1 having focal length 125 mm, Lens 2 having focal length 200 mm, and the object being located approximately 135 mm away from Lens 1.
  • the magnification inherent in this optical system results in an increase in the distance between the two image planes produced by the optical system.
  • the object was a reflective USAF test pattern mask, and it was illuminated in an epi-illumination technique with light of ⁇ 20 nm bandwidth.
  • the birefringent lens was a PCX lens with curvature -457 mm made from alpha-BBO.
  • a polarizing beam splitter was installed between the object and Lens 1, and a BBO compensating plate and broadband quarter wave plate were installed between Lens 2 and the polarized camera, which was at the hologram plane of maximum overlap.
  • Standard images were recorded at both the short and long (fdl and fd2 respectively) image planes, and a hologram was recorded at the hologram plane 2614 and was reconstructed to a focused image.
  • the resulting images are shown in the insets in the lower right corner; the images marked fdl image, fd2 image and FINCH image are all exactly the same size, and the FINCH image is of high quality, showing that telecentricity was maintained and the interference efficiency was high.
  • BRL-enabled FINCH brings the advantages of its well-characterized three-dimensional (3D) imaging to telecentric imaging.
  • 3D three-dimensional
  • previous telecentric imaging is not capable of distinguishing 3D information in an object or providing any 3D perspective.
  • Telecentric FINCH can reconstruct different object planes in an object that is outside the depth of focus of the telecentric system, and can identify what the axial (depth) location of different parts of the object are, an ability not currently available in telecentric imaging.
  • a FINCH system can be considered as a sum of two independent systems, a FINCH-specific system and a general system, that are connected to each other for a combined purpose.
  • the goal of the approach is to have a FINCH-specific system containing only the optical components - Polarizer, BRL and associated optics, Quarter-waveplate, polarization camera - necessary to generate two (ideally perfect) beams from a single (ideally perfect) received beam, that is ready to be combined with any other system that can provide a perfect beam for the FINCH optics to receive.
  • the FINCH-specific optical system must be optimized and corrected independently, and the general system also must be optimized and corrected independently.
  • This approach has the advantage that a single FINCH-specific system can be constructed that can interface to any general optical system, lowering the cost and time-to-market. This approach still requires the optimization of the entire general system beyond the optimization systems usually undergo for standard purposes.
  • the FINCH-specific system is optimized independently for FINCH holography on a perfect received beam.
  • the general system is optimized for its own purpose without requiring a perfect non-aberrated output beam to transmit to the FINCH-specific system.
  • a third system, the corrective system is provided to act as the interface between the general and FINCH-specific systems.
  • This approach may in fact be the most optimal corrective approach since any off-the-shelf general system can be interfaced with a single FINCH-specific system, saving time and cost on developing new general systems or multiple single-purpose systems, while only designing one (or few) FINCH-specific systems.
  • the corrective system can be dedicated solely to correcting whatever known aberration exist in the general system and making any further adjustments necessary to allow the FINCH-specific system to perform to its maximum capabilities.
  • There are many elements that can be used for correction including SLMs, deformable mirrors, adjustable lens assemblies and others.
  • a corrective system used to correct a known aberration is found in "Any immersion remote refocus (AIRR) microscopy" (published online by Millett-Sikking, Alfred, 2022, found at https://amsikking.github.io/any_immersion_remote_refocus_microscopy) in which a zoom-lens system is used in place of a tube lens in an after-market add-on that converts a standard microscope into a remote-refocusing microscope.
  • the known aberration in that case is sample-medium induced spherical aberration, for which the zoom-lens performs a correction that is adjustable based on a rational understanding of the refractive index mismatch of the actual sample medium and the objective design.
  • the inventors have determined that the current FINCH microscope may produce pairs of interfering Beams 1 and 2 (fdl and fd2) with asymmetry and discrepancies between them. The inventors have further found that the asymmetry and discrepancies are due to the microscope objectives used in the microscope. Note that while the following teachings are made with reference to microscope objectives as the primary cause of aberrations, these teachings are not limited to objectives and are analogously applicable to aberrations, asymmetry and discrepancies caused by any other element. With the conclusion that the objective is the main source of aberrations in practice for FINCH microscopy, it is necessary to propose methods for eliminating or correcting the aberrations due to the objective. Generally, aberration removal or correction may take one of four broad approaches:
  • Prevent aberrations Create beams of light from the object that have as few aberrations as possible in the defocus parts of the beam.
  • Remove aberrations Create aberrated beams of light from the object, and then spatially filter out the aberrations with a spinning disk or other filtering approach.
  • Correct aberrations Create aberrated beams of light from the object, and use other optical elements such as deformable mirrors, spatial light modulators, aspheric lenses or others to correct the aberrations.
  • Compensate for aberrations in the computation of the final reconstructed image, use a numerical adjustment to the image creation (Fresnel propagation or other) process to compensate for the aberrations in the recorded hologram and prevent their propagation through to the final image.
  • Widefield, confocal, phase contrast, TIRF, DIC, polarization, reflection, etc. and color correction lenses are all optimized during the design phase for the imaging method they serve. In each case they are designed to provide the highest resolution possible at the plane of focus. These lenses are not optimal for holographic imaging in which each image beam originating from an object at focus ideally produces two defocus beams with equal intensity profiles and roughly opposite phases, ultimately interfering with each other to create a hologram that accurately represents the 3D volume of the object.
  • the inventors have discovered this fact and have invented a variety of methods and apparatus to allow for the efficient imaging of objects with better than optical resolution in a variety of ways.
  • One such way is the design of new optics to create, from each light beam from the object, two out of focus beams with equal intensities and roughly opposite phase characteristics.
  • these lenses can be called H-objectives, designed for various specialized tasks and to provide ideal defocus beams for each specialized task (H-Widefield, H-confocal, H-color corrected, H-TIRF, etc.). All of these objectives will give enhanced resolution when the microscope is operated in holographic mode.
  • Modern lens design software such as ZEMAX can be used to design objective lenses with the appropriate characteristics needed for FINCH imaging, i.e. good in and out of focus uniform beams that also provide good resolution at the plane of focus.
  • One common method for correcting spherical aberration is to use an aspheric lens element at a pupil plane (such as the plane wherein the BRL is located in the FINCH microscope).
  • Another method would be to use a deformable mirror or a spatial light modulator (SLM) to apply beam corrections by analyzing a given objective lenses and applying Zernike or Seidel corrections.
  • SLM spatial light modulator
  • Figures 27 and 28 demonstrate applying Zemax analysis and design for FINCH with a TIRF or regular objective with a corrective strategy of simply adding an aspheric lens to the optical train.
  • Figure 27 contains through- focus spot diagrams of a 60x 1.49 NA TIRF objective and a 60x 1.4 NA standard objective as well as corresponding Seidel diagrams showing the Seidel coefficients of the spherical aberration (SA) of all the lens components in a graphical format.
  • SA spherical aberration
  • the data show that the 60xTIRF has significant asymmetry between the beam going into focus (-20, -10 mm) and coming out of focus (10, 20 mm) due to strong SA, as confirmed by the total SA Seidel coefficient of -3.32 mm indicated on the Seidel chart below.
  • This is consistent with the data for the 60x TIRF objective shown in Figures 6, 14, 19, and 20 which demonstrate suboptimal performance of FINCH when used with a 60x TIRF objective and no correction by confocal or spatially filtered imaging.
  • the diagrams in Figure 27 for the 60x standard objective show much less asymmetry and SA with a total SA Seidel coefficient of 0.24.
  • Figure 28 shows the effect of one corrective strategy, adding an aspheric lens to fix the SA.
  • the optical diagrams show that the addition of a single corrective element, an aspheric lens, is enough to dramatically reduce the SA by multiple orders of magnitude from -3.332 to -0.0009 and from 0.24 to -0.0008.
  • the aspheric lenses in Figure 28 were designed in Zemax and have a conic constant of zero, with both sides of the lens having infinite major curvature (each side is piano) but with one surface having a fourth-order coefficient with an absolute value on the order of between 6 to 9 x 10' 6 .
  • these aspheric corrective lenses were designed to provide SA correction without adding any extra focusing power to the system. Further, they were designed with a 10 mm center thickness. These parameters could easily be changed to accommodate other systems or placement at different locations in the optical train. For example, in Zemax simulation data (not shown) of a FINCH microscope of the type of 400, other aspheric correctors with less thickness and larger fourth order coefficients were placed at the relayed objective pupil plane just prior to the BRL 203 in Figure 4, and successfully reduced the overall SA of the microscope to effectively zero.
  • the last class of solutions to the problem of aberrations in FINCH holograms induced by asymmetrical beams in the hologram formation process is to apply a correction factor ⁇ ?to either the raw hologram or the reconstruction function in equation 2, as exemplified in equation 5.
  • the correction could be accomplished by multiplying either the complex hologram (as in equation 5) or the reconstruction function such as the IRF or the OTF of Equations 2 and 3 (which is complex-valued) with a corrective phase matrix such as a Zernike phase polynomial. (equation 5)
  • the Zernike coefficients can be iteratively adjusted to improve the correction that is applied.
  • the optimal set of coefficients can be determined for any particular objective by using PSF methods; ie an aberrated PSF hologram can be recorded with the objective, and the Zernike correction can be iteratively adjusted until a satisfactory image spot with no halo (sidelobes) is produced.
  • the set of Zernike coefficients that is thus generated can then be used to generate a correction factor for the reconstruction of images from other sample objects.
  • an electromagnetic imaging apparatus configured to create two distinct electromagnetic waves from each electromagnetic wave received from any point of an object, wherein said two distinct electromagnetic waves perfectly interfere at any plane as if each of the two distinct electromagnetic waves originated from a perfectly collimated laser with no aberrations.
  • the electromagnetic radiation may be coherent or incoherent.
  • the optical system may be telecentric and the creation of the two colinear waves from the received wave may be accomplished at the location of the telecentric stop.
  • an electromagnetic imaging method comprises: creating two distinct electromagnetic waves with no aberrations from each electromagnetic wave received from an object, wherein said two distinct electromagnetic waves have wave characteristics of a perfectly collimated laser beam; and causing the two distinct electromagnetic waves to interfere at any plane.
  • an electromagnetic imaging apparatus comprises: a means to create two distinct defocused beams of light from each original beam received from an object, wherein said two distinct defocused beams perfectly interfere at any plane after the apparatus, as if each of the distinct defocused beams originated from a perfectly collimated and nonaberrated laser.
  • the means to create interfering beams may comprise a lens system, electromagnetic beam system, SLM, deformable mirror system, multiple beam-splitter system, multifocal lens system, or any other beam separating system. All of the optics and other elements in the apparatus including the means to create two beams from a single received beam may be constructed by design to balance and correct each other in order to produce the distinct beams of perfect character.
  • all optics and other elements of the apparatus prior to the means that create the two beams from the beam received from the object may be designed together for the purpose of supplying a perfect unaberrated beam to the means that creates the two beams.
  • an electromagnetic imaging method is provided. The method includes creating two distinct defocused beams of light from each original beam received from an object, wherein said distinct defocused beams perfectly interfere at any plane after the apparatus, as if each of the distinct beams originated from a perfectly collimated non-aberrated laser.
  • an optical system is configured to receive, at a first subassembly, EM (electromagnetic) waves from an object wherein the first subassembly is configured to convert said EM waves into altered EM waves that propagate away from the first subassembly with one or more optical aberrations not present in the altered EM waves, and produce, after transmission through one or more further optical assemblies, an unaberrated interference pattern that is recorded with a recording means.
  • the first assembly may include a simple or compound lens with a composition of surfaces shapes and materials configured to produce altered waves that lack at least one of the well- known optical aberrations, for at least one wavelength of EM radiation.
  • Each of the altered waves, at the plane of the recording means has been transformed into two descendant waves in different states of defocus, each of which lacks one or more of the optical aberrations known to one skilled in the art and listed elsewhere herein.
  • an optical system may be configured to receive, at a first subassembly, EM waves from an object wherein the first subassembly is configured to create altered waves that propagate away from the first subassembly with one or more optical aberrations present in the altered waves, and to remove said aberrations with a spatial filtering means, and produce, after transmission through one or more further optical assemblies, an unaberrated interference pattern that is recorded with a recording means.
  • the spatial filtering means may be a scanned array of pinholes of approximately the size of the airy disk of the EM radiation as focused onto the location of the spatial filter means.
  • the spatial filter means may alternatively be a scanned array of slits or other apertures with at least one dimension of about the size of the airy disk of the EM radiation as focused onto the location of the spatial filter means.
  • an optical system configured to receive, at a first subassembly, EM waves from an object wherein the first subassembly is configured to create altered waves that propagate away from the first subassembly with one or more optical aberrations present in the altered waves, and to correct said aberrations with a corrective optical means, and produce, after transmission through one or more further optical assemblies, an unaberrated interference pattern that is recorded with a recording means.
  • the corrective optical means may include a static optical element with materials and surface features configured to invert or otherwise correct one or more of the common aberrations that is present in the altered waves.
  • the corrective optical means may include an optical element with materials and surface features configured to invert or otherwise correct one or more of the common aberrations that is present in the altered waves, and wherein said optical element is movable to different positions and performs differing optical corrections according to the specific location in which it is located, to correct for different optical aberrations in the altered waves.
  • the corrective optical means may include more than one optical element, separate from each other and able to move independently from each other, each with materials and surface features configured to invert or otherwise correct one or more of the common aberrations that is present in the altered waves, and wherein the total correction applied by the means is changed based on the relative positions of the optical elements relative to each other and the first subassembly of the optical system.
  • the correction performed in this embodiment may be applied by means of a deformable mirror, by means of a spatial light modulator, by a means including at least one aspheric lens, or by using Zernike coefficients derived from PSF images recorded without correction to the corrective optical means.
  • an optical system configured to receive, at a first subassembly, EM waves from an object wherein the first subassembly is configured to create altered waves that propagate away from the first subassembly with one or more optical aberrations present in the altered waves, and produce, after transmission through one or more further optical assemblies, an aberrated interference pattern that is recorded on a recording means, and to correct the aberrations in the recorded interference pattern with a computational means.
  • the computational means may include creating a complex-valued representation of the recorded interference pattern, and applying a pre-calculated correction function to remove the aberrations in the recorded interference pattern.
  • the computational means may include performing an iterative correction to the recorded interference pattern until a given quality metric for the corrected interference patter is reached.
  • the computational means may include an iterative process comprising: producing an image of the object from the interference pattern; analyzing the image for aberrations and defects, and deducing from the analysis a correction to apply to the interference pattern and using the corrected interference in a repeat of the first step of the algorithm unless the analysis indicates an acceptably low level of aberrations and defects in the image is obtained, in which case the iterative process is stopped and the corrected interference pattern is accepted as the best-corrected interference pattern.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Computing Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Holo Graphy (AREA)

Abstract

L'holographie FINCH incohérente est un procédé d'imagerie à super-résolution 3D simple à prise unique basé sur l'interférence de deux faisceaux de lumière non focalisée d'un sujet focalisé Les inventeurs ont découvert qu'en pratique, une uniformité élevée (symétrie) entre les faisceaux individuels interférents de focalisation supérieurs et inférieurs est importante pour produire les images microscopiques à base holographique FINCH sans distorsion et à la résolution la plus élevée. Dans le cas de la microscopie holographique, de nombreux objectifs de microscope ne fournissent pas de faisceaux défocalisés sans caractéristiques spéciales, non structurés et sans aberrations, qui sont identiques et symétriques à la fois au-dessus et au-dessous du plan de focalisation, et qui sont optimaux pour une holographie incohérente. Les objectifs de microscope sont généralement conçus pour assurer une résolution et des résultats optimaux au niveau du plan de focalisation sans préoccupation de conception primaire pour les aberrations dans les faisceaux défocalisés au-dessus et au-dessous du plan de focalisation. Des appareils et des techniques pour obtenir la caractéristique appropriée de faisceaux défocalisés symétriques au-dessus et au-dessous du plan de focalisation pour une holographie incohérente sont présentés.
EP23908624.2A 2022-12-24 2023-12-22 Système, appareil et procédé d'imagerie et d'holographie améliorées Pending EP4639286A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US202263435247P 2022-12-24 2022-12-24
PCT/US2023/085700 WO2024138130A1 (fr) 2022-12-24 2023-12-22 Système, appareil et procédé d'imagerie et d'holographie améliorées

Publications (1)

Publication Number Publication Date
EP4639286A1 true EP4639286A1 (fr) 2025-10-29

Family

ID=91590160

Family Applications (1)

Application Number Title Priority Date Filing Date
EP23908624.2A Pending EP4639286A1 (fr) 2022-12-24 2023-12-22 Système, appareil et procédé d'imagerie et d'holographie améliorées

Country Status (2)

Country Link
EP (1) EP4639286A1 (fr)
WO (1) WO2024138130A1 (fr)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN119269038B (zh) * 2024-10-30 2026-01-13 中国科学院西安光学精密机械研究所 基于背照式的激光空间滤波小孔照明监测系统及方法

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2006058187A2 (fr) * 2004-11-23 2006-06-01 Robert Eric Betzig Microscopie optique de reseau cristallin
US8009340B2 (en) * 2007-01-30 2011-08-30 Celloptic, Inc. Apparatus and method for recording fresnel holograms
US20190335994A1 (en) * 2011-04-29 2019-11-07 The General Hospital Corporation Methods and arrangements for obtaining information and providing analysis for biological tissues
WO2016054293A1 (fr) * 2014-09-30 2016-04-07 The Regents Of The University Of California Cytomètre de flux à imagerie utilisant une transformation spatio-temporelle
US20210299879A1 (en) * 2018-10-27 2021-09-30 Gilbert Pinter Machine vision systems, illumination sources for use in machine vision systems, and components for use in the illumination sources
US12393161B2 (en) * 2019-07-03 2025-08-19 Celloptic, Inc. Device and method for calibration-free phase shifting procedure for self-interference holography

Also Published As

Publication number Publication date
WO2024138130A1 (fr) 2024-06-27

Similar Documents

Publication Publication Date Title
Picazo-Bueno et al. Single-shot slightly off-axis digital holographic microscopy with add-on module based on beamsplitter cube
US9575302B2 (en) Stimulated emission depletion microscopy
Bewersdorf et al. Comparison of I5M and 4Pi‐microscopy
Siegel et al. Single shot holographic super-resolution microscopy
Hanser et al. Phase‐retrieved pupil functions in wide‐field fluorescence microscopy
US10180564B2 (en) Methods and systems for transport-of-intensity imaging
US7732750B2 (en) Wavefront coding interference contrast imaging systems
EP2788820B1 (fr) Appareil permettant de produire un hologramme
US12393161B2 (en) Device and method for calibration-free phase shifting procedure for self-interference holography
US10228655B2 (en) Incoherent fluorescence digital holographic microscopy using transmission liquid crystal lens
EP3137946B1 (fr) Appareil et procédé d'utilisation de lentilles biréfringentes pour créer des hologrammes à partir d'un rayonnement électromagnétique reçu
JP2009223348A (ja) 解像深度が強化された３次元顕微鏡法のための方法及び装置
US12094081B2 (en) Method for super-resolution evaluation of microscope images illuminated in a structured manner and microscope having structured illumination
US20200077015A1 (en) Image acquisition device and image acquisition system
Murray Methods for imaging thick specimens: confocal microscopy, deconvolution, and structured illumination
Brooker et al. Historical development of FINCH from the beginning to single-shot 3D confocal imaging beyond optical resolution
EP4639286A1 (fr) Système, appareil et procédé d'imagerie et d'holographie améliorées
Gong et al. Tandem aberration correction optics (TACO) in wide-field structured illumination microscopy
EP3994529A1 (fr) Procédure de déphasage sans étalonnage pour holographie à auto-interférence
CN119395899B (zh) 复用slm实现菲涅尔非相干相关全息超分辨显微系统及方法
WO2022014579A1 (fr) Programme de correction d'aberrations optiques et programme d'estimation de front d'onde optique
Hanser et al. Phase retrieval of widefield microscopy point spread functions
Dvinskikh Remote refocusing light-sheet fluorescence microscopy for high-speed 2D and 3D imaging of calcium dynamics in cardiomyocytes
Landry High-Speed Isotropic Resolution and Structured Illumination Using Phased Arrays In Light Sheet Fluorescence Microscopy
Shabani Three-Dimensional (3D) Image Formation and Reconstruction for Structured Illumination Microscopy Using a 3D Tunable Pattern

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20250722

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC ME MK MT NL NO PL PT RO RS SE SI SK SM TR

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)