WO2020110069A1 - Microscopy method and system - Google Patents

Microscopy method and system Download PDF

Info

Publication number
WO2020110069A1
WO2020110069A1 PCT/IB2019/060305 IB2019060305W WO2020110069A1 WO 2020110069 A1 WO2020110069 A1 WO 2020110069A1 IB 2019060305 W IB2019060305 W IB 2019060305W WO 2020110069 A1 WO2020110069 A1 WO 2020110069A1
Authority
WO
WIPO (PCT)
Prior art keywords
sample
sample holder
plasmonic
light
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/IB2019/060305
Other languages
French (fr)
Inventor
Brian Abbey
Eugeniu Balaur
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
La Trobe University
Original Assignee
La Trobe University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from AU2018904553A external-priority patent/AU2018904553A0/en
Priority to CA3121434A priority Critical patent/CA3121434A1/en
Priority to EP19890517.6A priority patent/EP3966619A4/en
Priority to SG11202105293SA priority patent/SG11202105293SA/en
Priority to AU2019387397A priority patent/AU2019387397B2/en
Priority to JP2021530110A priority patent/JP7483707B2/en
Application filed by La Trobe University filed Critical La Trobe University
Priority to CN201980090294.2A priority patent/CN113661425B/en
Priority to NZ776432A priority patent/NZ776432B2/en
Priority to US17/297,974 priority patent/US12332463B2/en
Publication of WO2020110069A1 publication Critical patent/WO2020110069A1/en
Anticipated expiration legal-status Critical
Priority to JP2024074205A priority patent/JP7693054B2/en
Priority to US19/239,786 priority patent/US20250370171A1/en
Ceased legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/17Systems in which incident light is modified in accordance with the properties of the material investigated
    • G01N21/55Specular reflectivity
    • G01N21/552Attenuated total reflection
    • G01N21/553Attenuated total reflection and using surface plasmons
    • G01N21/554Attenuated total reflection and using surface plasmons detecting the surface plasmon resonance of nanostructured metals, e.g. localised surface plasmon resonance
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B5/00Optical elements other than lenses
    • G02B5/008Surface plasmon devices
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/17Systems in which incident light is modified in accordance with the properties of the material investigated
    • G01N21/25Colour; Spectral properties, i.e. comparison of effect of material on the light at two or more different wavelengths or wavelength bands
    • G01N21/255Details, e.g. use of specially adapted sources, lighting or optical systems
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/17Systems in which incident light is modified in accordance with the properties of the material investigated
    • G01N21/55Specular reflectivity
    • G01N21/552Attenuated total reflection
    • G01N21/553Attenuated total reflection and using surface plasmons
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64Fluorescence; Phosphorescence
    • G01N21/645Specially adapted constructive features of fluorimeters
    • G01N21/6456Spatial resolved fluorescence measurements; Imaging
    • G01N21/6458Fluorescence microscopy
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64Fluorescence; Phosphorescence
    • G01N21/645Specially adapted constructive features of fluorimeters
    • G01N21/648Specially adapted constructive features of fluorimeters using evanescent coupling or surface plasmon coupling for the excitation of fluorescence
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/06Means for illuminating specimens
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/16Microscopes adapted for ultraviolet illumination ; Fluorescence microscopes
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/34Microscope slides, e.g. mounting specimens on microscope slides
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/01Arrangements or apparatus for facilitating the optical investigation
    • G01N21/03Cuvette constructions
    • G01N2021/0339Holders for solids, powders
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/17Systems in which incident light is modified in accordance with the properties of the material investigated
    • G01N21/25Colour; Spectral properties, i.e. comparison of effect of material on the light at two or more different wavelengths or wavelength bands
    • G01N2021/258Surface plasmon spectroscopy, e.g. micro- or nanoparticles in suspension

Definitions

  • the present disclosure relates to the field of optical microscopy.
  • the disclosure provides systems and methods of using an optical microscope and an enhanced sample holder.
  • PCT/AU2018/050496 in the name of La Trobe University discloses systems and methods of optical microscopy which provide enhanced image contrast through use of a sample holder having a plasmonic layer including a periodic array of sub-micron structures.
  • reference to a nanoslide is reference to a sample holder in accordance with the teaching of PCT/AU2018/050496, or the Applicant’s co-pending Australian patent application 2018904553, filed on 29 November 2018, entitled“Microscopy method and system” and the International patent application claiming priority to AU2018904553 which was filed on the same day as present application, the contents of both being incorporated herein by reference for all purposes.
  • Microscopy methods using such a sample holder are called or histoplasmonics or colour contrast microscopy herein, which is abbreviated to CCM.
  • the sample is placed on the sample holder adjacent the plasmonic layer.
  • the sample and sample holder are illuminated and an image of the sample is created.
  • the inventors have observed that through interaction of the light with the sample and the plasmonic layer, a colour contrast is exhibited in the observed image.
  • areas of the sample having different dielectric constant appear in the image with different colours.
  • An increase in the intensity contrast is also achieved.
  • images obtained from conventional optical microscopy using a non-specific stain typically only exhibit an intensity contrast in a single colour, which corresponds to the stain used. Even when a counter-stain or biomarker is used, these conventional techniques only provide images in distinct colours.
  • reflected light microscopy in broad concept, is a microscopy technique that uses light reflected from the sample to form an image of the sample.
  • the exemplary embodiments of the nanoslide disclosed in PCT/AU2018/050496 can be used in reflection microscopy without modification, the inventors have determined that such sample holders can be enhanced to improve its use in reflected light microscopy.
  • “forming an image” includes forming a human perceptible image, e.g. by focusing light so that a user can perceive an image of the sample (or part thereof); or generating a digital or
  • a sample holder for use in an optical microscope including:
  • sample holder is configured to support an object such that the periodic array of sub-micron structures is adjacent the object when supporting the object;
  • the periodic array of sub-micron structures comprise an array of separated plasmonic regions.
  • a sample holder for use in an optical microscope including:
  • plasmonic layer extending over a region of the sample holder, the plasmonic layer defining a periodic array of sub-micron structures
  • sample holder is configured to support an object such that the periodic array of sub-micron structures is adjacent the object when supporting the object;
  • the periodic array of sub-micron structures cause the plasmonic layer to fill, by area, not more than 80% of said region.
  • the periodic array of sub-micron structures cause the plasmonic layer to fill, by area, not more than one of 75%, 70%, 65%, 60%, 55%, 50%, 45%, 40%, 35%, 30%, 25%, 20%, 15%, 10%, 5% of the region.
  • the region can cover an entire side of the sample holder.
  • the plasmonic regions can be islands of plasmonic material. In other embodiments the plasmonic regions can be lines or strips of plasmonic material separated from a neighbouring line(s) or stripe(s) by a non-plasmonic strip or line to form a one dimensional array of separated plasmonic regions.
  • sub-micron structures may be arranged in a periodic array with a separation between the sub micron structures in the range of 200 nm to 500 nm. The sub-micron structures may have a largest dimension in the range of 50 nm to 300 nm.
  • the sub micron structures are regions of plasmonic material about between 100nm and 200nm across.
  • the plasmonic regions can be shaped as any one or more of: a circle, a torus, an ellipse, a cross, rectangle, square.
  • the plasmonic layer may be formed from one or more metals selected from any one of: Al, Ag, Au, Ni, Pt and Pd.
  • the plasmonic layer may have a thickness in the range of 20 nm to 300 nm.
  • the array of separated plasmonic regions may be regular array with equal spacing between neighbouring plasmonic regions in a first and a second direction.
  • the first and a second directions are orthogonal directions.
  • the array may have different spacing in the first and second directions.
  • sample holder includes a substrate connected to at least a portion of a first surface of the plasmonic layer to provide mechanical support for the plasmonic layer.
  • the sample holder includes an optically clear protective layer bonded to an upper side of the plasmonic layer to isolate the plasmonic layer.
  • the optically clear protective layer may have a thickness less than 150 nm. In some embodiments the optically clear protective layer may have a thickness less than 80 nm.
  • the optically clear protective layer may include any one or more of: silicon oxide, silicon nitride,
  • the sample holder can comprise a microscope slide.
  • the sample holder enables light, which is transmitted through the sample to the plasmonic layer to be reflected from the sample holder for the creation of images comprising the reflected light.
  • incident light illuminates the sample and sample holder and interacts with the sample and the plasmonic layer.
  • the reflected light includes a characteristic spectra in which each colour is dependent on the localised dielectric constant of the sample. In this way, a colour image encoding localised dielectric constants of the sample can be formed from the reflected light.
  • a nanoslide as described herein or in PCT/AU2018/050496 can also advantageously be used for fluorescence microscopy. Most advantageously, this can be performed in a microscopy arrangement adapted for reflected light microscopy.
  • the present invention also provides a method of imaging a sample comprising:
  • a sample holder having an upper surface face and a lower surface, the upper surface having a plasmonic layer associated therewith, the plasmonic layer including a periodic array of sub-micron structures;
  • the method can further include receiving light after interaction with said sample and sample holder and forming at least one image thereof, wherein at least one localised structural property of the sample is visible in the image based on the colour of the received light.
  • imaging is described in PCT/AU2018/050496 in greater detail.
  • an image so formed in this manner is termed a colour contrast image.
  • a sample mounted on the sample holder can be imaged using fluorescence microscopy in addition to using colour contrast imaging.
  • the image formed from the light emitted from the sample by fluorescence can be formed in a first time period, and the colour contrast image can be formed in a second time period.
  • illuminating the sample with light so that said light interacts with the sample and sample holder can include using a first illumination spectrum in the first time period, and a second illumination spectrum in the second time period.
  • the first illumination spectrum can be selected on the basis of a fluorescence property of the sample.
  • the first and second illumination spectra may be the same.
  • receiving light emitted from the sample by fluorescence includes filtering (e.g. based on wavelength or spatially filtering) light received from the sample and/or sample holder to minimise received light from sources other than said
  • the method includes illuminating the sample from the side of the sample holder on which the sample is positioned, and receiving light emitted from the sample by fluorescence, and also light which has after interacted with said sample and sample holder, from the same side as said illumination.
  • upper surface and lower surface are not intended to reference a specific orientation of the sample holder either during sample preparation or use.
  • the method can include spatially correlating an image formed from the light emitted from the sample by fluorescence, and a colour contrast image.
  • the method can include forming a combined image including an image formed from the light emitted from the sample by fluorescence, and a colour contrast image. Multiple images formed from the light emitted from the sample by fluorescence and/or multiple colour contrast images may be combined into a single image. The combination may be performed optically (e.g. during optical image formation) or digitally (e.g. by combining data values representing said images).
  • the sample is preferably a biological sample.
  • the sample holder used in embodiments of the present aspect of the invention can be a sample holder according to an embodiment of PCT/AU2018/050496, but most preferably is a sample holder in accordance with an embodiment of the first aspect of the present invention.
  • the system can include a reflected light microscope having an image forming system, and an illumination system, and sample holder having an upper surface and a lower surface, the upper surface having a plasmonic layer associated therewith, the plasmonic layer including a periodic array of sub-micron structures.
  • the system can include an image capture system to generate at least one image of the sample.
  • Embodiments of an aspect of the present disclosure can be used in embodiments of the teaching of the applicant’s co-pending Australian patent application 2018904550 , filed on 29 November 2018, entitled“Method of identifying a structure” and the International patent application claiming priority to AU 2018904550 which was filed on the same day as present application, and is incorporated herein for all purposes..
  • Figure 1 a illustrates details of an exemplary sample holder used in embodiments of the present disclosure.
  • Figures 1 b and 1 c illustrate examples in which the plasmonic layer includes an array of sub-micron apertures.
  • Figures 1 d to 1 i illustrate examples were the sub-micron structures in the plasmonic layer are separated plasmonic regions.
  • the present invention should not be considered to be limited to use of sample holders with the particular microstructure arrays illustrated figures 1 b to 1 i.
  • Figure 2a illustrates an example sample holder from figure 1 a on which is positioned a sample for use in embodiments of the present invention.
  • Figure 3A is a schematic diagram of a system used to perform reflected light microscopy.
  • Figure 3B is a schematic diagram of a system illustrating how the embodiment of figure 3A can be used to perform fluorescence microscopy.
  • Figure 3C illustrates schematically one example system in which fluorescence and colour contrast microscopy can be performed together.
  • Figure 3D illustrates schematically another example system in which fluorescence and colour contrast microscopy can be performed together.
  • Figure 4 illustrates an image captured using CCM (using a nanoslide) in reflection mode.
  • Figure 5 illustrates exemplary light reception spectra when a nanoslide is used in reflection mode, for the case of no sample (air), a sample consisting of water, a sample consisting of a material with a refractive index of 1 .5 (e.g. a polymer).
  • Figure 6 illustrates the simulated appearance (in colour) of the samples of figure 5, showing that colour contrast is exhibited between samples with differing structural properties in reflection mode microscopy.
  • Figure 1 a shows an embodiment of a sample holder used in an example of the present disclosure.
  • Figure 1 a shows a cross section through a sample holder suitable for use in the present invention.
  • the sample holder 100 includes a substrate, on which is deposited a plasmonic layer 102.
  • Figures 1 b and 1 c show two types of plasmonic layer as exemplified in PCT/AU2018/050496 with sub-micron arrays of that have been fabricated and may be used in an embodiment.
  • the layers are each silver films with a thickness of 150 nm, although other suitable materials can be used.
  • Figure 1 b has sub micron arrays in the form of circular shaped nanoapertures with a 450 nm period arranged in a hexagonal pattern.
  • Figure 1 c has cross-shaped nanoapertures on a rectangular pattern.
  • the cross-shaped nanoapertures have a 450 nm period in one direction (defined here as the 0° direction) and a 400 nm period in the orthogonal direction (defined as the 90° direction).
  • These arrays have a Surface Plasmon Polariton (SPP) resonance mode in the 470-550 nm range (which is within the visible region of the electromagnetic spectrum).
  • SPP Surface Plasmon Polariton
  • HSQ hydrogen silsesquioxane
  • the sample holder 100 After capping with HSQ, the sample holder 100 has an upper surface similar to that of a conventional microscope slide on which a sample may be supported. In use, the HSQ layer also presents a polar surface which aids tissue adherence. In other embodiments a metal oxide capping layer e.g. S1O2 can be used in place of HSQ.
  • a metal oxide capping layer e.g. S1O2 can be used in place of HSQ.
  • Samples to be imaged are prepared and placed on sample holders in accordance with an embodiment of PCT/AU2018/050496 in the name of La Trobe University or the Applicant’s co-pending Australian patent application 2018904553 , filed on 29 November 2018, entitled“Microscopy method and system” and the International patent application claiming priority to AU2018904553 which was filed on the same day as present application.
  • a sample 106 typically a slice of a biological tissue, which need not be stained or labelled in the preferred embodiment of the present invention, is placed on the sample holder adjacent the plasmonic layer, as shown in figure 2a.
  • Figure 3A is a schematic representation of a system 300 in which the sample holder 100 is used in reflected light microscopy. Techniques and equipment used inreflected light microscopy with conventional slides are known to those skilled in the art and in order to avoid obscuring the details of the present invention, the descriptions of known techniques will be omitted.
  • the system 300 includes a light source 310 which emits incident light 31 1 to illuminate the sample 106.
  • the illumination is performed in this example from the side of the sample holder on which the sample is positioned.
  • Reflected light 315 is reflected back to an imaging system 312 for creation of a colour contrast image.
  • the sample holder 100 is a nanoslide having a plasmonic layer.
  • FIG. 4 illustrates a reflection image of a thin section (70 nm) of the optical nerve of a mouse. Tissue was prepared in a convention manner and embedded in epoxy resin. 70nm thick sections were cut on a Leica UC7 ultramicrotome. The image was captured using a 20x magnification and taken in reflection mode.
  • the submicron structures in the plasmonic layer of the nanoslide include structure with a periodicity of -450 nm, which lies in the visible region of the Em spectrum and therefore producing visible fringes in the image.
  • Using smaller periodicities or different shaped arrays (e,g, hexagonal ) can avoid such artefacts.
  • the simulated spectra are based on a nanoslide having circular islands of plasmonic material of radius 90nm arranged in an array having a separation of 480nm in a first direction in a hexagonal lattice array.
  • the plasmonic layer region can be filled (by area) by not more than one of 75%, 70%, 65%, 60%, 55%, 50%, 45%, 40%, 35%, 30%, 25%, 20%, 15%, 10%, 5% of the region
  • the reduction in fill factor can be advantageous in reflection microscopy because it reduces reflection of incident light (i.e. allows more
  • FIG. 5b illustrate a simulated image of such samples showing the resultant visible colours from such samples. As can be seen:
  • the nanoslide enables such colour contrast to be obtained without staining the sample, and when using substantially transparent samples. Accordingly the reflected light received includes light reflected from the plasmonic layer, as opposed to the upper surface of the sample. It also means that absorption within the sample itself is relatively low.
  • the microscope used conventional optical microscope with eyepieces for viewing by a user, however it can alternatively or additionally include an image capture system to generate a digital image for display, storage or other later use. In some forms the microscope can form part of an automated slide scanner.
  • the system 300 can include a user terminal for display of captured digital images of the sample, and a data storage system for storing captured images.
  • the periodic array of sub-micron structures can comprise an array of separated plasmonic regions.
  • the plasmonic regions can be islands of plasmonic material separated by gaps.
  • the plasmonic regions will typically be arranged in a periodic array with a separation between the sub-micron structures in the range of 200 nm to 500 nm.
  • Each plasmonic region may have a largest dimension in the range of 50 nm to 300 nm.
  • the sub-micron structures are regions of plasmonic material between about 100nm and 200nm across.
  • the plasmonic regions can be shaped as any one or more of: a circle, a torus, an ellipse, a cross, rectangle, square.
  • a plasmonic layer may be formed from one or more metals such as: Al, Ag, Au, Ni, Pt or Pd.
  • the plasmonic layer may have a thickness in the range of 20 nm to 300 nm.
  • Figures 1 d to 1j illustrate examples of such periodic arrays of sub-micron structures which comprise arrays of separated plasmonic regions.
  • Figure 1 d illustrates a plasmonic layer 102 including a regular rectangular array of square plasmonic regions 103. The spacing of the plasmonic regions 103 in the first and second directions are equal.
  • Figure 1 e illustrates a plasmonic layer 102 including an array of square plasmonic regions 103 arranged with equal spacing of the plasmonic regions 103 in the first and second directions, but with each row offset from its neighbour to form a hexagonal array of plasmonic regions 103.
  • the separation between regions in the first and second (x and y) directions may be the same (as illustrated) or different.
  • Figure 1 f illustrates a plasmonic layer 102 including an array of square plasmonic regions 103 in which the spacing of the plasmonic regions 103 in the first and second directions are unequal.
  • such an example can enable the use of polarised illumination to vary the spectrum of the received light by switching the relative polaraisation of the received light with respect to the rows and columns of the array.
  • Figure 1 g illustrates an example plasmonic layer 102 including circular plasmonic regions 103.
  • the spacing of the plasmonic regions 103 in the first and second directions are equal, but other array arrangements could be used.
  • Figure 1 h illustrates an example plasmonic layer 102 including cross shaped plasmonic regions 103.
  • the spacing of the plasmonic regions 103 in the first and second directions are unequal equal, but other array arrangements could be used.
  • Figure 1 i illustrates an example plasmonic layer 102 including rectangular shaped plasmonic regions 103. However unlike the other embodiments the spacing beween neighbouring plasmonic regions is relatively narrow. This yields a plasmonic layer in which the plasmonic regions occupy a fraction of the plasmonic layer greater than 50% by area.
  • Figure 1j illustrates an example plasmonic layer 102 including plasmonic regions 103 shaped as strips separated by non-plasmonic strips, creating a 1 -dimensional array of separated plasmonic regions.
  • the array of plasmonic regions may be regular array with equal spacing between neighbouring plasmonic regions in a first and/or a second direction.
  • the first and a second directions are orthogonal directions.
  • the array may have different spacing in the first and second directions.
  • the present invention also provides a method of fluorescence microscopy including:
  • a sample holder having an upper surface face and a lower surface, the upper surface having a plasmonic layer associated therewith, the plasmonic layer including a periodic array of sub-micron structures;
  • the method can further include receiving light after interaction with said sample and sample holder and forming at least one image thereof, wherein at least one localised structural property of the sample is visible in the image based on the colour of the received light.
  • imaging is described in PCT/AU2018/050496 in greater detail.
  • an image formed in this manner termed a colour contrast image.
  • a sample mounted on the sample holder can be imaged using fluorescence microscopy in addition to using colour contrast imaging.
  • fluorescence microscopy is typically performed with a reflected light microscopy arrangement, as it is necessary (or desirable) to illuminate the sample from the same side on which fluorescence induced in the sample is to be imaged.
  • the schematic arrangement of figure 3A can be also used for fluorescence imaging of the same sample as illustrated in figure 3B.
  • the light source 310 emits incident light 321 to illuminate the sample 106.
  • the illumination causes the sample 106 to fluoresce.
  • Light 325 emitted from the sample by fluorescence is captured an imaging system 312 the enable creation of a fluorescence image of the sample.
  • fluorescence microscopy may require specialised sample preparation and labelling techniques. Wavelength selective illumination and image capture techniques may also be used. Details of general fluorescent sample preparation, illumination techniques or image capture techniques used in fluorescence microscopy images will not be described here in order not to obscure the details of the present invention.
  • fluorescence and colour contrast microscopy can be performed on the same sample serially or at the same time.
  • the image formed from the light emitted from the sample by fluorescence can be formed in a first time period, and the colour contrast image can be formed in a second time period.
  • the light used in the colour contrast imaging can have a different illumination spectrum than that used in fluorescence imaging. This may require using two light sources interchangeably or a common light source which is filtered differently in each time period. However in some cases the same spectra may be used.
  • Figure 3C illustrates schematically an example where fluorescence imaging and colour contrast imaging of the same sample is performed using the system of figures 3A and 3B.
  • the light source 310 emit light 321 /31 1 (which may have the same spectrum or different spectra) to illuminate the sample 106.
  • the illumination causes the sample 106 to fluoresce and also interacts with the sample and the plasmonic layer 102 of the sample holder 100.
  • Received light 325 is emitted from the sample by fluorescence and received light 315 is reflected by the sample holder 100.
  • Received light 315/325 is captured by an imaging system 312 to enable creation of both a fluorescence image and a colour contrast image of the sample.
  • the emission of light 31 1 and 321 may be simultaneous or not.
  • Figure 3D illustrates schematically an example where fluorescence imaging and colour contrast imaging of the same sample is performed using the system of figures 3A and 3B.
  • the light source 310 emit light 321 /31 1 (which may have the same spectrum or different spectra) to illuminate the sample 106.
  • the illumination causes the sample 106 to fluoresce and also interacts with the sample and the plasmonic layer 102 of the sample holder 100.
  • Received light 325 is emitted from the sample by fluorescence and received light 315 is reflected by the sample holder 100.
  • Received light 315 is captured by a first imaging system 312 to enable creation of a colour contrast reflection image.
  • Received light 325 is captured by a second imaging system 312’ to enable creation of a fluorescence image of the same sample.
  • a sample may fluoresce during colour contrast microscopy when it is not desired. This can generally be dealt with by filtering out the fluorescent wavelength(s) at image formation or by not illuminating the sample in a wavelength bend that causes flourescence. Fluorescence occurs at very specific wavelengths as it is generated via specific optical transitions within a fluorescent tag, and therefore the fluorescence appears as a line (or lines) in a received spectrum. These characteristic line(s) can be isolated from the smoother continuous background spectrum of the colour contrast image.
  • Images captured by the present methods can be used individually or together to draw conclusions about the sample.
  • the method can include spatially correlating an image formed from the light emitted from the sample by fluorescence, and a colour contrast image.
  • Multiple images formed from the light emitted from the sample by fluorescence e.g. one for each fluorescence wavelength
  • multiple colour contrast images captured at different polarisations
  • the combination may be performed optically (e.g. during optical image formation) or digitally (e.g. by combining data values representing said images). It will be understood that the invention disclosed and defined in this specification extends to all alternative combinations of two or more of the individual features mentioned or evident from the text or drawings. All of these different combinations constitute various alternative aspects of the invention.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Health & Medical Sciences (AREA)
  • Optics & Photonics (AREA)
  • Biochemistry (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Immunology (AREA)
  • Pathology (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Engineering & Computer Science (AREA)
  • Nanotechnology (AREA)
  • Microscoopes, Condenser (AREA)
  • Investigating, Analyzing Materials By Fluorescence Or Luminescence (AREA)
  • Investigating Or Analysing Materials By Optical Means (AREA)

Abstract

A sample holder for use in an optical microscope is disclosed. The sample holder includes a plasmonic layer defining a periodic array of sub-micron structures wherein the periodic array of sub-micron structures comprise an array of separated plasmonic regions. The regions may be a circle, a torus, an ellipse, a cross, rectangle, square, line, strip. Methods of performing reflection and fluorescence microscopy using such a sample holder and other sample holders are also disclosed.

Description

Microscopy method and system
Field of the disclosure
The present disclosure relates to the field of optical microscopy. In one form the disclosure provides systems and methods of using an optical microscope and an enhanced sample holder.
Background of the disclosure
PCT/AU2018/050496 in the name of La Trobe University (the entire contents of which are herein incorporated by reference) discloses systems and methods of optical microscopy which provide enhanced image contrast through use of a sample holder having a plasmonic layer including a periodic array of sub-micron structures. In the present disclosure reference to a nanoslide is reference to a sample holder in accordance with the teaching of PCT/AU2018/050496, or the Applicant’s co-pending Australian patent application 2018904553, filed on 29 November 2018, entitled“Microscopy method and system” and the International patent application claiming priority to AU2018904553 which was filed on the same day as present application, the contents of both being incorporated herein by reference for all purposes. Microscopy methods using such a sample holder are called or histoplasmonics or colour contrast microscopy herein, which is abbreviated to CCM. The sample is placed on the sample holder adjacent the plasmonic layer. In use, the sample and sample holder are illuminated and an image of the sample is created. The inventors have observed that through interaction of the light with the sample and the plasmonic layer, a colour contrast is exhibited in the observed image. In particular, areas of the sample having different dielectric constant appear in the image with different colours. An increase in the intensity contrast is also achieved. In contrast to CCM, images obtained from conventional optical microscopy using a non-specific stain typically only exhibit an intensity contrast in a single colour, which corresponds to the stain used. Even when a counter-stain or biomarker is used, these conventional techniques only provide images in distinct colours.
Summary of the disclosure
As will be known to those skilled in the art, reflected light microscopy, in broad concept, is a microscopy technique that uses light reflected from the sample to form an image of the sample. Whilst the exemplary embodiments of the nanoslide disclosed in PCT/AU2018/050496 can be used in reflection microscopy without modification, the inventors have determined that such sample holders can be enhanced to improve its use in reflected light microscopy. In the present specification“forming an image” includes forming a human perceptible image, e.g. by focusing light so that a user can perceive an image of the sample (or part thereof); or generating a digital or
photographic image of the sample (or part thereof) for storage, transmission, display or other downstream process.
Accordingly, a first aspect the present invention provides a sample holder for use in an optical microscope, the sample holder including:
a plasmonic layer defining a periodic array of sub-micron structures; and
wherein the sample holder is configured to support an object such that the periodic array of sub-micron structures is adjacent the object when supporting the object;
wherein the periodic array of sub-micron structures comprise an array of separated plasmonic regions.
Accordingly, a second aspect the present invention provides a sample holder for use in an optical microscope, the sample holder including:
a plasmonic layer extending over a region of the sample holder, the plasmonic layer defining a periodic array of sub-micron structures; and
wherein the sample holder is configured to support an object such that the periodic array of sub-micron structures is adjacent the object when supporting the object;
wherein within the region the periodic array of sub-micron structures cause the plasmonic layer to fill, by area, not more than 80% of said region.
In some forms of the second aspect the periodic array of sub-micron structures cause the plasmonic layer to fill, by area, not more than one of 75%, 70%, 65%, 60%, 55%, 50%, 45%, 40%, 35%, 30%, 25%, 20%, 15%, 10%, 5% of the region. The region can cover an entire side of the sample holder.
In some embodiments of either the first or second aspects of the invention, the plasmonic regions can be islands of plasmonic material. In other embodiments the plasmonic regions can be lines or strips of plasmonic material separated from a neighbouring line(s) or stripe(s) by a non-plasmonic strip or line to form a one dimensional array of separated plasmonic regions. In some embodiments of either the first or second aspects of the invention, sub-micron structures may be arranged in a periodic array with a separation between the sub micron structures in the range of 200 nm to 500 nm. The sub-micron structures may have a largest dimension in the range of 50 nm to 300 nm. Most preferably the sub micron structures are regions of plasmonic material about between 100nm and 200nm across. The plasmonic regions can be shaped as any one or more of: a circle, a torus, an ellipse, a cross, rectangle, square.
In some embodiments of either the first or second aspects of the invention, the plasmonic layer may be formed from one or more metals selected from any one of: Al, Ag, Au, Ni, Pt and Pd. The plasmonic layer may have a thickness in the range of 20 nm to 300 nm.
In some embodiments of either the first or second aspects of the invention, the array of separated plasmonic regions may be regular array with equal spacing between neighbouring plasmonic regions in a first and a second direction. Preferably the first and a second directions are orthogonal directions. However, the array may have different spacing in the first and second directions.
In some embodiments of either the first or second aspects of the invention, ihe sample holder includes a substrate connected to at least a portion of a first surface of the plasmonic layer to provide mechanical support for the plasmonic layer. In some embodiments, the sample holder includes an optically clear protective layer bonded to an upper side of the plasmonic layer to isolate the plasmonic layer. The optically clear protective layer may have a thickness less than 150 nm. In some embodiments the optically clear protective layer may have a thickness less than 80 nm. The optically clear protective layer may include any one or more of: silicon oxide, silicon nitride,
transparent metal oxide, and a polymer. The sample holder can comprise a microscope slide.
In some embodiments of either the first or second aspects of the invention, the sample holder enables light, which is transmitted through the sample to the plasmonic layer to be reflected from the sample holder for the creation of images comprising the reflected light.
In some embodiments of either the first or second aspects of the invention, in use incident light illuminates the sample and sample holder and interacts with the sample and the plasmonic layer. The reflected light includes a characteristic spectra in which each colour is dependent on the localised dielectric constant of the sample. In this way, a colour image encoding localised dielectric constants of the sample can be formed from the reflected light.
The present inventors have further realised that a nanoslide, as described herein or in PCT/AU2018/050496 can also advantageously be used for fluorescence microscopy. Most advantageously, this can be performed in a microscopy arrangement adapted for reflected light microscopy.
Accordingly, the present invention also provides a method of imaging a sample comprising:
Providing a sample holder having an upper surface face and a lower surface, the upper surface having a plasmonic layer associated therewith, the plasmonic layer including a periodic array of sub-micron structures;
Applying the sample to the upper surface of the sample holder;
Illuminating the sample with light so that said light interacts with the sample and sample holder;
Receiving light emitted from the sample by fluorescence and forming an image thereof.
The method can further include receiving light after interaction with said sample and sample holder and forming at least one image thereof, wherein at least one localised structural property of the sample is visible in the image based on the colour of the received light. Such imaging is described in PCT/AU2018/050496 in greater detail. Herein an image so formed in this manner is termed a colour contrast image.
Advantageously, in this way a sample mounted on the sample holder can be imaged using fluorescence microscopy in addition to using colour contrast imaging.
The image formed from the light emitted from the sample by fluorescence can be formed in a first time period, and the colour contrast image can be formed in a second time period. In some embodiments, illuminating the sample with light so that said light interacts with the sample and sample holder can include using a first illumination spectrum in the first time period, and a second illumination spectrum in the second time period. The first illumination spectrum can be selected on the basis of a fluorescence property of the sample. In some cases the first and second illumination spectra may be the same. In some embodiments receiving light emitted from the sample by fluorescence includes filtering (e.g. based on wavelength or spatially filtering) light received from the sample and/or sample holder to minimise received light from sources other than said
fluorescence.
In a preferred form, the method includes illuminating the sample from the side of the sample holder on which the sample is positioned, and receiving light emitted from the sample by fluorescence, and also light which has after interacted with said sample and sample holder, from the same side as said illumination.
It should be noted that the term upper surface and lower surface are not intended to reference a specific orientation of the sample holder either during sample preparation or use.
In embodiments of the present invention the method can include spatially correlating an image formed from the light emitted from the sample by fluorescence, and a colour contrast image. The method can include forming a combined image including an image formed from the light emitted from the sample by fluorescence, and a colour contrast image. Multiple images formed from the light emitted from the sample by fluorescence and/or multiple colour contrast images may be combined into a single image. The combination may be performed optically (e.g. during optical image formation) or digitally (e.g. by combining data values representing said images).
The sample is preferably a biological sample.
The sample holder used in embodiments of the present aspect of the invention can be a sample holder according to an embodiment of PCT/AU2018/050496, but most preferably is a sample holder in accordance with an embodiment of the first aspect of the present invention.
Images formed in the manners set out above may be used in histology and pathology in ways that may be apparent to those skilled in the art.
In a further aspect there is provided a system for forming an image using an
embodiment of any one of the aspects set out above. The system can include a reflected light microscope having an image forming system, and an illumination system, and sample holder having an upper surface and a lower surface, the upper surface having a plasmonic layer associated therewith, the plasmonic layer including a periodic array of sub-micron structures. The system can include an image capture system to generate at least one image of the sample.
Embodiments of the present invention can be used to generate digital images subject to automated or partially automated methods of identifying a structure as taught in
Applicant’s co-pending Australian patent application 2018904551 , filed on 29 November 2018, entitled“Automated method of identifying a structure” and the International patent application claiming priority to AU2018904551 which was filed on the same day as present application, the contents of both being incorporated herein by reference for all purposes.
Embodiments of an aspect of the present disclosure can be used in embodiments of the teaching of the applicant’s co-pending Australian patent application 2018904550 , filed on 29 November 2018, entitled“Method of identifying a structure” and the International patent application claiming priority to AU 2018904550 which was filed on the same day as present application, and is incorporated herein for all purposes..
Brief description of the drawings
Illustrative embodiments of the present invention will be described by way of non limiting example with reference to the accompanying drawings. The drawings filed with the present international application include colour images used in, and arising from use of embodiments of the present invention. The colour information forms part of the disclosure of the embodiments. Should black and white or greyscale reproduction of the images occur, colour disclosure can be obtained from the originally filed documents. In the drawings:
Figure 1 a illustrates details of an exemplary sample holder used in embodiments of the present disclosure.
Figures 1 b and 1 c illustrate examples in which the plasmonic layer includes an array of sub-micron apertures.
Figures 1 d to 1 i illustrate examples were the sub-micron structures in the plasmonic layer are separated plasmonic regions. The present invention should not be considered to be limited to use of sample holders with the particular microstructure arrays illustrated figures 1 b to 1 i. Figure 2a illustrates an example sample holder from figure 1 a on which is positioned a sample for use in embodiments of the present invention.
Figure 3A is a schematic diagram of a system used to perform reflected light microscopy. Figure 3B is a schematic diagram of a system illustrating how the embodiment of figure 3A can be used to perform fluorescence microscopy.
Figure 3C illustrates schematically one example system in which fluorescence and colour contrast microscopy can be performed together.
Figure 3D illustrates schematically another example system in which fluorescence and colour contrast microscopy can be performed together.
Figure 4 illustrates an image captured using CCM (using a nanoslide) in reflection mode.
Figure 5 illustrates exemplary light reception spectra when a nanoslide is used in reflection mode, for the case of no sample (air), a sample consisting of water, a sample consisting of a material with a refractive index of 1 .5 (e.g. a polymer).
Figure 6 illustrates the simulated appearance (in colour) of the samples of figure 5, showing that colour contrast is exhibited between samples with differing structural properties in reflection mode microscopy.
Detailed description of the embodiments
Figure 1 a shows an embodiment of a sample holder used in an example of the present disclosure. Figure 1 a shows a cross section through a sample holder suitable for use in the present invention. The sample holder 100 includes a substrate, on which is deposited a plasmonic layer 102. Figures 1 b and 1 c show two types of plasmonic layer as exemplified in PCT/AU2018/050496 with sub-micron arrays of that have been fabricated and may be used in an embodiment. The layers are each silver films with a thickness of 150 nm, although other suitable materials can be used. Figure 1 b has sub micron arrays in the form of circular shaped nanoapertures with a 450 nm period arranged in a hexagonal pattern. Figure 1 c has cross-shaped nanoapertures on a rectangular pattern. The cross-shaped nanoapertures have a 450 nm period in one direction (defined here as the 0° direction) and a 400 nm period in the orthogonal direction (defined as the 90° direction). These arrays have a Surface Plasmon Polariton (SPP) resonance mode in the 470-550 nm range (which is within the visible region of the electromagnetic spectrum). To protect the surface of the plasmonic layer 102, a layer 104 (10nm ±1 nm) of hydrogen silsesquioxane (HSQ), a glass-like material, is deposited after fabrication of the plasmonic layer 102. After capping with HSQ, the sample holder 100 has an upper surface similar to that of a conventional microscope slide on which a sample may be supported. In use, the HSQ layer also presents a polar surface which aids tissue adherence. In other embodiments a metal oxide capping layer e.g. S1O2 can be used in place of HSQ.
Samples to be imaged are prepared and placed on sample holders in accordance with an embodiment of PCT/AU2018/050496 in the name of La Trobe University or the Applicant’s co-pending Australian patent application 2018904553 , filed on 29 November 2018, entitled“Microscopy method and system” and the International patent application claiming priority to AU2018904553 which was filed on the same day as present application. A sample 106, typically a slice of a biological tissue, which need not be stained or labelled in the preferred embodiment of the present invention, is placed on the sample holder adjacent the plasmonic layer, as shown in figure 2a.
Figure 3A is a schematic representation of a system 300 in which the sample holder 100 is used in reflected light microscopy. Techniques and equipment used inreflected light microscopy with conventional slides are known to those skilled in the art and in order to avoid obscuring the details of the present invention, the descriptions of known techniques will be omitted.
The system 300 includes a light source 310 which emits incident light 31 1 to illuminate the sample 106. The illumination is performed in this example from the side of the sample holder on which the sample is positioned. Reflected light 315 is reflected back to an imaging system 312 for creation of a colour contrast image. The sample holder 100 is a nanoslide having a plasmonic layer.
When system 300 is used in reflected light microscopy, the reflected light which forms the image has interacted with the plasmomnic layer of the sample holder and the sample such that it possesses a reflection spectrum, which varies according to the local dielectric constant of the sample. Thus the reflected light image displays colour contrast. Figure 4 illustrates a reflection image of a thin section (70 nm) of the optical nerve of a mouse. Tissue was prepared in a convention manner and embedded in epoxy resin. 70nm thick sections were cut on a Leica UC7 ultramicrotome. The image was captured using a 20x magnification and taken in reflection mode. In the image visible stripes arise from the fact that the submicron structures in the plasmonic layer of the nanoslide include structure with a periodicity of -450 nm, which lies in the visible region of the Em spectrum and therefore producing visible fringes in the image. Using smaller periodicities or different shaped arrays (e,g, hexagonal ) can avoid such artefacts.
The specific reflection spectrum will be somewhat similar to the inverse of the normalised transmission spectra (e.g. as illustrated in PCT/AU2018/050496) with troughs appearing at the peaks in the transmission spectra. However there may be different sets of plasmon resonance modes present. Figure 5 illustrates exemplary simulated light reception spectra when a nanoslide is used in reflection mode, for three sample cases as follows:
a sample with R=1 i.e. no sample, or the sample is air
a sample with R=1.33 (e.g. a sample consisting of water)
a sample with R=1.5 (e.g. a material, such as a polymer)
The simulated spectra are based on a nanoslide having circular islands of plasmonic material of radius 90nm arranged in an array having a separation of 480nm in a first direction in a hexagonal lattice array.
Compared to the illustrative examples of PCT/AU2018/050496, in which the plasonic layer covers an entire region of the nanoslide with only small voids in it provided by the sub-micron structures, it has been found that when used in reflection microscopy it can be advantageous to provide a plasmonic layer region that because of the arrangement of a its sub-micron structures fills less (by area) of the region covered by the plasmonic layer. In some cases the plasmonic layer region can be filled (by area) by not more than one of 75%, 70%, 65%, 60%, 55%, 50%, 45%, 40%, 35%, 30%, 25%, 20%, 15%, 10%, 5% of the region The reduction in fill factor can be advantageous in reflection microscopy because it reduces reflection of incident light (i.e. allows more
transmission), such that the spectral peaks in the reflected light are more easily discernible from the troughs, which enhances the colour contrast effect in the received image. Figure 5b illustrate a simulated image of such samples showing the resultant visible colours from such samples. As can be seen:
the Rl=1 sample (left) appears blue, corresponding to the position of the peak in its reflection spectrum;
the Ftl=1 .33 sample (middle) appears orange, corresponding to the position of the peak in its reflection spectrum; and
the Rl=1 .5 sample (right) appears red, corresponding to the position of the peak in its reflection spectrum;
demonstrating that images formed using a nanoslide in reflection microscopy display colour contrast based on the dielectric constant of the sample which is related to the refractive index of the sample.
Importantly use of the nanoslide enables such colour contrast to be obtained without staining the sample, and when using substantially transparent samples. Accordingly the reflected light received includes light reflected from the plasmonic layer, as opposed to the upper surface of the sample. It also means that absorption within the sample itself is relatively low.
The microscope used conventional optical microscope with eyepieces for viewing by a user, however it can alternatively or additionally include an image capture system to generate a digital image for display, storage or other later use. In some forms the microscope can form part of an automated slide scanner. The system 300 can include a user terminal for display of captured digital images of the sample, and a data storage system for storing captured images.
When performing reflected light microscopy using a nanoslide, the present inventors have determined that the plasmonic layer can be specialised to yield improved results in some cases Where/When/Why are dots better. In particular the periodic array of sub-micron structures can comprise an array of separated plasmonic regions. The plasmonic regions can be islands of plasmonic material separated by gaps. The plasmonic regions will typically be arranged in a periodic array with a separation between the sub-micron structures in the range of 200 nm to 500 nm. Each plasmonic region may have a largest dimension in the range of 50 nm to 300 nm. Most preferably the sub-micron structures are regions of plasmonic material between about 100nm and 200nm across. The plasmonic regions can be shaped as any one or more of: a circle, a torus, an ellipse, a cross, rectangle, square.
As set out in PCT/AU2018/050496, a plasmonic layer may be formed from one or more metals such as: Al, Ag, Au, Ni, Pt or Pd. The plasmonic layer may have a thickness in the range of 20 nm to 300 nm.
Figures 1 d to 1j illustrate examples of such periodic arrays of sub-micron structures which comprise arrays of separated plasmonic regions.
Figure 1 d illustrates a plasmonic layer 102 including a regular rectangular array of square plasmonic regions 103. The spacing of the plasmonic regions 103 in the first and second directions are equal.
Figure 1 e illustrates a plasmonic layer 102 including an array of square plasmonic regions 103 arranged with equal spacing of the plasmonic regions 103 in the first and second directions, but with each row offset from its neighbour to form a hexagonal array of plasmonic regions 103. The separation between regions in the first and second (x and y) directions may be the same (as illustrated) or different.
Figure 1 f illustrates a plasmonic layer 102 including an array of square plasmonic regions 103 in which the spacing of the plasmonic regions 103 in the first and second directions are unequal. As set out in PCT/AU 2018/050496 such an example can enable the use of polarised illumination to vary the spectrum of the received light by switching the relative polaraisation of the received light with respect to the rows and columns of the array.
Figure 1 g illustrates an example plasmonic layer 102 including circular plasmonic regions 103. In this example the spacing of the plasmonic regions 103 in the first and second directions are equal, but other array arrangements could be used.
Figure 1 h illustrates an example plasmonic layer 102 including cross shaped plasmonic regions 103. In this example the spacing of the plasmonic regions 103 in the first and second directions are unequal equal, but other array arrangements could be used.
Figure 1 i illustrates an example plasmonic layer 102 including rectangular shaped plasmonic regions 103. However unlike the other embodiments the spacing beween neighbouring plasmonic regions is relatively narrow. This yields a plasmonic layer in which the plasmonic regions occupy a fraction of the plasmonic layer greater than 50% by area. Figure 1j illustrates an example plasmonic layer 102 including plasmonic regions 103 shaped as strips separated by non-plasmonic strips, creating a 1 -dimensional array of separated plasmonic regions.
As can be seen the array of plasmonic regions may be regular array with equal spacing between neighbouring plasmonic regions in a first and/or a second direction. Preferably the first and a second directions are orthogonal directions. However the array may have different spacing in the first and second directions.
The present invention also provides a method of fluorescence microscopy including:
Providing a sample holder having an upper surface face and a lower surface, the upper surface having a plasmonic layer associated therewith, the plasmonic layer including a periodic array of sub-micron structures;
Applying the sample to the upper surface of the sample holder;
Illuminating the sample with light so that said light interacts with the sample and sample holder;
Receiving light emitted from the sample by fluorescence and forming an image thereof.
The method can further include receiving light after interaction with said sample and sample holder and forming at least one image thereof, wherein at least one localised structural property of the sample is visible in the image based on the colour of the received light. Such imaging is described in PCT/AU2018/050496 in greater detail. Herein an image formed in this manner termed a colour contrast image.
Advantageously, in this way a sample mounted on the sample holder can be imaged using fluorescence microscopy in addition to using colour contrast imaging.
As will be appreciated by those skilled in the art, fluorescence microscopy is typically performed with a reflected light microscopy arrangement, as it is necessary (or desirable) to illuminate the sample from the same side on which fluorescence induced in the sample is to be imaged. Accordingly the schematic arrangement of figure 3A can be also used for fluorescence imaging of the same sample as illustrated in figure 3B. In this example the light source 310 emits incident light 321 to illuminate the sample 106. The illumination causes the sample 106 to fluoresce. Light 325 emitted from the sample by fluorescence is captured an imaging system 312 the enable creation of a fluorescence image of the sample. As will be known to those skilled in the art fluorescence microscopy may require specialised sample preparation and labelling techniques. Wavelength selective illumination and image capture techniques may also be used. Details of general fluorescent sample preparation, illumination techniques or image capture techniques used in fluorescence microscopy images will not be described here in order not to obscure the details of the present invention.
In some embodiments fluorescence and colour contrast microscopy can be performed on the same sample serially or at the same time. In the case that they are performed serially, the image formed from the light emitted from the sample by fluorescence can be formed in a first time period, and the colour contrast image can be formed in a second time period.
It may be necessary or advantageous to use specific illumination properties in each type of microscopy, in this case the light used in the colour contrast imaging can have a different illumination spectrum than that used in fluorescence imaging. This may require using two light sources interchangeably or a common light source which is filtered differently in each time period. However in some cases the same spectra may be used.
Figure 3C illustrates schematically an example where fluorescence imaging and colour contrast imaging of the same sample is performed using the system of figures 3A and 3B. In this example the light source 310 emit light 321 /31 1 (which may have the same spectrum or different spectra) to illuminate the sample 106. The illumination causes the sample 106 to fluoresce and also interacts with the sample and the plasmonic layer 102 of the sample holder 100. Received light 325 is emitted from the sample by fluorescence and received light 315 is reflected by the sample holder 100. Received light 315/325 is captured by an imaging system 312 to enable creation of both a fluorescence image and a colour contrast image of the sample. As noted above the emission of light 31 1 and 321 may be simultaneous or not.
Figure 3D illustrates schematically an example where fluorescence imaging and colour contrast imaging of the same sample is performed using the system of figures 3A and 3B. In this example the light source 310 emit light 321 /31 1 (which may have the same spectrum or different spectra) to illuminate the sample 106. The illumination causes the sample 106 to fluoresce and also interacts with the sample and the plasmonic layer 102 of the sample holder 100. Received light 325 is emitted from the sample by fluorescence and received light 315 is reflected by the sample holder 100. Received light 315 is captured by a first imaging system 312 to enable creation of a colour contrast reflection image. Received light 325 is captured by a second imaging system 312’ to enable creation of a fluorescence image of the same sample. As noted above the emission of light 31 1 and 321 may be simultaneous or not. For figures 3C and 3D, in some instances a sample may fluoresce during colour contrast microscopy when it is not desired. This can generally be dealt with by filtering out the fluorescent wavelength(s) at image formation or by not illuminating the sample in a wavelength bend that causes flourescence. Fluorescence occurs at very specific wavelengths as it is generated via specific optical transitions within a fluorescent tag, and therefore the fluorescence appears as a line (or lines) in a received spectrum. These characteristic line(s) can be isolated from the smoother continuous background spectrum of the colour contrast image. In the event that a fluorescence line happens to coincide with a strong wavelength peak in the received colour spectrum in the colour contrast image this can be corrected by using a nanoslide with a different separation sub-micron structures or in the event that the nanoslide being used has a different separation between sub-micron structures in different directions, changing the polarisation of the illumination of the colour contrast image. As set out in the Applicant’s co-pending Australian patent applications, filed on the same day as the present application and entitled“Automated method of identifying a structure” and“Method of identifying a structure”, this will alter the received light spectrum in the colour contrast image but not the fluorescence image.
Images captured by the present methods can be used individually or together to draw conclusions about the sample. In some embodiments of the present invention the method can include spatially correlating an image formed from the light emitted from the sample by fluorescence, and a colour contrast image.
This can be performed by generating a combined image showing both colour contrast information and fluorescence images. Multiple images formed from the light emitted from the sample by fluorescence (e.g. one for each fluorescence wavelength) and/or multiple colour contrast images (captured at different polarisations) may be combined into a single image.
The combination may be performed optically (e.g. during optical image formation) or digitally (e.g. by combining data values representing said images). It will be understood that the invention disclosed and defined in this specification extends to all alternative combinations of two or more of the individual features mentioned or evident from the text or drawings. All of these different combinations constitute various alternative aspects of the invention.

Claims

Claims
1 . A sample holder for use in an optical microscope, the sample holder including: a plasmonic layer defining a periodic array of sub-micron structures; and
wherein the sample holder is configured to support an object such that the periodic array of sub-micron structures is adjacent the object when supporting the object;
wherein the periodic array of sub-micron structures comprise an array of separated plasmonic regions.
2. The sample holder as claimed in claim 1 wherein the plasmonic regions are islands of plasmonic material.
3. The sample holder as claimed in claim 1 or 2 wherien the sub-micron structures are arranged in a periodic array with a separation between the sub-micron structures in the range of 200 nm to 500 nm.
4. The sample holder as claimed in any one of the preceding claims wherein the periodic array is a 1 -dimensional or 2 dimensional array.
5. The sample holder as claimed in any one of the preceding claims wherein the sub-micron structures have a largest dimension in the range of 50 nm to 300 nm.
6. The sample holder as claimed in any one of the preceding claims wherein the sub-micron structures are regions of plasmonic material about between 100nm and 200nm across.
7. The sample holder as claimed in any one of the preceding claims wherein the plasmonic regions are shaped as any one or more of: a circle, a torus, an ellipse, a cross, rectangle, square, line, strip.
8. The sample holder as claimed in any one of the preceding claims wherein the plasmonic is formed from one or more metals selected from any one of: Al, Ag, Au, Ni, Pt and Pd.
9. The sample holder as claimed in any one of the preceding claims wherein the plasmonic layer has a thickness in the range of 20 nm to 300 nm.
10. The sample holder as claimed in any one of the preceding claims wherein the array of separated plasmonic regions are arranged in an array with equal or unequal spacing between neighbouring plasmonic regions in a first and a second direction.
1 1 . The sample holder as claimed in claim 10 wherein the first and a second directions are orthogonal directions.
12. The sample holder as claimed in any one of the preceding claims wherein the sample holder includes a substrate connected to at least a portion of a first surface of the plasmonic layer to provide mechanical support for the plasmonic layer.
13. The sample holder as claimed in claim 12 wherein the sample holder includes an optically clear protective layer on an upper side of the plasmonic layer to isolate the plasmonic layer.
14. The sample holder as claimed in claim 13 wherein the optically clear protective layer has a thickness less than 150 nm.
15. The sample holder as claimed in claim 13 wherein the optically clear protective layer has have a thickness less than 80 nm.
16. The sample holder as claimed in any one of claims 13 to 15 wherein the optically clear protective layer includes any one or more of: silicon oxide, silicon nitride, transparent metal oxide, and a polymer.
17. The sample holder as claimed in any one of the preceding claims, wherein the sample holder is arranged in use to enable light, which is transmitted through the sample to the plasmonic layer to be reflected from the sample holder for the creation of images comprising the reflected light.
18. The sample holder as claimed in claim 17 wherein incident light illuminates the sample and sample holder and interacts with the sample and the plasmonic layer.
19. The sample holder as claimed in any one of claims 17 or 18 wherein the reflected light includes a characteristic spectra in which each colour is dependent on the localised dielectric constant of a sample held on the sample holder.
20. A method of imaging a sample comprising:
Providing a sample holder having an upper surface face and a lower surface, the upper surface having a plasmonic layer associated therewith, the plasmonic layer including a periodic array of sub-micron structures;
Applying the sample to the upper surface of the sample holder;
Illuminating the sample with light so that said light interacts with the sample and sample holder; Receiving light emitted from the sample by fluorescence and forming an image thereof.
21 . The method of claim 20 wherein the method further includes receiving light after interaction with said sample and sample holder and forming at least one image thereof, wherein at least one localised structural property of the sample is visible in the image based on the colour of the received light.
22. The method of claim 21 wherein an image formed from the light emitted from the sample by fluorescence is formed in a first time period, and an image formed from light after interaction with said sample and sample holder are formed in a second time period.
23. The method as claimed in claim 22 wherein the method includes , illuminating the sample using light having a first illumination spectrum in the first time period, and a second illumination spectrum in the second time period.
24. The method as claimed in claim 23 wherein the first illumination spectrum is selected on the basis of a fluorescence property of the sample.
25. The method as claimed in claim 23 or 24 wherein the first and second illumination spectra are either the same or different.
26. The method as claimed in any one of claims 20 to 25 wherein receiving light emitted from the sample by fluorescence includes filtering light received from the sample and/or sample holder to minimise received light from sources other than said fluorescence.
27. The method as claimed in any one of claims 20 to 26 wherein the method includes illuminating the sample from the side of the sample holder on which the sample is positioned, and receiving light emitted from the sample by fluorescence, and also light which has after interacted with said sample and sample holder, from the same side as said illumination.
28. The method as claimed in any one of claims 20 to 27 which further includes spatially correlating an image formed from the light emitted from the sample by fluorescence, and an image formed from light after interaction with said sample and sample holder.
29. The method of claim 28 wherein the method further includes forming a combined image including at least one image formed from the light emitted from the sample by fluorescence, and at least one image formed from light after interaction with said sample and sample holder.
30. The method as claimed in claim 29 wherein the images are combined optically before capture as a digital image or after capture by digital combination.
31 . The method as claime in any one of claims 20 to 30 wherein the sample is a biological sample.
32. A system for forming an image in accordance with a method of any one of claims 1 to 31 .
33. A system as claimed in claim 32 wherein the system includes a reflected light microscope having an image forming system,
an illumination system,
a sample holder having an upper surface and a lower surface, the upper surface having a plasmonic layer associated therewith, the plasmonic layer including a periodic array of sub-micron structures.
34. The system of claim 33 wherein the system includes an image capture system to generate at least one digital image of the sample.
PCT/IB2019/060305 2018-11-29 2019-11-29 Microscopy method and system Ceased WO2020110069A1 (en)

Priority Applications (10)

Application Number Priority Date Filing Date Title
US17/297,974 US12332463B2 (en) 2018-11-29 2019-11-29 Microscopy method and system
NZ776432A NZ776432B2 (en) 2019-11-29 Microscopy method and system
SG11202105293SA SG11202105293SA (en) 2018-11-29 2019-11-29 Microscopy method and system
AU2019387397A AU2019387397B2 (en) 2018-11-29 2019-11-29 Microscopy method and system
JP2021530110A JP7483707B2 (en) 2018-11-29 2019-11-29 Microscopy method and system
CA3121434A CA3121434A1 (en) 2018-11-29 2019-11-29 Microscopy method and system
CN201980090294.2A CN113661425B (en) 2018-11-29 2019-11-29 Microscopy methods and systems
EP19890517.6A EP3966619A4 (en) 2018-11-29 2019-11-29 MICROSCOPY METHOD AND SYSTEM
JP2024074205A JP7693054B2 (en) 2018-11-29 2024-05-01 Microscopy method and system
US19/239,786 US20250370171A1 (en) 2018-11-29 2025-06-16 Microscopy method and system

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
AU2018904553A AU2018904553A0 (en) 2018-11-29 Microscopy method and system
AU2018904553 2018-11-29

Related Child Applications (2)

Application Number Title Priority Date Filing Date
US17/297,974 A-371-Of-International US12332463B2 (en) 2018-11-29 2019-11-29 Microscopy method and system
US19/239,786 Continuation US20250370171A1 (en) 2018-11-29 2025-06-16 Microscopy method and system

Publications (1)

Publication Number Publication Date
WO2020110069A1 true WO2020110069A1 (en) 2020-06-04

Family

ID=70853205

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2019/060305 Ceased WO2020110069A1 (en) 2018-11-29 2019-11-29 Microscopy method and system

Country Status (8)

Country Link
US (2) US12332463B2 (en)
EP (1) EP3966619A4 (en)
JP (2) JP7483707B2 (en)
CN (1) CN113661425B (en)
AU (1) AU2019387397B2 (en)
CA (1) CA3121434A1 (en)
SG (1) SG11202105293SA (en)
WO (1) WO2020110069A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12270981B2 (en) 2018-11-29 2025-04-08 La Trobe University Method of analysis of a sample including forming an image and controlling a subsequent analysis process using the image formed
US12315201B2 (en) 2018-11-29 2025-05-27 La Trobe University Automated method of identifying a structure
US12332463B2 (en) 2018-11-29 2025-06-17 La Trobe University Microscopy method and system
US12608793B2 (en) 2018-11-29 2026-04-21 La Trobe University Method of identifying a structure

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB202006259D0 (en) 2020-04-28 2020-06-10 Leeds Teaching Hospitals Nhs Trust Stain Assessment
EP4491742B1 (en) * 2020-09-18 2026-03-04 10X Genomics, Inc. Sample handling apparatus and image registration methods
DE102023104498A1 (en) * 2023-02-23 2024-08-29 Gesellschaft für angewandte Mikro- und Optoelektronik mit beschränkter Haftung - AMO GmbH Structured semiconductor device and method for producing a structured semiconductor device

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080252894A1 (en) * 2007-04-16 2008-10-16 Lakowicz Joseph R Subwavelength resolution optical microscopy
WO2013089996A1 (en) * 2011-12-13 2013-06-20 Konica Minolta Laboratory U.S.A., Inc. Nanohole sensor chip with reference sections
US20140168651A1 (en) * 2012-12-15 2014-06-19 Junpeng Guo Nanostructure diffraction gratings for integrated spectroscopy and sensing
EP3121587A1 (en) * 2014-03-21 2017-01-25 Universidad De Cantabria Device and method for detecting biomarkers
AU2018904550A0 (en) 2018-11-29 2018-12-13 La Trobe University Method of identifying a structure

Family Cites Families (108)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5016173A (en) 1989-04-13 1991-05-14 Vanguard Imaging Ltd. Apparatus and method for monitoring visually accessible surfaces of the body
CA2236268A1 (en) 1995-11-30 1997-06-05 Chromavision Medical Systems, Inc. Method and apparatus for automated image analysis of biological specimens
US6650357B1 (en) 1997-04-09 2003-11-18 Richardson Technologies, Inc. Color translating UV microscope
JP3766803B2 (en) 1999-08-04 2006-04-19 クロマビジョン メディカル システムズ インコーポレイテッド Method and apparatus for providing a color threshold in the use of an optical microscope
US6285020B1 (en) 1999-11-05 2001-09-04 Nec Research Institute, Inc. Enhanced optical transmission apparatus with improved inter-surface coupling
US20020115224A1 (en) * 2001-02-16 2002-08-22 Ulrich Rudel Method for the preparation of optical (bio)chemical sensor devices
WO2002068932A2 (en) 2001-02-23 2002-09-06 Genicon Sciences Corporation Methods for providing extended dynamic range in analyte assays
US20080099667A1 (en) 2001-08-14 2008-05-01 President And Fellows Of Harvard College Methods and apparatus for sensing a physical substance
EP2311934B1 (en) 2001-09-06 2013-06-05 Rapid Micro Biosystems, Inc. Rapid detection of replicating cells
US7122384B2 (en) 2002-11-06 2006-10-17 E. I. Du Pont De Nemours And Company Resonant light scattering microparticle methods
US7460224B2 (en) * 2005-12-19 2008-12-02 Opto Trace Technologies, Inc. Arrays of nano structures for surface-enhanced Raman scattering
DE10329195A1 (en) 2003-06-28 2005-01-13 Carl Zeiss Jena Gmbh Slide for fluorescence-based analytical apparatus employing bio-specific sensor chips, comprises a dielectric substrate with a layer containing metallic particles on the surface
JP2007501391A (en) 2003-08-06 2007-01-25 ユニバーシティー オブ ピッツバーグ Nano-optical element for enhancing surface plasmon and method for manufacturing the same
US20050136549A1 (en) 2003-10-30 2005-06-23 Bioimagene, Inc. Method and system for automatically determining diagnostic saliency of digital images
US8298780B2 (en) 2003-09-22 2012-10-30 X-Body, Inc. Methods of detection of changes in cells
KR101168654B1 (en) 2004-05-19 2012-07-25 브이피 호울딩 엘엘씨 Optical sensor with layered plasmon structure for enhanced detection of chemical groups by sers
FR2872910B1 (en) 2004-07-07 2006-10-13 Nanoraptor Sa OPTICAL COMPONENT FOR OBSERVING A NANOMETRIC SAMPLE, SYSTEM COMPRISING SUCH A COMPONENT, ANALYSIS METHOD USING THE SAME, AND APPLICATIONS THEREOF
WO2006102292A2 (en) * 2005-03-21 2006-09-28 The Trustees Of The University Of Pennsylvania Nanogaps: methods and devices containing same
JP4838626B2 (en) 2005-04-28 2011-12-14 キヤノン株式会社 Substrate for target substance detection element used in apparatus for detecting target substance using plasmon resonance, detection element and detection apparatus using the same
US20160355869A1 (en) * 2005-08-02 2016-12-08 University Of Utah Research Foundation Biosensors including metallic nanocavities
WO2007041340A2 (en) * 2005-09-30 2007-04-12 The Trustees Of Columbia University In The City Of New York Microfluidic cells with parallel arrays of individual dna molecules
WO2008039212A2 (en) 2005-10-21 2008-04-03 University Of California, San Diego Optical sensing based on surface plasmon resonances in nanostructures
JP2007192806A (en) 2005-12-22 2007-08-02 Canon Inc Target substance detection element substrate, target substance detection element, target substance detection apparatus and method using the same, and kit for the same
US8154722B2 (en) 2006-03-03 2012-04-10 Canon Kabushiki Kaisha Sensor element structure, sensor element array, and manufacturing method of sensor element array
KR100905241B1 (en) * 2007-04-13 2009-07-01 엘지전자 주식회사 Optical film including a plurality of structures and a backlight unit comprising the same
CA2704796A1 (en) 2007-10-11 2009-04-16 British Columbia Cancer Agency Branch Systems and methods for automated characterization of genetic heterogeneity in tissue samples
CN101952697B (en) 2007-11-02 2014-08-13 加利福尼亚大学董事会 Real-time single-step bioassays using nanoplasmon resonators with ultrahigh sensitivity
US20100264032A1 (en) * 2007-11-07 2010-10-21 Bazant Martin Z Induced-charge electrokinetics with high-slip polarizable surfaces
EP2227774B1 (en) 2007-12-04 2014-07-09 University College Dublin, National University of Ireland Dublin Method and system for image analysis
CN101470219B (en) 2007-12-27 2010-09-01 上海科学院 Nano lens and scanning microscope using the same
WO2009089292A1 (en) 2008-01-07 2009-07-16 Myskin, Inc. System and method for analysis of light-matter interaction based on spectral convolution
JP5175584B2 (en) 2008-03-13 2013-04-03 地方独立行政法人 東京都立産業技術研究センター Local surface plasmon resonance imaging system
JP5010511B2 (en) 2008-03-18 2012-08-29 株式会社リコー Polarization control element, polarization control device
JP4995231B2 (en) 2008-05-30 2012-08-08 キヤノン株式会社 Optical filter
JP5195112B2 (en) 2008-07-18 2013-05-08 株式会社リコー Refractive index sensor, refractive index sensor array and biosensor
JP5621983B2 (en) * 2008-09-01 2014-11-12 日立化成株式会社 SPR sensor
CA2761114A1 (en) 2009-05-15 2010-11-18 Sru Biosystems, Inc. Detection of changes in cell populations and mixed cell populations
JP5452140B2 (en) 2009-09-03 2014-03-26 日本航空電子工業株式会社 Surface plasmon resonance element for hydrogen detection, surface plasmon resonance optical hydrogen detector, and method for optically detecting hydrogen using surface plasmon resonance
CN102713720B (en) 2009-10-28 2016-05-11 阿兰蒂克微科学股份有限公司 Microscopic imaging device and microscopic imaging method
WO2011106057A2 (en) 2009-12-04 2011-09-01 Trustees Of Boston University Nanostructure biosensors and systems and methods of use thereof
WO2011163624A1 (en) 2010-06-25 2011-12-29 Cellmark Theranostics, Llc Method for analyzing biological specimens by spectral imaging
US8536545B2 (en) * 2010-09-09 2013-09-17 California Institute Of Technology Delayed emission detection devices and methods
DE102010063965A1 (en) 2010-12-22 2012-06-28 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus and method for determining objects of a color photograph
KR101211092B1 (en) 2010-12-28 2012-12-12 한국과학기술연구원 Bio channel system
JP2012159792A (en) 2011-02-02 2012-08-23 Ricoh Co Ltd Wavelength selective element
US9304234B2 (en) 2011-03-10 2016-04-05 The Regents Of The University Of California Plasmonic dark field and fluorescence microscopy
FR2973917B1 (en) * 2011-04-08 2014-01-10 Hologram Ind OPTICAL SECURITY COMPONENT WITH TRANSMISSIVE EFFECT, MANUFACTURE OF SUCH A COMPONENT AND SECURE DOCUMENT EQUIPPED WITH SUCH A COMPONENT
US20230266291A1 (en) * 2011-06-17 2023-08-24 James J. Myrick Sensors and sensing methods
CN103018167A (en) 2011-09-23 2013-04-03 中国科学院微电子研究所 Surface plasmon resonance sample stage and preparation method thereof
WO2013056137A1 (en) 2011-10-12 2013-04-18 Brown University Systems and methods enabling high-throughput, real time detection of analytes
JP2013142546A (en) 2012-01-06 2013-07-22 Panasonic Corp Method of measuring density of biogenic substances and measuring device
CN104380084A (en) 2012-04-10 2015-02-25 普林斯顿大学理事会 Ultra-sensitive sensor
EP2653903A1 (en) 2012-04-20 2013-10-23 FOM Institute for Atomic and Molecular Physics Plasmonic microscopy
JP2013231682A (en) 2012-05-01 2013-11-14 Seiko Epson Corp Optical device and detection apparatus
US8687180B2 (en) 2012-06-07 2014-04-01 Molecular Devices, Llc System, method, and device for determining a focal position of an objective in a microscopy imaging system
DE102012214932B4 (en) 2012-08-22 2023-08-24 Carl Zeiss Microscopy Gmbh Test sample apparatus and test method for a sub-wavelength optical microscope
CN104919299A (en) 2012-10-03 2015-09-16 皇家飞利浦有限公司 Combined sample inspection
TWI497056B (en) 2012-11-14 2015-08-21 Nat Univ Tsing Hua An imaging metamaterial
US9464985B2 (en) 2013-01-16 2016-10-11 The Board Of Trustees Of The University Of Illinois Plasmon resonance imaging apparatus having nano-lycurgus-cup arrays and methods of use
US9675288B2 (en) * 2013-01-29 2017-06-13 Hewlett-Packard Development Company, L.P. Apparatus having surface-enhanced spectroscopy elements on an exterior surface
GB201305171D0 (en) 2013-03-21 2013-05-01 Univ Nottingham Measurement of tissue structures
JP2015012128A (en) 2013-06-28 2015-01-19 ソニー株式会社 Imaging apparatus and electronic apparatus
EP2989442A4 (en) 2013-07-09 2016-12-28 Halliburton Energy Services Inc Integrated computational elements with frequency selective surface
JP2016212126A (en) 2013-10-18 2016-12-15 シャープ株式会社 Photoelectric conversion device
US20160258114A1 (en) * 2013-11-08 2016-09-08 Bank Of Canada Optically Variable Devices, Their Production and Use
WO2015084800A1 (en) 2013-12-02 2015-06-11 The General Hospital Corporation Nano-plasmonic sensor for exosome detection
WO2015175433A1 (en) 2014-05-12 2015-11-19 Cellomics, Inc. Automated imaging of chromophore labeled samples
WO2015199976A1 (en) 2014-06-24 2015-12-30 The United States Of America, As Represented By The Secretary, Department Of Health & Human Services Target activated microdissection
US11111396B2 (en) * 2014-10-17 2021-09-07 C3 Nano, Inc. Transparent films with control of light hue using nanoscale colorants
EP3207499A4 (en) 2014-10-17 2018-09-19 Cireca Theranostics, LLC Methods and systems for classifying biological samples, including optimization of analyses and use of correlation
EP3268724A1 (en) 2015-03-13 2018-01-17 Plasmonix, Inc. Microarray slides that enhance fluorescent signals via plasmonic interaction
KR101704584B1 (en) 2015-04-16 2017-02-22 포항공과대학교 산학협력단 Microscopic apparatus for super-resolution imaging organisms or biomatter and method for super-resolution imaging organisms or biomatter using the same
US9835870B2 (en) 2015-06-05 2017-12-05 Vasily N. Astratov Super-resolution microscopy methods and systems enhanced by dielectric microspheres or microcylinders used in combination with metallic nanostructures
ES2862905T3 (en) 2015-06-19 2021-10-08 Us Gov Sec Navy Determination of the extracellular concentration of analytes with nanoplasmonic sensors
WO2017010411A1 (en) 2015-07-13 2017-01-19 国立研究開発法人理化学研究所 Structure for use in infrared spectroscopy and infrared spectroscopy method using same
RU2716746C2 (en) 2015-07-16 2020-03-16 Конинклейке Филипс Н.В. Information transformation in digital pathology
JP2018532132A (en) 2015-07-16 2018-11-01 コーニンクレッカ フィリップス エヌ ヴェKoninklijke Philips N.V. Digital pathology system
GB2543030A (en) 2015-09-23 2017-04-12 Pathxl Ltd Pattern driven image processing method & apparatus for tissue recognition
US9964494B1 (en) * 2015-09-28 2018-05-08 U.S. Department Of Energy Thermally emissive sensing materials for chemical spectroscopy analysis
RU2734097C2 (en) 2015-12-23 2020-10-12 Конинклейке Филипс Н.В. Calibration slide for digital pathology
WO2017135430A1 (en) 2016-02-03 2017-08-10 国立大学法人大阪大学 Plasmonic structure, color generation structure, and recording medium
EP3430377B1 (en) 2016-03-16 2025-10-08 Ohio State Innovation Foundation System and method for the discrimination of tissues using a fast infrared cancer probe
CN105700262B (en) 2016-04-13 2019-04-30 深圳市华星光电技术有限公司 Liquid crystal display device and preparation method thereof
CN205691505U (en) 2016-05-17 2016-11-16 南京信息工程大学 Nanometer annular chamber SERS substrate based on surface phasmon effect
WO2017216123A1 (en) 2016-06-13 2017-12-21 Nanolive Sa Method of characterizing and imaging microscopic objects
US10768105B1 (en) 2016-07-29 2020-09-08 Labrador Diagnostics Llc Image analysis and measurement of biological samples
JP6794727B2 (en) 2016-09-06 2020-12-02 コニカミノルタ株式会社 Structural color change type material and strain detector
AU2017374052B2 (en) 2016-12-08 2022-10-27 Drinksavvy, Inc. Surface plasmon resonance sensor comprising metal coated nanostructures and a molecularly imprinted polymer layer
CN106896489B (en) 2017-02-13 2019-11-22 清华大学 Frequency Domain Collage Microscopy System and Its Method Based on Wavelength Multiplexing
TWI756365B (en) 2017-02-15 2022-03-01 美商脫其泰有限責任公司 Image analysis systems and related methods
US11774361B2 (en) 2017-05-04 2023-10-03 The Regents Of The University Of California Waveguide-based side-illumination technique for muse microscopy and associated histology cassettes
JP7189621B2 (en) * 2017-05-22 2022-12-14 ラ トローブ ユニバーシティ Image contrast enhancement for optical microscopy
DE102017113683A1 (en) 2017-06-21 2018-12-27 Carl Zeiss Microscopy Gmbh High-resolution scanning microscopy with the distinction of at least two wavelength ranges
US11236426B2 (en) 2017-09-06 2022-02-01 Wisconsin Alumni Research Foundation Plasmonic diamond films and related methods
US11545237B2 (en) 2017-09-26 2023-01-03 Visiongate, Inc. Morphometric genotyping of cells in liquid biopsy using optical tomography
WO2019086770A1 (en) 2017-11-06 2019-05-09 Aalto University Foundation Sr A field-enhancing device
US11351760B2 (en) * 2017-11-27 2022-06-07 Washington University Plasmonic patch as a universal fluorescence enhancer
US11874480B2 (en) * 2017-12-20 2024-01-16 The Regents Of The University Of Michigan Plasmonic lithography for patterning high aspect-ratio nanostructures
US11099136B2 (en) * 2017-12-22 2021-08-24 Regents Of The University Of Minnesota 3D graphene optical sensors and methods of manufacture
CN113544492B (en) 2018-11-29 2024-10-01 乐卓博大学 Methods for identifying structures
JP7466540B2 (en) 2018-11-29 2024-04-12 ラ トローブ ユニバーシティ How to Identify a Structure
WO2020110069A1 (en) 2018-11-29 2020-06-04 La Trobe University Microscopy method and system
EP3887799B1 (en) 2018-11-29 2024-04-24 La Trobe University Automated method of identifying a structure
US11733507B2 (en) * 2019-02-19 2023-08-22 Purdue Research Foundation Optical device, method of using the same, and method of making the same
US10859436B2 (en) * 2019-02-19 2020-12-08 Renesas Electronics America Inc. Spectrometer on a chip
KR20240035622A (en) * 2019-03-08 2024-03-15 알심 에너지, 인크. Aqueous aluminum ion batteries, hybrid battery-capacitors, compositions of said batteries and battery-capacitors, and associated methods of manufacture and use
CN113874524A (en) * 2019-04-30 2021-12-31 根特罗玛有限公司 Graphene nanopore device for nucleic acid sequencing
US20220381984A1 (en) * 2021-05-31 2022-12-01 Jinan University Fiber optic sensing apparatus and system

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080252894A1 (en) * 2007-04-16 2008-10-16 Lakowicz Joseph R Subwavelength resolution optical microscopy
WO2013089996A1 (en) * 2011-12-13 2013-06-20 Konica Minolta Laboratory U.S.A., Inc. Nanohole sensor chip with reference sections
US20140168651A1 (en) * 2012-12-15 2014-06-19 Junpeng Guo Nanostructure diffraction gratings for integrated spectroscopy and sensing
EP3121587A1 (en) * 2014-03-21 2017-01-25 Universidad De Cantabria Device and method for detecting biomarkers
AU2018904550A0 (en) 2018-11-29 2018-12-13 La Trobe University Method of identifying a structure
AU2018904553A0 (en) 2018-11-29 2018-12-13 La Trobe University Microscopy method and system
AU2018904551A0 (en) 2018-11-29 2018-12-13 La Trobe University Automated method of identifying a structure

Non-Patent Citations (5)

* Cited by examiner, † Cited by third party
Title
HUANG, FU MIN ET AL.: "Nanohole Array as a Lens", NANOLETTERS, vol. 8, no. 8, 2008, pages 2469 - 2472, XP055494761, DOI: 10.1021/nl801476v *
JIANG, JING ET AL.: "Plasmonic Nano-arrays for Ultrasensitive Bio-Sensing", NANOPHOTONICS, vol. 7, no. 9, 2018, pages 1517 - 1531, XP055711747 *
LEE ET AL., ACS NANO, vol. 5, no. 2, 2011, pages 897 - 904
MUDACHATHI ET AL., PROC. OF SPIE, vol. 10346, pages 966817 - 1
See also references of EP3966619A4

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12270981B2 (en) 2018-11-29 2025-04-08 La Trobe University Method of analysis of a sample including forming an image and controlling a subsequent analysis process using the image formed
US12315201B2 (en) 2018-11-29 2025-05-27 La Trobe University Automated method of identifying a structure
US12332463B2 (en) 2018-11-29 2025-06-17 La Trobe University Microscopy method and system
US12608793B2 (en) 2018-11-29 2026-04-21 La Trobe University Method of identifying a structure

Also Published As

Publication number Publication date
EP3966619A4 (en) 2022-12-07
JP7483707B2 (en) 2024-05-15
AU2019387397A1 (en) 2021-06-10
EP3966619A1 (en) 2022-03-16
CN113661425A (en) 2021-11-16
US12332463B2 (en) 2025-06-17
CN113661425B (en) 2024-06-11
US20220091307A1 (en) 2022-03-24
NZ776432A (en) 2025-10-31
JP7693054B2 (en) 2025-06-16
SG11202105293SA (en) 2021-06-29
AU2019387397B2 (en) 2024-11-28
JP2022510645A (en) 2022-01-27
US20250370171A1 (en) 2025-12-04
JP2024109617A (en) 2024-08-14
CA3121434A1 (en) 2020-06-04

Similar Documents

Publication Publication Date Title
AU2019387397B2 (en) Microscopy method and system
Phillips et al. CryoSIM: super-resolution 3D structured illumination cryogenic fluorescence microscopy for correlated ultrastructural imaging
AU2019389908B2 (en) Method of identifying a structure
EP3394657B1 (en) Fluorescence microscope calibration system
US10308062B2 (en) Optical anti-counterfeiting element and optical anti-counterfeiting product utilizing the same
Sivaguru et al. Capturing the surface texture and shape of pollen: a comparison of microscopy techniques
RU2571447C2 (en) Optically variable element, primarily protective element
Gjonaj et al. Focusing and scanning microscopy with propagating surface plasmons
Thomas et al. Optical sectioning structured illumination microscopy with enhanced sensitivity
Zhong et al. High-throughput optical sectioning via line-scanning imaging with digital structured modulation
Caarls et al. Minimizing light exposure with the programmable array microscope
WO2013064843A1 (en) Support for microscope sample comprising a diffraction grating for forming an illumination pattern thereon
HK40063483A (en) Microscopy method and system
Ball et al. Confocal microscopy applied to paleontological specimens
EP4067105A1 (en) Optical anti-counterfeiting element and optical anti-counterfeiting product
Chen et al. Bridging scales in scattering tissues via multifocal two-photon microscopy
Duan et al. Hybrid wide-field and scanning microscopy for high-speed 3D imaging
HK40063482A (en) Method of identifying a structure
Haase OMX-a novel high speed and high resolution microscope and its application to nuclear and chromosomal structure analysis
DE102025102033A1 (en) Wavelength converter system for an imaging system
Ai et al. Fluorescence imaging of dendritic spines of Golgi-Cox-stained neurons using brightening background
Sencan et al. 12 Compressive

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19890517

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2021530110

Country of ref document: JP

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 3121434

Country of ref document: CA

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2019387397

Country of ref document: AU

Date of ref document: 20191129

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 2019890517

Country of ref document: EP

Effective date: 20210629

WWG Wipo information: grant in national office

Ref document number: 17297974

Country of ref document: US

WWG Wipo information: grant in national office

Ref document number: 776432

Country of ref document: NZ