EP4633454A1 - Imagerie polarimétrique multispectrale en temps réel pour identification non invasive de nerfs et d'autres tissus - Google Patents

Imagerie polarimétrique multispectrale en temps réel pour identification non invasive de nerfs et d'autres tissus

Info

Publication number
EP4633454A1
EP4633454A1 EP23847679.0A EP23847679A EP4633454A1 EP 4633454 A1 EP4633454 A1 EP 4633454A1 EP 23847679 A EP23847679 A EP 23847679A EP 4633454 A1 EP4633454 A1 EP 4633454A1
Authority
EP
European Patent Office
Prior art keywords
tissue
image
images
polarization
region
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP23847679.0A
Other languages
German (de)
English (en)
Inventor
Wayne H. Knox
Haolin LIAO
Gregory HEYWORTH
David MITTEN
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
University of Rochester
Original Assignee
University of Rochester
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by University of Rochester filed Critical University of Rochester
Publication of EP4633454A1 publication Critical patent/EP4633454A1/fr
Pending legal-status Critical Current

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002—Operational features of endoscopes
    • A61B1/00004—Operational features of endoscopes characterised by electronic signal processing
    • A61B1/00009—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope
    • A61B1/000094—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope extracting biological structures
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00163—Optical arrangements
    • A61B1/00186—Optical arrangements with imaging filters
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
    • A61B1/0605—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements for spatially modulated illumination
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
    • A61B1/0638—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements providing two or more wavelengths
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
    • A61B1/0646—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements with illumination filters
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0075—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence by spectroscopy, i.e. measuring spectra, e.g. Raman spectroscopy, infrared absorption spectroscopy
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/48—Other medical applications
    • A61B5/4887—Locating particular structures in or on the body
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/48—Other medical applications
    • A61B5/4887—Locating particular structures in or on the body
    • A61B5/489—Blood vessels
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/48—Other medical applications
    • A61B5/4887—Locating particular structures in or on the body
    • A61B5/4893—Nerves
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/74—Details of notification to user or communication with user or patient; User input means
    • A61B5/742—Details of notification to user or communication with user or patient; User input means using visual displays
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B90/37—Surgical systems with images on a monitor during operation
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002—Operational features of endoscopes
    • A61B1/00043—Operational features of endoscopes provided with output arrangements
    • A61B1/00045—Display arrangement
    • A61B1/00048—Constructional features of the display
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B2090/364—Correlation of different images or relation of image positions in respect to the body
    • A61B2090/365—Correlation of different images or relation of image positions in respect to the body augmented reality, i.e. correlating a live optical image with another image
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B90/37—Surgical systems with images on a monitor during operation
    • A61B2090/372—Details of monitor hardware
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B90/37—Surgical systems with images on a monitor during operation
    • A61B2090/373—Surgical systems with images on a monitor during operation using light, e.g. by using optical scanners
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2505/00—Evaluating, monitoring or diagnosing in the context of a particular type of medical care
    • A61B2505/05—Surgical care

Definitions

  • the present disclosure relates to automatic tissue identification using imaging, and more particularly systems and methods using polarimetric imaging for tissue identification.
  • the present disclosure provides techniques for automatically identifying tissues and can be used in real-time tissue identification. Instead of a very limited view provided through a surgical microscope, the presently-disclosed techniques can be used on wide fields-of- view. In this way, the technique can be used for visualizing the entire surgical field in an open surgery (though it is not limited to such open surgeries).
  • An experimental embodiment was used to examine human cadaver (human arm) and was found to enable the differentiation of nerves from other nearby tissues.
  • a system for tissue identification includes a light source configured to illuminate a region of interest with polarized light.
  • the light may be linearly polarized.
  • a polarization of the polarized light is configured to rotate during a sample period.
  • the polarization of the polarized light may be configured to rotate at least l A rotation during the sample period.
  • the polarization of the polarized light may be configured to rotate at least one full rotation during the sample period.
  • the polarization of the polarized light may be configured to rotate at least x /i rotation during the sample period.
  • the system includes an image sensor for acquiring images of the region of interest illuminated by the polarized light of the light source.
  • the image sensor has a field of view.
  • An analyzer is disposed within the field of view of the image sensor.
  • the analyzer has a polarization which rotates to maintain a non-zero angle (for example, 90°) relative to the polarization of the polarized light.
  • a processor is in electronic communication with the image sensor.
  • the processor is configured to obtain, from the image sensor, a series of images of the region of interest acquired during at least one sample period.
  • the processor is configured to and identify a tissue within the region of interest based on an intensity of one or more pixels of the series of images varying according to the polarization angle of the rotating polarized light.
  • the processor may be configured to identify the tissue as nen e tissue.
  • the processor may be configured to identify’ the tissue as nerve, artery vein, fat, or muscle.
  • the processor may be configured to distinguish tissue types in the region of interest based on differences in the variability of intensity associated with tissue types (e.g., differences in a variability of intensify of muscle tissue compared to a variability of intensify of nerve tissue, etc.)
  • the processor may be further configured to identify the tissue as abnormal tissue (e.g., diseased or physically damaged).
  • the processor may identify the tissue as abnormal based on the varying intensify.
  • the processor is further configured to determine an orientation of the identified tissue.
  • the image sensor acquires images in one or more limited spectral bands
  • the processor identifies the tissue within the region of interest based on an intensity when illuminated by the one or more limited spectral bands.
  • the light source may be configured to provide light in one or more limited spectral bands.
  • the light source may be a broadband light source (e.g. a white light source) and an optical filter may be disposed between the light source and the image sensor. Such embodiments may be used to acquire images in one or more limited spectral bands.
  • the image sensor may acquire images in a first limited spectral band for at least a first full rotation of the polarization of the polarized light and in a second limited spectral band for at least a second full rotation of the polanzation of the polarized light.
  • the processor may be configured to identity 7 the tissue by determining a frequency spectra time series of images obtained from the image sensor and determining pixels corresponding to the tissue based on a peak amplitude of a frequency corresponding to the tissue.
  • the processor is configured to identify the tissue using phase-sensitive detection (lock-in signal detection) to determine pixels corresponding to the tissue.
  • the processor may be configured to remove an offset (e.g.. a mean value) from a set of time series values of a pixel to generate a centered signal for the pixel, mix a reference signal with the centered signal for the pixel, shift the phase of the reference signal and/or the centered signal to determine a phase-locked signal, and calculate an average value of the phase-locked signal.
  • the processor may be further configured to generate an image mask based on image pixels corresponding to the identified tissue.
  • the processor may be further configured to alter an image or a series of images (e.g.. a video) using the image mask.
  • altering the image or series of images includes one or more of increasing an intensity of an unmasked portion of the image, drawing a boundary line around an unmasked portion of the image, changing a color of an unmasked portion of the image, animating an unmasked portion of the image.
  • the system further includes a projector in electronic communication with the processor, and the projector may be configured to project a highlight on the region of interest based on the identified tissue.
  • the system further includes a wearable display in electronic communication with the processor.
  • the wearable display may be configured to provide augmented reality information to a wearer.
  • the processor may be further configured to provide a highlight overlaying the region of interest based on the identified tissue to a user using the wearable display.
  • a method for tissue identification includes illuminating a region of interest with a rotating linearly-polarized light. A series of images of the region of interest is obtained using an image sensor via an analyzer rotating synchronously with the linearly- polarized light such that the light received by the image sensor is cross polarized.
  • a tissue is identified within the region of interest based on an intensity of one or more pixels of the series of images vary ing according to the polarization angle of the rotating linearly-polarized light.
  • the tissue may be identified as nerve tissue.
  • the tissue may be identified as nerve, artery vein, fat, or muscle.
  • the tissue may be identified by distinguishing tissue types in the region of interest based on differences in the variability of intensity associated with tissue types.
  • the method may include identifying the tissue as abnormal tissue (e.g., diseased or physically damaged) based on the vary ing intensity of the tissue.
  • the method may include determining an orientation of the identified tissue based on an intensity of the tissue corresponding to a rotational position of the rotating linearly -polarized light, and relative to the varying intensity of the tissue.
  • the series of images is obtained in one or more limited spectral bands, and the tissue is identified based on an intensity when illuminated by the one or more limited spectral bands.
  • the illumination light may be configured to have one or more limited spectral bands.
  • the images may be acquired in a first limited spectral band for at least a first full rotation of the polarization of the polarized light.
  • the images may be acquired in a second limited spectral band for at least a second full rotation of the polarization of the polarized light.
  • identifying the tissue includes calculating a frequency spectra of the time series of images obtained from the image sensor, and determining pixels corresponding to the tissue based on a peak amplitude of a frequency corresponding to the tissue.
  • identify ing the tissue includes removing an offset from a set of time series values of a pixel to generate a centered signal for the pixel, mixing a reference signal yvith the centered signal for the pixel, shifting the phase of the reference signal and/or the centered signal to determine a phase-locked signal; and calculating an average value of the phase-locked signal.
  • the method may include generating an image mask based on image pixels corresponding to the identified tissue.
  • an image or a series of images (e.g, a movie) is altered using the image mask. Altering the image or series of images may include one or more of increasing an intensity of an unmasked portion of the image, drawing a boundary line around an unmasked portion of the image, changing a color of an unmasked portion of the image, and animating an unmasked portion of the image.
  • the method includes projecting a highlight on the region of interest based on the identified tissue.
  • the method includes providing augmented reality information to a wearable display.
  • the augmented reality information may be a highlight overlaying the region of interest based on the identified tissue.
  • a non-transitory computer-readable medium may have stored thereon a program for instructing a processor to perform any of the methods described herein.
  • the stored program may include instructions for a processor to: illuminate a region of interest with a rotating linearly -polarized light; obtain a series of images of the region of interest using an image sensor via an analyzer rotating synchronously with the linearly-polarized light such that the light received by the image sensor is cross polarized; and identify a tissue within the region of interest based on an intensity of one or more pixels of the series of images varying according to the polarization angle of the rotating linearly -polarized light.
  • the stored program includes instructions to: calculate a frequency spectra of the time series of images obtained from the image sensor; and determine pixels corresponding to the tissue based on a peak amplitude of a frequency corresponding to the tissue.
  • the stored program includes instructions to: remove an offset from a set of time series values of a pixel to generate a centered signal for the pixel; mix a reference signal with the centered signal for the pixel; shift the phase of the reference signal and/or the centered signal to determine a phase-locked signal; and calculate an average value of the phase- locked signal.
  • the stored program includes instructions to generate an image mask based on image pixels corresponding to the identified tissue. In some embodiments, the stored program includes instructions to alter an image or a series of images using the image mask. Description of the Drawings
  • Figure 1 is a photograph showing four different types of tissue, (from J. Cha et al., '‘Real-time, label -free, intraoperative visualization of peripheral nerves and microvasculatures using multimodal optical imaging techniques,” Biomed Opt Express, vol. 9, no. 3, p. 1097, Mar. 2018).
  • Figure 2 is a diagram of a system according to an embodiment of the present disclosure.
  • Figure 3 shows 8-bit gray results of imaging the sciatic nerve (white arrow) in ex vivo chicken thigh using: (a) traditional white LED light imaging; (b) crossed-circular polarization imaging (CPI); (c) crossed-linear polarization imaging arranged such that the polarizer was at 0 degree to the nerve; and (d) crossed-linear polarization imaging while the polarizer was arranged at 45 degrees to the nerve.
  • CPI crossed-circular polarization imaging
  • Figure 4 shows the imaging subtraction result of subtracting Figure 3(c) from Figure 3(d) (cross-polarization (XP)@45° - XP@0°).
  • Figure 5 is a chart showing the measured reflectance of five different tissue types using rotating crossed polarization.
  • Figure 6 shows an image (frame) from a video of a chicken sciatic nerve surrounded by muscle and other tissues under a rotating cross-linearly polarized imaging (XP1) system: (a) the nerve exhibits periodic white highlighting by the XPI light having rotating polarization; and (b) the periodic highlighting signal was extracted by a processor using techniques as described herein and overlaid on the image thereby highlighting the nerve in green to serving as a visualization aid as to the location of the nerve (green in original is shown as increased brightness in Figure 6(b)).
  • XP1 rotating cross-linearly polarized imaging
  • Figure 7 is a set of charts showing the rotational variance of different tissues illuminated by light sources of four colors with the XPI system rotating at a constant speed: (a) 460 nm (blue); (b) 530 nm (green); (c) 590 nm (amber); and (d) 630 nm (red).
  • Figure 8 is a set of charts comparing the spectral reflective intensities of different tissues in XP@0° and in XP@45°
  • Figure 9 is a chart showing an angle-sensitive component versus a mean-value for various tissue types.
  • Figure 10 is a chart depicting a point cloud used to display image data.
  • Figure 11 is a chart showing reflective intensity values for different tissue types.
  • Figure 12 is a schematic and flow chart showing a technique for variance extraction to automatically find nerve tissue.
  • Figure 13 shows the intensity variance of tissues in the time (left) and frequency (right) domains.
  • Figure 14 is a flow chart of identifying tissue using an FFT technique.
  • Figure 16 shows pictures of various rotating XPI prototypes and components, (a) 3D printed stage and gears. The polarizer and analyzer are orthogonally attached to the gears and connected to the driving gear separately so that they can remain crossed during rotation, (b) the rotating disk contains inner and outer linear polarizers that are in crossed position, (c) Early prototype of crossed-linear polarization device and light source attached to cell phone.
  • Figure 17 is a chart showing a method according to another embodiment of the present disclosure.
  • Figure 18 Nerve identification using FFT.
  • FIG. 19 Nerve identification using lock-in processing, (a) An original frame acquired by a rotating XPI system under the illumination of a 590 nm LED source (arrow: the chicken sciatic nerve), (b) Grayscale image of the result from lock-in processing, (c) False color image of the result from lock-in processing.
  • Figure 20 Nerve identification using inter-frame calculation, (a) An original frame acquired by the rotating XPI system under the illumination of a 590 nm LED source (arrow: the chicken sciatic nerve), (b) The result of frame subtraction and averaging during the inter-frame calculation process, (c) Output as a false color map of the inter-frame calculation processing, (d) Image resulting from masking the binary mask back onto the original frames to highlight the nen e tissue.
  • Figure 21 An experimental system and processing flow used for real-time experiments according to another embodiment of the present disclosure.
  • FIG 22 Real-time XPI video and the processing.
  • the position of the nerve bundle is indicated with an arrow nen e in the top left frame.
  • the solid double side arrow indicates the orientation of a polarization state generator (PSG), and the dotted line double side arow indicates the orientation of a polarization state analyzer (PSA).
  • PSG polarization state generator
  • PSA polarization state analyzer
  • Figure 23 Frames of the real-time nerve highlighting result at five different times.
  • Figure 24 XPI image of the median nerve when the PSG and the nerve bundle is at 0°(a) and 45°(b).
  • Figure 25 XPI images of the cut open section of the median nerve, (a) Taken when the PSG and the nen e bundle is at 0°. (b) Taken when the PSG and the nerve bundle is at 45°.
  • Figure 26 Nerve identification in a cadaver study, (a) An image of the dissected volar sided region of the arm, a small branch of the median nerve (arrow) is surrounded by fat tissues, (b) The highlighted nerve resulting from inter-frame calculation and overlaying a red mask on the nerve, (c) Grayscale image of the lock-in processing, (d) False color result of the lock-in processing.
  • Figure 27 Procedure of making a fat wedge having a linearly tapered thickness from 0 to 1 mm.
  • FIG. 28 Left: fat wedge on top of a ruler, showing the fat layer is less transparent as the thickness increases linearly. Right: fat wedge on top of a chicken sciatic nerve fiber.
  • Figure 30 An illustration of fitting the curve with four data points.
  • Figure 31 (a) An original frame of the chicken modal XPI video, the position of the nerve is indicated by the arrow, (b) The value map output after curve fitting with four frames.
  • Figure 32 left: Image of the cadaver nerve model. Right: A value output map when different combinations of data points are chosen.
  • Figure 33 A four-angle XPI system according to another embodiment of the present disclosure.
  • Figure 34 Four XPI images obtained (left) and the curve fitting output (right) of a first sample chicken thigh.
  • Figure 35 Four XPI images (left) and the curve fitting output (right) of a second sample chicken thigh.
  • Figure 1 is a photograph of four different tissue types and shows the difficulty’ in distinguishing nerve tissue from other tissue types.
  • Polarized light has found increasing use in combination with, or as an alternative to, traditional imaging.
  • the randomness and anisotropy of some biological tissues results in unique interaction with polarized light.
  • peripheral nerves are made up of a number of nerve axons wrapped by connective tissues.
  • Such nerves have shown strong birefringence within the epineurium and perineurium.
  • the natural tension and the structure of nerve tissue can also depolarize the polarized light due to multiple scattering.
  • the Muller Polarimetric Imaging technique can be useful in imaging and identifying nerves in animal tissue samples.
  • the MPI approach requires three states of a polarizer and four states of an analyzer to obtain enough data so that the intrinsic retardance value of the object can be determined.
  • MPI requires the use of expensive medical microscopes and polarimetric cameras, and it is difficult to develop a portable equipment for use with MPI.
  • a surgical microscope was used demonstrate the usefulness of birefringence for nerve differentiation.
  • a simpler approach for revealing the polarimetric properties of biological tissues is the use of crossed polarizers.
  • a first polarization film is used to polarize light from a light source, and a second polarization film is placed before a camera and oriented such that surface reflected light cannot pass through to the camera.
  • a cross- polarization system will only record the light whose state of polarization is changed when interacting the illuminated subject.
  • a cross-polarization system can eliminate flares often seen when imaging tissue. It also has the effect of ‘highlighting’ tissues that have higher depolarization and/or birefringence, thus increasing the contrast of an image and improving image qualify.
  • a cross-polarization imaging system may use linearly polarization or circular polarization.
  • the polarizer and the analyzer are both linearly polarized (e.g., linear polarization fdms), and they are placed at a non-zero angle (for example, orthogonally) to each other.
  • the polarizer and analyzer may have the same handedness because the surface reflecting light will change the chirality.
  • FIG. 3 shows that a nerve exhibits the strongest intensity value under XPI when the polarizer was oriented at an angle of 45 degrees to the nerve bundle (/. ⁇ ?., to a longitudinal axis of the nerve), which indicates the state of the linearly polarized illumination light was changed the most when the polarization direction was at 45 degrees relating to the nerve.
  • Other tissue types such as, for example, veins, were also observed so show' some amount of dependence to the polarization angle.
  • the intensity response of various tissues can be enhanced by selecting one or more spectral bands (e.g., colors) of the illumination light, as further described below (see also, Figure 7 — showing different variance and intensity under four different illumination light bands.
  • spectral bands e.g., colors
  • Figure 7 showing different variance and intensity under four different illumination light bands.
  • the changes of intensity from 0 degree to 45 degree were obtained for thirteen spectral bands.
  • the present disclosure provides techniques using polarimetric imaging systems and image processing methods to automatically identify certain tissues.
  • the presently disclosed techniques may help the surgeons quickly and accurately identify target tissues, such as, for example, peripheral nerves.
  • the present disclosure may be embodied as a system 10 for tissue identification.
  • the system includes a light source 20 configured to illuminate a region of interest 90 with polarized light.
  • the region of interest 90 may be, for example, a region on, within, or partially on or within, an individual, a surgical field, etc.
  • the light source may be inherently polarized or polarized using one or more external components such as, for example, a polarizing film, a quarter-wave plate, etc.
  • the polarized light may be linearly polarized, circularly polarized, or elliptically polarized. In some embodiments, the polarized light is linearly polarized.
  • light from an inexpensive light source e g., white LED, colored LED, infrared LED. etc.
  • an inexpensive polarizer such as, for example, a polarizing film.
  • the light source may be a broadband light source or a source having one or more limited spectral bands.
  • the light source may include one or more spectral bandpass filters (such as a tunable filter) to limit the emitted light to one or more spectral bands having a pre-determined wavelength range.
  • spectral bandpass filters such as a tunable filter
  • Examples of a limited spectral band may be spectral bands covering wavelength ranges (bandwidths) of ⁇ 1 nm, 10 nm, 20 nm, 30, nm, 50 nm, 100 nm, 150 nm, 200 nm, or more, or spectral bandwidths between these example values.
  • the light source may have a desired wavelength such as, for example, 460 nm (blue), 530 nm (green). 590 nm (amber), and 630 nm (red), or ranges containing a desired wavelength such as, for example, ranges centered on a desired wavelength.
  • the light source may cover visible light, infrared, ultra violet, or portions of one or more of these.
  • the light source may include one or more lightemitting diodes (LEDs), one or more laser diodes, lasers, halogen lights, xenon lights, metal halide lights, incandescent lights, and/or the like.
  • the light source may include other components such as, for example, optical fibers to provide illumination to the region of interest.
  • the system 10 includes a light source 20 made up of a lamp 22, a polarizer 24, and a color filter (i.e.. spectral bandpass filter) 26.
  • the light source 20 is configured to provide polarized light at more than one polarization angle with respect to the region of interest.
  • the light source may be configured to provide light at four polarization angles.
  • the polarization source is configured to provide light at polarization angles of 0°, 25°, 50°, and 75° with respect to the region of interest.
  • the polarization of the light provided by the light source 20 is configured to rotate.
  • a polarization of linearly-polarized light from the light source is configured to rotate.
  • a polarizing filter may be physically rotated (e.g, using a motor, actuator, etc.) within the beam of light provided to the region of interest.
  • the light source is rotated to rotate the polarization of the light.
  • the polarization rotates through at least of a full rotation (i.e., at least 90°) during a sample period.
  • the polarization may rotate through at least a full rotation (i.e., at least 360°) during the sample period.
  • the polarization may have a rotation speed of, for example, 60 revolutions per minute (RPM), 100 RPM, 200 RPM, 300 RPM, or more or less, or any speed between these example values.
  • the light source may have more than one polarizers (e.g., four polarizers) each having a different polarization from the others.
  • the light source may include more than one light source (e.g., four light sources) each having a different polarization from the others.
  • the system 10 includes an image sensor 30 having a field of view for acquiring images of the region of interest illuminated by the polarized light of the light source 20.
  • the image sensor may be positioned to acquire images using polarized light reflected from the region of interest.
  • the image sensor may be a charge-coupled device (CCD), an activepixel sensor (i.e., CMOS sensor), or otherwise.
  • At least one analyzer 34 is positioned within the field of view of the image sensor such that light from the region of interest (for example, reflected by the region of interest) passes through the analyzer before impinging on the image sensor.
  • the analyzer 34 has a type of polarization similar to that of the light source 20.
  • the analyzer is linearly polarized.
  • the at least one analyzer is configured to have a polarization which maintains a non-zero angle relative to the polarization angle of the polarized light from the light source.
  • the non-zero angle may be orthogonal (i.e., 90°) with respect to the polarized light of the light source.
  • the polarization of the analyzer is configured to rotate and maintain a non-zero angle relative to the polarization of the polarized light.
  • the polarization of the analyzer is rotated to maintain orthogonality to the polarization of the polarized light from the light source.
  • the analyzer may be physically rotated in coordination with a rotation of a polarizer of the light source to maintain cross-polarization.
  • the at least one analyzer is made up of four analyzers, and each of the four analyzers is configured to be orthogonal to a different polarization angle of the four polarization angles of the light source.
  • the system 10 includes a processor 40 in electronic communication ith the image sensor 30.
  • the processor 40 is configured to obtain, from the image sensor, a series of images (frames) of the region of interest acquired using more than one polarization angle. For example, the processor may obtain 2, 3, 4, 5, 10, 15, 20, 30, 45, 60, or 100 images, or more images, or any number of images between these example values.
  • the crossed polarizers are configured to rotate, higher rotational speed of the crossed polarizers may allow fast overall response (nerve identification) using the system. Along with higher rotational speed, it may be advantageous to increase acquisition rate (shorter time between each image acquisition) and/or decrease exposure time for each image.
  • the polarizer may rotate through multiple rotations and the resulting data from each rotation averaged (for example, to reduce noise in the resulting averaged data).
  • data from a partial rotation may be averaged with one or more additional partial rotation.
  • the system may be configured to acquire images from using each polarization at faster sample speeds and/or with shorter intervals between samples.
  • the processor identifies a tissue within the region of interest based on an intensity of one or more pixels of the series of images varying over the time series of images. For example, the different polarization angles of the polarized light may cause nerve tissue in the region of interest to vary in brightness according to each the polarization angle of the received light. As such, one or more pixels corresponding to such nerve tissue within an image of the region of interest will vary in intensity, and the processor may be configured to identity' such nerve tissue based on the varying intensity of the one or more pixels. The processor may be configured to identify the tissue as one or more of nerve, artery, vein, fat, or muscle, or other tissue types.
  • the varying intensity associated with certain tissues may be distinguishable from an intensity (which may or may not vary) associated with another type of tissue (e.g, nerve, fat, artery, vein, cartilage, muscle, etc.)
  • the processor may be configured to determine a mean value of a pixel over the time series of images, and an angle-sensitive component of the pixel value (e.g., pixel value - mean value) such as in the chart depicted in Figure 9.
  • the processor may utilize a point could (for example, the three-dimensional point cloud of Figure 10) in color space to distinguish and/or display tissue types. Additional detail regarding identifying tissue by the processor is provided below including under the heading “Image/Signal Processing.”
  • the image sensor acquires images in one or more limited spectral bands (e.g., colors, infrared, ultraviolet, etc. and subsets of one or more of these examples).
  • the processor may be configured to identify the tissue within the region of interest based on an intensity at the one or more spectral bands.
  • the light source may be configured to provide light in one or more limited spectral bands.
  • the light source may be a broadband light source (e.g., white light, light source emitting light in a wavelength range of 100-1200 nm, 400-700 nm, or other desirable broadband range) and an optical filter (e.g., tunable filter, fixed color filter(s), etc.) is disposed between the light source and the image sensor (e.g, configured to be between the light source and the sample, between the sample and the image sensor, etc.)
  • color filtering may be performed by the processor.
  • the processor may obtain images from the image sensor acquired in a first limited spectral band for at least a first full rotation of the polarization of the polarized light. The processor may then obtain images from the image sensor acquired in a second limited spectral band for at least a second full rotation of the polarization of the polarized light, and (optionally) so on for additional limited spectral bands.
  • a system for identifying tissue may be a portable system using a smartphone or tablet (collectively referred to herein as a smart device) (see, e.g. Figure 16(b)).
  • a typical smart device includes a camera (image sensor) and an LED light source.
  • a smart-device system according to the present disclosure may use a rotating linear polarizer over the LED light source for providing polarized light to illuminate a region of interest, and a rotating analyzer over the camera. The polarizer and analyzer are configured to rotate synchronously so as to maintain cross-polarization of the light provided through the polarizer and received through the analyzer.
  • the light source and polarizer may be an external device — i.e., not a part of the smart device.
  • the system may use an image sensor having multiple on-chip analyzers (for example, the Sony POLARSENSTM imaging sensor).
  • an XPI system may eliminate some or all moving components.
  • the XPI system may be built into a wearable device such as, for example, augmented reality glasses or goggles.
  • the processor is further configured to generate an image mask based on image pixels corresponding to the identified tissue.
  • Such an image mask may be overlaid on images acquired by the image sensor.
  • the image mask may be structured such that an unmasked portion corresponds to the identified tissue.
  • a masked portion of the image mask corresponds to the identified tissue.
  • the processor may be configured to alter an image or a video (e.g., a series of images, etc.) using the image mask.
  • the processor may increase an intensity of an unmasked portion of the image, add a boundary line to an unmasked portion of the image, animate an unmasked portion of the image, etc. In this way, the altered image of view may be displayed to a user, such as, for example, a surgeon, in order to assist the user in identif ing tissue.
  • the system 10 further includes a projector 50 in electronic communication with the processor 40.
  • the projector 50 is configured to project one or more images on the region of interest 90.
  • the processor in such embodiments is further configured to project, using the projector, a highlight on the region of interest based on the identified tissue.
  • a highlight can be any type of augmentation that would cause the highlighted object/ area to be more easily distinguishable to a user.
  • a highlight may be a white light, colored light, patterned light (e.g, stripes, outline of the area/object, etc.), projected arrow(s). flashing light, etc. and combinations of these or other types of augmentation.
  • such projected highlighting would allow the surgeon to have a hands-free surgical aid.
  • the system 10 further includes a wearable display 55 in electronic communication with the processor 40.
  • the wearable display may be a pair of augmented reality' glasses or goggles, a monocle, etc.
  • the wearable display is configured to provide augmented reality information to a wearer.
  • the processor in such embodiments is further configured to provide, using the wearable display, a highlight overlaying the region of interest (i.e., overlaying the wearer's view of the region of interest) based on the identified tissue.
  • the processor is further configured to identify the tissue as abnormal tissue. For example, it has been found that physically damaged tissue or diseased tissue may have polarization-related properties different from those of normal tissue. For example, stretched nerves, pinched nerves, diseased nerves (e.g, diabetic nerves), etc. may behave differently under polarized light from normal nerve tissue. As such, the present system may be used to differentiate abnormal tissue from normal tissue. In this way, the present system may be used as a diagnostic aid.
  • the processor 40 may be in communication with and/or include a memory.
  • the memory' can be, for example, a random-access memory (RAM) (e.g., a dynamic RAM, a static RAM), a flash memory , a removable memory, and/or so forth.
  • RAM random-access memory
  • instructions associated with performing the operations described herein can be stored within the memory and/or a storage medium (which, in some embodiments, includes a database in which the instructions are stored) and the instructions are executed at the processor.
  • the processor includes one or more modules and/or components.
  • Each module/component executed by the processor can be any combination of hardware-based module/component (e.g, a field-programmable gate array (FPGA), an application specific integrated circuit (ASIC), a digital signal processor (DSP)), software-based module (e.g, a module of computer code stored in the memory and/or in the database, and/or executed at the processor), and/or a combination of hardware- and software-based modules.
  • FPGA field-programmable gate array
  • ASIC application specific integrated circuit
  • DSP digital signal processor
  • software-based module e.g, a module of computer code stored in the memory and/or in the database, and/or executed at the processor
  • Each module/component executed by the processor is capable of performing one or more specific functions/operations as described herein.
  • the modules/components included and executed in the processor can be, for example, a process, application, virtual machine, and/or some other hardware or software module/component.
  • the processor can be any suitable processor configured to run and/or execute those modules/components.
  • the processor can be any suitable processing device configured to run and/or execute a set of instructions or code.
  • the processor can be a general purpose processor, a central processing unit (CPU), an accelerated processing unit (APU), a field-programmable gate array (FPGA). an application specific integrated circuit (ASIC), a digital signal processor (DSP), and/or the like.
  • the presently-disclosed systems and methods may be used for exposed tissues and/or tissues below the surface of the region of interest.
  • the birefringent properties of nerves are visible even where the nerve is beneath other tissue (e.g., beneath fat tissue).
  • the present disclosure may be embodied as a method 100 for tissue identification.
  • the method 100 includes illuminating 103 a region of interest with a linearly-polarized light configured to have at least four polarization angles relative to the region of interest.
  • the region of interest may be, for example, a region on, within, or partially on or within, an individual, a surgical field, etc.
  • the illumination may be provided using a light source that is inherently polarized or polarized using one or more external components such as, for example, a polarizing film, a quarter- wave plate, etc.
  • light from an inexpensive light source e.g., white LED, colored LED, infrared LED, etc.
  • an inexpensive polarizer such as, for example, a polarizing film.
  • the linearly-polarized light may be a broadband light or may be a light having one or more limited spectral bands.
  • Examples of a limited spectral band may be spectral bands covering wavelength ranges (bandwidths) of ⁇ 1 nm, 10 nm, 20 nm, 30, nm, 50 nm, 100 nm, 150 nm. 200 nm, or more, or spectral bandwidths between these example values.
  • the light may have a desired wavelength such as, for example, 460 nm (blue), 530 nm (green), 590 nm (amber), and 630 nm (red), or ranges containing a desired wavelength such as, for example, ranges centered on a desired wavelength.
  • the light may comprise or consist of visible light, infrared, ultra violet, or portions of one or more of these.
  • a series of images of the region of interest is acquired 106 using an image sensor.
  • the images are acquired through an analyzer having a polarization configured to have at least four polarization angles which are non-zero (e.g., orthogonal) to the polarization angle of the linearly-polarized light.
  • the polarization of the analyzer may rotate synchronously with the linearly -polarized light such that the light received by the image sensor is cross polarized.
  • the polarization rotates through at least ‘A of a full rotation (i.e., at least 90°) during a sample period.
  • the polarization may rotate through at least a full rotation (i.e., at least 360°) during the sample period.
  • the polarization may have a rotation speed of, for example. 60 revolutions per minute (RPM), 100 RPM, 200 RPM.
  • the series of images may be obtained in one or more limited spectral bands.
  • the images may be acquired in a first limited spectral band for at least a first full rotation of the polarization of the polarized light, and acquired in a second limited spectral band for at least a second full rotation of the polarization of the polarized light.
  • the method includes identifying 109 a tissue within the region of interest based on an intensity of one or more pixels of the series of images varying according to the polarization angle of the rotating linearly-polarized light.
  • the identified 109 tissue is one or more of nerve, artery, vein, fat, and muscle tissue.
  • the identified 109 tissue is nerve tissue.
  • the method may include distinguishing tissue ty pes in the region of interest based on differences in the variability of intensity associated with tissue types. In embodiments where at least some of the images are acquired in one or more limited spectral bands, the issue may be identified based on an intensity when illuminated by the one or more limited spectral bands.
  • the tissue may be identified as abnormal tissue diseased or physically damaged) based on the vary ing intensity of the tissue.
  • an orientation of the identified tissue may be determined based on an intensity of the tissue corresponding to a rotational position of the rotating linearly -polarized light, and relative to the varying intensity of the tissue.
  • the tissue may be identified by calculating 112 frequency spectra of the time series of images obtained from the image sensor; and determining 115 pixels corresponding to the tissue based on a peak amplitude of a frequency corresponding to the tissue.
  • the tissue is identified by removing 118 an offset from a set of time series values of a pixel to generate a centered signal for the pixel; mixing 121 a reference signal with the centered signal for the pixel; shifting 124 the phase of the reference signal and/or the centered signal to determine a phase-locked signal; and calculating 127 an average value of the phase-locked signal.
  • the method 100 may further include generating 130 an image mask based on image pixels corresponding to the identified tissue.
  • An image or a series of images may be altered 133 using the generated 130 image mask. Altering 133 the image or series of images includes one or more of increasing an intensity of an unmasked portion of the image, drawing a boundary line around an unmasked portion of the image, changing a color of an unmasked portion of the image, and animating an unmasked portion of the image.
  • a highlight may be projected on the region of interest based on the identified tissue.
  • augmented reality information may be provided to a wearable display. For example, the augmented reality information may be a highlight overlaying the region of interest based on the identified tissue.
  • the present disclosure may be embodied as a non-transitory computer-readable medium having stored thereon a program for instructing a processor to: illuminate a region of interest with a rotating linearly -polarized light; obtain a series of images of the region of interest using an image sensor via an analyzer rotating synchronously with the linearly -polarized light such that the light received by the image sensor is cross polarized; and identify a tissue within the region of interest based on an intensity of one or more pixels of the series of images varying according to the polarization angle of the rotating linearly -polarized light.
  • the method include detecting a surgical instrument within the field of view (e.g., near the region of interest).
  • the method may include generating an alert when the surgical instrument approaches the identified tissue (e.g., nerve tissue).
  • the identified tissue e.g., nerve tissue
  • an audible alarm may be sounded, a visible indicator may be displayed, and/or haptic feedback may be provided to an operator (e.g., a surgeon or assistant).
  • an indicator may be displayed within augmented reality goggle.
  • an ambient light or a light illuminating the surgical field may change color to indicate proximity to the identified tissue.
  • Image processing may be performed within a device according to the above disclosure (e.g., a wearable device) or may be performed separate from the device.
  • the processor may be within an operating room where the XPI system is being used, and the image processing may be performed using this in-room processor.
  • the processor may be located within a same building or campus, or may be a cloud processor.
  • the processor may communicate with the image sensor via wired and/or wireless communication.
  • the processor identifies a tissue using inter-frame subtraction and averaging. For example, with reference to Figure 11, from the intensity plots of different tissues in a region of interest illuminated by amber light, it can be seen that although all the tissues have some amount of variance in reflective intensity relating to polarization angle, the nerve tissue has the greatest variance and is the most sinusoidal. Inter-frame processing can be applied to extract the variance, followed by averaging to obtain a stabilized signal. A threshold is then applied, where the threshold is configured such that only nerve tissue signal remains. In this way, nene tissue may be identified by the processor.
  • the nerve tissue has the highest value, and may be identified by using a threshold. In this way a binary mask can be made and/or the data corresponding to the identified tissue may be exploited.
  • Figure 20 shows the results of nerve tissue identification using an inter-frame calculation as described in this section.
  • the inter-frame calculation was performed using 88 frames extracted from a rotating XPI video of a sample.
  • Figures 20(b) and 20(c) are the normalized gray scaled and false color image of the calculation result — the high intensity area indicates the existence of exposed nerve tissue, while low intensity portions are other tissues.
  • a binary mask can also be generated by thresholding the frame calculation results and then applied back to the original image resulting in the image shown in Figure 20(d).
  • the intensity plots of some tissues will vary periodically over the time series of images obtained by the processor (periodic intensities in the time domain). FFT was applied to the intensity profiles of different tissue types and differences in the frequency domain were observed.
  • time domain plots of five types of tissue were obtained and are shown on the left side of Figure 13. FFTs of these time domain data were calculated and are shown on the right side of Figure 13.
  • Each of the frequency domain plots in the experimental embodiment had a peak at a common frequency (related to the rotational speed of the crossed polarizers — e.g., four peaks per 360° rotation).
  • the vein, fat, and muscle tissue show other peaks in the frequency spectrum as well. It was noted that the nerve tissue shows the strongest peak at the common frequency as compared to the others. This allows the use of a threshold in order to differentiate nerve tissue from other tissues.
  • the processor is programmed to identify a tissue using an FFT technique.
  • the processor identifies a tissue by determining a frequency spectra of some or all of pixels of the time series of images.
  • An exemplary embodiment is shown in Figure 14. A relatively large number of frames was used to generate a time domain plot for each selected pixel. An FFT is performed for each of the selected pixels to determine the frequency spectrum for each. It should be noted that the data need not be plotted (visualized, graphed, etc. in either the time domain or frequency domain.
  • an amplitude is determined at the common frequency peak.
  • a threshold amplitude is set to determine which pixels correspond to a tissue of interest (e.g., a nerve tissue).
  • the FFT approach reveals a true frequency domain property of the tissues under a rotating XPI system, and this approach is less dependent on the light source used.
  • the pixels determined to correspond with the desired tissue can be used to, for example, create an image mask, such as a binary mask. It should be noted that, while the approach has been described as acting pixel-by-pixel, it may be performed on a subset of pixels. For example, the approach may be performed on every second pixel, every third pixel, every fourth pixel, every fifth pixel, etc. or other subsets, patterned or not patterned. In some embodiments, once the subset of pixels has been processed, the processor may be configured to analyze additional pixels. For example, the above pattern may be filled in to analyze additional pixels according to the pattern. In another example, additional pixels are analyzed between pixels which have been determined to be different from each other. In this way, the edges of each tissue can be determined.
  • an image mask such as a binary mask.
  • phase-sensitive detection may be used to resolve a tissue signal in the obtained series of images. This approach can be used to select the signal of varying intensity reflected from the desired tissue — e.g.. nerve tissue.
  • a mean value of the time domain series of the pixel is calculated and then subtracted from each value of the pixel. In this way, the time series data of the pixel are re-centered around a 0 value (e.g., an offset is removed).
  • a reference signal is generated having a frequency based on the known rotational speed of the polarization. The reference signal may alternate between values of -1 and 1 (as shown in Figures 15A-15C). Other reference signals suitable for use with lock-in amplification can be used.
  • the reference signal is mixed (z.e., multiplied) with the time series pixel data, and a phase of the reference signal is varied relative to the frames of the image data (e.g., the phase of the reference signal may be adjusted, the time series data may be shifted, or both) to lock-in the desired signal.
  • the signal is locked-in at the phase shift which maximizes the average value of the mixed time series data.
  • a tissue of interest can then be selected based on the average value of the locked-in signal. For example, because nerve tissue has been found to exhibit the largest variance due its polarization- related properties (e.g. birefringence, etc.), nerve tissue will show the highest average values for its locked-in signal (see, for example, Table 1).
  • Table 1 Average value of lock-in signals for varying tissue and (for nerve tissue) varying phase offset.
  • the orientation of some tissues may be determined. For example, knowing the peak reflective intensity of nerve tissue appears at when the polarization is at 45 degrees to the longitudinal axis of the nerve, the orientation of the nerve can be determined based on the reference signal phase offset.
  • inter-frame calculation can be advantageous for realtime practice since it skips the step of transferring the video frames into arrays of pixel values, and the nerve can be recognized by direct frame calculating and thresholding out the periodic varying signals.
  • Figure 21 shows a rotating XPI system used for preliminary real-time testing.
  • the example system used for the real-time experiments included a grayscale webcam (recording at 30 fps and display in real-time) connected to a laptop computer and a motor operating at 20 rpm.
  • the processing technique used for the experiments is shown in the flow chart at the right side of Figure 21.
  • Figure 23 shows the final output video at the same five times. The position of the nen e is highlighted throughout these frames by the calculated binary mask. During the experiment, the resulting video was able to be displayed on a monitor with a delay of approximately 0.5 s from the acquisition of the original rotating XPI video.
  • a cadaver arm study was also conducted to show the feasibility of the processing methods described above. Firstly, a dissection on the volar side of the upper left arm was performed by a surgeon, exposing the region of interest, a small branch of the median nerve surrounded by other tissues and covered by a thin fat later ( Figure 26(a)). Due to the similar colors of the nerve and the surrounding tissues, the nerve bundle cannot be seen clearly, which might lead to accidental injury of the nerve if further dissection is performed.
  • a multispectnal XPI System with a 460 nm source to acquire videos for further processing.
  • Frames from the rotating XPI video were processed using the inter-frame calculation technique described above.
  • Figure 26(b) shows a frame with the highlighted nerve obtained using frame calculation and applying a resulting red mask to the original nerve image.
  • the nerve bundle was mostly covered, and the nearby fat tissues were relatively dark in the 460 nm illumination.
  • a grayscale image and false color image of result from the video lock-in processing method are shown in Figures 26(c) and 26(d), respectively, from which it can be seen that the nerve tissue stands out clearly from the background tissues. In this instance, the nerve was located several hundred microns below other tissue. The ability to differentiate the nerve at different depths was studied using linearly tapered fat wedge.
  • nerve identification was performed using the three types of video frame processing methods and based on a large amount of data.
  • the vary ing intensities w ere directly extracted from the high speed (240 fps) recorded video, which can bring heavy loads to the data saving and processing procedures.
  • the nerve tissue shows a sine wave-like intensity profile under rotating XPI
  • the vary ing intensity profiles of the nerve tissue can be fitted out from a reduced number of data points.
  • the sine wave can be described in the equation: where x is the number of frames, y is the value of intensity, and f is a known frequency value which shows the speed of the rotation of the XPI system.
  • coefficient b shows the phase of the intensity curve
  • coefficient c shows the average intensity value
  • coefficient a indicates how the periodic variation goes.
  • Table 2 the combinations of data points chosen in different equidistance and the output coefficient a value for different types of tissue.
  • Table 3 the combinations of data points chosen in different phase and the output coefficient a value for different types of tissue.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Surgery (AREA)
  • Engineering & Computer Science (AREA)
  • Molecular Biology (AREA)
  • Public Health (AREA)
  • Physics & Mathematics (AREA)
  • Veterinary Medicine (AREA)
  • Pathology (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • General Health & Medical Sciences (AREA)
  • Animal Behavior & Ethology (AREA)
  • Biophysics (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Radiology & Medical Imaging (AREA)
  • Optics & Photonics (AREA)
  • Gynecology & Obstetrics (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Neurology (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Vascular Medicine (AREA)
  • Signal Processing (AREA)
  • Investigating Or Analysing Materials By Optical Means (AREA)

Abstract

L'invention concerne des systèmes et des procédés pour identifier automatiquement des tissus à l'aide d'une imagerie, et plus particulièrement des systèmes et des procédés utilisant une imagerie polarimétrique pour l'identification de tissu en temps réel. Un système d'identification des tissus comprend une source lumineuse pour éclairer une région d'intérêt avec une lumière polarisée, un capteur d'images pour acquérir des images de la région d'intérêt, au moins un analyseur disposé dans le champ de vue du capteur d'images, et un processeur configuré pour obtenir une série d'images de la région d'intérêt acquises en utilisant plus d'un angle de polarisation. Un tissu est identifié dans la région d'intérêt sur la base d'une intensité d'un ou de plusieurs pixels de la série d'images.
EP23847679.0A 2022-12-12 2023-12-12 Imagerie polarimétrique multispectrale en temps réel pour identification non invasive de nerfs et d'autres tissus Pending EP4633454A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US202263387089P 2022-12-12 2022-12-12
PCT/US2023/083680 WO2024129766A1 (fr) 2022-12-12 2023-12-12 Imagerie polarimétrique multispectrale en temps réel pour identification non invasive de nerfs et d'autres tissus

Publications (1)

Publication Number Publication Date
EP4633454A1 true EP4633454A1 (fr) 2025-10-22

Family

ID=89723241

Family Applications (1)

Application Number Title Priority Date Filing Date
EP23847679.0A Pending EP4633454A1 (fr) 2022-12-12 2023-12-12 Imagerie polarimétrique multispectrale en temps réel pour identification non invasive de nerfs et d'autres tissus

Country Status (4)

Country Link
EP (1) EP4633454A1 (fr)
JP (1) JP2025541532A (fr)
KR (1) KR20250124335A (fr)
WO (1) WO2024129766A1 (fr)

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7460248B2 (en) * 2006-05-15 2008-12-02 Carestream Health, Inc. Tissue imaging system
EP3254234A4 (fr) * 2015-02-06 2018-07-11 The University of Akron Système d'imagerie optique et procédés associés
WO2020180755A1 (fr) * 2019-03-01 2020-09-10 Sri International Appareils et procédés impliquant une imagerie multimodale d'un échantillon

Also Published As

Publication number Publication date
WO2024129766A1 (fr) 2024-06-20
JP2025541532A (ja) 2025-12-18
KR20250124335A (ko) 2025-08-19

Similar Documents

Publication Publication Date Title
AU2019203346B2 (en) Optical detection of skin disease
RU2718427C2 (ru) Система цифровой патологии
Wisotzky et al. Intraoperative hyperspectral determination of human tissue properties
KR101699812B1 (ko) 조직 표면의 형태를 탐지하는 방법 및 시스템
US20090043363A1 (en) Method and apparatus for measuring skin texture
JP2016526185A (ja) 構造化照明を用いた組織試料の顕微鏡観察
Yang et al. Structured polarized light microscopy for collagen fiber structure and orientation quantification in thick ocular tissues
KR101819602B1 (ko) 촬영 장치
WO2015120020A1 (fr) Appareil et procédés pour scatteroscopie à lumière structurée
MXPA01009449A (es) Sistema y metodo para calibrar un espectrofotometro formador de imagen reflejada.
US20190247142A1 (en) Image processing method and apparatus using elastic mapping of vascular plexus structures
Cha et al. Multispectral tissue characterization for intestinal anastomosis optimization
Leon et al. Hyperspectral imaging for in-vivo/ex-vivo tissue analysis of human brain cancer
EP4633454A1 (fr) Imagerie polarimétrique multispectrale en temps réel pour identification non invasive de nerfs et d'autres tissus
Mieites et al. PoLambRimetry: a multispectral polarimetric atlas of lamb brain
Liao et al. Polarimetric imaging of peripheral nerves: an intraoperative aid
Pruitt et al. A dual-camera hyperspectral laparoscopic imaging system
Tran et al. Nerve detection and visualization using hyperspectral imaging for surgical guidance
Squiers et al. Multispectral imaging burn wound tissue classification system: a comparison of test accuracies between several common machine learning algorithms
Yang et al. Color structured light imaging of skin
Kanamori Averaged subtracted polarization imaging for endoscopic diagnostics of surface microstructures on translucent mucosae
JP2000506982A (ja) 可動物の、干渉計に基づくスペクトル結像方法
Pigula et al. Video-rate dual polarization multispectral endoscopic imaging
Medievsky et al. Use of a NIR camera and laser-based illumination to improve the visibility of blood vessels in a surgical wound during massive bleeding
Kawasaki et al. Improvement of optical setup for microcirculation imaging and flow analysis in septic shock rats

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20250710

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC ME MK MT NL NO PL PT RO RS SE SI SK SM TR

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)