EP4137866A1 - Microscope numérique et procédé de capture et d'affichage d'images microscopiques - Google Patents

Microscope numérique et procédé de capture et d'affichage d'images microscopiques Download PDF

Info

Publication number
EP4137866A1
EP4137866A1 EP21191927.9A EP21191927A EP4137866A1 EP 4137866 A1 EP4137866 A1 EP 4137866A1 EP 21191927 A EP21191927 A EP 21191927A EP 4137866 A1 EP4137866 A1 EP 4137866A1
Authority
EP
European Patent Office
Prior art keywords
geometric dimension
microscopic images
images
capturing
visual information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP21191927.9A
Other languages
German (de)
English (en)
Inventor
Alexander Gaiduk
Jin Young Sohn
Cheong Soo Seo
Gyoungil CHO
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Carl Zeiss Microscopy GmbH
Sd Optics Inc
Stereo Display Inc
Original Assignee
Carl Zeiss Microscopy GmbH
Sd Optics Inc
Stereo Display Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Carl Zeiss Microscopy GmbH, Sd Optics Inc, Stereo Display Inc filed Critical Carl Zeiss Microscopy GmbH
Priority to EP21191927.9A priority Critical patent/EP4137866A1/fr
Priority to US17/860,794 priority patent/US20230055287A1/en
Priority to CN202210852427.9A priority patent/CN115708007A/zh
Publication of EP4137866A1 publication Critical patent/EP4137866A1/fr
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
    • G02B21/365—Control or image processing arrangements for digital or video microscopes
    • G02B21/367—Control or image processing arrangements for digital or video microscopes providing an output produced by processing a plurality of individual source images, e.g. image tiling, montage, composite images, depth sectioning, image comparison
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/0004—Microscopes specially adapted for specific applications
    • G02B21/0016—Technical microscopes, e.g. for inspection or measuring in industrial production processes
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/06—Means for illuminating specimens
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0075—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for altering, e.g. increasing, the depth of field or depth of focus
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G06T7/593—Depth or shape recovery from multiple images from stereo images
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B3/00—Simple or compound lenses
    • G02B3/12—Fluid-filled or evacuated lenses
    • G02B3/14—Fluid-filled or evacuated lenses of variable focal length
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10056—Microscopic image

Definitions

  • the present invention concerns a method for capturing and displaying microscopic images of a sample to be microscopically examined using a digital microscope.
  • the microscopic images comprise enhanced visual information in a third geometric dimension such as images with an extended depth of field (EDoF) or three-dimensional images. These microscopic images are captured and displayed live.
  • EDOF extended depth of field
  • the present invention concerns a digital microscope.
  • US 2005/0057812 A1 shows a variable focus system that includes an electrovariable optic and a controller operatively configured for changing the focal configuration of the electrovariable optic.
  • the electrovariable optic includes a plurality of movable optical elements for changing the focal length of the electrovariable optic or the direction of the focal axis of the electrovariable optic.
  • the variable focus system may be used in conjunction with an image source to construct a 3D floating image projector that projects a series of 2D image.
  • US 2014/0368920 A1 shows micro-mirror arrays that are configured for use in a variable focal length lens.
  • the variable focal length lens comprises a micro-mirror array having a plurality of micro-mirror element arranged in at least a first section and a second section.
  • the DE 10 2017 107 489 B3 is related to a microscope assembly for the three-dimensional capture of a sample to be microscopically examined and for the display of three-dimensional images of the sample under the microscope.
  • the microscope assembly comprises an image capture unit for obtaining photographs of the sample and an image processing unit for generating three-dimensional images of the sample from the photographs.
  • WO 2007/134264 A2 shows a three-dimensional imaging system with a variable focal length micromirror array lens.
  • the micro mirror array lens comprises a plurality of micromirrors, wherein each of the micromirrors is controlled to change the focal length of the Micromirror Array Lens.
  • the imaging system further comprises an optical unit and an image processing unit which produces three-dimensional image data using the images captured by the optical unit and the focal length information of the Micromirror Array Lens.
  • US 2017/0061601 A1 teaches a method for defining operations for acquiring a multi-exposure image of a workpiece including first and second regions of interest at different Z heights.
  • the multi-exposure image is acquired by a machine vision inspection system including strobed illumination and a variable focal length lens used for periodically modulating a focus position.
  • US 2012/0050562 A1 shows a digital imaging system being configured for synthesizing an image of a plenoptic optical device.
  • the plenoptic optical device comprises a photosensor array with a plurality of photosensors arranged in a predetermined image plane. Further, the plenoptic optical device comprises a microlens array with a plurality of microlenses arranged for directing light from an object to the photosensor array.
  • KR 1020180076466 A shows an inspection apparatus which comprises a socket belt transferring a plurality of objects and a plurality of inspection modules arranged along the socket belt.
  • EP 3 486 706 A1 concerns a functional module for a microscope.
  • the functional module comprises an image sensor and two microelectromechanical optical systems for enhancing a depth of field on two optical subpaths.
  • US 2013/0321927 A1 teaches a system with a lens that shows a tuneable acoustic gradient index of refraction. This system permits a dynamic selection of the lens output including dynamic focusing and imaging.
  • An object of the present invention is to allow a user-friendly and efficient workflow for capturing and displaying microscopic images with enhanced visual information in a third geometric dimension such as images with an extended depth of field (EDoF) or three-dimensional images.
  • EDOF extended depth of field
  • the aforementioned object is achieved by a method according to the enclosed claim 1 and by a digital microscope according to the enclosed claim 15.
  • the method according to the invention aims at capturing and displaying microscopic images of a sample to be microscopically examined using a digital microscope.
  • the third geometric dimension lies preferably in an optical axis used for capturing the microscopic images.
  • this third geometric dimension is preferably a depth of the sample.
  • Regular two-dimensional images comprise visual information of the sample in a first geometric dimension and a second geometric dimension.
  • the first geometric dimension and the second geometric dimension are usually width and height.
  • the visual information in the first geometric dimension and the visual information in the second geometric dimension arise from a two-dimensional object plane.
  • the enhanced visual information in the third geometric dimension arises from different object planes, especially, from an object volume.
  • the third dimension is preferably perpendicular to the first dimension and preferably perpendicular to the second dimension.
  • the method allows configuring a digital microscope in order to capture and to display the enhanced microscopic images of the sample. This configuring can be done user-friendly and efficiently by a user of any level of education and preparation.
  • the method comprises a step of capturing a sequence of microscopic images with the enhanced visual information in the third geometric dimension.
  • This sequence of microscopic images is preferably captured live.
  • a frame rate of the sequence of microscopic images is preferably at least one image per second and, more preferably, at least 10 images per second. The skilled person can easily adopt other suitable frame rates.
  • the sequence of the microscopic images is displayed while it is captured. Hence, each of the microscopic images is displayed immediately after it has been captured.
  • a delay of displaying one of the microscopic images after its capturing is preferably less than one second and, more preferably, less than 0.1 second.
  • the sequence of microscopic images is preferably displayed live.
  • the sequence of microscopic images is preferably displayed at a graphical user interface.
  • the method comprises a step of determining a capturing range in the third geometric dimension depending on an extent of an area of interest of the sample. This determination is preferably done automatically during an initiation of a microscopic examination of the sample.
  • the area of interest of the sample is along the whole extent of the sample in the third dimension and, therefore, the initial capturing range in the third geometric dimension equals to the extent of the sample in the third geometric dimension.
  • the area of interest of the sample is determined by a user input at the graphical user interface.
  • the area of interest of the sample is determined automatically by image data processing of the captured microscopic images.
  • the determined initial capturing range in the third geometric dimension can be named as initial experiment z-range "expZrange" since the microscopic inspection as it is expected in the third dimension will experimented in this range in the third geometric dimension.
  • the enhanced visual information in the third geometric dimension will be captured in this capturing range. For this, properties and parameters of the microscope will be chosen in order to ensure that the enhanced visual information in the third geometric dimension can be captured in this capturing range.
  • a visual representation of the capturing range of the third geometric dimension is displayed at the graphical user interface of the digital microscope.
  • the visual representation represents the capturing range including its lower limit and its upper limit.
  • a user can visually recognize the capturing range in the third geometric dimension.
  • the user can visually recognize how large this range is.
  • the user can visually recognize the limits of this range.
  • This visual representation of the capturing range is displayed in order to allow the user to input at least one adjustment of this range.
  • At least the lower limit of the capturing range and the upper limit of the capturing range are adjustable at the graphical user interface.
  • the at least one adjustment is preferably a limitation, an expansion or a shifting of the capturing range.
  • the at least one adjustment results in an adjusted lower limit of the capturing range and/or an adjusted upper limit of the capturing range.
  • the user inputs this at least one adjustment at the graphical user interface.
  • the user input that defines the at least one adjustment of the capturing range in the third geometric dimension is received. This results in an adjusted capturing range in the third geometric dimension.
  • the received user input is electronically processed.
  • the visual representation of the capturing range is refreshed while the user inputs the modification. Hence, a visual representation of the adjusted capturing range is displayed.
  • At least one parameter of detecting visual information in the third geometric dimension is adjusted according to the adjusted capturing range in the third geometric dimension.
  • this at least one parameter is adjusted according to the received user input.
  • This at least one parameter is adjusted at least according to the adjusted lower limit of the capturing range and/or the adjusted upper limit of the capturing range.
  • the at least one parameter defines how the visual information in the third geometric dimension is captured and/or processed and/or displayed.
  • the at least one parameter effects the extent and/or quality of the visual information in the third geometric dimension.
  • at least two parameters of detecting visual information in the third geometric dimension are adjusted according to the adjusted capturing range. More preferably, at least four parameters of detecting visual information in the third geometric dimension are adjusted according to the adjusted capturing range.
  • capturing the sequence of the microscopic images with the enhanced visual information in the third geometric dimension is continued applying the at least one adjusted parameter.
  • displaying the sequence of microscopic images is continued.
  • the at least one adjusted parameter is applied when capturing and/or processing and/or displaying the microscopic images of the sequence of microscopic images with the enhanced visual information in the third geometric dimension after the user has input the at least one adjustment of the range in the third geometric dimension.
  • a special benefit of the method according to the invention is that the user can easily control the capturing and displaying of the microscopic images with enhanced visual information in the third geometric dimension such as images with an extended depth of field (EDoF) or three-dimensional images.
  • the user has to adjust the range of the third geometric dimension as it is necessary for the inspection of the sample, wherein further parameters for capturing and/or processing and/or displaying the microscopic images are adjusted automatically depending on that user input.
  • the user has to input the adjustment of the capturing range as the only quantitative parameter that influences the capturing, processing, and displaying of the microscopic images.
  • the graphical user interface allows the adjustment of the capturing range as the only quantitative parameter that is adjustable.
  • the images with the enhanced visual information in the third geometric dimension are images with an extended depth of field (EDoF) or 2.5-dimensional images or three-dimensional images.
  • the images with an extended depth of field are preferably completely in focus. These images can be named as all-in-focus images.
  • the images with an extended depth of field are preferably completely sharp.
  • the depth of the images with an extended depth of field is increased by a factor of preferably at least 5 and more preferably at least 10.
  • the 2.5-dimensional images comprise information in the third geometric dimension that is not complete as the visual information in the first and second geometric dimensions.
  • the thee-dimensional images comprise complete visual information in the first, second, and third geometric dimensions.
  • the least one parameter of detecting visual information in the third geometric dimension is preferably a selection of an objective of a set of exchangeable objectives, an optical magnification of an objective, a step size in the third geometric dimension, a number of steps in the third geometric dimension, a number of images per stack, a field of view, an illumination setting, an illumination condition, an option for an automatic correction of reflexes, an option for an automatic telecentric correction, a rate of images per second, a rate of volumes per second, a depth quality threshold, a smoothing index, an index of a pixelwise iteration, a depthwise kernel size, a value of a bilateral sigma colour, a value of a bilateral sigma space; a resize ratio, a number of threads, a spectral range of an illumination, a frequency of a stroboscopic illumination, an acquisition time, a selection of rings of illumination, a selection of a coaxial illumination, an exposure time, a mode of white balance, and/or a camera gain.
  • the at least one parameter of detecting visual information in the third geometric dimension is preferably a step size in the third geometric dimension, a number of steps in the third geometric dimension, an acquisition time, and/or a camera gain. More preferably, the parameters of detecting visual information in the third geometric dimension are a step size in the third geometric dimension, a number of steps in the third geometric dimension, an acquisition time, and a camera gain.
  • an available range in the third geometric dimension is determined based on properties of the used digital microscope.
  • the enhanced visual information in the third geometric dimension is available in the available range by using the digital microscope in its current configuration.
  • the enhanced visual information in the third geometric dimension can be captured in the available range by using the digital microscope in its current configuration.
  • This available range in the third geometric dimension can be named as maximum z-range "MaxZrange” since it is a maximum range, in which the enhanced visual information in the third geometric dimension can be captured.
  • This available range in the third geometric dimension is determined based on the properties of the digital microscope in its current configuration, wherein these properties preferably comprise a present magnification, especially, an optical magnification of an objective of the microscope. This magnification is preferably determined automatically by detecting the present objective, e. g. a selected one of a set of exchangeable objectives.
  • the properties of the digital microscope to be used for determining the available range preferably comprise further measures and parameters such as a focal length, an illumination, and/or an aperture.
  • the visual representation of the capturing range in the third geometric dimension is an inner bar.
  • the inner bar is located within an outer bar.
  • the outer bar visually represents the available range in the third geometric dimension.
  • the user can easily perceive in which quantitative relation the capturing range stands to the available range.
  • the upper limit and the lower limit of the capturing range are visually emphasized by extended lines at the ends of the inner bar.
  • a centre of the capturing range is visually emphasized by an extended line across the inner bar. The centre of the capturing range is preferably determined based on a position of an actuator of an apparatus for gathering the enhanced visual information in the third geometric dimension.
  • the inner bar is preferably refreshed while the user inputs the adjustments of the capturing range. Hence, the inner bar permanently represents the modified capturing range in its current status.
  • the method comprises a further step that is an initial step for configuring the digital microscope before the sample is microscopically examined by the user.
  • parameters of capturing and/or displaying the microscopic images with the enhanced visual information in the third geometric dimension are automatically determined. This determination is preferably based on recognized characteristics of the sample to be microscopically examined. These characteristics preferably comprise an extent of the sample in the third geometric dimension.
  • the parameters of capturing and/or displaying the images with the enhanced visual information in the third geometric dimension to be automatically determined preferably comprise a step size in the third geometric dimension, a number of steps in the third geometric dimension, a number of images per stack, a selection of an objective of a set of exchangeable objectives, an optical magnification of an objective, an illumination, a spectral range of an illumination, a frequency of a stroboscopic illumination, an acquisition time and/or a camera gain.
  • the objective of the set of exchangeable objectives is preferably selected as its field of view fits to a size of the sample to be microscopically examined or to the area of interest.
  • the objective of the set of exchangeable objectives is preferably selected as it suitable for capturing of enhanced visual information in a third geometric dimension in the initial capturing range.
  • the determined parameter of illumination preferably defines a maximum of the illumination.
  • the determined acquisition time preferably defines a minimum of the acquisition time in order to ensure fastest acquisition.
  • the determined camera gain ensures optimal sample illumination and/or a low degree of overexposed and underexposed areas of the sample as well as appropriate noise.
  • the named parameters preferably ensure an auto-exposure process.
  • a number of images per stack is determined initially. As an example, this number is 10 images per stack.
  • Preferred embodiments of the method comprise further steps for defining an illumination by the user.
  • a visual representation of an available exposing range is displayed at the graphical user interface. That available exposing range ranges from a minimally available exposure to a maximally available exposure of the sample.
  • a further user input is received that defines a selected exposing range that ranges from a minimally applicable exposure to a maximally applicable exposure of the sample.
  • the selected exposing range is a subset of the available exposing range.
  • the selected exposing range is visually represented at the graphical user interface as an inner bar. This inner bar is in an outer bar.
  • the outer bar visually represents the available exposing range.
  • the inner bar is preferably refreshed after the user input.
  • the sample is illuminated by an illumination in the selected exposing range.
  • the method according to the invention is suitable for a live investigation of a sample to be microscopically analysed.
  • the displayed microscopic images are watched live by the user.
  • the user can move the sample and/or move optics.
  • this mode of investigation can be named as “live” mode or "navigation” mode.
  • Preferred embodiments offer a further mode of investigation.
  • single microscopic images are captured and displayed as a still image.
  • This mode can be named as "snap" mode.
  • a toggle button is displayed at the graphical user interface. The user can toggle between the "live” mode and the "snap” mode. A user input of toggling the toggle button is received. After this, microscopic images are captured and displayed according to the selected mode of investigation.
  • Preferred embodiments of the method comprise steps for selecting a mode of capturing the microscopic images.
  • a first menu is displayed at the graphical user interface.
  • the first menu comprises at least two menu items.
  • Each of the menu items stands for a mode of capturing microscopic images.
  • the modes describe the technical manner and/or technical parameters of capturing the microscopic images.
  • the modes preferably describe the capturing of two-dimensional microscopic images, auto-focused two-dimensional images or microscopic images with enhanced visual information in the third geometric dimension. At least one of the modes describes capturing of microscopic images with enhanced visual information in the third geometric dimension.
  • the user selects the required mode by choosing the corresponding menu item.
  • a user input of selecting one of the menu items of the first menu is received. After this, the microscopic images are captured according to the selected mode.
  • FIG. 1 A second menu is displayed at the graphical user interface.
  • the second menu comprises at least two menu items. At least one of the menu items stands for a mode of displaying the microscopic images with enhanced visual information in the third geometric dimension. This at least one mode describes the technical manner and/or technical parameters of displaying the microscopic images with enhanced visual information in the third geometric dimension.
  • the user selects the required mode by choosing the corresponding menu item.
  • a user input of selecting one of the menu items of the second menu is received. After this, the microscopic images are displayed according to the selected mode.
  • the at least one mode of displaying the microscopic images with enhanced visual information in the third geometric dimension represented by one of the menu items of the second menu is preferably a mode of displaying the microscopic images with enhanced visual information in the third geometric dimension as images with an extended depth of field (EDoF).
  • EDOF extended depth of field
  • the at least one mode of displaying the microscopic images with enhanced visual information in the third geometric dimension represented by one of the menu items of the second menu is preferably a mode of displaying the microscopic images with enhanced visual information in the third geometric dimension as a heightmap.
  • the at least one mode of displaying the microscopic images with enhanced visual information in the third geometric dimension represented by one of the menu items of the second menu is preferably a mode of displaying the microscopic images with enhanced visual information in the third geometric dimension as a 2.5-dimensional image or as a three-dimensional image.
  • Such images can also be named as topographic images. Hence, this mode can be named as "topo" mode.
  • the second menu comprises at least one of the menu items that stand for a mode of displaying further microscopic images with enhanced visual information in the third geometric dimension as at least one still image.
  • a mode can be named as a "snap" mode.
  • This mode is preferably a mode of displaying the further microscopic images with enhanced visual information in the third geometric dimension as at least one still image with an extended depth of field (EDoF).
  • EDOF extended depth of field
  • it is a mode of displaying the further microscopic images with enhanced visual information in the third geometric dimension as a 2.5-dimensional still image or as a three-dimensional still image.
  • the further microscopic images with enhanced visual information in the third geometric dimension are preferably stored for later processing.
  • the second menu is not necessary since a mode of displaying is selected automatically.
  • a mode of displaying the microscopic images with enhanced visual information in the third geometric dimension as images with an extended depth of field (EDoF) is preferably selected automatically if the user uses a two-dimensional display for watching the microscopic images.
  • a mode of displaying the microscopic images with enhanced visual information in the third geometric dimension as 2.5-dimensional images or as three-dimensional images is preferably selected automatically if the user uses a 2.5-dimensional display or a three-dimensional display for watching the microscopic images.
  • the 2.5-dimensional display or the three-dimensional display is preferably a 3D stereo display or 3D glasses.
  • a further option is displayed at the graphical user interface.
  • This option can be displayed as a single button or as a third menu at the graphical user interface.
  • This option stands for a mode of displaying the microscopic images with enhanced visual information in the third geometric dimension as images showing an extended depth of field and/or showing a focused area, wherein the extended depth of field and the focused area, respectively, are at least present in at least one region of interest.
  • This embodiment is inspired by the analogy with human vision. This embodiment results in a reduced field of view since parts of the images outside the region of interest are not necessarily displayed with an extended depth of field and as focused areas, respectively.
  • the region of interest is preferably selected automatically by tracking an eye of the user.
  • the region of interest is preferably selected by the user at the graphical user interface.
  • a special benefit of this preferred embodiment is a high frame rate that it can offer. The reduction to the region of interest allows displaying the extended depth of field and/or the focused visual information at a higher rate.
  • This frame rate is preferably at least 10 images per second and more preferably at least 25 images per second.
  • Displaying the microscopic images with enhanced visual information in the third geometric dimension as microscopic images that show a focused area in the region of interest is in accordance with an alternative "live" mode.
  • That mode can be preferably configured as a "fast focus” mode or as a "very fast focus” mode.
  • the region of interest will be set in focus in a short time that is preferably less than 200 ms after the user has chosen the region of interest, e. g. by moving to the this region of the sample or by moving a pointer at the graphical user interface to the region of interest.
  • the user moves the sample to the region of interest and leaves the region of interest unchanged.
  • the user combines a movement of the sample and a movement of the pointer at the graphical user interface.
  • Displaying the microscopic images with enhanced visual information in the third geometric dimension as images showing an extended depth of field in the region of interest is in accordance with an alternative "live" mode.
  • That mode can be preferably configured as a "fast EDoF” mode.
  • a stack of microscopic images is captured and processed.
  • the extended depth of field is present in the region of interest, whereas areas around the region of interest can contain image information that is not in focus what is similar to human vision.
  • the position of the region of interest can be controlled by the user at a volume rate that is preferably between 10 and 30 volumes per second.
  • Displaying the microscopic images with enhanced visual information in the third geometric dimension as microscopic images that show an extended depth of field and a focused area in the at least one region of interest is in accordance with an alternative "live" mode. That mode can be preferably configured as a "fast focus and fast EDoF" mode.
  • the microscopic images with enhanced visual information in the third geometric dimension are displayed as microscopic images that show an extended depth of field and a focused area in more than one region of interest at once.
  • a third menu is displayed at the graphical user interface.
  • This third menu comprises at least two menu items.
  • One of the menu items stands for a mode of displaying the microscopic images with enhanced visual information in the third geometric dimension as images showing a focused area in a region of interest.
  • This mode can be a "fast focus” mode or a "very fast focus” mode.
  • one of the menu items stands for a mode of displaying the microscopic images with enhanced visual information in the third geometric dimension as images showing an extended depth of field in a region of interest.
  • This mode can be a "fast EDoF" mode.
  • one of the menu items stands for a mode of displaying the microscopic images with enhanced visual information in the third geometric dimension as images showing an extended depth of field and a focused area, wherein the extended depth of field and the focused area are at least present in at least one region of interest.
  • This mode can be a "fast focus and fast EDoF" mode.
  • a tool for measuring the sample is offered to the user.
  • This tool is especially offered in the "live” mode or in the alternative "live” mode.
  • the tool for measuring is presented at the graphical user interface.
  • the tool is preferably presented in form of graphical pointers in the displayed microscopic images.
  • the user uses this tool resulting in a user input. This user input on that tool is received.
  • Geometric data are determined by image data processing of the captured sequence of the microscopic images with the enhanced visual information in the third geometric dimension.
  • parameters of the microscope such as an optical magnification of an objective and a position of a sample table of the microscope are additionally used for transforming the captured sequence of the microscopic images into the geometric data.
  • the geometric data describe the sample.
  • the geometric data preferably describe an extent of the sample in the three dimensions.
  • the user input is applied to the geometric data in order to calculate a measure of the sample. This is the measure that was requested by the user using the tool, e. g. by setting two pointers at the displayed microscopic images of the sample.
  • the measure is preferably a distance between two points at the sample.
  • the calculated measure is output at the graphical user interface, especially as a value.
  • the microscope according to the invention is a digital microscope, in which microscopic images are captured electronically and processed digitally.
  • the digital microscope is configured for capturing microscopic images of a sample to be microscopically examined.
  • the digital microscope comprises an objective for gathering light from the sample to be microscopically examined.
  • the objective comprises at least one optical lens.
  • the objective preferably comprises a plurality of the optical lenses.
  • the digital microscope comprises at least one image sensor for converting an image transferred from the objective to the image sensor into an electrical signal. From there, the image sensor converts an image taken by the objective into an electrical signal.
  • the image sensor is preferably a semiconductor, e. g., a CMOS.
  • the digital microscope further comprises an illumination unit for illuminating the sample.
  • the digital microscopic images show enhanced visual information in a third geometric dimension.
  • the digital microscope comprises an apparatus for capturing enhanced visual information in the third geometric dimension.
  • This apparatus preferably comprises a microelectromechanical optical system on an optical path from the objective to the image sensor.
  • the microelectromechanical optical system is configured for extending a depth of field on the optical path from the objective to the image sensor.
  • the microelectromechanical optical system is preferably a Micromirror Array Lens System (MALS) or a Micromirror Array Lens (MMAL).
  • the apparatus for capturing enhanced visual information in the third geometric dimension is preferably an actuator for changing a distance between the sample and the image sensor.
  • the digital microscope further comprises a graphical user interface that is presentable to the user.
  • the digital microscope further comprises a control circuitry that is configured for executing the method according to the invention.
  • the control circuitry is configured for executing a preferred embodiment of the method according to the invention.
  • the control circuitry is preferably a computer.
  • the digital microscope preferably shows features that are described in regard to the method and its preferred embodiments.
  • the digital microscope further comprises a sample table for holding the sample.
  • the sample table is preferably moveable.
  • control circuitry is further configured to control the illumination unit, the moveable sample table, the apparatus for capturing enhanced visual information in the third geometric dimension, and the graphical user interface.
  • control circuitry is further configured to determine properties and parameters of the objective, of the image sensor, of the illumination unit, and/or of the apparatus for capturing enhanced visual information in the third geometric dimension.
  • the only Fig. shows a graphical user interface of a preferred embodiment of a digital microscope according to the invention.
  • That digital microscope can be used, e. g. for shop-floor microscopy.
  • the digital microscope according to the invention can be used by a user of any level of education and preparation since its graphical user interface is simple and user-friendly.
  • the user can use the digital microscope as an efficient tool in his daily routine.
  • An example of usage is supervision.
  • the user makes supervision and control of six machines (not shown) for drills production at a factory shop floor. Every 30 minutes or on demand, the user visits each machine in a turn and takes a sample (not shown) to be inspected under the microscope.
  • the sample is a drill bit (not shown) that must be inspected with a particular microscopic magnification as, e. g. 2.5 ⁇ to fulfil resolution and size requirements.
  • the requirement to inspect the drill bit (not shown) fast benefits from an extended depth of field that is provided by the digital microscope.
  • This embodiment of the digital microscope allows seeing a complete microscopic image in form of a volume in order to inspect a three-dimensional structure of the drill (not shown) at once.
  • the user can rotate drill (not shown) while inspecting.
  • the user can rotate it either by hand or using a specialized manipulator (not shown).
  • the user can observe the constant quality and the absence of any defect.
  • the user can ensure that quality degradation does not occur.
  • a pre-defined quality degradation will indicate need for particular adjustments on one of the machines (not shown).
  • the user is enabled to quickly document a quality level with high attentions to details.
  • the preferred embodiment of the digital microscope provides live microscopic images 01 of the sample with an extended depth of field and live microscopic images 01 that are completely in focus.
  • the user has to adjust only one parameter or only very few parameters in order the configure the digital microscope for capturing and displaying the live microscopic images 01 of the sample with an extended depth of field (EDoF) or the live microscopic images 01 that are completely in focus based on an autofocus (AF).
  • EDOF extended depth of field
  • AF autofocus
  • live microscopic images 01 that are completely in focus are also referred to as all-in-focus images (AIF).
  • AIF all-in-focus images
  • the shown graphical user interface comprises a presentation of the live microscopic images 01 of the sample (not shown) that is inspected.
  • the graphical user interface further comprises a toggle button 02 for toggling between "live” mode and a "snap” mode.
  • the "live” mode can also be named as “navigation” mode and allows live capturing and live displaying of the microscopic images 01 that are images with an extended depth of field (EDoF) or images that are completely in focus (AF).
  • EEOF extended depth of field
  • AF completely in focus
  • individual still microscopic images 01 that are still images with an extended depth of field (EDoF) or still images that are completely in focus (AF) are captured and stored.
  • the graphical user interface further comprises a first menu 03.
  • the first menu 03 comprises four menu items that stands for modes of capturing the microscopic images 01 with an extended depth of field (EDoF) or images that are completely in focus based on an autofocus (AF-2D) as three-dimensional images or two-dimensional images (2D). These images that are completely in focus are also referred to as all-in-focus images (AIF).
  • EDO extended depth of field
  • AF-2D autofocus
  • AIF all-in-focus images
  • the graphical user interface further comprises a first inner bar 06 in a first outer bar 07.
  • the first outer bar 07 visually represents a range available for capturing visual information in depth. Hence, this range can be named as "MaxZrange”.
  • the first inner bar 06 is a filled area within the first outer bar 07.
  • the first inner bar 06 visually represents a range, in which the depth information is actually captured. Hence, this range can be named as "expZrange”.
  • the user can interactively move the first inner bar 06 and the user can interactively adjust the ends of the first inner bar 06 in order to adjust the capturing range.
  • An upper limit and a lower limit of the capturing range are visually emphasized by extended lines 08 at the ends of the first inner bar 06.
  • a centre of the capturing range is visually emphasized by a further extended line 09 across the first inner bar 06.
  • the centre of the capturing range is determined based on a position of an actuator of an apparatus (not shown) for gathering the extended depth of field.
  • the graphical user interface further comprises a second inner bar 11 in a second outer bar 12.
  • the second outer bar 12 visually represents a range available for exposing the sample (not shown). That available exposing range ranges from a minimally available exposure that is zero to a maximally available exposure. Hence, this range can be named as "ExpRange”.
  • the second inner bar 12 visually represents a range, in which the sample (not shown) is actually exposed. Hence, this range can be names as applied exposing range. An upper limit of the applied exposing range is visually emphasized by an extended line 13 at the end of the second inner bar 12.
  • the graphical user interface further comprises a second menu 14.
  • the second menu 14 comprises menu items that stand for modes of displaying the microscopic images with extended depth of field as three-dimensional images with extended depth of field. Such images can also be named as topographic images (Texture).
  • the microscopic images are displayed as a heightmap (Heightmap).
  • the modes are divided in "live” modes and "snap" modes. In the “live” modes, the microscopic images 01 are displayed continuously. In the "snap" modes, the microscopic images 01 are displayed as still images.
  • the second menu 14 is not present since that selection of the mode is done automatically.
  • the graphical user interface further comprises a third menu 16.
  • the third menu 16 comprises menu items that stand for alternative "live" modes of displaying the microscopic images 01 showing an extended depth of field (Fast-EDoF) or showing a focused area based on an autofocus (Fast AF) or an combination thereof (Fast AF/EDoF), wherein the extended depth of field and the focused area, respectively, are at least present in at least one region of interest. These modes are in accordance with human vision. These modes allow fast investigation and fast navigation.
  • the graphical user interface further comprises a fourth menu 17.
  • the fourth menu 17 comprises menu items that stand for different modes of illuminating the sample (not shown). These modes comprise a mode for a high dynamic range (HDR) and a mode for automatic exposure (AE).
  • HDR high dynamic range
  • AE automatic exposure

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Multimedia (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Theoretical Computer Science (AREA)
  • Microscoopes, Condenser (AREA)
EP21191927.9A 2021-08-18 2021-08-18 Microscope numérique et procédé de capture et d'affichage d'images microscopiques Pending EP4137866A1 (fr)

Priority Applications (3)

Application Number Priority Date Filing Date Title
EP21191927.9A EP4137866A1 (fr) 2021-08-18 2021-08-18 Microscope numérique et procédé de capture et d'affichage d'images microscopiques
US17/860,794 US20230055287A1 (en) 2021-08-18 2022-07-08 Digital microscope and method for capturing and displaying microscopic images
CN202210852427.9A CN115708007A (zh) 2021-08-18 2022-07-20 用于拍摄和显示显微图像的数字显微镜和方法

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP21191927.9A EP4137866A1 (fr) 2021-08-18 2021-08-18 Microscope numérique et procédé de capture et d'affichage d'images microscopiques

Publications (1)

Publication Number Publication Date
EP4137866A1 true EP4137866A1 (fr) 2023-02-22

Family

ID=77398481

Family Applications (1)

Application Number Title Priority Date Filing Date
EP21191927.9A Pending EP4137866A1 (fr) 2021-08-18 2021-08-18 Microscope numérique et procédé de capture et d'affichage d'images microscopiques

Country Status (3)

Country Link
US (1) US20230055287A1 (fr)
EP (1) EP4137866A1 (fr)
CN (1) CN115708007A (fr)

Citations (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050057812A1 (en) 2003-01-13 2005-03-17 Raber Peter E. Variable focus system
US6934072B1 (en) 2004-05-27 2005-08-23 Angstrom Inc. Variable focal length lens comprising micromirrors with two degrees of freedom rotation and one degree of freedom translation
US6934073B1 (en) 2004-05-28 2005-08-23 Angstrom Inc. Variable focal length lens comprising micromirrors with one degrees of freedom rotation and one degree of freedom translation
US6970284B1 (en) 2004-05-27 2005-11-29 Angstrom Inc. Variable focusing lens comprising micromirrors with one degree of freedom rotation
US6999226B2 (en) 2004-05-28 2006-02-14 Angstrom Inc. Variable focal length lens comprising micromirrors with one degree of freedom translation
US7031046B2 (en) 2004-05-27 2006-04-18 Angstrom Inc. Variable focal length lens comprising micromirrors with two degrees of freedom rotation
US7095548B1 (en) 2005-07-28 2006-08-22 Angstrom Inc. Micromirror array lens with free surface
US7274517B2 (en) 2005-03-10 2007-09-25 Angstrom, Inc. Micromirror array lens with focal length gradient
WO2007134264A2 (fr) 2006-05-11 2007-11-22 Stereo Display, Inc. Système d'imagerie tridimensionnelle
US7619807B2 (en) 2004-11-08 2009-11-17 Angstrom, Inc. Micromirror array lens with optical surface profiles
US20120050562A1 (en) 2009-04-22 2012-03-01 Raytrix Gmbh Digital imaging system, plenoptic optical device and image data processing method
US20130321927A1 (en) 2007-02-26 2013-12-05 TAG Optics Inc. Tunable acoustic gradient index of refraction lens and system
US20140022236A1 (en) * 2012-07-19 2014-01-23 Sony Corporation Method and apparatus for navigating stacked microscopy images
US20140368920A1 (en) 2012-01-20 2014-12-18 Imec Vzw Micro-Mirror Arrays
US20150145980A1 (en) * 2013-11-27 2015-05-28 Mitutoyo Corporation Machine Vision Inspection System and Method for Obtaining an Image With an Extended Depth of Field
US20170061601A1 (en) 2015-08-31 2017-03-02 Mitutoyo Corporation Multi-level image focus using a tunable lens in a machine vision inspection system
US20180143419A1 (en) * 2016-11-23 2018-05-24 Mitutoyo Corporation Variable focal length lens system with multi-level extended depth of field image processing
DE102017107489B3 (de) 2017-04-07 2018-07-05 Carl Zeiss Microscopy Gmbh Mikroskopanordnung zur Aufnahme und Darstellung dreidimensionaler Bilder einer Probe
KR20180076466A (ko) 2016-12-28 2018-07-06 주식회사 에스디옵틱스 원통형 제품의 고속 검사장치
EP3486706A1 (fr) 2017-11-16 2019-05-22 Carl Zeiss Microscopy GmbH Module fonctionnel et microscope en étant équipé
US20200195836A1 (en) * 2018-12-13 2020-06-18 Mitutoyo Corporation High-speed tag lens assisted 3d metrology and extended depth-of-field imaging

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4673000B2 (ja) * 2004-05-21 2011-04-20 株式会社キーエンス 蛍光顕微鏡、蛍光顕微鏡装置を使用した表示方法、蛍光顕微鏡画像表示プログラム及びコンピュータで読み取り可能な記録媒体並びに記憶した機器
SG172182A1 (en) * 2008-09-30 2011-07-28 Panasonic Corp Reproduction device, recording medium, and integrated circuit
US9076204B2 (en) * 2010-11-08 2015-07-07 Panasonic Intellectual Property Management Co., Ltd. Image capturing device, image capturing method, program, and integrated circuit
JP6288952B2 (ja) * 2013-05-28 2018-03-07 キヤノン株式会社 撮像装置およびその制御方法
JP6325816B2 (ja) * 2013-12-27 2018-05-16 株式会社キーエンス 拡大観察装置、拡大画像観察方法、拡大画像観察プログラム及びコンピュータで読み取り可能な記録媒体
US9740190B2 (en) * 2014-10-09 2017-08-22 Mitutoyo Corporation Method for programming a three-dimensional workpiece scan path for a metrology system
US20180299658A1 (en) * 2015-04-23 2018-10-18 Duke University Systems and methods of optical coherence tomography stereoscopic imaging for improved microsurgery visualization
US10709422B2 (en) * 2016-10-27 2020-07-14 Clarius Mobile Health Corp. Systems and methods for controlling visualization of ultrasound image data
DE102017101188B4 (de) * 2017-01-23 2021-09-30 Carl Zeiss Microscopy Gmbh Mikroskop und Verfahren zum Mikroskopieren einer Probe
US10496265B2 (en) * 2017-06-05 2019-12-03 Adobe Inc. Slider manipulation with precision alteration
DE102017123510A1 (de) * 2017-10-10 2019-04-11 Carl Zeiss Microscopy Gmbh Digitales Mikroskop und Verfahren zum Aufnehmen eines Stapels von mikroskopischen Bildern einer Probe
CN107747915A (zh) * 2017-11-10 2018-03-02 华东师范大学 基于数字微镜器件的闭环式三维视觉装置
DE102018105308A1 (de) * 2018-03-08 2019-09-12 Carl Zeiss Microscopy Gmbh Mikroskop und Verfahren zum Mikroskopieren einer Probe für die Darstellung von Bildern mit erweiterter Schärfentiefe oder dreidimensionalen Bildern
JP7214368B2 (ja) * 2018-05-31 2023-01-30 キヤノン株式会社 画像処理装置、撮像装置、画像処理方法、プログラムおよび記録媒体
DE102019119310A1 (de) * 2019-07-17 2021-01-21 Carl Zeiss Microscopy Gmbh Mikroskop und Verfahren zum Erzeugen eines mikroskopischen Bildes mit einer erweiterten Schärfentiefe
EP4202524A1 (fr) * 2021-12-21 2023-06-28 Leica Microsystems CMS GmbH Agencement de commande de microscope

Patent Citations (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050057812A1 (en) 2003-01-13 2005-03-17 Raber Peter E. Variable focus system
US6934072B1 (en) 2004-05-27 2005-08-23 Angstrom Inc. Variable focal length lens comprising micromirrors with two degrees of freedom rotation and one degree of freedom translation
US6970284B1 (en) 2004-05-27 2005-11-29 Angstrom Inc. Variable focusing lens comprising micromirrors with one degree of freedom rotation
US7031046B2 (en) 2004-05-27 2006-04-18 Angstrom Inc. Variable focal length lens comprising micromirrors with two degrees of freedom rotation
US6934073B1 (en) 2004-05-28 2005-08-23 Angstrom Inc. Variable focal length lens comprising micromirrors with one degrees of freedom rotation and one degree of freedom translation
US6999226B2 (en) 2004-05-28 2006-02-14 Angstrom Inc. Variable focal length lens comprising micromirrors with one degree of freedom translation
US7619807B2 (en) 2004-11-08 2009-11-17 Angstrom, Inc. Micromirror array lens with optical surface profiles
US7274517B2 (en) 2005-03-10 2007-09-25 Angstrom, Inc. Micromirror array lens with focal length gradient
US7095548B1 (en) 2005-07-28 2006-08-22 Angstrom Inc. Micromirror array lens with free surface
WO2007134264A2 (fr) 2006-05-11 2007-11-22 Stereo Display, Inc. Système d'imagerie tridimensionnelle
US20130321927A1 (en) 2007-02-26 2013-12-05 TAG Optics Inc. Tunable acoustic gradient index of refraction lens and system
US20120050562A1 (en) 2009-04-22 2012-03-01 Raytrix Gmbh Digital imaging system, plenoptic optical device and image data processing method
US20140368920A1 (en) 2012-01-20 2014-12-18 Imec Vzw Micro-Mirror Arrays
US20140022236A1 (en) * 2012-07-19 2014-01-23 Sony Corporation Method and apparatus for navigating stacked microscopy images
US20150145980A1 (en) * 2013-11-27 2015-05-28 Mitutoyo Corporation Machine Vision Inspection System and Method for Obtaining an Image With an Extended Depth of Field
US20170061601A1 (en) 2015-08-31 2017-03-02 Mitutoyo Corporation Multi-level image focus using a tunable lens in a machine vision inspection system
US20180143419A1 (en) * 2016-11-23 2018-05-24 Mitutoyo Corporation Variable focal length lens system with multi-level extended depth of field image processing
KR20180076466A (ko) 2016-12-28 2018-07-06 주식회사 에스디옵틱스 원통형 제품의 고속 검사장치
DE102017107489B3 (de) 2017-04-07 2018-07-05 Carl Zeiss Microscopy Gmbh Mikroskopanordnung zur Aufnahme und Darstellung dreidimensionaler Bilder einer Probe
EP3486706A1 (fr) 2017-11-16 2019-05-22 Carl Zeiss Microscopy GmbH Module fonctionnel et microscope en étant équipé
US20200195836A1 (en) * 2018-12-13 2020-06-18 Mitutoyo Corporation High-speed tag lens assisted 3d metrology and extended depth-of-field imaging

Non-Patent Citations (5)

* Cited by examiner, † Cited by third party
Title
"ZEISS Visioner 1", 2020, CARL ZEISS INDUSTRIELLE MESSTECHNIK GMBH
ANONYMOUS: "Software Guide Zen 2 (blue edition)", 7 November 2014 (2014-11-07), XP055885407, Retrieved from the Internet <URL:https://www.unige.ch/medecine/bioimaging/files/3914/3765/2064/ZEN_2_blue_edition_-_Software_Guide.pdf> [retrieved on 20220131] *
ANONYMOUS: "TAGLENS VARIOFOKUS-OBJEKTIV", 20 November 2020 (2020-11-20), XP055885059, Retrieved from the Internet <URL:https://www.mitutoyo.pt/application/files/3316/0432/3799/PR14982_TAGLENS_WEB.pdf> [retrieved on 20220128] *
ANONYMOUS: "Vision Engineering DRV-Z1 product brochure", 24 May 2019 (2019-05-24), XP055885077, Retrieved from the Internet <URL:https://uploads-ssl.webflow.com/5fa655b56251b0e528b5207a/5fb38f4f2c09a8d685293090_brochure-vision1.pdf> [retrieved on 20220128] *
NEDINSCO B.V., DEPTH-VIEW PRO, 2020

Also Published As

Publication number Publication date
US20230055287A1 (en) 2023-02-23
CN115708007A (zh) 2023-02-21

Similar Documents

Publication Publication Date Title
JP6761312B2 (ja) 可変焦点距離レンズを含む撮像システムにおける色収差補正
US11226478B2 (en) Microscope and method for viewing a specimen using a microscope
US10101572B2 (en) Variable focal length lens system with multi-level extended depth of field image processing
JP6839578B2 (ja) 可変焦点距離レンズシステムにおける位相差較正
JP6717692B2 (ja) 倍率調整可能光学システムにおける可変焦点距離レンズの適応的な動作周波数の調整方法
US9830694B2 (en) Multi-level image focus using a tunable lens in a machine vision inspection system
US10146039B2 (en) Image capture method for a microscope system, and corresponding microscope system
US20190353886A1 (en) Method for generating a three-dimensional model of a sample in a digital microscope and a digital microscope
CN111989608B (zh) 对样品进行显微观察以呈现具有扩展景深的图像或三维图像的显微镜和方法
JP2018084821A (ja) 拡大被写界深度を有する画像を取得するためのマシンビジョン検査システム及び方法
JP2015104136A (ja) 拡張被写界深度を有する画像を得るマシンビジョン検査システム及び方法
JP2007256956A (ja) 可変焦点距離定倍率レンズアセンブリを備えた撮像装置、およびこの撮像装置を用いた撮像方法
CN107850754A (zh) 具有快速样本自动聚焦的成像组件
US20190107702A1 (en) Microscope and method for producing a microscopic image with expanded depth of field
JP7725597B2 (ja) バーチャルズームレンズ
CN111325785B (zh) 高速tag透镜辅助3d计量和扩展景深成像
US11940609B2 (en) Image conversion module with a microelectromechanical optical system and method for applying the same
US20230055287A1 (en) Digital microscope and method for capturing and displaying microscopic images
JP2015102694A (ja) アライメント装置、顕微鏡システム、アライメント方法、及びアライメントプログラム
JP2023173421A (ja) 画像処理装置
JP4812325B2 (ja) 走査型共焦点顕微鏡および試料情報測定方法
JP4860378B2 (ja) レンズの偏芯調整方法及び装置
CN210605346U (zh) 一种可变焦的交叉光路3d摄像装置
US11988824B2 (en) Microscope and method for forming a microscopic image with an extended depth of field

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20230718

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20250320