WO2025002930A1 - Procédés et systèmes pour minimiser l'exposition au rayonnement tout en maintenant une qualité d'image optimale - Google Patents

Procédés et systèmes pour minimiser l'exposition au rayonnement tout en maintenant une qualité d'image optimale Download PDF

Info

Publication number
WO2025002930A1
WO2025002930A1 PCT/EP2024/067029 EP2024067029W WO2025002930A1 WO 2025002930 A1 WO2025002930 A1 WO 2025002930A1 EP 2024067029 W EP2024067029 W EP 2024067029W WO 2025002930 A1 WO2025002930 A1 WO 2025002930A1
Authority
WO
WIPO (PCT)
Prior art keywords
frame rate
images
minimum required
patient
machine learning
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/EP2024/067029
Other languages
English (en)
Inventor
Amin FEIZPOUR
Leili SALEHI
Javad Fotouhi
Ayushi Sinha
Brian Curtis LEE
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips NV filed Critical Koninklijke Philips NV
Priority to CN202480042793.5A priority Critical patent/CN121443221A/zh
Priority to EP24735926.8A priority patent/EP4734851A1/fr
Publication of WO2025002930A1 publication Critical patent/WO2025002930A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/48—Diagnostic techniques
    • A61B6/486—Diagnostic techniques involving generating temporal series of image data
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/44—Constructional features of apparatus for radiation diagnosis
    • A61B6/4417—Constructional features of apparatus for radiation diagnosis related to combined acquisition of different diagnostic modalities
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/48—Diagnostic techniques
    • A61B6/486—Diagnostic techniques involving generating temporal series of image data
    • A61B6/487—Diagnostic techniques involving generating temporal series of image data involving fluoroscopy
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/54—Control of apparatus or devices for radiation diagnosis
    • A61B6/542—Control of apparatus or devices for radiation diagnosis involving control of exposure
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/54—Control of apparatus or devices for radiation diagnosis
    • A61B6/545—Control of apparatus or devices for radiation diagnosis involving automatic set-up of acquisition parameters

Definitions

  • the present disclosure is directed generally to methods and systems for minimizing hazardous radiation exposure during a patient procedure.
  • X-ray imaging is utilized during endovascular navigation in order to visualize the device that is being advanced inside the patient’s body, as well as to visualize the vessels in which the device is moving. This visualization allows the interventionalist to determine how to handle the catheter and guidewire to achieve a smooth and rapid navigation toward the target.
  • These X-ray sources are, additionally, equipped with the capability to change the delivered radiation intensity or dose, and the X-ray frame rate (FR).
  • FR X-ray frame rate
  • the X-ray frame rate is a feature that determines with what frequency a field of view is imaged by X-ray to allow a full image reconstruction. For example, an FR equal to 1 frame per second (fps) would allow visualization of the guidewire tip once every second.
  • fps frame per second
  • Various embodiments and implementations are directed to a method and system for determining a minimal frame rate during a patient procedure using a radiation-based patient procedure imaging system.
  • the system receives images during the procedure at an initial frame rate.
  • the system determines a lower, minimum required frame rate for a subsequent window of the patient procedure.
  • a trained machine learning model such as a neural network may analyze the received images and determine the frame rate.
  • the system adjusts the frame rate to the lower rate and receives one or more new images at that lower frame rate.
  • the system provides the one or more images received at the adjusted frame rate to a clinician via a user interface.
  • imaging system for performing a patient procedure.
  • the system includes: a processor configured to: obtain one or more images acquired at an initial predetermined frame rate; analyze the one or more images to determine a minimum required frame rate for a subsequent window of the patient procedure; adjust the initial predetermined frame rate to the determined minimum required frame rate, resulting in an adjusted frame rate; obtain one or more new images at the adjusted frame rate; predict one or more images when the determined minimum required frame rate is below a predetermined rate; and combine the one or more new images at the adjusted frame rate and the predicted one or more images to generate a complete image sequence.
  • the system further includes a radiation source configured to acquire images of a patient during a patient procedure.
  • the processor is further configured to apply a trained machine learning model configured to determine the minimum required frame rate for the subsequent window of the patient procedure.
  • the machine learning model is trained to generate the one or more predicted images when the determined minimum required frame rate is below a predetermined rate.
  • the system further includes a user interface configured to provide the complete image sequence.
  • the processor is further configured to obtain additional navigation data from a navigation data source, and wherein analyzing the one or more images to determine the minimum required frame rate for a subsequent window of the patient procedure further comprises analyzing the received additional navigation data.
  • the navigation data source is a second imaging modality.
  • the additional navigation data is generated by the navigation source before the patient procedure.
  • the additional navigation data is generated by the navigation source during at least a portion of the patient procedure.
  • the system further includes a catheter utilized inside the patient during the patient procedure, and wherein the complete image sequence is utilized for navigation of the catheter.
  • another processor is configured to train a machine learning model to generate the trained machine learning model, the another processor configured to: obtain training data comprising imaging data from a plurality of patient procedures; train the machine learning model to determine a minimum required frame rate for a subsequent window of a patient procedure, wherein the minimum required frame rate minimizes the frame rate while maintaining an image quality necessary to successfully perform the patient procedure; and store the trained machine learning model in memory.
  • the imaging data is obtained at a frame rate at or above the initial predetermined frame rate.
  • the another processor is further configured to identify, by the machine learning model, one or more factors within the training data influencing the minimum required frame rate.
  • the one or more factors comprises one or more of the patient procedure being performed, an anatomy of the patient, and a behavior of a device being navigated inside the patient including translational velocity or rotational velocity of the device.
  • a method for performing a patient procedure comprising: obtaining one or more images of a patient acquired at an initial predetermined frame rate; analyzing the one or more images to determine a minimum required frame rate for a subsequent window of the patient procedure; adjusting the initial predetermined frame rate to the determined minimum required frame rate, resulting in an adjusted frame rate; obtaining one or more new images at the adjusted frame rate; predicting one or more images when the determined minimum required frame rate is below a predetermined rate; and combining the one or more new images at the adjusted frame rate and the predicted one or more images to generate a complete image sequence.
  • the method further includes applying a trained machine learning model configured to determine the minimum required frame rate for the subsequent window of the patient procedure and to predict the one or more predicted images when the determined minimum required frame rate is below a predetermined rate.
  • the method further includes generating the trained machine learning model by: obtaining training data comprising imaging data from a plurality of patient procedures; training the machine learning model to determine a minimum required frame rate for a subsequent window of a patient procedure, wherein the minimum required frame rate minimizes the frame rate while maintaining an image quality necessary to successfully perform the patient procedure; and storing the trained machine learning model in memory.
  • the method includes training of the machine learning model comprises by identifying, by the machine learning model, one or more factors within the training data influencing the minimum required frame rate.
  • the method includes training of the machine learning model comprises by identifying, by the machine learning model, one or more factors within the training data influencing the minimum required frame rate.
  • the instructions when executed by a processor, cause the processor to obtain one or more images acquired at an initial predetermined frame rate; analyze the one or more images to determine a minimum required frame rate for a subsequent window of the patient procedure; adjust the initial predetermined frame rate to the determined minimum required frame rate, resulting in an adjusted frame rate; obtain one or more new images at the adjusted frame rate; predict one or more images when the determined minimum required frame rate is below a predetermined rate; and combine the one or more new images at the adjusted frame rate and the predicted one or more images to generate a complete image sequence.
  • FIG. 1 is a flowchart of a method for radiation-based imaging, in accordance with an embodiment.
  • FIG. 2 is a schematic representation of a patient procedure imaging system, in accordance with an embodiment.
  • FIG. 3 is a flowchart of a method for training a machine learning model, in accordance with an embodiment.
  • FIG. 4 is a flowchart of a method for training a machine learning model, in accordance with an embodiment.
  • a patient procedure imaging system receives images during the procedure at an initial frame rate.
  • the system analyzes the received images to determine a lower, minimum required frame rate for a subsequent window of the patient procedure.
  • a trained machine learning model such as a neural network analyzes the received images to determine the lower, minimum required frame rate.
  • the system adjusts the initial frame rate to the lower rate and receives one or more new images at that lower frame rate.
  • the system further generates one or more predicted images when the determined minimum required frame rate is below a predetermined rate, and combines the received one or more images at the adjusted frame rate and the generated one or more predicted images to generate a complete image sequence.
  • the system provides the images received at the adjusted frame rate, and/or the complete image sequence to a clinician via a user interface.
  • the embodiments and implementations disclosed or otherwise envisioned herein can be utilized with any system that may utilize or benefit from minimizing patient imaging and harmful radiation exposure.
  • one application of the embodiments and implementations disclosed or otherwise envisioned herein is minimizing X-ray imaging, such as during catheterization and other patient procedures.
  • One application is to improve the functionality of the Philips® Azurion® imaging system and software (manufactured by Koninklijke Philips, N.V.), among other products.
  • the disclosure is not limited to these devices or systems, and thus disclosure and embodiments disclosed herein can encompass any system that may utilize or benefit from minimizing patient imaging and radiation exposure.
  • FIG. 1 is a flowchart of a method 100 for radiationbased imaging using a patient procedure imaging system 200.
  • the methods described in connection with the figures are provided as examples only, and shall be understood not to limit the scope of the disclosure.
  • the patient procedure imaging system can be any of the systems described or otherwise envisioned herein.
  • the patient procedure imaging system can be a single system or multiple different systems.
  • method 100 is utilized for X- ray imaging, although other radiation-based imaging systems are possible.
  • a patient procedure imaging system 200 is provided.
  • the system comprises one or more of a processor 220, memory 230, user interface 240, communications interface 250, and storage 260, interconnected via one or more system buses 212.
  • FIG. 2 constitutes, in some respects, an abstraction and that the actual organization of the components of the system 200 may be different and more complex than illustrated.
  • patient procedure imaging system 200 can be any of the systems described or otherwise envisioned herein. Other elements and components of the patient procedure imaging system 200 are disclosed and/or envisioned elsewhere herein.
  • the patient procedure imaging system 200 comprises or is in direct or indirect communication with a radiation source 270.
  • the radiation source can be, for example, a radiation-based imaging device, machine, or system.
  • the radiation-based imaging device may be any device designed or configured to obtain images at a plurality of different frame rates using radiation.
  • the radiation-based imaging device may be an X-ray device, component, or machine, and may be configured to obtain X-ray images at a plurality of different frame rates.
  • the radiation-based imaging device 270 comprises one or more adjustable settings and/or parameters, including but not limited to an adjustable frame rate.
  • the patient procedure imaging system 200 comprises or is in direct or indirect communication with a second imaging modality 280.
  • the second imaging modality is configured to obtain images during a patient procedure.
  • the second imaging modality may be any imaging device, and may obtain one or more images using any imaging modality.
  • the most common forms of imaging modality are magnetic resonance imaging (MRI), ultrasound, computed tomography scan (CT scan), and nuclear imaging such as Positron Emission Tomography (PET), although many other types of health- or medicine-based imaging modalities are possible.
  • the one or more images obtained using the imaging modality may be obtained from a patient or other individual.
  • the patient procedure imaging system 200 is utilized during a patient procedure to minimize X-ray exposure to patients and clinicians without negatively impacting the outcome of the procedure.
  • the patient procedure is a procedure in which a catheter or other instrument is navigated within the body, although many other patient procedures are possible including procedures without a catheter or other instrument.
  • the system uses available information, including information about the device location relative to the anatomy in which it is being navigated, its behavior such as translational and rotational velocity, and the anatomical features, to determine what X-ray frame rate is essential or desired at each time point.
  • image features influences the optimal frame are learned and utilized to enable missing-frame replacement without compromising image quality.
  • the system can determine or estimate the minimum essential frame rate (MEFR) at each point in time according to at least one input from a catheter procedure (such as fluoro image features, robotics haptic feedback, etc.) and learn how to replace missing frames in the case of low frame rate to avoid any compromise of image resolution and quality.
  • This system can optionally include a neural network that is trained on input data including high-FR X-ray images or fluoroscopy runs (e.g., 50-60 fps sequences) in which the device (e.g., catheter and/or guidewire) used for navigation is observable. If available, the path to the target site - which can be determined by fluoroscopy throughout the procedure - can also be used.
  • Additional data from sources such as robotics, fiber optics, or any other device that can enable localization of the catheter without a need for X-ray can be used as complementary information to further reduce the required FR for achieving a good image quality for device navigation.
  • the system overcomes the lack of intelligence in interventional systems for automatic adjustment of X-ray framerate depending on the procedure phase, anatomical complexity, and navigation difficulty, while maintaining a high image quality.
  • data such as a series of X-ray images containing a moving device (such as catheter) is input into the system, and the system analyzes the relevant image sequence features to determine the MEFR (e.g., between 1 and 60 fps) required for smooth navigation while replacing the missing frames with high-quality images.
  • the system can utilize a video frame extrapolation network to learn which features, and to what extent, influence the MEFR such the system maintains, for instance, a Structural Similarity Index (SSIM) above 0.95 when comparing predicted frames with ground truth frames available in input frame-grabbed data.
  • SSIM Structural Similarity Index
  • the model will then be able to let the live X-ray imaging system start with a high FR, determine (based on sequence/image features) what MEFR is appropriate for each next 1 second window (or any other time frame for the window) in the future, and dynamically apply that to the device FR settings, while replacing the missing frames to avoid any image quality degradation.
  • the window size may be smaller or larger than 1 second. Therefore, the system will automatically increase the FR at more challenging steps of navigation and decrease at less complex steps based on what it has experienced during the last few frames of the live imaging sequence while maintaining the original imaging resolution.
  • the patient procedure can be any procedure for which radiation is utilized for imaging or any other component of the procedure.
  • the patient procedure is a procedure in which a catheter or other instrument is navigated within the body, although many other patient procedures are possible including procedures without a catheter or other instrument.
  • the patient procedure imaging system 200 receives one or more images of a patient during the initiated patient procedure.
  • the one or more images are obtained at an initial predetermined frame rate, which in many cases will be a high frame rate, such as a typical frame rate utilized by prior art systems.
  • the images of the patient may be obtained by and thus received from radiation-based imaging device 270, which may be any device, component, or machine configured to obtain images at a plurality of different frame rates using radiation.
  • the radiation-based imaging device 270 may be a component of patient procedure imaging system 200, or it may be in wired and/or wireless communication with the system.
  • the patient procedure imaging system 200 receives additional navigation data from a navigation data source.
  • This additional navigation data may be obtained prior to initiation of the patient procedure, or may be obtained in part or in whole during the patient procedure.
  • the additional navigation data may be obtained prior to initiation of the patient procedure and stored until that data is utilized during the patient procedure.
  • the additional navigation data may be obtained in part or in whole during the patient procedure and may be stored for subsequent use or may be utilized by the system immediately.
  • the additional navigation data may be any information that facilitates navigation of a catheter or other instrument is within the patient during the patient procedure.
  • the navigation data source is the second imaging modality (280), which may be any imaging device, and may obtain one or more images using any imaging modality.
  • the second imaging modality may obtain images of the patient before and/or during the patient procedure.
  • the additional navigation data may be obtained from or for a robotically controlled device.
  • the robotically controlled device can determine the length of a device that has been inserted into a patient, the approximate tip velocity, the torque applied to the device, and other parameters about the device.
  • This information can thus comprise additional navigation data to be added to make the analysis less complex with regard to device shape, location, and velocity at each time point.
  • This additional information lets the network be optimized at lower input/output ratios and thus will result in lower possible MEFR values for fluoroscopy runs at various stages of the procedure.
  • the additional navigation data may be obtained from or for shape sensed devices (e.g., fiber optic devices) and/or electromagnetic (EM) devices.
  • shape, tip location, tip velocity, and/or other information from these devices can be used as additional inputs for the system to further enhance its predictive capacity and decrease the requirement for increasing the input/output frame ratio.
  • additional input can result in a near-zero MEFR, considering that, given a pre-planned vessel path for an area of the anatomy, the device location and behavior can be fully reconstructed without an essential need for extensive X-ray-based visualization.
  • the patient procedure imaging system 200 analyzes the received one or more images to determine a minimum required frame rate for a subsequent window of the patient procedure. This analysis may be performed by the processor 220 of system 200. The analysis will provide, as output based on the received images and any other input information, an appropriate minimum required frame rate for images for a subsequent window of the patient procedure. For example, the subsequent window of the patient procedure might be the next 1 second of the procedure, or a longer or shorter subsequent window.
  • the analysis of the received one or more images to determine a minimum required frame rate for a subsequent window of the patient procedure is performed by a trained machine learning model 262 of the system.
  • the machine learning model can be any network, algorithm, classifier, or artificial intelligence component which is trained to utilize the described input and generate the described output.
  • the machine learning model is a neural network trained (such as according to the methods described or otherwise envisioned herein) to receive high-FR X-ray image data and output an appropriate MEFR according to a specific time window of a predetermined or adjustable length.
  • the neural network can be optimized in a self-supervised manner using a perceptual loss function that compares extrapolated output frames with their corresponding ground truth input frames.
  • the network can be a convolutional encoder-decoder that, in each batch, inputs 2-60 previous frame sequences, deconstructs their features into a low dimensional representation, and reconstructs the next 1 -60 frames (with a 2/60 ratio of input/output in the beginning) from the low dimensional representation.
  • the length of these sequences is only an example, and other sequence lengths are possible.
  • the loss and SSIM can then be calculated using the extrapolated frames compared with the input frames.
  • This network can, then, be wrapped in an architecture similar to that of automated hyperparameter optimization algorithms, where if training loss cannot converge to a value lower than a threshold after a certain number of training epochs, the training for that region of the image/sequence (i.e., a certain procedure step) will be restarted with an increased input/output frame ratio (i.e., increased MEFR) to reduce the complexity of the problem and achieve an acceptable loss value.
  • an increased input/output frame ratio i.e., increased MEFR
  • the wrapper network can, additionally, include a convolutional classification network that learns the image/sequence features at each temporal region (i.e., each procedure step), including device behavior (e.g., device tip moving back and forth near a vessel branch for an extended period), that influence the changes in MEFR, as described above, and outputs optimized weights that define this relationship.
  • the optimized classification model on its own, can then be used to infer a proper MEFR for each temporal region without necessarily requiring the aforementioned frame extrapolation (or frame synthesis) network.
  • the determination by the system of a minimum required frame rate for a subsequent window of the patient procedure is further based on an analysis of the additional navigation data received from the navigation data source.
  • processor 220 of system 200 may utilize both the received one or more images and the received additional navigation data to determine the minimum required frame rate for images for a subsequent window of the patient procedure.
  • the additional navigation data received from the navigation data source can be any data that can be utilized by the processor to determine the minimum required frame rate.
  • the additional navigation data can be imaging data, information about the device(s) utilized in the patient procedure such as catheter information, and/or any other information.
  • the image reconstruction loss is used directly at inference to compute a change in FR based on an experimentally-derived relationship between the two. If the loss is small, the change in FR may be large (approaching zero starting from an initial maximum FR value), whereas if the loss is large the change in FR may be smaller. As long as the loss is below a threshold, FR is reduced. If the loss goes above threshold, FR is increased to control the loss. In this embodiment, the change in FR will always be slower than real time (i.e., 1 second behind if predicting frames 1 second in the future). This embodiment can be used at certain framerates such that the change in FR is faster than human reaction.
  • the system may use image sequences from both views to compute the minimum required frame rate.
  • the neural network may be adapted to a Siamese network architecture to accommodate two streams of input, and can output a single minimum required frame rate. If the FR of image acquisition can be modulated individually on the two arms of the biplane system, then the two inputs may be processed in parallel through the network, and output two separate minimum required frame rate which are applied to the corresponding arm of the biplane system. This may be applicable in a situation where the distal end of the device is foreshortened in one view and the changes in its shape are not seen in that view.
  • the frame rate for that view can remain low, while the frame rate in the other view may be increased if the proximal end of the device is more clearly visible and increasing the frame rate may ease the process of cannulating a vessel, for example. This can significantly reduce the radiation burden of biplane systems.
  • the patient procedure imaging system 200 adjusts the initial frame rate to the determined minimum required frame rate, for at least the duration of the subsequent window of the patient procedure.
  • This can comprise, for example, the system sending a command to the radiation source 270 to adjust the frame rate to the determined minimum required frame.
  • the command can be sent to the radiation source, such as an X-ray machine, which can be a component of system 200 or a component in communication with system 200, via wired and/or wireless communication.
  • This can be a fully automated process such that it can be performed very quickly and efficiently, including on a second-by-second basis (or optionally even faster).
  • the command is sent to a clinician, such as via a user interface of the system, and the clinician subsequently adjusts the frame rate of the radiation source.
  • the patient procedure imaging system 200 receives from radiation-based imaging device 270 one or more images of a patient during the initiated patient procedure, at the adjusted frame rate.
  • the images may be utilized immediately, or they may be temporarily or permanently stored for subsequent use by the system. Additionally, these new images may be fed back into the system to determine a minimum required frame rate for a subsequent window of the patient procedure.
  • the patient procedure imaging system 200 determines that the frame rate is below a predetermined frame rate, and generates or extrapolates one or more predicted images.
  • the predetermined frame rate may be any frame rate that the system or a clinician determines jeopardizes the quality of the imaging obtained by the system.
  • the predetermined frame rate may be determined experimentally, may be determined by a set of rules, or may be determined by a clinician, among other mechanism.
  • system 200 may comprise a user interface into which the clinician enters a predetermined frame rate, and/or system 200 may be preprogrammed with a specific frame rate that comprises the predetermined frame rate, and/or may be preprogrammed with a set of rules that determines the predetermined frame rate.
  • the predetermined frame rate may be zero.
  • Extrapolated image frames for one or more time points can be generated or utilized when the radiation source is off or otherwise not gathering images. For example, when the radiation source is off or otherwise not gathering images such as for a fraction of a second - such as between 1/60 - 59/60 of a second - extrapolated image frames are generated or utilized.
  • the trained machine learning model 262 of the system which can be any model, network, algorithm, classifier, or artificial intelligence component, can be trained to extrapolate one or more X-ray frames for one or more time points, using input imaging obtained by the system.
  • the patient procedure imaging system 200 combines one or more images received at the adjusted frame rate with one or more of the extrapolated or predicted images in order to generate a complete image sequence.
  • “Combine” may mean, for example, inserting one or more of the extrapolated or predicted images between two of the images received at the adjusted frame rate to generate an image sequence comprising both the received and generated images.
  • the patient procedure imaging system 200 may comprise an algorithm, software, or other video processing module configured to combine received and generated images into a complete image sequence. Once generated, the complete image sequence can be utilized immediately, and/or it may be temporarily or permanently stored in local and/or remote memory for future use.
  • the patient procedure imaging system 200 provides the complete image sequence to a user, such as a clinician, via a user interface 240.
  • the complete image sequence may be provided via the user interface using any method for displaying imaging.
  • the system may also provide other information via the user interface, including but not limited information about the patient, the patient procedure, the determined minimum required frame rate, and/or information about the received and generated images within the complete image sequence.
  • FIG. 3 in one embodiment, is a flowchart of a method 300 for training the machine learning model 262 of the patient procedure imaging system 200. This method may be performed by the patient procedure imaging system, or may be performed by another system such as a machine learning model training system.
  • the training system receives training data comprising imaging data for a plurality of patient procedures.
  • the training data may comprise, for example, historical image data, such as fluoroscopy procedures, obtained from a large number of procedures.
  • the historical image data may comprise static or moving devices (e.g., catheter, micro-catheter, guidewire, or any other device); (ii) static or moving background anatomy (including the planned path to the target site); and/or (ii) segmentation maps of devices and vessels per frame, if available.
  • the training data may also comprise other information. This training data may be curated by an expert such as a clinician, or it may be obtained and utilized without curation.
  • the training data may be received from any source.
  • the training data may be received from a database or other component of the patient procedure imaging system or a training system.
  • the patient procedure imaging system 200 comprises or is in direct or indirect communication with an imaging database which comprises some or all of the training data set.
  • the training system may comprise a data pre-processor or similar component or algorithm configured to process the received training data.
  • the data pre-processor analyzes the training data to remove noise, bias, errors, and other potential issues.
  • the data pre-processor may also analyze the input data to remove low quality data. Many other forms of data pre-processing or data point identification and/or extraction are possible.
  • the training system trains the machine learning model, using the training data, to determine a minimum frame rate that maintains a required image quality.
  • the network can be any algorithm, classifier, or model capable of creating the output, including but not limited to machine learning algorithms, classifiers, and other algorithms.
  • the machine learning model is trained using any method for training a machine learning algorithm.
  • the trained machine learning model is a unique algorithm based on the training data used to train the algorithm.
  • the system comprises a trained machine learning model 262.
  • the machine learning model is a neural network trained to receive high frame rate X-ray image data and output an appropriate MEFR for a subsequent window, optimized in a self-supervised manner using a perceptual loss function that compares extrapolated output frames with their corresponding ground truth input frames.
  • the neural network can be a convolutional encoder-decoder that, in each batch, inputs 2-60 previous frame sequences, deconstructs their features into a low dimensional representation, and reconstructs the next 1 -60 frames (with a 2/60 ratio of input/output in the beginning) from the low dimensional representation. Other sequence lengths can also be used.
  • the loss and SSIM can be calculated using the extrapolated frames compared with the input frames.
  • This network can be wrapped in an architecture similar to that of automated hyperparameter optimization algorithms, where if training loss cannot converge to a value lower than a threshold after a certain number of training epochs, the training for that region of the image/sequence (i.e., a certain procedure step) will be restarted with an increased input/output frame ratio (i.e., increased MEFR) to reduce the complexity of the problem and achieve an acceptable loss value.
  • an increased input/output frame ratio i.e., increased MEFR
  • the wrapper network can, additionally, include a convolutional classification network that learns the image/sequence features at each temporal region (i.e., each procedure step), including device behavior (e.g., device tip moving back and forth near a vessel branch for an extended period), that influence the changes in MEFR, as described herein, and outputs optimized weights that define this relationship.
  • the optimized classification model on its own, can then be used to infer a proper MEFR for each temporal region without necessarily requiring the aforementioned frame extrapolation (or frame synthesis) network.
  • the neural network is trained to generate an output comprising the determined minimum required frame rate for each region (such as 1 second clips) of a sequence that in a live X-ray imaging case will be dynamically changing the X-ray FR.
  • the neural network is further trained to generate and provide the extrapolated X-ray frames for each time point when the determined minimum required frame rate is lower than a maximum (i.e., the X-ray is off for a fraction of a second, for example between 1/60 - 59/60 of a second). This fills in the live X-ray sequence with an accuracy that is optimized to be nearly equal to that of the original image series.
  • the machine learning model is configured to be trained in a fully or semi-supervised manner, shown as flowchart 400.
  • This embodiment might require additional clinical input as annotations on frame-grabbed image sequences of endovascular procedures.
  • Annotations for this task could include experts such as clinicians labeling per temporal region along a procedure what FR (e.g., between 1-60 fps) would be essential to be able to smoothly navigate, based on clinical experience.
  • the machine learning model will then be simplified to the classification wrapper described herein in which the image sequences can be fed as input and the physician annotations can be used as ground truth for the model to learn what image/sequence features change the MEFR to what extent.
  • the trained machine learning model 262 is stored for future use.
  • the trained machine learning model 262 may be stored in local or remote storage.
  • FIG. 2 is a schematic representation of a patient procedure imaging system 200.
  • System 200 may be any of the systems described or otherwise envisioned herein, and may comprise any of the components described or otherwise envisioned herein. It will be understood that FIG. 2 constitutes, in some respects, an abstraction and that the actual organization of the components of the system 200 may be different and more complex than illustrated.
  • system 200 comprises a processor 220 capable of executing instructions stored in memory 230 or storage 260 or otherwise processing data to, for example, perform one or more steps of the method.
  • Processor 220 may be formed of one or multiple modules.
  • Processor 220 may take any suitable form, including but not limited to a microprocessor, microcontroller, multiple microcontrollers, circuitry, field programmable gate array (FPGA), application-specific integrated circuit (ASIC), a single processor, or plural processors.
  • FPGA field programmable gate array
  • ASIC application-specific integrated circuit
  • Memory 230 can take any suitable form, including a non-volatile memory and/or RAM.
  • the memory 230 may include various memories such as, for example LI, L2, or L3 cache or system memory.
  • the memory 230 may include static random access memory (SRAM), dynamic RAM (DRAM), flash memory, read only memory (ROM), or other similar memory devices.
  • SRAM static random access memory
  • DRAM dynamic RAM
  • ROM read only memory
  • the memory can store, among other things, an operating system.
  • the RAM is used by the processor for the temporary storage of data.
  • an operating system may contain code which, when executed by the processor, controls operation of one or more components of system 200. It will be apparent that, in embodiments where the processor implements one or more of the functions described herein in hardware, the software described as corresponding to such functionality in other embodiments may be omitted.
  • User interface 240 may include one or more devices for enabling communication with a user.
  • the user interface can be any device or system that allows information to be conveyed and/or received, and may include a display, a mouse, and/or a keyboard for receiving user commands.
  • user interface 240 may include a command line interface or graphical user interface that may be presented to a remote terminal via communication interface 250.
  • the user interface may be located with one or more other components of the system, or may located remote from the system and in communication via a wired and/or wireless communications network.
  • Communication interface 250 may include one or more devices for enabling communication with other hardware devices.
  • communication interface 250 may include a network interface card (NIC) configured to communicate according to the Ethernet protocol.
  • NIC network interface card
  • communication interface 250 may implement a TCP/IP stack for communication according to the TCP/IP protocols.
  • TCP/IP protocols Various alternative or additional hardware or configurations for communication interface 250 will be apparent.
  • Storage 260 may include one or more machine-readable storage media such as readonly memory (ROM), random-access memory (RAM), magnetic disk storage media, optical storage media, flash-memory devices, or similar storage media.
  • ROM readonly memory
  • RAM random-access memory
  • storage 260 may store instructions for execution by processor 220 or data upon which processor 220 may operate.
  • storage 260 may store an operating system 261 for controlling various operations of system 200.
  • memory 230 may also be considered to constitute a storage device and storage 260 may be considered a memory.
  • memory 230 and storage 260 may both be considered to be non-transitory machine-readable media.
  • non-transitory will be understood to exclude transitory signals but to include all forms of storage, including both volatile and non-volatile memories.
  • processor 220 may include multiple microprocessors that are configured to independently execute the methods described herein or are configured to perform steps or subroutines of the methods described herein such that the multiple processors cooperate to achieve the functionality described herein.
  • processor 220 may include a first processor in a first server and a second processor in a second server. Many other variations and configurations are possible.
  • system 200 comprises or is in direct or indirect communication with a radiation source 270, which may be a radiation-based imaging device, machine, or system .
  • the radiation-based imaging device may be any radiation-based imaging device, component, or machine configured to obtain images at a plurality of different frame rates using radiation.
  • the radiation-based imaging device 270 comprises one or more adjustable settings and/or parameters, including but not limited to an adjustable frame rate.
  • the radiation source 270 is an X-ray machine or system.
  • system 200 comprises or is in direct or indirect communication with a second imaging modality 280.
  • the second imaging modality is configured to obtain images during a patient procedure.
  • the second imaging modality may be any imaging device, and may obtain one or more images using any imaging modality.
  • the most common forms of imaging modality are magnetic resonance imaging (MRI), ultrasound, computed tomography scan (CT scan), and nuclear imaging such as Positron Emission Tomography (PET), although many other types of health- or medicine-based imaging modalities are possible.
  • MRI magnetic resonance imaging
  • CT scan computed tomography scan
  • PET Positron Emission Tomography
  • storage 260 of system 200 may store one or more algorithms, modules, and/or instructions to carry out one or more functions or steps of the methods described or otherwise envisioned herein.
  • storage 260 may comprise, among other instructions or data, a trained machine learning model 262, training instructions 263, and/or reporting instructions 264.
  • the trained machine learning model 262 of the patient procedure imaging system 200 is trained to analyze one or more received images to determine a minimum required frame rate for a subsequent window of the patient procedure, to maintain image quality.
  • the machine learning model is also trained to extrapolate images and to insert the extrapolated images into obtained images when the frame rate is below a predetermined frame rate.
  • the machine learning model can be any model, network, algorithm, classifier, or artificial intelligence component which is trained to utilize the described input and generate the described output.
  • the machine learning model is a neural network trained (such as according to the methods described or otherwise envisioned herein) to receive high-FR X-ray image data and output an appropriate MEFR according to a specific time window of a predetermined or adjustable length.
  • the machine learning model is also trained to analyze received additional navigation data together with the one or more received images in order to determine the minimum required frame rate for a subsequent window of the patient procedure.
  • the trained machine learning model is unique based on the training data used to train the machine learning model. Once generated, the trained machine learning model 262 can be utilized immediately, or it may be stored in local and/or remote memory for future use.
  • training instructions 263 direct the system to train a machine learning model 262 of the patient procedure imaging system 200.
  • the instructions direct the system to: at step 310 of the method 300 in FIG. 3, for example, retrieve, obtain, or receive training data comprising imaging data for a plurality of patient procedures.
  • the training data may comprise, for example, historical image data, such as fluoroscopy procedures, obtained from a large number of procedures.
  • the historical image data may comprise: (i) static or moving devices (e.g., catheter, micro-catheter, guidewire, or any other device); (ii) static or moving background anatomy (including the planned path to the target site); and/or (ii) segmentation maps of devices and vessels per frame, if available.
  • the training data may also comprise other information.
  • a training system trains the machine learning model, using the training data, to determine a minimum frame rate that maintains a required image quality.
  • the trained machine learning model 262 is stored for future use.
  • the patient procedure imaging system 200 is configured to process many thousands or millions of datapoints in the input data used to train the machine learning model 262, such as via the training instructions 263.
  • generating a functional and skilled trained machine learning model from a corpus of training data requires processing of millions of datapoints from input data and generated features. This can require millions or billions of calculations to generate a novel trained machine learning model from those millions of datapoints and millions or billions of calculations.
  • each trained machine learning model is novel and distinct based on the input data and parameters of the machine learning algorithm, and thus improves the functioning of the system.
  • Generating a functional and skilled trained machine learning model comprises a process with a volume of calculation and analysis that a human brain cannot accomplish in a lifetime, or multiple lifetimes.
  • reporting instructions 264 direct the system to provide the output of the system to a user, such as a clinician, via a user interface.
  • the provided output can be any of the information as described or otherwise envisioned herein.
  • the system may provide the information to a user via any mechanism, including but not limited to a visual display, an audible notification, a page, or any other method of notification.
  • the information may be communicated by wired and/or wireless communication to another device.
  • the system may communicate the information to a mobile phone, computer, laptop, wearable device, and/or any other device configured to allow display and/or other communication of the information.
  • the phrase “at least one,” in reference to a list of one or more elements, should be understood to mean at least one element selected from any one or more of the elements in the list of elements, but not necessarily including at least one of each and every element specifically listed within the list of elements and not excluding any combinations of elements in the list of elements.
  • This definition also allows that elements may optionally be present other than the elements specifically identified within the list of elements to which the phrase “at least one” refers, whether related or unrelated to those elements specifically identified.
  • inventive embodiments are presented by way of example only and that, within the scope of the appended claims and equivalents thereto, inventive embodiments may be practiced otherwise than as specifically described and claimed.
  • inventive embodiments of the present disclosure are directed to each individual feature, system, article, material, kit, and/or method described herein.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Medical Informatics (AREA)
  • Engineering & Computer Science (AREA)
  • Radiology & Medical Imaging (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Optics & Photonics (AREA)
  • Pathology (AREA)
  • Physics & Mathematics (AREA)
  • High Energy & Nuclear Physics (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Apparatus For Radiation Diagnosis (AREA)

Abstract

Système (200) d'imagerie d'intervention sur un patient, comprenant : une source de rayonnement (270) destinée à acquérir des images d'un patient pendant une intervention sur un patient ; et un processeur (220) destiné à : obtenir une ou plusieurs images acquises à une fréquence image prédéterminée initiale, analyser la ou les images pour déterminer une fréquence image requise minimale pour une fenêtre ultérieure de l'intervention sur un patient, ajuster la fréquence image prédéterminée initiale sur la fréquence image requise minimale déterminée, obtenir de nouvelles images à la fréquence image ajustée, prédire des images lorsque la fréquence image requise minimale déterminée est inférieure à un taux prédéterminé, et combiner les nouvelles images à la fréquence image ajustée et les images prédites pour générer une séquence d'image complète.
PCT/EP2024/067029 2023-06-28 2024-06-19 Procédés et systèmes pour minimiser l'exposition au rayonnement tout en maintenant une qualité d'image optimale Ceased WO2025002930A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202480042793.5A CN121443221A (zh) 2023-06-28 2024-06-19 用于使辐射暴露最小化并同时维持最优图像质量的方法和系统
EP24735926.8A EP4734851A1 (fr) 2023-06-28 2024-06-19 Procédés et systèmes pour minimiser l'exposition au rayonnement tout en maintenant une qualité d'image optimale

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US202363523731P 2023-06-28 2023-06-28
US63/523,731 2023-06-28

Publications (1)

Publication Number Publication Date
WO2025002930A1 true WO2025002930A1 (fr) 2025-01-02

Family

ID=91664769

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2024/067029 Ceased WO2025002930A1 (fr) 2023-06-28 2024-06-19 Procédés et systèmes pour minimiser l'exposition au rayonnement tout en maintenant une qualité d'image optimale

Country Status (3)

Country Link
EP (1) EP4734851A1 (fr)
CN (1) CN121443221A (fr)
WO (1) WO2025002930A1 (fr)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130216025A1 (en) * 2010-10-27 2013-08-22 Koninklijke Philips Electronics N.V. Adaptive imaging and frame rate optimizing based on real-time shape sensing of medical instruments
US20160106389A1 (en) * 2014-10-16 2016-04-21 Samsung Electronics Co., Ltd. X-ray apparatus and x-ray imaging method
US20230038871A1 (en) * 2020-02-11 2023-02-09 Subtle Medical, Inc. Systems and methods for real-time video enhancement

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130216025A1 (en) * 2010-10-27 2013-08-22 Koninklijke Philips Electronics N.V. Adaptive imaging and frame rate optimizing based on real-time shape sensing of medical instruments
US20160106389A1 (en) * 2014-10-16 2016-04-21 Samsung Electronics Co., Ltd. X-ray apparatus and x-ray imaging method
US20230038871A1 (en) * 2020-02-11 2023-02-09 Subtle Medical, Inc. Systems and methods for real-time video enhancement

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
XIAO-LEI YIN ET AL: "Reducing the X-ray radiation exposure frequency in cardio-angiography via deep-learning based video interpolation", ARXIV.ORG, CORNELL UNIVERSITY LIBRARY, 201 OLIN LIBRARY CORNELL UNIVERSITY ITHACA, NY 14853, 1 June 2020 (2020-06-01), XP081689627 *

Also Published As

Publication number Publication date
EP4734851A1 (fr) 2026-05-06
CN121443221A (zh) 2026-01-30

Similar Documents

Publication Publication Date Title
US12254677B2 (en) System and methods for augmenting X-ray images for training of deep neural networks
JP7752596B2 (ja) 自動冠動脈血管造影分析
EP4104765B1 (fr) Procédé et dispositif pour extraire une région de vaisseau majeure sur la base d'une image de vaisseau
US12089981B2 (en) Interventional system
CN105246411B (zh) 介入x射线系统
EP3656309A1 (fr) Collimation en temps réel et positionnement de filtres roi dans l'imagerie par rayons x par l'intermédiaire de la détection automatique de repères d'intérêt
EP2940657B1 (fr) Régression pour une modélisation périodique en fonction de la phase en angiographie
US20220304555A1 (en) Systems and methods for use of stereoscopy and color change magnification to enable machine learning for minimally invasive robotic surgery
EP3480787B1 (fr) Détermination d'une correspondance entre les trames d'un ensemble de données d'images médicales
WO2025002930A1 (fr) Procédés et systèmes pour minimiser l'exposition au rayonnement tout en maintenant une qualité d'image optimale
CN117279588A (zh) 导航介入设备
EP4380683B1 (fr) Réduction du mouvement en imagerie diagnostique ou en radiothérapie
Lessard et al. Guidewire tracking during endovascular neurosurgery
US20260120851A1 (en) Method and system for optimizing provision of medical image data
US20250231123A1 (en) Method for operating an x-ray device, x-ray device, computer program, and electronically readable data carrier
WO2024126112A1 (fr) Estimation de longueur de dispositif flexible à partir d'images de fluoroscopie mobiles
WO2025229497A1 (fr) Systèmes et procédés de génération d'une ou de plusieurs reconstructions
CN120267410A (zh) 介入手术的多系统自动控制方法、系统、装置和设备
Zeng et al. Catheter Tracking Based on Multi-scale Filter and Direction-oriented Method
DE112021006795T5 (de) Erkennung von fremdkörpern in intraoperativen bildern
JP2022542599A (ja) 信号トリガー式介入デバイス制御

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 24735926

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2024735926

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2024735926

Country of ref document: EP

Effective date: 20260128

ENP Entry into the national phase

Ref document number: 2024735926

Country of ref document: EP

Effective date: 20260128