WO2020101428A1 - Dispositif de détection de zone de lésion, procédé de détection de zone de lésion, et programme d'ordinateur - Google Patents

Dispositif de détection de zone de lésion, procédé de détection de zone de lésion, et programme d'ordinateur Download PDF

Info

Publication number
WO2020101428A1
WO2020101428A1 PCT/KR2019/015653 KR2019015653W WO2020101428A1 WO 2020101428 A1 WO2020101428 A1 WO 2020101428A1 KR 2019015653 W KR2019015653 W KR 2019015653W WO 2020101428 A1 WO2020101428 A1 WO 2020101428A1
Authority
WO
WIPO (PCT)
Prior art keywords
lesion
image
lesion area
diffusion
area detection
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/KR2019/015653
Other languages
English (en)
Korean (ko)
Inventor
서우근
김윤철
이지은
송하나
성준경
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Life Public Welfare Foundation
Korea University Research and Business Foundation
Original Assignee
Samsung Life Public Welfare Foundation
Korea University Research and Business Foundation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Life Public Welfare Foundation, Korea University Research and Business Foundation filed Critical Samsung Life Public Welfare Foundation
Publication of WO2020101428A1 publication Critical patent/WO2020101428A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/149—Segmentation; Edge detection involving deformable models, e.g. active contour models
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—Two-dimensional [2D] image generation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T12/00—Tomographic reconstruction from projections
    • G06T12/10—Image preprocessing, e.g. calibration, positioning of sources or scatter correction
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G06T7/0012—Biomedical image inspection
    • G06T7/0014—Biomedical image inspection using an image reference approach
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning

Definitions

  • the present disclosure relates to a lesion area detection apparatus, a lesion area detection method, and a computer program.
  • Magnetic resonance imaging (MRI) imaging device is a device that photographs an object using a magnetic field, and it shows the bone, as well as the disc, joints, nerve ligaments, heart, and cerebral blood vessels in three dimensions from the desired angle. It is widely used for diagnosis. Magnetic resonance imaging has the advantage of being able to obtain various contrast ratios by adjusting several parameters, and by using this, clinical diagnosis is performed by obtaining images of multiple contrast ratios for the same site.
  • Korean Patent Publication No. 2009-0075644 discloses a magnetic resonance imaging device that obtains a steady-state image of a patient by changing the spin phases of the patient's fat and moisture to generate a contrast ratio of the magnetic resonance image.
  • One embodiment of the present invention is to provide a lesion area detection apparatus, method, and computer program for detecting a lesion area using a weighted diffusion image and a diffusion coefficient image of an object.
  • a method for detecting a lesion region comprises: a lesion region detecting apparatus receiving a weighted diffusion image (DWI) and a diffusion coefficient image (ADC) of an object; Normalizing the weighted diffusion image by the lesion area detection apparatus; Normalizing the diffusion coefficient image by the lesion area detection apparatus; Extracting lesion regions from the weighted diffusion image and the diffusion coefficient image normalized by the lesion region detection apparatus using a lesion region detection model; And outputting one or more lesion areas extracted by the lesion area detection device.
  • DWI weighted diffusion image
  • ADC diffusion coefficient image
  • the lesion area detection model repeatedly receives pre-registered lesion masks corresponding to weighted diffusion images and diffusion coefficient images, and among the weighted diffusion images and input data extracted from the diffusion coefficient images, a lesion mask It can be characterized by selecting the data to be the basis for detecting them and learning based on the selected data.
  • the lesion area detection model may be characterized in that it is changed to another lesion area detection model when it is determined that the predetermined evaluation criteria are not satisfied in comparison with a previously registered lesion mask.
  • the lesion area detection model is characterized by receiving the transformed spreading coefficient images and weighted spreading images through a process of standardizing spreading coefficient images using a preset threshold and a standard deviation of spreading coefficients of each pixel. can do.
  • a data receiving unit for receiving a weighted diffusion image (DWI) and a diffusion coefficient image (ADC) of an object by the lesion area detection apparatus according to an embodiment of the present invention;
  • a pre-processing unit to normalize the weighted diffusion image and the diffusion coefficient image;
  • a lesion region detection unit for extracting lesion regions from the weighted diffusion image and the diffusion coefficient image normalized using a lesion region detection model;
  • an input / output unit outputting the extracted one or more lesion regions.
  • a computer program according to an embodiment of the present invention may be stored in a medium to execute any one of the methods of detecting a lesion area according to an embodiment of the present invention using a computer.
  • a lesion region of an object may be automatically detected through a lesion region detection model trained using a weighted diffusion image and a diffusion coefficient image.
  • FIG. 1 is a block diagram of a lesion area detection system according to embodiments of the present invention.
  • FIG. 2 is a block diagram of an apparatus for detecting a lesion area according to embodiments of the present invention
  • FIG. 3 is a view for explaining a structure of a storage unit of the apparatus for detecting a lesion area.
  • FIG. 4 is a block diagram of a learning model unit.
  • 5 and 6 are flowcharts of a method for detecting a lesion area according to embodiments of the present invention.
  • FIG. 7 is a diagram illustrating a learning process and a testing process in the lesion area detection apparatus.
  • FIG. 8 is an exemplary view of lesion masks predicted based on diffusion weighted images and diffusion coefficient images.
  • FIG. 9 is an exemplary diagram of a user interface for a diagnostic device that automatically measures the distribution of lesions and the volume of lesions based on the methods mentioned in the specification.
  • ICC a value corresponding to a matching ratio between an actual lesion region and a lesion region obtained through various methods.
  • first and second may be used to describe various components, but the components are not limited by the terms. The terms are only used to distinguish one component from other components.
  • first component may be referred to as a second component without departing from the scope of the present invention, and similarly, the second component may be referred to as a first component.
  • a part when a part is connected to another part, this includes not only the case of being directly connected, but also the case of being electrically connected with another element in between. Also, when a part includes a certain component, this means that other components may be further included rather than excluding other components unless otherwise specified.
  • terms such as “... unit” and “module” described in the specification mean a unit that processes at least one function or operation, which may be implemented in hardware or software, or a combination of hardware and software. .
  • an image may mean multidimensional data composed of discrete image elements (eg, pixels in a 2D image and voxels in a 3D image).
  • the image may include an X-ray device, a CT device, an MRI device, an ultrasound diagnostic device, and a medical image of an object acquired by another medical imaging device.
  • the subject may include a person or an animal, or a part of a person or animal.
  • the subject may include blood vessels or devices such as the liver, heart, uterus, brain, breast, and abdomen.
  • the object may include a phantom. Phantom refers to a material having a volume very close to the density and effective atomic number of an organism, and may include a spherical phantom having properties similar to a body.
  • the user is a medical professional, and may be a doctor, a nurse, a clinical pathologist, a medical imaging expert, or the like, but may be a technician repairing a medical device, but is not limited thereto.
  • the diffusion-weighted image is an image that maps the diffusion motion of molecules, particularly water molecules, in a biological tissue of a subject.
  • the diffusion of water molecules within the tissue is not free.
  • Diffusion weighted images reflect water molecules colliding with fibrous tissue or membranes. Therefore, the diffusion pattern of water molecules indicates the normal or abnormal state of the tissue.
  • the diffusion weighted image may well represent normal and abnormal states of the white matter fiber structure or gray matter of the brain.
  • the diffusion coefficient image refers to the processed image based on the value processed through a function of temperature as a diffusion coefficient.
  • the diffusion coefficient can be calculated using a diffusion weighted image because the cell walls are present in the body and the temperature is non-uniform.
  • the infarct area reduces the diffusion of water outside the cell due to the expansion of the cell.
  • a signal decrease becomes a small area, and the diffusion-weighted image appears bright.
  • the diffusion-reduced region appears darker than normal in the diffusion coefficient.
  • Water such as cerebrospinal fluid (CSF) is a free diffusion region, where the diffusion coefficient image is bright and the diffusion weighted image is dark.
  • CSF cerebrospinal fluid
  • FIG. 1 is a block diagram of a lesion area detection system according to embodiments of the present invention.
  • the lesion area detection system 10 may include an image photographing device 100 and a lesion area detection device 200.
  • the lesion area detection system 10 transmits an image of the object 1 acquired through the image capturing apparatus 100 to the lesion area detection device 200, and the lesion area detection device 200 models a lesion area detection model in blood vessels The lesion area of the object 1 is detected based on the obtained data.
  • the imaging device 100 is a device that outputs an image or image of the object 1, and may be an X-ray device, a CT device, an MRI device, an ultrasound diagnostic device, and other medical imaging devices.
  • the imaging apparatus 100 may acquire blood vessel images of all or part of the object 1.
  • the imaging apparatus 100 may photograph an object and output a TOF image, diffusion weighted imaging (DWI), or apparent diffusion coefficient imaging (ADC).
  • DWI diffusion weighted imaging
  • ADC apparent diffusion coefficient imaging
  • the lesion area detection apparatus 200 extracts input data necessary for detecting a lesion area from the diffusion weighted image and the diffusion coefficient image of the object, and uses the lesion area detection model learned using the input data to detect one or more lesion areas of the object. Can deduce.
  • the lesion region detection apparatus 200 may detect a lesion region distributed in a blood vessel of the object based on the input image.
  • the lesion area detection device 200 may be a computing device including one or more processors and storage media.
  • FIG. 2 is a block diagram of the lesion area detection apparatus 200 according to embodiments of the present invention
  • FIG. 3 is a view for explaining the structure of the storage unit 250 of the lesion region detection device.
  • the lesion area detection apparatus 200 may include a control unit 210, a communication unit 220, an input / output unit 240, and a storage unit 250.
  • the control unit 210 may be implemented with one or more processors, and configured to process instructions of a computer program by performing basic arithmetic, logic, and input / output operations.
  • the command may be provided to the control unit 210 by the storage unit 250 and the communication unit 220.
  • the control unit 210 may be configured to execute a received command according to program code stored in a recording device such as the storage unit 250.
  • the communication unit 220 may provide a function for communicating with an external device through a network.
  • the request generated by the control unit 210 of the lesion area detection device 200 according to the program code stored in the recording device such as the storage unit 250 is taken from the external image through the network under the control of the communication unit 220 It can be delivered to the device 100, a database, or another user terminal.
  • a control signal or command received through the communication unit 220 may be transmitted to the control unit 210 or the storage unit 250, and the received image image may be stored by the storage unit 250.
  • the storage unit 250 is a computer-readable recording medium, and may include a non-destructive mass storage device such as random access memory (RAM), read only memory (ROM), and a disk drive.
  • RAM random access memory
  • ROM read only memory
  • an operating system and at least one program code may be stored in the storage unit 250.
  • These software components may be loaded from a computer-readable recording medium separate from the storage unit 250 using a drive mechanism.
  • Such a separate computer-readable recording medium may include a computer-readable recording medium such as a floppy drive, disk, tape, DVD / CD-ROM drive, and memory card.
  • software components may be loaded into storage 250 via communication unit 220 rather than a computer-readable recording medium.
  • at least one program is a storage unit 250 based on a program (for example, the application described above) installed by files provided by a file distribution system that distributes installation files of developers or applications through a network. Can be loaded on.
  • the input / output unit 240 may receive a lesion area detection input, a lesion area input, and the like, and display a screen showing a blood vessel image, a lesion area, and the like.
  • the input / output unit 240 may include an operation panel for receiving user input, a display panel for displaying the screen, and the like.
  • the input unit may include devices capable of receiving various types of user input, such as a keyboard, a physical button, a touch screen, a camera, or a microphone.
  • the output unit may include a display panel or a speaker.
  • the present invention is not limited thereto, and the input / output unit 240 may include a configuration supporting various input / output.
  • the lesion region detection apparatus 200 may include an image receiving unit 251, an image preprocessing unit 252, a lesion region detection unit 253, and a learning model unit to detect the lesion region based on the diffusion weighted image and the diffusion coefficient image of the object (254).
  • the image receiving unit 251 may receive a diffusion weighted image and a diffusion coefficient image of the object.
  • the image pre-processing unit 252 standardizes the diffusion weighted image and the diffusion coefficient image in order to input the lesion region detection model.
  • the standardization process can be expressed by the following equation.
  • DWI (x, y) is the DWI signal value of the pixel at (x, y), Is the standardized DWI signal value of the pixel at the (x, y) position.
  • DWI signals obtained from other MRI machines can be unified into a single signal range, and the signal range is also suitable for training a neural network model.
  • the diffusion coefficient image (ADC) standardization process is different from the DWI standardization process.
  • the ADC standardization process can be expressed by the following equation.
  • the pixel's diffusion coefficient at position The This is the pixel's normalized spreading factor value at the location.
  • the image preprocessing unit 252 normalizes the spreading coefficient image using the standard deviation of the spreading coefficient values of each pixel of the spreading coefficient image and the threshold value of the spreading coefficient.
  • the image pre-processing unit 252 may standardize the diffusion weighted image in a manner similar to the diffusion coefficient image.
  • the lesion region detection unit 252 detects a lesion region of an object photographed using a lesion region detection model trained using a standardized diffusion coefficient image and a diffusion weighted image.
  • the lesion region may be part of the subject's brain.
  • the lesion region detection apparatus 200 may detect a lesion region of an object by using the lesion region detection model learned through the learning model unit 253.
  • the learning model unit 254 may include a data learning unit 2251 and a data recognition unit 2542.
  • the operation of each component is as follows.
  • the data learning unit 2251 may learn criteria for detecting a lesion area.
  • the data learning unit 2251 may learn criteria to determine what data to use to determine a predetermined lesion area and how to determine the lesion area using the data.
  • the data learning unit 2251 may be trained to use a diffusion coefficient image and a weighted diffusion image as data to be used for learning.
  • the data learning unit 2251 may learn to detect a lesion region using a standardized diffusion coefficient image and a weighted diffusion image.
  • the data learning unit 2251 may output a mask image representing the lesion area.
  • the data recognition unit 2252 may detect the lesion area of the object based on the input data.
  • the data recognition unit 2252 may detect the lesion region of the object from predetermined data using the trained lesion region detection model.
  • the data recognition unit 2252 acquires predetermined data according to a preset criterion by learning, and uses the acquired data as an input value to use the lesion area detection model, thereby detecting the lesion area of the object based on the predetermined data. Can be. Further, the result value output by the lesion region detection model using the obtained data as an input value may be used to update the lesion region detection model.
  • At least one of the data learning unit 2251 and the data recognition unit 2542 may be manufactured in the form of at least one hardware chip and mounted on an electronic device.
  • at least one of the data learning unit 2251 and the data recognition unit 2252 may be manufactured in the form of a dedicated hardware chip for artificial intelligence (AI), or an existing general-purpose processor (for example, a CPU) Alternatively, it may be manufactured as a part of an application processor or a graphics-only processor (for example, a GPU) and mounted on various electronic devices described above.
  • AI artificial intelligence
  • an existing general-purpose processor for example, a CPU
  • it may be manufactured as a part of an application processor or a graphics-only processor (for example, a GPU) and mounted on various electronic devices described above.
  • the data learning unit 2251 and the data recognition unit 2542 may be mounted on one electronic device, or may be mounted on separate electronic devices, respectively.
  • one of the data learning unit 2251 and the data recognition unit 2252 may be included in the electronic device, and the other may be included in the server.
  • the data learning unit 2251 and the data recognition unit 2252 may provide the model information constructed by the data learning unit 2251 to the data recognition unit 2252 through wired or wireless communication.
  • the data input to 2542) may be provided to the data learning unit 2251 as additional learning data.
  • At least one of the data learning unit 2251 and the data recognition unit 2252 may be implemented as a software module.
  • the software module is a computer-readable, non-transitory readable It may be stored in a readable media (non-transitory computer readable media).
  • at least one software module may be provided by an operating system (OS) or may be provided by a predetermined application.
  • OS operating system
  • OS operating system
  • OS operating system
  • OS operating system
  • some of the at least one software module may be provided by an operating system (OS), and the other may be provided by a predetermined application.
  • the data learning unit 2251 includes a data acquisition unit 2541-1, a pre-processing unit 2251-2, a training data selection unit 2541-3, and a model learning unit 2541-4 , May include a model evaluation unit 2251-5.
  • the data acquisition unit 251-1 may acquire data necessary for detecting a lesion region.
  • the data acquisition unit 251-1 may acquire data necessary for learning to detect a lesion region.
  • the data acquisition unit 2521-1 may acquire images, images, and text related to blood vessels from the lesion area detection device 200 or the image capture device 100.
  • the data acquisition unit 2541-1 may acquire a diffusion weighted image and a diffusion coefficient image.
  • the preprocessing unit 2251-2 may preprocess the acquired data so that the acquired data can be used for learning to detect the lesion area.
  • the pre-processing unit 2251-2 may process the acquired data in a preset format so that the model learning unit 2251-4, which will be described later, can use the acquired data for learning to detect the lesion area.
  • the preprocessing unit 2251-2 may resize the diffusion weighted image and the diffusion coefficient image.
  • the preprocessing unit 2251-2 resizes the resolution of the diffusion weighted image and the diffusion coefficient image while increasing or decreasing the resolution at a predetermined ratio.
  • the pre-processing unit 2251-2 can standardize the diffusion coefficient image and the weighted diffusion image. Specifically, the pre-processing unit 2251-2 can standardize the spreading coefficient image by using the standard deviation of the spreading coefficient values of each pixel of the spreading coefficient image and a preset threshold.
  • the learning data selection unit 2251-3 may select data necessary for learning from pre-processed data.
  • the selected data may be provided to the model learning unit 2251-4.
  • the learning data selector 2251-3 may select data necessary for learning from pre-processed data according to a preset criterion for detecting a lesion region.
  • the learning data selection unit 313 may select data according to criteria set by learning by the model learning unit 314 to be described later.
  • the model learning unit 2251-4 may train a lesion area detection model used for lesion area detection using learning data.
  • the lesion area detection model may be a model learning using an artificial neural network algorithm.
  • the lesion area detection model may extract features using a low-resolution weighted diffusion image and a diffusion coefficient image with a reduced resolution of the weighted diffusion image and the diffusion coefficient image.
  • the model learning unit 2541-4 restores regions corresponding to the lesion to a high dimension by using low-dimensional feature information extracted from the weighted diffusion image and the diffusion coefficient image, and the regions corresponding to the lesion are a lesion mask image, that is, a segmentation map ( segmentation map).
  • the lesion area detection model may be constructed in consideration of the application field of the recognition model, the purpose of learning, or the computer performance of the device.
  • the lesion area detection model may be, for example, a model based on a neural network.
  • a model such as a deep neural network (DNN), a recurrent neural network (RNN), or a bidirectional recurrent deep neural network (BRDNN) may be used as a lesion area detection model, but is not limited thereto.
  • the model learning unit 2251-4 may train the lesion area detection model, for example, through supervised learning using learning data as an input value.
  • the model learning unit 2251-4 learns the type of data necessary for the detection of a lesion region without any guidance, thereby unsupervised learning to discover a criterion for the detection of the lesion region. Through this, the lesion area detection model can be trained.
  • the model learning unit 314 may train the lesion area detection model, for example, through reinforcement learning using feedback on whether the result of the detection of the lesion area according to learning is correct.
  • the model learning unit 2251-4 may store the trained lesion region detection model.
  • the model learning unit 2251-4 may store the trained lesion area detection model in the memory of the electronic device including the data recognition unit 2542.
  • the model learning unit 2251-4 may store the trained lesion area detection model in the memory of the electronic device including the data recognition unit 2542 to be described later.
  • the model learning unit 2251-4 may store the trained lesion area detection model in a memory of a server connected to a wired or wireless network with the electronic device.
  • the memory in which the learned lesion area detection model is stored may store, for example, instructions or data related to at least one other component of the electronic device.
  • the memory may store software and / or programs.
  • the program may include, for example, a kernel, middleware, application programming interface (API), and / or application program (or "application").
  • the model evaluation unit 2251-5 inputs evaluation data to the lesion area detection model, and, when the recognition result output from the evaluation data does not satisfy a predetermined criterion, causes the model learning unit 2251-4 to learn again.
  • the evaluation data may be preset data for evaluating the lesion area detection model.
  • the model evaluator 2251-5 when the number or ratio of the evaluation data for which the lesion area detection result is not accurate among the recognition results of the trained lesion area detection model for the evaluation data exceeds a preset threshold. It can be evaluated that the predetermined criteria are not satisfied.
  • the model evaluator 2251-5 evaluates whether or not the predetermined criteria are satisfied for each trained lesion area detection model, and finalizes the model that satisfies the predetermined criteria. It can be determined as a lesion area detection model. In this case, when there are a plurality of models satisfying a predetermined criterion, the model evaluator 2251-5 may determine, as a final lesion area detection model, any one or a predetermined number of models preset in order of highest evaluation score.
  • the data acquisition unit 2541 in the data learning unit 2251, the pre-processing unit 2251-2, the learning data selection unit 2541-3, the model learning unit 2541-4 and the model evaluation unit 2541 may be manufactured in the form of at least one hardware chip and mounted on an electronic device.
  • at least one of the data acquisition unit 2541-1, the pre-processing unit 2251-2, the training data selection unit 2251-3, the model learning unit 2251-4 and the model evaluation unit 2551-5 One may be manufactured in the form of a dedicated hardware chip for artificial intelligence (AI), or as part of an existing general-purpose processor (eg, CPU or application processor) or graphics-only processor (eg, GPU), as described above. It may be mounted on various electronic devices.
  • AI artificial intelligence
  • an existing general-purpose processor eg, CPU or application processor
  • graphics-only processor eg, GPU
  • the data acquisition unit (2541-1), the pre-processing unit (2541-2), the training data selection unit (2541-3), the model learning unit (2541-4) and the model evaluation unit (2541-5) is one electronic It may be mounted on a device, or may be mounted on separate electronic devices, respectively.
  • at least one of the data acquisition unit (2541-1), the pre-processing unit (2541-2), the training data selection unit (2541-3), the model learning unit (2541-4) and the model evaluation unit (2541-5) It can be implemented as a software module.
  • At least one of the data acquisition unit 251-1, the pre-processing unit 2551-2, the training data selection unit 2551-3, the model learning unit 2541-4, and the model evaluation unit 2551-5 is a software module When implemented as (or a program module including an instruction), the software module may be stored in a computer-readable non-transitory computer readable media.
  • the data recognition unit 2252 includes a data acquisition unit 2542-1, a preprocessing unit 2542-2, a recognition data selection unit 2542-3, and a recognition result providing unit 2542-4 And a model update unit 2542-5.
  • the data acquisition unit 2252-1 may acquire data necessary for detecting the lesion area, and the pre-processing unit 2252-2 may preprocess the acquired data so that the acquired data for detecting the lesion area can be used. have.
  • the pre-processing unit 2542-2 may process the acquired data in a preset format so that the recognition result providing unit 2542-4, which will be described later, can use the acquired data to detect the lesion area.
  • the preprocessing unit 2251-2 may resize the diffusion weighted image and the diffusion coefficient image.
  • the preprocessing unit 2251-2 resizes the resolution of the diffusion weighted image and the diffusion coefficient image while increasing or decreasing the resolution at a predetermined ratio.
  • the pre-processing unit 2251-2 can standardize the diffusion coefficient image and the weighted diffusion image. Specifically, the pre-processing unit 2251-2 can standardize the spreading coefficient image by using the standard deviation of the spreading coefficient values of each pixel of the spreading coefficient image and a preset threshold.
  • the recognition data selection unit 2542-3 may select data necessary for detecting a lesion area from among pre-processed data.
  • the selected data may be provided to the recognition result providing unit 2542-4.
  • the recognition data selection unit 2542-3 may select some or all of the pre-processed data according to a preset criterion for detecting a lesion area.
  • the recognition data selection unit 2542-3 may select data according to a preset criterion by training by the model learning unit 2251-4.
  • the recognition result providing unit 2542-4 may apply the selected data to the lesion region detection model to determine the lesion region detection.
  • the recognition result providing unit 2542-4 may provide a recognition result according to the purpose of recognizing data.
  • the recognition result providing unit 2542-4 can apply the selected data to the lesion area detection model by using the data selected by the recognition data selection unit 2542-3 as an input value.
  • the recognition result is determined by the lesion region detection model, and may include a segmentation map representing only the region corresponding to the lesion of the object.
  • the model update unit 2252-5 may cause the lesion area detection model to be updated based on the evaluation of the recognition result provided by the recognition result providing unit 2542-4.
  • the model updating unit 2542-5 provides the model learning unit 2542-4 with the recognition result provided by the recognition result providing unit 2542-4, so that the model learning unit 2542-4
  • the lesion area detection model can be updated.
  • the data acquisition unit 2542-1, the pre-processing unit 2252-2, the recognition data selection unit 2542-3, the recognition result providing unit 2542-4 and the model update unit in the data recognition unit 2542 may be manufactured in the form of at least one hardware chip and mounted on an electronic device.
  • the data acquisition unit 2542-1, the pre-processing unit 2542-2, the recognition data selection unit 2542-3, the recognition result providing unit 2542-4, and the model update unit 2542-5 At least one may be manufactured in the form of a dedicated hardware chip for artificial intelligence (AI), or it may be manufactured as part of an existing general-purpose processor (for example, a CPU or application processor) or a graphics-only processor (for example, GPU). It may be mounted on various electronic devices.
  • AI artificial intelligence
  • 4 and 5 are flowcharts of a method for detecting a lesion area according to embodiments of the present invention.
  • the method for detecting a lesion area receives an image captured from the image capturing apparatus 100.
  • the lesion area detection apparatus 200 receives a weighted diffusion image and a diffusion coefficient image of the object.
  • the lesion area detection apparatus 200 standardizes the weighted diffusion image and the diffusion coefficient image, respectively.
  • the lesion region detection apparatus 200 extracts lesion regions from a standardized weighted diffusion image and a diffusion coefficient image using a lesion region detection model.
  • the lesion area detecting apparatus 200 outputs the extracted lesion areas.
  • the lesion area detecting apparatus 200 may output a lesion mask image representing a region corresponding to the lesion as 1, that is, a segmentation map.
  • the lesion area detection apparatus 200 may train a lesion area detection model.
  • the lesion area detection apparatus 200 receives a weighted diffusion image and a diffusion coefficient image of the object.
  • the lesion area detection apparatus 200 preprocesses the weighted diffusion image and the diffusion coefficient image.
  • the lesion area detection apparatus 200 may resize the diffusion weighted image and the diffusion coefficient image.
  • the lesion area detection apparatus 200 resizes the resolution of the diffusion weighted image and the diffusion coefficient image while increasing or decreasing the resolution at a predetermined ratio.
  • the lesion region detection apparatus 200 may standardize the diffusion coefficient image and the weighted diffusion image. Specifically, the lesion area detection apparatus 200 may standardize the diffusion coefficient image using a standard deviation and a preset threshold value of the diffusion coefficient values of each pixel of the diffusion coefficient image.
  • the lesion region detection apparatus 200 trains a lesion region detection model using a pre-processed weighted diffusion image and a diffusion coefficient image.
  • the lesion area detecting apparatus 200 outputs a lesion mask image specific to the lesion area in consideration of the location of the lesion and the degree of the lesion output through the trained lesion area detection model.
  • the lesion area detection apparatus 200 compares a preset lesion mask and an output lesion mask image to evaluate a lesion area detection model.
  • the lesion area detection apparatus 200 stores a lesion area detection model that satisfies a predetermined evaluation criterion in the storage unit.
  • the lesion region detection apparatus 200 may receive the lesion region detection model through the learning model apparatus 300 and infer the vascular age of the subject using the lesion region detection model. .
  • the learning model unit 254 may learn through a weighted diffusion image and a diffusion coefficient image and a lesion mask set by an expert.
  • the learning model unit 254 forms a lesion area detection model based on the parameters obtained as a result of the learning.
  • the learning model unit 254 may generate a supervised learning of U-net model through a lesion mask selected by experts for a weighted diffusion image (DWI) and a diffusion coefficient image (ADC).
  • DWI weighted diffusion image
  • ADC diffusion coefficient image
  • the lesion mask is output by inputting a weighted diffusion image (DWI) and a diffusion coefficient image (ADC) of an actual patient in the learned lesion area detection model.
  • DWI weighted diffusion image
  • ADC diffusion coefficient image
  • the trained lesion area detection model may be trained through various algorithms of machine learning such as U-net, ED-CNN, and SegNet.
  • the batch size to be learned may be determined according to processor performance, graphics processing power, instruction processing power, etc. of the computing device including the learning model unit 254.
  • FIG. 8 is an example showing, in each case, a map of lesions predicted by an actual machine learning model and a map of lesions designated by a stroke specialist when weighted diffusion images and diffusion coefficient images are given as inputs. It can be seen that the maps of the two lesions qualitatively match each other.
  • FIG. 9 is an exemplary diagram of a user interface for a diagnostic device that automatically measures the distribution of lesions and the volume of lesions based on the methods mentioned in the specification.
  • ICC a value corresponding to a matching ratio between an actual lesion region and a lesion region obtained through various methods.
  • ICC according to a lesion area detection model (RAPID-U-net (DWI + ADC)
  • the value was found to be 0.99.
  • the lesion area extracted by considering only the weighted diffusion image (DWI) had a correlation value with the actual lesion area of only 0.86. That is, as a result of the experiment, it was found that the lesion area detection model of the present invention that detects the lesion area in consideration of both DWI and ADC exhibits excellent performance.
  • the lesion area detection model may be generated by optimizing parameters such as the number of layers, the convolution filter, the number of epochs, and the batch size by the learning model unit 254.
  • the device described above may be implemented with hardware components, software components, and / or combinations of hardware components and software components.
  • the devices and components described in the embodiments include, for example, processors, controllers, arithmetic logic units (ALUs), digital signal processors (micro signal processors), microcomputers, field programmable gate arrays (FPGAs).
  • a programmable logic unit (PLU), microprocessor, or any other device capable of executing and responding to instructions may be implemented using one or more general purpose computers or special purpose computers.
  • the processing device may perform an operating system (OS) and one or more software applications running on the operating system.
  • the processing device may access, store, manipulate, process, and generate data in response to the execution of the software.
  • OS operating system
  • the processing device may access, store, manipulate, process, and generate data in response to the execution of the software.
  • a processing device may be described as one being used, but a person having ordinary skill in the art, the processing device may include a plurality of processing elements and / or a plurality of types of processing elements. It can be seen that may include.
  • the processing device may include a plurality of processors or a processor and a controller.
  • other processing configurations such as parallel processors, are possible.
  • the software may include a computer program, code, instruction, or a combination of one or more of these, and configure the processing device to operate as desired, or process independently or collectively You can command the device.
  • Software and / or data may be interpreted by a processing device, or to provide instructions or data to a processing device, of any type of machine, component, physical device, virtual equipment, computer storage medium or device. , Or may be permanently or temporarily embodied in the transmitted signal wave.
  • the software may be distributed over networked computer systems, and stored or executed in a distributed manner.
  • Software and data may be stored in one or more computer-readable recording media.
  • the method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable medium.
  • the computer-readable medium may include program instructions, data files, data structures, or the like alone or in combination.
  • the program instructions recorded in the medium may be specially designed and configured for the embodiments or may be known and usable by those skilled in computer software.
  • Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs, DVDs, and magnetic media such as floptical disks.
  • -Hardware devices specifically configured to store and execute program instructions such as magneto-optical media, and ROM, RAM, flash memory, and the like.
  • program instructions include high-level language codes that can be executed by a computer using an interpreter, etc., as well as machine language codes produced by a compiler.
  • the hardware device described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Software Systems (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Radiology & Medical Imaging (AREA)
  • Quality & Reliability (AREA)
  • Image Analysis (AREA)
  • Magnetic Resonance Imaging Apparatus (AREA)

Abstract

La présente invention concerne un procédé de détection de zone de lésion qui comprend : une étape dans laquelle un dispositif de détection de zone de lésion reçoit une image pondérée de diffusion (DWI) et une image de coefficient de diffusion apparent (ADC) d'un sujet ; une étape dans laquelle le dispositif de détection de zone de lésion normalise la DWI ; dans laquelle le dispositif de détection de zone de lésion normalise l'image d'ADC ; une étape dans laquelle le dispositif de détection de zone de lésion extrait des zones de lésion à partir de la DWI normalisée et de l'image de d'ADC normalisée en utilisant un modèle de détection de zone de lésion ; et une étape dans laquelle le dispositif de détection de zone de lésion produit en sortie une ou plusieurs zones de lésion.
PCT/KR2019/015653 2018-11-15 2019-11-15 Dispositif de détection de zone de lésion, procédé de détection de zone de lésion, et programme d'ordinateur Ceased WO2020101428A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020180141129A KR102375258B1 (ko) 2018-11-15 2018-11-15 병변 영역 검출 장치, 병변 영역 검출 방법 및 컴퓨터 프로그램
KR10-2018-0141129 2018-11-15

Publications (1)

Publication Number Publication Date
WO2020101428A1 true WO2020101428A1 (fr) 2020-05-22

Family

ID=70731242

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2019/015653 Ceased WO2020101428A1 (fr) 2018-11-15 2019-11-15 Dispositif de détection de zone de lésion, procédé de détection de zone de lésion, et programme d'ordinateur

Country Status (2)

Country Link
KR (1) KR102375258B1 (fr)
WO (1) WO2020101428A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112330619A (zh) * 2020-10-29 2021-02-05 浙江大华技术股份有限公司 一种检测目标区域的方法、装置、设备及存储介质
US20250054134A1 (en) * 2023-08-09 2025-02-13 Uti Limited Partnership Systems and methods for detecting ocular lesions in fundus images
US12456197B2 (en) 2022-05-24 2025-10-28 International Business Machines Corporation Lesion detection and segmentation

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102744753B1 (ko) * 2021-08-26 2024-12-20 재단법인 아산사회복지재단 중이염 고막 영상에 기계 학습 모델을 이용하여 정상 고막 영상을 생성하기 위한 고막 영상 처리 장치 및 방법
KR20240078793A (ko) * 2022-11-28 2024-06-04 사회복지법인 삼성생명공익재단 Ai를 이용해 간의 구조를 3d 모델로 구현하는 방법 및 이를 위한 장치

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20140042531A (ko) * 2012-09-28 2014-04-07 삼성전자주식회사 카테고리별 진단 모델을 이용한 병변 진단 장치 및 방법
JP2016000102A (ja) * 2014-06-11 2016-01-07 ザイオソフト株式会社 画像処理装置、画像処理方法、及び画像処理プログラム
WO2017165801A1 (fr) * 2016-03-24 2017-09-28 The Regents Of The University Of California Classification de cancer sur la base d'apprentissage profond au moyen d'une infrastructure de classification hiérarchique
US20180240233A1 (en) * 2017-02-22 2018-08-23 Siemens Healthcare Gmbh Deep Convolutional Encoder-Decoder for Prostate Cancer Detection and Classification
WO2018161078A1 (fr) * 2017-03-03 2018-09-07 Massachusetts Eye And Ear Infirmary Réglage et normalisation d'image

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101854071B1 (ko) * 2017-01-13 2018-05-03 고려대학교 산학협력단 딥러닝을 사용하여 관심 부위 이미지를 생성하는 방법 및 장치
KR101917947B1 (ko) * 2017-02-23 2018-11-12 고려대학교 산학협력단 딥러닝을 사용하여 재발 부위를 예측하고, pet 이미지를 생성하는 방법과 장치

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20140042531A (ko) * 2012-09-28 2014-04-07 삼성전자주식회사 카테고리별 진단 모델을 이용한 병변 진단 장치 및 방법
JP2016000102A (ja) * 2014-06-11 2016-01-07 ザイオソフト株式会社 画像処理装置、画像処理方法、及び画像処理プログラム
WO2017165801A1 (fr) * 2016-03-24 2017-09-28 The Regents Of The University Of California Classification de cancer sur la base d'apprentissage profond au moyen d'une infrastructure de classification hiérarchique
US20180240233A1 (en) * 2017-02-22 2018-08-23 Siemens Healthcare Gmbh Deep Convolutional Encoder-Decoder for Prostate Cancer Detection and Classification
WO2018161078A1 (fr) * 2017-03-03 2018-09-07 Massachusetts Eye And Ear Infirmary Réglage et normalisation d'image

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112330619A (zh) * 2020-10-29 2021-02-05 浙江大华技术股份有限公司 一种检测目标区域的方法、装置、设备及存储介质
CN112330619B (zh) * 2020-10-29 2023-10-10 浙江大华技术股份有限公司 一种检测目标区域的方法、装置、设备及存储介质
US12456197B2 (en) 2022-05-24 2025-10-28 International Business Machines Corporation Lesion detection and segmentation
US20250054134A1 (en) * 2023-08-09 2025-02-13 Uti Limited Partnership Systems and methods for detecting ocular lesions in fundus images

Also Published As

Publication number Publication date
KR20200056871A (ko) 2020-05-25
KR102375258B1 (ko) 2022-03-17

Similar Documents

Publication Publication Date Title
WO2020101428A1 (fr) Dispositif de détection de zone de lésion, procédé de détection de zone de lésion, et programme d'ordinateur
KR102237441B1 (ko) 뉴럴 네트워크를 이용하여 캡슐 내시경 영상으로부터 병변 판독 방법 및 장치
WO2019103440A1 (fr) Procédé permettant de prendre en charge la lecture d'une image médicale d'un sujet et dispositif utilisant ce dernier
WO2019132168A1 (fr) Système d'apprentissage de données d'images chirurgicales
WO2017022908A1 (fr) Procédé et programme de calcul de l'âge osseux au moyen de réseaux neuronaux profonds
WO2022131642A1 (fr) Appareil et procédé pour déterminer la gravité d'une maladie sur la base d'images médicales
WO2020111557A1 (fr) Dispositif et procédé d'élaboration de carte de vaisseau sanguin et programme informatique d'exécution dudit procédé
WO2021177771A1 (fr) Procédé et système pour prédire l'expression d'un biomarqueur à partir d'une image médicale
WO2021071288A1 (fr) Procédé et dispositif de formation de modèle de diagnostic de fracture
WO2021034138A1 (fr) Procédé d'évaluation de la démence et appareil utilisant un tel procédé
WO2019189972A1 (fr) Méthode d'analyse d'image d'iris par l'intelligence artificielle de façon à diagnostiquer la démence
WO2019143021A1 (fr) Procédé de prise en charge de visualisation d'images et appareil l'utilisant
WO2021002669A1 (fr) Appareil et procédé pour construire un modèle d'apprentissage de lésion intégré, et appareil et procédé pour diagnostiquer une lésion à l'aide d'un modèle d'apprentissage de lésion intégré
WO2018093189A1 (fr) Système, procédé et programme d'estimation d'heure d'apparition d'un infarctus cérébral aigu
WO2022145841A1 (fr) Procédé d'interprétation de lésion et appareil associé
CN113052930A (zh) 一种胸部dr双能量数字减影图像生成方法
WO2019124836A1 (fr) Procédé de mappage d'une région d'intérêt d'une première image médicale sur une seconde image médicale, et dispositif l'utilisant
WO2021241830A1 (fr) Procédé et appareil d'analyse d'image rétinienne basé sur un réseau neuronal profond pour la détection d'une fonction rénale anormale
WO2020246676A1 (fr) Système de diagnostic automatique du cancer du col de l'utérus
CN113096132A (zh) 图像处理的方法、装置、存储介质和电子设备
WO2017010612A1 (fr) Système et méthode de prédiction de diagnostic pathologique reposant sur une analyse d'image médicale
US11120554B2 (en) Image diagnosis apparatus, image diagnosis method, and program
WO2025023801A1 (fr) Procédé de segmentation d'image médicale et dispositif pour son exécution
WO2025048107A1 (fr) Procédé de segmentation d'image médicale et dispositif pour son exécution
CN119379675A (zh) 基于深度学习的前列腺mri图像辅助诊断方法及系统

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19885601

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19885601

Country of ref document: EP

Kind code of ref document: A1