EP2845139A2 - Systeme und verfahren zur durchführung einer korrelationsanalyse klinischer ergebnisse und der eigenschaften von biologischem gewebe - Google Patents

Systeme und verfahren zur durchführung einer korrelationsanalyse klinischer ergebnisse und der eigenschaften von biologischem gewebe

Info

Publication number
EP2845139A2
EP2845139A2 EP13721622.2A EP13721622A EP2845139A2 EP 2845139 A2 EP2845139 A2 EP 2845139A2 EP 13721622 A EP13721622 A EP 13721622A EP 2845139 A2 EP2845139 A2 EP 2845139A2
Authority
EP
European Patent Office
Prior art keywords
biological
user interface
view
image
biological tissue
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP13721622.2A
Other languages
English (en)
French (fr)
Inventor
Vidya Pundalik KAMATH
Colin Craig MCCULLOCH
Megan ROTHNEY
Alberto Santamaria-Pang
Brion Daryl SARACHAN
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Leica Microsystems CMS GmbH
Original Assignee
General Electric Co
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US13/459,999 external-priority patent/US8737709B2/en
Priority claimed from US13/460,018 external-priority patent/US20130286043A1/en
Priority claimed from US13/460,081 external-priority patent/US9036888B2/en
Priority claimed from US13/459,958 external-priority patent/US20130286038A1/en
Priority claimed from US13/460,100 external-priority patent/US20150032671A9/en
Application filed by General Electric Co filed Critical General Electric Co
Publication of EP2845139A2 publication Critical patent/EP2845139A2/de
Withdrawn legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16B—BIOINFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR GENETIC OR PROTEIN-RELATED DATA PROCESSING IN COMPUTATIONAL MOLECULAR BIOLOGY
    • G16B20/00—ICT specially adapted for functional genomics or proteomics, e.g. genotype-phenotype associations
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/98—Detection or correction of errors, e.g. by rescanning the pattern or by human intervention; Evaluation of the quality of the acquired patterns
    • G06V10/993—Evaluation of the quality of the acquired pattern
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/69—Microscopic objects, e.g. biological cells or cellular parts
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16B—BIOINFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR GENETIC OR PROTEIN-RELATED DATA PROCESSING IN COMPUTATIONAL MOLECULAR BIOLOGY
    • G16B45/00—ICT specially adapted for bioinformatics-related data visualisation, e.g. displaying of maps or networks
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00—ICT specially adapted for the handling or processing of medical images
    • G16H30/40—ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
    • G02B21/365—Control or image processing arrangements for digital or video microscopes
    • G02B21/367—Control or image processing arrangements for digital or video microscopes providing an output produced by processing a plurality of individual source images, e.g. image tiling, montage, composite images, depth sectioning, image comparison

Definitions

  • exemplary embodiments may access data corresponding to multiple biological tissue samples corresponding to a patient cohort including the first patient and one or more other patients with breast cancer. Exemplary embodiments may retrieve data for the cohort corresponding to one or more features
  • the computer processor is also programmed to, in response to user input selecting a first biomarker and a first field of view corresponding to a biological tissue at the field of view selection component, render, on the graphical user interface, a first image of the selected first field of view corresponding to the biological tissue, the first image representing expression levels of the selected first biomarker and including representations of one or more biological units in the biological tissue.
  • a file structure browser 306 may be displayed to allow the user to view a file structure in which data files are organized.
  • the file structure browser 306 may allow the user to select one or more topmost level directories that include all of the image and/or text data corresponding to a study.
  • a default data source may be automatically selected if the user fails to make a selection.
  • the user interface may render in an overlaid manner the first image of the selected field-of-view of biological tissue in which expression levels of the first biomarker are automatically represented as one or more intensities of the first color, and a second image of the selected field-of-view corresponding to the biological tissue in which the expression levels of the second biomarker are automatically represented as one or more intensities of the second color.
  • Exemplary embodiments may display expression of one or more DNA sequences and one or more protein biomarkers in an overlaid manner in the same display panel.
  • the expression and non-expression of DNA sequences on a cell-by-cell basis may be determined based on fluorescence in situ hybridization (FISH).
  • FISH is a technique used to detect and localize the presence or absence of specific DNA sequences on chromosomes.
  • FISH is used in a similar manner as used for multiplexing to detect the hybridization of DNA probes at the cellular level.
  • the probes may look like tiny bright dots on a dark background, with each dot representing a probe on one copy of the gene. The brighter a spot, the more likely it is that the dot represents overlapping copies of the gene.
  • the morphological representation 1910 may facilitate identifying one or more biomarkers that are effective for isolating a target morphologically-related population of particles.
  • the user interface may receive, at the field-of-view selection component, user input selecting a field-of-view of biological tissue.
  • the user interface may also receive user input selection one or more biomarkers whose expression levels are to be displayed in the selected field-of-view of the biological tissue.
  • the user interface may receive, at the clinical outcome selection component, user input selecting a clinical outcome, for example, positive diagnosis of a disease or tissue condition, negative diagnosis of a disease or tissue condition, a disease prognosis, a prediction of drug response, stratification into a clinically-relevant group, and the like.
  • a clinical outcome for example, positive diagnosis of a disease or tissue condition, negative diagnosis of a disease or tissue condition, a disease prognosis, a prediction of drug response, stratification into a clinically-relevant group, and the like.
  • the selection of the aspects of the field-of- view may be automatically expanded using a supervised learning method or algorithm encoded on one or more non-transitory computer-readable media and implemented as computer- executable instructions.
  • the supervised leaming method may expand the selection of the aspects of the field-of-view by including one or more additional aspects in the same data cohort having one or more similar features. For example, if the user selects one or more biological units, exemplary embodiments may expand the selection with one or more additional biological units in the cohort having one or more similar features as in the user-selected biological units.
  • the quality review selection component 2504 may include a "Next Marker" tool 2514 to allow a user to replace the first image displayed in the display panel 502 with a different image of the same field-of-view of biological tissue obtained by treating the biological tissue with a different biomarker than the biomarker used to obtain the first image.
  • the user interface may render a second, different image of the selected field-of-view of biological tissue, while continuing to render the representation of the result of the selected morphological analysis such that the second image is overlaid by the representation of the result of the morphological analysis.
  • the second image may replace the first image on the user interface.
  • the second image result may be overlaid on the first image on the user interface.
  • Figure 30 is a flowchart illustrating an exemplary computer-implemented method performed in exemplary embodiments to allow a user to perform quality review of results of an image analysis method.
  • the class may manage one or more file streams used to read files and/or images in the database, memory allocated to store temporary data and/or variables during the data access operations, and the like.
  • Exemplary inputs to the class may include, but are not limited to, a class derived from the PathData interface class, information on specific images to be read, and the like.
  • the "PathlmageData" class may query the data structures generated by the "PathData” class to selectively retrieve the data specified in the input.
  • the attributes may include, but are not limited to, a unique identifier for the cell, a sample identifier identifying a sample, test, slide, and/or spot in which the cell was identified, a tissue identifier identifying a tissue that the cell is part of, and the like.
  • the attributes may also include, but are not limited to, one or more types corresponding to the cell (e.g., a structural type like red blood cell, a morphological type like oversized, a diagnostic type like diseased, and the like), a size of the cell, the boundaries of the cell (e.g., the boundaries of the cell on an image of biological tissue), a location of the cell (e.g., a location of the cell on an image of biological tissue), and the like.
  • the attributes may also include, but are not limited to, one or more expression levels associated with the cell (e.g., expression levels of one or more biomarkers, expression of one or more DNA sequences), and the like.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Theoretical Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Quality & Reliability (AREA)
  • Evolutionary Biology (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Biotechnology (AREA)
  • Biophysics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Proteomics, Peptides & Aminoacids (AREA)
  • Biomedical Technology (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Genetics & Genomics (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Data Mining & Analysis (AREA)
  • Radiology & Medical Imaging (AREA)
  • Epidemiology (AREA)
  • Primary Health Care (AREA)
  • Public Health (AREA)
  • Investigating Or Analysing Biological Materials (AREA)
  • Medical Treatment And Welfare Office Work (AREA)
  • Image Processing (AREA)
  • Processing Or Creating Images (AREA)
  • Apparatus Associated With Microorganisms And Enzymes (AREA)
  • User Interface Of Digital Computer (AREA)
EP13721622.2A 2012-04-30 2013-04-26 Systeme und verfahren zur durchführung einer korrelationsanalyse klinischer ergebnisse und der eigenschaften von biologischem gewebe Withdrawn EP2845139A2 (de)

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
US13/459,999 US8737709B2 (en) 2012-04-30 2012-04-30 Systems and methods for performing correlation analysis on clinical outcome and characteristics of biological tissue
US13/460,018 US20130286043A1 (en) 2012-04-30 2012-04-30 Systems and methods for analyzing biomarker co-localization in a biological tissue
US13/460,081 US9036888B2 (en) 2012-04-30 2012-04-30 Systems and methods for performing quality review scoring of biomarkers and image analysis methods for biological tissue
US13/459,958 US20130286038A1 (en) 2012-04-30 2012-04-30 Systems and methods for selection and display of multiplexed images of biological tissue
US13/460,100 US20150032671A9 (en) 2010-07-23 2012-04-30 Systems and methods for selecting and analyzing particles in a biological tissue
PCT/EP2013/058790 WO2013164281A2 (en) 2012-04-30 2013-04-26 Systems and methods for performing correlation analysis on clinical outcome and characteristics of biological tissue

Publications (1)

Publication Number Publication Date
EP2845139A2 true EP2845139A2 (de) 2015-03-11

Family

ID=48190980

Family Applications (3)

Application Number Title Priority Date Filing Date
EP13721622.2A Withdrawn EP2845139A2 (de) 2012-04-30 2013-04-26 Systeme und verfahren zur durchführung einer korrelationsanalyse klinischer ergebnisse und der eigenschaften von biologischem gewebe
EP13719105.2A Withdrawn EP2845138A1 (de) 2012-04-30 2013-04-26 Systeme und verfahren zur analyse der biomarker co-lokalisierung in einem biologischen gewebe
EP13719104.5A Active EP2845137B1 (de) 2012-04-30 2013-04-26 Systeme und verfahren zur qualitätsprüfungswertung von biomarkern und bildanalyseverfahren für biologisches gewebe

Family Applications After (2)

Application Number Title Priority Date Filing Date
EP13719105.2A Withdrawn EP2845138A1 (de) 2012-04-30 2013-04-26 Systeme und verfahren zur analyse der biomarker co-lokalisierung in einem biologischen gewebe
EP13719104.5A Active EP2845137B1 (de) 2012-04-30 2013-04-26 Systeme und verfahren zur qualitätsprüfungswertung von biomarkern und bildanalyseverfahren für biologisches gewebe

Country Status (4)

Country Link
EP (3) EP2845139A2 (de)
JP (2) JP6317732B2 (de)
AU (1) AU2013255961B2 (de)
WO (5) WO2013164281A2 (de)

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5953195B2 (ja) * 2012-09-21 2016-07-20 株式会社キーエンス 撮影解析装置、その制御方法及び撮影解析装置用のプログラム
US9891804B2 (en) * 2012-12-06 2018-02-13 Ge Healthcare Bio-Sciences Corp. Selection and display of biomarker expressions
US20170183648A1 (en) * 2015-08-12 2017-06-29 Quick Biology, Inc. Method, kit and array for functional validation of results derived from high throughput studies
US10890592B2 (en) * 2015-11-04 2021-01-12 Metabolon, Inc. Automated sample quality assessment
JP2021500539A (ja) * 2017-10-18 2021-01-07 ヴェン バイオサイエンシズ コーポレーション 診断及び治療モニタリングのための生体パラメータの同定及び使用
EP3789960A1 (de) * 2019-09-05 2021-03-10 Leica Biosystems Imaging, Inc. Benutzerunterstützte iteration von zellbildsegmentierung
CA3161263A1 (en) * 2020-01-28 2021-08-05 Jilian SUE Systems and methods for delivery of digital biomarkers and genomic panels
US11475251B2 (en) 2020-01-31 2022-10-18 The Toronto-Dominion Bank System and method for validating data
JP2021124861A (ja) * 2020-02-04 2021-08-30 ソニーグループ株式会社 解析装置、解析方法、解析プログラム及び診断支援システム
JP7653267B2 (ja) 2021-02-12 2025-03-28 株式会社Screenホールディングス 閾値決定方法
US11783083B2 (en) 2021-03-19 2023-10-10 International Business Machines Corporation Computing trade-offs between privacy and accuracy of data analysis
JP7897622B2 (ja) * 2022-10-28 2026-07-30 株式会社biomy 情報処理装置、情報処理方法及びプログラム

Family Cites Families (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5235522A (en) * 1990-10-10 1993-08-10 Cell Analysis Systems, Inc. Method and apparatus for automated analysis of biological specimens
JPH1198372A (ja) * 1997-09-18 1999-04-09 Olympus Optical Co Ltd 色調整方法
US6642716B1 (en) * 2002-05-15 2003-11-04 Koninklijke Philips Electronics, N.V. Diffusion tensor magnetic resonance imaging including fiber rendering using hyperstreamlines
US7369696B2 (en) * 2003-04-02 2008-05-06 Ge Healthcare Uk Limited Classification of cells into subpopulations using cell classifying data
US20060031187A1 (en) * 2004-08-04 2006-02-09 Advizor Solutions, Inc. Systems and methods for enterprise-wide visualization of multi-dimensional data
CA2580795A1 (en) * 2004-09-22 2006-04-06 Tripath Imaging, Inc. Methods and compositions for evaluating breast cancer prognosis
JP4518281B2 (ja) * 2005-06-09 2010-08-04 株式会社日立メディコ 疾患判定支援システム
US20070168154A1 (en) * 2005-12-23 2007-07-19 Ericson Richard E User interface for statistical data analysis
US8131476B2 (en) * 2006-08-07 2012-03-06 General Electric Company System and method for co-registering multi-channel images of a tissue micro array
US20090327906A1 (en) * 2008-06-30 2009-12-31 Microsoft Corporation Supporting brand assets in a social networking service
US8861810B2 (en) * 2009-01-06 2014-10-14 Vala Sciences, Inc. Automated image analysis with GUI management and control of a pipeline workflow
US20100177942A1 (en) * 2009-01-14 2010-07-15 Applied Spectral Imaging Ltd. Method and apparatus for analyzing imagery data
US8269827B2 (en) 2009-09-29 2012-09-18 General Electric Company System and methods for mapping fluorescent images into a bright field color space
US8706184B2 (en) * 2009-10-07 2014-04-22 Intuitive Surgical Operations, Inc. Methods and apparatus for displaying enhanced imaging data on a clinical image
US20110091081A1 (en) * 2009-10-16 2011-04-21 General Electric Company Method and system for analyzing the expression of biomarkers in cells in situ in their tissue of origin
US8320655B2 (en) * 2009-10-16 2012-11-27 General Electric Company Process and system for analyzing the expression of biomarkers in cells
US20110202624A1 (en) * 2010-02-11 2011-08-18 Virtual Gestures, LLC. Techniques for sharing content
US8693743B1 (en) * 2010-02-19 2014-04-08 Olive Tree Media, LLC Analysis and display of multiple biomarker co-expression in cells and tissues
JP5864559B2 (ja) * 2010-06-04 2016-02-17 ライカ バイオシステムズ イメージング インコーポレイテッドAperio Technologies, Inc. デジタル化された顕微鏡スライドのスライド品質を判断するシステム及び方法
CA2807144C (en) * 2010-07-30 2019-05-28 Fundacao D. Anna Sommer Champalimaud E Dr. Carlos Montez Champalimaud Systems and methods for segmentation and processing of tissue images and feature extraction from same for treating, diagnosing, or predicting medical conditions
US8766803B2 (en) * 2011-05-13 2014-07-01 Roche Diagnostics Operations, Inc. Dynamic data collection
US9740912B2 (en) * 2011-12-20 2017-08-22 Definiens Ag Evaluation of co-registered images of differently stained tissue slices

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
None *
See also references of WO2013164281A2 *

Also Published As

Publication number Publication date
WO2013164277A2 (en) 2013-11-07
JP2015527622A (ja) 2015-09-17
WO2013164281A3 (en) 2013-12-27
JP6187989B2 (ja) 2017-08-30
JP2015526771A (ja) 2015-09-10
EP2845137A1 (de) 2015-03-11
WO2013164277A3 (en) 2013-12-27
WO2013164278A1 (en) 2013-11-07
WO2013164281A2 (en) 2013-11-07
WO2013164279A1 (en) 2013-11-07
WO2013164280A1 (en) 2013-11-07
EP2845138A1 (de) 2015-03-11
AU2013255961B2 (en) 2017-12-07
AU2013255961A1 (en) 2014-10-23
EP2845137B1 (de) 2021-01-20
JP6317732B2 (ja) 2018-04-25

Similar Documents

Publication Publication Date Title
US9036888B2 (en) Systems and methods for performing quality review scoring of biomarkers and image analysis methods for biological tissue
US20130290225A1 (en) Systems and methods for selecting and analyzing particles in a biological tissue
US8737709B2 (en) Systems and methods for performing correlation analysis on clinical outcome and characteristics of biological tissue
EP2845137B1 (de) Systeme und verfahren zur qualitätsprüfungswertung von biomarkern und bildanalyseverfahren für biologisches gewebe
US20130286038A1 (en) Systems and methods for selection and display of multiplexed images of biological tissue
US9891804B2 (en) Selection and display of biomarker expressions
US9836865B2 (en) Systems and methods for split screen display of biological specimen and for capturing records thereof
US20220237796A1 (en) Quality Control of Automated Whole-slide Analyses
JP2019533805A (ja) 視覚化されたスライド全域画像分析を提供するためのデジタル病理学システムおよび関連するワークフロー
US20240086460A1 (en) Whole slide image search
KR20220058637A (ko) 머신 러닝 알고리즘을 사용하여 훈련 데이터세트들을 준비하는 방법
US11721115B2 (en) Systems and methods for processing images to determine image-based computational biomarkers from liquid specimens
US20130286043A1 (en) Systems and methods for analyzing biomarker co-localization in a biological tissue
KR20240149778A (ko) 병리 슬라이드 이미지를 출력하는 방법 및 장치
Mishra et al. Automated grading and staging of ovarian cancer using deep learning on the transmission optical microscopy bright-field images of thin biopsy tissue samples

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20141006

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20180919

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: GLOBAL LIFE SCIENCES SOLUTIONS USA LLC

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN WITHDRAWN

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: LEICA MICROSYSTEMS CMS GMBH

18W Application withdrawn

Effective date: 20210719