WO2021146420A1 - Systems and methods for assessing colonoscopy preparation - Google Patents

Systems and methods for assessing colonoscopy preparation Download PDF

Info

Publication number
WO2021146420A1
WO2021146420A1 PCT/US2021/013433 US2021013433W WO2021146420A1 WO 2021146420 A1 WO2021146420 A1 WO 2021146420A1 US 2021013433 W US2021013433 W US 2021013433W WO 2021146420 A1 WO2021146420 A1 WO 2021146420A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
preparation
information processing
component
processing component
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2021/013433
Other languages
French (fr)
Inventor
Dale R. Bachwich
Vera O. KOWAL
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
DARK CANYON LABORATORIES LLC
Original Assignee
DARK CANYON LABORATORIES LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by DARK CANYON LABORATORIES LLC filed Critical DARK CANYON LABORATORIES LLC
Priority to MX2022008698A priority Critical patent/MX2022008698A/en
Priority to KR1020227027442A priority patent/KR20220143655A/en
Priority to CA3164381A priority patent/CA3164381A1/en
Priority to AU2021208546A priority patent/AU2021208546A1/en
Priority to US17/792,933 priority patent/US20230070807A1/en
Priority to JP2022543124A priority patent/JP2023510582A/en
Priority to IL294753A priority patent/IL294753A/en
Priority to CN202180009609.3A priority patent/CN115516310A/en
Priority to EP21741031.5A priority patent/EP4090968A4/en
Priority to BR112022013945A priority patent/BR112022013945A2/en
Publication of WO2021146420A1 publication Critical patent/WO2021146420A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/103Measuring devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/1032Determining colour of tissue for diagnostic purposes
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B10/00Instruments for taking body samples for diagnostic purposes; Other methods or instruments for diagnosis, e.g. for vaccination diagnosis, sex determination or ovulation-period determination; Throat striking implements
    • A61B10/0038Devices for taking faeces samples; Faecal examination devices
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/145Measuring characteristics of blood in vivo, e.g. gas concentration or pH-value ; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid or cerebral tissue
    • A61B5/14507Measuring characteristics of blood in vivo, e.g. gas concentration or pH-value ; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid or cerebral tissue specially adapted for measuring characteristics of body fluids other than blood
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/145Measuring characteristics of blood in vivo, e.g. gas concentration or pH-value ; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid or cerebral tissue
    • A61B5/1455Measuring characteristics of blood in vivo, e.g. gas concentration or pH-value ; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid or cerebral tissue using optical sensors, e.g. spectral photometrical oximeters
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/74Details of notification to user or communication with user or patient; User input means
    • A61B5/746Alarms related to a physiological condition, e.g. details of setting alarm thresholds or avoiding false alarms
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/17Systems in which incident light is modified in accordance with the properties of the material investigated
    • G01N21/25Colour; Spectral properties, i.e. comparison of effect of material on the light at two or more different wavelengths or wavelength bands
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • G01N21/8851Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/40Analysis of texture
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/90Determination of colour characteristics
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H10/00ICT specially adapted for the handling or processing of patient-related medical or healthcare data
    • G16H10/20ICT specially adapted for the handling or processing of patient-related medical or healthcare data for electronic clinical trials or questionnaires
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00ICT specially adapted for the handling or processing of medical images
    • G16H30/40ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • G01N21/8851Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges
    • G01N2021/8887Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges based on image processing techniques

Definitions

  • the present disclosure relates to systems and methods for assessing the status of colon cleansing.
  • the present disclosure relates to systems and methods to determine completion of colon preparation in subjects, e.g., in real-time, prior to a gastrointestinal procedure.
  • the methods may further comprise one or each of capturing a background image of the toilet, and loading the image, and optionally the background image, into an information processing component from the imaging device.
  • the methods further comprise adding a flushable marker to the toilet.
  • die methods further comprise adding an antifoaming agent to the toilet.
  • Also disclosed herein are systems for assessing the status of a colon preparation in a subject comprising an imaging device, a communication component, an information processing component configured to analyze data from two or more images of bowel effluent, and a protocol component.
  • the imaging device is integrated into the information processing component.
  • the information processing component is a tablet computer, a portable computer, or a wearable computer, in some embodiments, the information processing component is in communication with a clinician device in contact with a clinician.
  • FIG. I is a flow diagram illustrating select embodiments of the me thods for assessing the status of a colon preparation in a subject.
  • FIG. 2 is a flow diagram illustrating exemplary feedback to the artificial intelligence component for machine learning.
  • FIGS. 3A-3E are exemplar ⁇ ' toilet bowl images during colon preparation.
  • FIG. 3A is an exemplary baseline toilet bowl image.
  • FIGS. 3B-3D are exemplar ⁇ ' images throughout colon preparation taken at an early stage (FIG. 3B), midway through preparation (FIG. 3C), and nearing the end of the preparation (FIG. 3D).
  • FIG. 3E is an exemplar ⁇ ' image at the end of the preparation.
  • FIGS. 4A-4I are exemplary toilet bowl images during colon preparation.
  • FIGS. 4A, 4D, and 4G are a raw image, an image resulting from using edge detection, and an image resulting from using red pixel intensity, respectively, of an exemplary baseline image, as the preparation commenced.
  • FIGS. 4B, 4E, and 4H are a raw' image, an image resulting from using edge detection, and an image resulting from using red pixel intensity, respectively, of an exemplary ' final image where preparation was still deemed incomplete (Not Ready).
  • FIGS, 4C, 4F, and 41 are a raw image, an image resulting from using edge detection, and an image resulting from using red pixel intensity, respectively, of an earliest image where the preparation was sufficient (Ready), based on the judgements of a colonoscopy preparation expert.
  • FIG. 5 is an image of exemplary ' marker capsules.
  • FIGS. 6A-6D are images showing the effect of a marker capsule on edge detection.
  • FIG. 6A and 6B are images of a dark toilet drain at baseline without and with the use of a marker capsule.
  • FIGS. 6C and 6D are images after applying edge detection to the images of FIGS. 6A and 6B, respectively.
  • processor and “central processing unit” or “CPU” are used interchangeably and refer to a device that is able to read a program from a computer memory' (e.g., ROM or other computer memory') and perfonn a set of steps according to the program.
  • a computer memory' e.g., ROM or other computer memory'
  • computer memory and “computer memory device” refer to any storage media readable by a computer processor. Examples of computer memory include, but are not limited to, RAM, ROM, computer chips, digital video discs (DVD), compact discs (CDs), hard disk drives (HDD), and magnetic tape.
  • the term “computer readable medium” refers to any device or system for storing and providing infonnation (e.g., data and instructions) to a computer processor. Examples of computer readable media include, but are not limited to, DVDs, CDs, hard disk drives, magnetic tape and servers for streaming media over networks. The computer readable medium may be non- transitoiy or include a de vice of system that is not a transitory signal.
  • the term “in electronic communication” refers to electrical devices (e.g. , computers, processors, etc.) that are configured to communicate with one another through direct or indirect signaling.
  • a “subject” or “patient”' may be human or non-human and may include, tor example, animal strains or species used as “model systems” for research purposes, such a mouse model as described herein.
  • patient may include either adults or juveniles (e.g., children).
  • patient may mean any living organism, preferably a mammal (e.g. , human or non-human). In one embodiment of the methods and systems provided herein, the mammal is a human.
  • the present disclosure provides methods and systems to assess the status of a colon preparation in a subject.
  • the methods and system assess the status (e.g., determine end-point) of a colon preparation in a subject in real-time.
  • Colon preparation is employed by a patient to cleanse their colon and digestive tract prior to a colon-related or gastrointestinal medical procedure, including, for example, colonoscopy, capsule endoscopy, single- and double-balloon enteroscopy, endo!ummal gastroplication, endoscopic ultrasound (EU8), esophagogastroduodenoscopy (EGD), endoscopic retrograde cholangiopancreatography (ERCP), esophageal pH exam, flexible sigmoidoscopy (Flex Sig), hydrogen breath test, liver biopsy, percutaneous endoscopic gastrostomy (PEG), biofeedback for anorectal dysfunction, intraoperative radiation therapy (TORT), diagnostic GI radiology, including barium enema, CT colonography, €T enterography, MR colonograpiry, and MR enterography; surgical procedures including, but not limited to laparoscopic cholecystectomy (Gallbladder Removal), colectomy, hysterectomy, hemorrhoidectomy, hernior
  • assessment aspects include, but are not limited to, color of effluent, clarity of effluent, texture of the effluent presence of particulate matter or solid material in the effluent, and density of particulate matter or solid material in the effluent.
  • considerations in assessing the image may include if any edges at the bottom of a toilet bowl are visible, if any edges from toilet paper beneath surface are visible, if there is a color gradient at. toilet bowl edges descending to the bottom of the bowl, or if there is a contrast gradient with a flushable marker, in some embodiments, the observable edges or contrasts in the toilet comprise edges or contrasts along bottom of toilet bowl, edges or contrasts from the flushable marker, or a combination thereof.
  • the systems and methods comprise one or more or each of: an imaging component, a communication component, an information processing component, and a protocol component.
  • the methods further comprise adding a flushable marker and/or an anti-foaming agent to the toilet.
  • the methods further comprise a clinician device. Illustrative embodiments of each of these components, their integration into the system, and their use in the methods is described below.
  • the systems and methods comprise an imaging device.
  • the imaging device facilitates capture of an image of bowel effluent in a toilet, and optionally an image of the toilet without bowel effluent, preferably taken immediately beforehand.
  • the imagining device may include, for example, a camera, a cellular phone with an embedded camera, or a computer.
  • Tire imaging device can comprise hardware such as the image sensor (e.g., CCD (charge coupled device), CMOS (complementary metal oxide semiconductor), etc.) and software for operating the image sensor and/or the imaging component, in some embodiments, the imaging device is incorporated or embedded in one of the other components of the system (e.g., the information processing component).
  • an imaging device is integrated into a toilet and automatically, or upon activation by a user, captures one or more images before and after (or during) generation of a bowel effluent.
  • sensors detect a toilet-related event (e.g., lifting of a lid, contact or depression of a handle, reduction in light due to movement of a person over the toilet, passage of effluent material into the toilet, etc.) in order to trigger the timing of image capture.
  • a toilet-related event e.g., lifting of a lid, contact or depression of a handle, reduction in light due to movement of a person over the toilet, passage of effluent material into the toilet, etc.
  • the systems and methods comprise a communication component.
  • the communication component communicates information from the imaging device to an information processing component.
  • the communication component communicates information to or from the information processing component (e.g., to or from the imaging device or a clinician device).
  • the communication component communicates information from any one component of the system (e.g., an imaging component), to any other component of the system, between two sub-components of the system, or between a component outside of the system (e.g,, a clinician device or an external device, for example, a wearable physiological tracker)).
  • a portion or ail of the communication component is wired.
  • the communication component comprises wires or cables connecting the imaging device directly or indirectly to an information processing component (e.g,, computer, a computer processor within a phone, etc.).
  • a portion of or the entire communication component is wireless.
  • Any desired wireless communication technology may be employed, including but not limited to, electromagnetic wireless telecommunications (e.g., wireless networking, cellular, satellite), and electromagnetic induction (such as light, magnetic, or electric fields or the use of sound).
  • electromagnetic wireless telecommunications e.g., wireless networking, cellular, satellite
  • electromagnetic induction such as light, magnetic, or electric fields or the use of sound.
  • any desired protocol can be used (e.g., ZigBee, EnOcean, Personal area networks, Bluetooth. TransferJet, ultra-wideband),
  • the imaging device comprises a wireless communication component such that signal generated from the imaging de vice is transmitted to an information processing component wirelessly in a HIPAA -compliant fashion.
  • the communication component communicates information comprising images and/or instructions to the information processing component.
  • the systems and methods comprise an information processing component.
  • the information processing component can provide a variety of functions, including but not limited to: receiving and processing images generated from the imaging device; receiving and processing data generated from an external device; displaying information to a subject; displaying instructions to a subject; storing information; storing, transmitting, executing, and/or displaying protocols; and presenting alarms.
  • the information processing component comprises one or more of a computer processor, computer readable medium, and software. Any of a variety of computing devices may be used as the information processing component, including but not limited to, a desktop computer, a mainframe computer, a laptop computer, a personal digital assistant (PDA), a portable computer (e.g., mobile devices such as telephones), a tablet computer (e.g., standard tablets, slates, mini tablets, phablets, customer handheld devices), and a wearable computer (e.g., eyeglass, wristwatch, clothing, helmet, etc.), in select embodiments, the information processing component comprises a tablet computer, a portable computer, or a wearable computer.
  • PDA personal digital assistant
  • a portable computer e.g., mobile devices such as telephones
  • a tablet computer e.g., standard tablets, slates, mini tablets, phablets, customer handheld devices
  • a wearable computer e.g., eyeglass, wristwatch, clothing, helmet, etc.
  • the information processing component comprises
  • the information processing component or a de vice in electronic communication with the information processing component comprises a display, in some embodiments, the display displays textual and/or graphical information to a user (e.g., a subject completing a colon preparation), in some embodiments, the display is a touchscreen display, permitting the user to select and manage system functions via a graphical interface, in some embodiments, audio information is conveyed (e.g., via speakers, headphones, etc,).
  • the display displays information to the user related to instructions for or status of the colon preparation
  • tire interface displays status identifiers (e.g,, ready, good progress, pause, not ready).
  • the interface provides an additional graphical interface of status (e.g., stop light indications).
  • the interface further provides textual instructions (e.g., stop taking prep, drink only clear liquids until procedure, wait 30 minutes, take another image of effluent, take another dose of prep medications).
  • the interface provides an additional graphical interface of instructions completed (e.g., thumbs up/thumbs down or check marks). The user interface may also pro vide step by step instructions of setting up, using, and managing the system ,
  • the information processing component or a device in electronic communication with the information processing component, comprises a networking component.
  • the networking component receives and/or transmits information to the communication component.
  • the information processing component comprises a database containing protocols, subject data, historic data, or other desired information.
  • the protocols, subject data, historic data, or other desired information may be provided by computer processor, computer readable medium, software, or be available through a web-based platform via a web browser across the internet.
  • the information processing component is in communication with a clinician device in contact with a clinician.
  • the communication with the clinician device is via the networking component and/or the communication component.
  • the information processing component comprises an artificial intelligence component (c.g . embodied in software running on the processor).
  • the artificial intelligence component alters stored protocols in response to instructions received from another component of the system (e.g., protocol component) or from another device (e.g., clinician device).
  • the artificial intelligence component comprises image analysis software.
  • the image analysis software evaluates the image obtained by the imaging component.
  • the image analysis software may assess the status of tire bowel effluent.
  • the image analysis software may assess the observable edges or contrasts (e.g., a flushable maker) on the bottom of or in the toilet bowl.
  • the image analysis software may include the ability to transform the images provided by the subject, creating enhanced images which may include highlighting, coloring, emphasis or de- emphasis of detail , digital filtering, among many other potential transformations. For example, the image analysis software may subtract out the background image without the bowel effluent or subtract out other foreign objects or abnormalities, such as toilet paper, glare, or shadows, from the bowel effluent image. The image analysis software may transform the image to align and correct the image to resemble the background image in brightness/contrast, size, and orientation (e.g., pan, tilt and rotation).
  • the imaging software could be custom designed, licensed from third parties, or even commercially available software. Multiple software programs may be utilized together in order to fully analyze the image.
  • the image analysis software may also generate results and/or reports based on die analysis of the image.
  • tire artificial intelligence component alters protocols or displays instructions based on the image analysis evaluation of the bowel effluent (e.g., utilizing a machine learning process).
  • the artificial intelligence component provides real-time feedback of the status of the colon cleanse to the subject based on the image analysis software. Consequently, the artificial intelligence component facilitates customization of protocols and prep medication dosing (e.g., increase or decrease in amount or frequency, continuation of dosing regimen, termination of dosing regimen) in real-time, based on active monitoring of the images unlike convention preparations utilizing a universal approach without a form of monitoring.
  • the artificial intelligence component instructs the information processing component to report the image results to a clinician device.
  • the baseline toilet bowl image is analyzed with regard to lighting quality and focus. Additional processing may occur, including, for example: identification of the meniscus; determination of uniformity of lighting across the field within the meniscus; determination of the level of focus of edges within the area defined by the meniscus (the region of interest): determination of the color of the toilet bowl outside of the meniscus in comparison to the color just inside the meniscus; subtraction of the bowl color from the image in those instances when the toilet bowl color is not white; and identification of the greatest color variation between segments of the image just inside the meniscus and other sites within the region of interest, excluding edges.
  • Subsequent images are analyzed comparing the baseline image with the newest image for focus, color analysis, edge analysis, visual texture and time analysis.
  • Each image is analyzed as the baseline image to identify tire meniscus and determine if tire overall image is in focus, in some embodiments, the methods and systems comprise addition of an anti-foaming agent, such as simethicone and the like, to the toilet to allow for better focus, color analysis, edge analysis, and visual texture during image analysis.
  • an anti-foaming agent such as simethicone and the like
  • Color analysis may include: subtraction of the baseline image color from the image being analyzed, detection and determination of a color change in the region of interest; determination of the colors of the textons (particular objects creating texture) in the region of interest; and evaluation of the new image data using algorithms defining acceptable and optimal values for color of the toilet water and of the textons.
  • the red color pixel intensity of the water in the grayscale image should have values of 125 to 255 to be acceptable. Red color pixel values of water below 125 indicate inadequate preparation in this example.
  • Edge analysis includes determination if any of the previously defined edges within the area defined by the meniscus (the region of interest) still in view and if there any new edges within the region of interest, in some embodiments, edge analysis includes assessing observable contrast or edges from a flushable marker.
  • Flushable markers include any agent or object useful in providing contrast to the image of the toilet, including, but not limited to, capsules, tablets, caplets, or pellets of any variety of sizes and shapes made of a flushable material in a color contrasting the toilet and/or effluent.
  • Visual texture analysis includes determination of the sizes of the textons within the region of interest and the homogeneity in the sizes of the textons within the region of interest and evaluation of any observable three-dimensional texture within the region of interest.
  • S5 Once a second subsequent image is available, each image will be analyzed to determine if there was a progressive change in edge improvement, color dilution, or texton size/homogeneity from the previous image(s).
  • the artificial intelligence component will go through a machine learning process, both supervised and unsupervised.
  • the machine learning process provides feedback the artificial intelligence uses to alter tire protocol component.
  • the endoscopy electronic health record (U IR) provides images and other data to the software; the software uses the images coupled to other outcome parameters to provide feedback to the system.
  • the feedback includes, for example, success of preparation (Bos ton Bowel Preparation Scale (BBPS) 6 or better, with a 2 or better in every segment); level of intra-procedural work required to make preparation successful; quality of the preparation (high quality is considered BBPS 8 or better); quantity of intra-procedural work necessary to make preparation high quality; completion of colonoscopy; detection and quantification of adenomatous polyps; detection and quantification of serrated polyps; detection of colon cancer.
  • success of preparation Bos ton Bowel Preparation Scale (BBPS) 6 or better, with a 2 or better in every segment
  • level of intra-procedural work required to make preparation successful quality of the preparation (high quality is considered BBPS 8 or better); quantity of intra-procedural work necessary to make preparation high quality
  • completion of colonoscopy detection and quantification of adenomatous polyps; detection and quantification of serrated polyps; detection of colon cancer.
  • the machine learning process aids in the creation of thresholds for color, turbidity (ability to detect edge), and visual texture for both size and color of textons for each of the following conditions: successful preparation, high quality preparation, successful prep with limited work, where the user may specify the work limit; high quality preparation with limited work, where the user may specify the work limit; unsuccessful prep; and preparation complicated by bleeding event.
  • FIGS. 3A-E Shown in FIGS. 3A-E is an example of toilet bowl images from a preparation, using artificial stool , FIG. 3A shows a high-quality baseline toilet bowl image.
  • Nearing the end of the preparation (FIG. 3D), even though the fluid is clearer than FIG. 3C, no edges seen in the baseline image can be discerned, the textons other than toilet paper are larger than 2mm, and the color has a Green intensity of 108, below a criteria threshold of 160.
  • edges from the baseline image can be easily seen, no textons other than toilet paper are visible, and the color is acceptable with a Green intensity of 180.
  • the disclosure also provides a pre-procedure preparation scale and methods of creating and using a pre -procedure preparation scale.
  • the machine learning process aids in the creation of a pre-procedure preparation scale and/or applies image analysis to classify or score the image based on a pre -procedure preparation scale
  • the pre -procedure preparation scale is based on analysis of bow el effluent (e.g., color of effluent, clarity of effluent, presence of particulate mater or solid material, density of particulate matter or solid material, texture of the effluent, or combinations thereof) and/or observable edges or contrasts (e.g., from a flushable marker).
  • the scale may be used to correlate the preparation or the status of the preparation with existing bowel cleanliness scales (e.g., Boston Bowel Preparation Scale, Aronc!iick Scale, Ottawa Bowel Preparation Scale, and Harefield Cleansing Scale).
  • the threshold may be adjusted for the individual patient, the planned colonic procedure, or other clinical factors. For example, a standard colonoscopy may have a lower acceptable score than a wireless capsule colonoscopy which requires a very high level of cleanliness.
  • the pre-procedure preparation scale may he updated based on ongoing data collection, including, but not limited to colonoscopic video during examinations, programs that monitor and score colonic cleanliness intra-proecdurallyy existing bowel cleanliness scales including the Boston Bowel Preparation Scale, Aronchick Scale, Ottawa Bow el Preparation Scale, Harefield Cleansing Scale, and clinically relevant outcome measures. Such clinical measures include adenoma detection rate, cleansing time, and overall procedure time. Such scale updates may he performed manually, by supervised artificial intelligence, or by unsupervised artificial intelligence. The described validation and update process would be performed in compliance with applicable FDA regulations.
  • An exemplary pre-procedure preparation scale may use a numbered-sca!e as shown in Table 1 ,
  • the threshold for an acceptable prep based on this scale may be in the range of 5 to 6, which likely correlates to a score of 6 on the Boston Bowel Preparation Scale.
  • the scores of any exemplary- scales can be validated in randomized, controlled, clinical trials before general use.
  • the information processing component, the imaging component, the communication component, or any combination thereof are contained within a single device (e.g., a tablet computer, a mobile phone, a wristwatch computer, etc.).
  • a single device e.g., a tablet computer, a mobile phone, a wristwatch computer, etc.
  • Protocol component
  • the systems and methods comprise a protocol component.
  • the protocol component comprises instructions, typically embodied in software, for managing the methods and use of the system.
  • the software comprises all non-transitory forms of software, or ail those forms of software except those based on a transitory, propagating signal, in some embodiments, the protocol component is stored m a computer readable medium. In some embodiments, the protocol component is embodied in the information processing component.
  • the protocol component directs the display of information, in some embodiments, the display comprises instructions (e.g., graphical, textual, audio, etc.) for use of the imaging component. For example, in some embodiments, the protocol component directs the subject to take an initial image or repeat an image if quality is not acceptable, in some embodiments, the protocol component displays information comprising tasks to be completed (e.g., how to take the medications, how 7 to take the images, how to modify the prep based on instructions), knowledge of task completion, or status of colon preparation.
  • the protocol component directs the display of information
  • the display comprises instructions (e.g., graphical, textual, audio, etc.) for use of the imaging component.
  • the protocol component directs the subject to take an initial image or repeat an image if quality is not acceptable
  • the protocol component displays information comprising tasks to be completed (e.g., how to take the medications, how 7 to take the images, how to modify the prep based on instructions), knowledge of task completion, or status of colon preparation.
  • the protocol component may comprise a scheduling function, such that the protocol can provide instructions prior to starting the colon cleanse (e.g., low residue diet instructions 5 days prior to cleanse, consume only clear liquids evening before colon cleanse).
  • the protocol component may display instructions for the day of the medical procedure or provide background information or answers to frequently asked questions regarding the specific medical procedure.
  • the format of the display is adjustable to accommodate any subject type, including those with impaired vision or hearing, impaired cognitive skills, color blindness, young age, varied language skills or knowledge, etc.
  • the protocol component comprises data storage and management capabilities.
  • Data storage includes data storage and management for individual subjects, for example, to monitor bowel effluent over time, in some embodiments, data storage also includes storage and management for multiple subjects, including, but not limited to, colonoscopy outcomes, bowel cleanliness at the time of exam, adenoma detection, intraprocedura! cleansing effort required, relevant health history factors, and other relevant factors (e.g., body habitus, socio-demographic) that impact colon cleansing.
  • These linked data may be used to make comparative analysis and/or improve artificial intelligence capabilities of the system which can then, in turn, be used to optimize the system and finally, applied to future patients using the system. This application of machine learning to optimize the management of future patients may be either supervised or unsupervised.
  • the protocol component comprises specific colon cleansing protocols.
  • the protocol component allows selection of specific colon cleansing protocols (e.g., specific medications or specific medical procedures) such that the instructions are tailored to the specific colon cleansing protocol or image analyses are completed within the colon cleansing specifications for a specific medical procedure.
  • the protocol may be selected by the subject following instructions by the clinician or pre-selected for the subject by the clinician through the integration with the clinician device.
  • the protocols employed can be updated and optimized for any desired cleansing protocol or medical procedure by the clinician.
  • the protocol instructs the processor to report the image results to a clinician device.
  • the protocol may compare data from previous measurements to determine whether the subject has progressed with the colon cleansing.
  • the specific colon cleansing protocol (e.g., amount and frequency of dosing of prep medications, maintenance of dosing beyond original dosing schedule, early termination of dosing schedule) may be customized during the preparation (e.g., by the clinician or based on image analysis) in real-time.
  • the protocol component comprises a query function, such that the protocol component displays questions regarding symptoms or side effects that may be experienced during the colon preparation to the subject for a response.
  • the query function may question the occurrence, absence, level or frequency of nausea, vomiting, thirst, light-headedness, abdominal pain, and the like.
  • the protocol component may adjust tire protocol instructions (e.g,, slow or pause colon cleansing protocol) based on the responses to the question(s).
  • the protocol component may send the responses to the information processing component which may adjust the instructions for the specific colon cleansing protocol based on the answers given to the questions regarding symptoms or side effects. Alternatively, the responses may be sent to the clinician device for review by the clinician and potential subsequent protocol adjustment.
  • the query' function may instruct a patient to capture data regarding physiological parameters (e.g., temperature, heart rate, and the like) from a connected device as described elsewhere herein (e.g., wearable devices, clothing with embedded monitoring devices), an external device (e.g., home-based devices, such as thermometers, blood sugar monitoring devices, home audio monitoring equipment (e.g., Siri and Alexa), a cell phone app which enables smartphones to monitor physiologic or other parameters directly or indirectly by linking to afferent sensing hardware, toilet-based sensors, or the like.
  • the information processing component may detect an anomaly or side-effect from a connected external de vice and trigger the query function within the protocol component. For example, the information processing component may detect tachycardia from a wearable device and trigger the query function of the protocol component to ask questions regarding patient distress or instruct the patient to capture a cardiac rhythm strip on the wearable device.
  • the protocol component comprises alarms to maximize the likelihood that the instructions will be followed and the system will be used optimally.
  • the protocol component comprises system diagnostics and any identified anomaly is noted with an alarm.
  • Alarms include audio, text, graphical or other desired warnings sent to the subject, the clinician device, and/or system manufacturer/distributor.
  • alarms are used to ensure proper compliance with instructions and/or protocols. For example, if the subject is not properly following the protocol, the display may indicate such and recommend the correct next step.
  • a healthcare provider may be provided with an alarm so that the subject can be contacted (e.g., by phone, text, e-mail, etc.) to ensure that the subject stays compliant with the protocol.
  • the protocol component comprises a means for which the subject can send questions separately or in conjunction with an image to a clinician via a clinician device which is in communication with the system.
  • the protocol component may be built on any desired hardware/software platform.
  • software components are provided via an application service provider (ASP) (e.g., are accessed by users within a web-based platform via a web browser across the internet; is bundled into a network -type appliance and run within an institution or an intranet; is provided as a software package and used as a stand-alone system; or is provided as downloadable software to an subject’s device(s).
  • ASP application service provider
  • the software components may be built on a system that comprises appropriate privacy and security features to comply with legal regulations regarding sharing and transferring of patient data and medical information.
  • a clinician device may be in contact and/or communication with the information processing device.
  • the clinician device is in contact and/or communication with a clinician or other health care or health care-related worker (e.g., third party trained effluent evaluation experts may he employed). Collectively, any such party is referred to as a clinician herein.
  • the clinician device allows the clinician to remain in contact with the subject during in-home prep, to monitor progress of the cleanse, or to answer any questions or address any concerns from the subject.
  • tire sy stem generates an alert and/or report of a new bowel effluent image or inquiry generated by the subject to a clinician device
  • the image of the bowel effluent, and optionally the background image is sent to a clinician device m contact with a clinician using a communication device within or in electronic communication with the information processing component
  • a clinician evaluates the image(s) included in the alert and/or report on the clinician device and makes a decision regarding the status of the colon cleanse
  • die clinician communicates die decision on die status of the colon cleanse with the clinician device
  • the clinician device relays messages in the form of instructions or status identifiers to the subject via the information processing component of the system
  • the clinician device can alter or adjust the protocol component as a result of the decision
  • the clinician communicates the answer to the inquiry to the subject with the clinician device
  • the clinician communicates the answer to the inquiry
  • the clinician device allow s a clinician to know and/or determine the status of the colon cleanse prior to the subject appearing at the hospital or endoscopy clinic.
  • the clinician device may comprise any of a variety of computing devices configured to receive communications from the system, including but not limited to, a desktop computer, a mainframe computer, a laptop computer, a personal digital assistant (PDA), a portable computer (e.g., mobile devices such as telephones), a tablet computer (e.g., standard tablets, slates, mini tablets, phablets, customer handheld devices), and a wearable computer (e.g., eyeglass, wristwatch, clothing, helmet, etc.).
  • PDA personal digital assistant
  • portable computer e.g., mobile devices such as telephones
  • a tablet computer e.g., standard tablets, slates, mini tablets, phablets, customer handheld devices
  • a wearable computer e.g., eyeglass, wristwatch, clothing, helmet, etc.
  • the clinician device may comprise a data collection, storage and analysis system.
  • the data may be stored on the clinician device or on another device in communication with the clinician device, such as a remote secure server.
  • This system may collect and analyze data on one patient over a single preparation to provide time course information of the preparation and allow' retrospective review of the preparation by a clinician.
  • This system may collect and analyze data on one patient over multiple preparations such that previous preparations can be used to design a starting protocol or analyzed to select protocols which resulted in the most effective previous preparation.
  • This system may collect and analyze data for multiple patients such that protocols can be optimized for best practices and/or procedure outcomes. Data from multiple patients may be used to alter or design protocols for a patient’s first colon preparation based on common medical history and/or risk factors for inadequate preps.
  • the present disclosure also provides colonoscopy preparation kits including one or more of: at least one purgative; a plurality of tlushahle marker; an anti-foaming agent; and computer readable medium, software, or an interface (e.g., an internet or computer application) for using the system described herein.
  • purgatives, flushable markers, anti- foaming agents and the components of the system apply to the kit as well, in some embodiments, die kits further comprise containers to collect fecal samples or used toilet paper and/or wipes throughout the preparation.
  • FIGS. 4A is a baseline image, as the preparation commenced.
  • FIG. 4B is an exemplary final image where preparation was still deemed incomplete (Not Ready), whereas
  • FIG. 4C was the earliest image where the preparation was sufficient (Ready), based on the judgements of a colonoscopy preparation expert. These images demonstrate the time point in the preparation where the preparation quality makes the transition from inadequate to adequate.
  • FIGS. 4A-4C resulting m the images in FIGS. 4D-4F, respectively.
  • the white edges in the box, capturing the bend in the bottom of the toilet, are apparent at Baseline (FIG. 4D).
  • FIG. 4E where the prep was NOT ready, these white edges cannot be seen.
  • FIG. 4F where the preparation was sufficient (Ready), die white edges in the box were seen once again.
  • FIG. 5 Several exemplary marker capsules are shown in FIG. 5. Other examples may differ in shape, color, and geometric design to optimize contrast in low-contrast settings, such as dark toilet howls.
  • FIGS. 6A-6D The impact of a marker capsule on edge detection is shown in FIGS. 6A-6D.
  • FIG. 6.4 shows an image of a dark toilet drain at baseline. Image analysis using edge detection was applied to FIG. 6A and no distinct edges were detected on the bottom of the drain (FIG. 6C).
  • FIG. 6B shows substantial contrast at the botom of the drain.
  • FIG. 6D shows multiple edges for image analysis at the bottom of the drain.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Pathology (AREA)
  • Medical Informatics (AREA)
  • Public Health (AREA)
  • Molecular Biology (AREA)
  • Biomedical Technology (AREA)
  • Veterinary Medicine (AREA)
  • Animal Behavior & Ethology (AREA)
  • Surgery (AREA)
  • Heart & Thoracic Surgery (AREA)
  • General Physics & Mathematics (AREA)
  • Biophysics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Immunology (AREA)
  • Biochemistry (AREA)
  • Analytical Chemistry (AREA)
  • Chemical & Material Sciences (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Theoretical Computer Science (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Dentistry (AREA)
  • Optics & Photonics (AREA)
  • Epidemiology (AREA)
  • Primary Health Care (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Physiology (AREA)
  • Radiology & Medical Imaging (AREA)
  • Quality & Reliability (AREA)
  • Signal Processing (AREA)
  • Investigating Or Analysing Biological Materials (AREA)
  • Medicines Containing Antibodies Or Antigens For Use As Internal Diagnostic Agents (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)
  • Nitrogen And Oxygen Or Sulfur-Condensed Heterocyclic Ring Systems (AREA)
  • Bidet-Like Cleaning Device And Other Flush Toilet Accessories (AREA)
  • Endoscopes (AREA)

Abstract

The present disclosure relates to systems and methods for assessing the status of colon cleansing. In particular, the present disclosure relates to systems and methods to determine completion of colon preparation in subjects prior to a gastrointestinal procedure in real time.

Description

SYSTEMS AND METHODS FOR ASSESSING COLONOSCOPY PREPARATION
CROSS-REFERENCE TO RELATED APPLICATIONS
[1] Tliis application claims the benefit of U.S. Provisional Application No. 62/961,482, filed January 15, 2020, the entire contents of which is incorporated herein by reference.
FIELD
[2] The present disclosure relates to systems and methods for assessing the status of colon cleansing. In particular, the present disclosure relates to systems and methods to determine completion of colon preparation in subjects, e.g., in real-time, prior to a gastrointestinal procedure.
BACKGROUND
[3] Millions of colonoscopy procedures are performed in a year, most often in an outpatient setting. Preparation prior to the day of the procedure is required to clean out the bowel contents to allow examination of the intestine walls. The preparation is typically completed at home by the patient usually over 2 days. In general, colonoscopy prep medications are difficult for patients to tolerate and patients are acutely interested in minimizing the amount of prep they drink prior to their colonoscopy,
[4] Current colonoscopy prep medications are dosed “one size fits all.” However, patients with certain risk factors, including but not limited to a history of poor colon prep on previous colonoscopies, male gender, obesity, hypertension, diabetes, constipation, drags that affect motility (narcotics, tri -cyclic antidepressants), and low educational level, are at higher risk of having an inadequate or suboptimal prep. Overall, approximately 40-70% of all colonoscopy patients have at least one recognizable risk factor for a suboptimal prep. Unfortunately, no one has been able to construct a schema to allow individualized dosing of the prep with any useful accuracy,
[5] Assessment of clarity and color of effluent and amoun t of particulate mater is key to determining the success or progress of the colon prep. However, patients are left to their own devices to assess if their prep is working properly or not. Presently, there are no readily accessible standards that allow patients to determine their prep effectiveness or completion. Further, even if these standards were accessible by patients, it remains to be seen as to whether these standards are effective when patients atempt to use them at home. It is not unusual for patients to place emergency phone calls to their physicians during the night to ask about certain symptoms they may be experiencing and to ask if they should continue the prep. It is also not unusual for patients experiencing such symptoms to prematurely terminate their prep under the mistaken conclusion that the prep, in their untrained estimation, is adequate. [6] Two research studies have documented that patients’ own descriptions of their own fecal effluent are very inaccurate and cannot be relied upon in most instances to ascertain whether they need additional preparation (Harewood GC, et ai., Am j Gastroenterol 2004;99:839-43 and Fatima H. et al.,Gastrointest Endosc 2010;? ! : 1244-1252 e2, incorporated herein by reference in their entirety). The only situation where the patient is accurate, albeit only 50% of time, is when they describe their own effluent as brown and having solid material present, signify ing an inadequate prep. However, without exception, patients prefer to prep in the privacy of their home and are reluctant to undergo additional prep at an endoscopy center or hospital using a public restroom.
[7] inadequate or incomplete preparation can result in a cancelled case or the necessity for an earlier repeat examination. Approximately 15-25% of all colonoscopy cases are inadequate. A stated goal of GI Societies is to reduce inadequate prep rates to less than 10-15%. An additional fraction, perhaps as high as 50% of preps, are less than excellent. Sub-optimal, or less than excellent, preparation requires an average of 4-5 minutes per case cleaning the colon to render the prep adequate prior to inspection. This can be as much as 10-15 minutes in some cases. This unnecessarily exposes the patient to the risk of prolonged anesthesia. Even with this cleansing, not all suboptimai preps can be salvaged. Current GI Society guidelines instruct gastroenterologists to repeat colonoscopy within one year if the prep quality is borderline, rather than a repeat colonoscopy in ten years if the bowel preparation is of good quality. For patients with a completely failed prep, which precludes completion of the exam, it is recommended that they repeat their prep and return as soon as possible for a reattempt at colonoscopy. Studies have documented that a third of such patients with a failed prep do not return for another. Inadequate and suboptimai colon preparations make colonoscopies less convenient, less cost-effective, and less accurate, resulting in more missed cancers and polyps.
SUMMARY
[8] Disclosed herein are methods for assessing the status of a colon preparation in a subject comprising capturing an image of a bowel effluent in a toilet with an imaging device and assessing the image for: one or more aspects of the bowel effluent including color of effluent, clarity of effluent, presence of particulate matter or solid material, density of particulate matter or solid material, texture of the effluent, or combinations thereof; observable edges or contrasts in the toilet; or any combination thereof. In some embodiments, the methods may further comprise one or each of capturing a background image of the toilet, and loading the image, and optionally the background image, into an information processing component from the imaging device. In some embodiments. the methods further comprise adding a flushable marker to the toilet. In some embodiments, die methods further comprise adding an antifoaming agent to the toilet.
[9] Also disclosed herein are systems for assessing the status of a colon preparation in a subject comprising an imaging device, a communication component, an information processing component configured to analyze data from two or more images of bowel effluent, and a protocol component. In some embodiments, the imaging device is integrated into the information processing component. In some embodiments, the information processing component is a tablet computer, a portable computer, or a wearable computer, in some embodiments, the information processing component is in communication with a clinician device in contact with a clinician.
[10] Other aspects and embodiments of the disclosure will be apparent in light of tire following detailed description and accompanying figures.
BRIEF DESCRIPTION OF THE DRAWINGS
[11] FIG. I is a flow diagram illustrating select embodiments of the me thods for assessing the status of a colon preparation in a subject.
[12] FIG. 2 is a flow diagram illustrating exemplary feedback to the artificial intelligence component for machine learning.
[13] FIGS. 3A-3E are exemplar}' toilet bowl images during colon preparation. FIG. 3A is an exemplary baseline toilet bowl image. FIGS. 3B-3D are exemplar}' images throughout colon preparation taken at an early stage (FIG. 3B), midway through preparation (FIG. 3C), and nearing the end of the preparation (FIG. 3D). FIG. 3E is an exemplar}' image at the end of the preparation.
[14] FIGS. 4A-4I are exemplary toilet bowl images during colon preparation. FIGS. 4A, 4D, and 4G, are a raw image, an image resulting from using edge detection, and an image resulting from using red pixel intensity, respectively, of an exemplary baseline image, as the preparation commenced. FIGS. 4B, 4E, and 4H, are a raw' image, an image resulting from using edge detection, and an image resulting from using red pixel intensity, respectively, of an exemplary' final image where preparation was still deemed incomplete (Not Ready). FIGS, 4C, 4F, and 41, are a raw image, an image resulting from using edge detection, and an image resulting from using red pixel intensity, respectively, of an earliest image where the preparation was sufficient (Ready), based on the judgements of a colonoscopy preparation expert.
[15] FIG. 5 is an image of exemplary' marker capsules.
[16] FIGS. 6A-6D are images showing the effect of a marker capsule on edge detection. FIG. 6A and 6B are images of a dark toilet drain at baseline without and with the use of a marker capsule. FIGS. 6C and 6D are images after applying edge detection to the images of FIGS. 6A and 6B, respectively.
DETAILED DESCRIPTION
[17] Section headings as used m this section and the entire disclosure herein are merely for organizational purposes and are not intended to be limiting.
1. Definitions
[18] The terms “comprise(s),” “mclude(s),” “having,” "‘has,” ‘"can,” “contain(s),” and variants thereof, as used herein, are intended to be open-ended transitional phrases, terms, or words that do not preclude the possibility of additional acts or structures. The singular forms “a,” “and” and “the” include plural references unless the context clearly dictates otherwise. The present disclosure also contemplates other embodiments “comprising,” “consisting of’ and “consisting essentially of,” the embodiments or elements presented herein, whether explicitly set forth or not.
[19J Unless otherwise defined herein, scientific and technical terms used in connection with the present disclosure shall have the meanings that are commonly understood by those of ordinary' skill in the art. The meaning and scope of the terms should be dear; in the event, howe ver of any latent ambiguity, definitions provided herein take precedent over any dictionary or extrinsic definition. Further, unless otherwise required by context, singular terms shall include pluralities and plural terms shall include the singular.
[20] As used herein, the terms “processor” and “central processing unit” or “CPU” are used interchangeably and refer to a device that is able to read a program from a computer memory' (e.g., ROM or other computer memory') and perfonn a set of steps according to the program.
[21 ] As used herein, the terms “computer memory” and “computer memory device” refer to any storage media readable by a computer processor. Examples of computer memory include, but are not limited to, RAM, ROM, computer chips, digital video discs (DVD), compact discs (CDs), hard disk drives (HDD), and magnetic tape.
[22] As used herein, the term “computer readable medium” refers to any device or system for storing and providing infonnation (e.g., data and instructions) to a computer processor. Examples of computer readable media include, but are not limited to, DVDs, CDs, hard disk drives, magnetic tape and servers for streaming media over networks. The computer readable medium may be non- transitoiy or include a de vice of system that is not a transitory signal. [23] As used herein, the term “in electronic communication” refers to electrical devices (e.g. , computers, processors, etc.) that are configured to communicate with one another through direct or indirect signaling.
[24] A “subject” or “patient”' may be human or non-human and may include, tor example, animal strains or species used as “model systems” for research purposes, such a mouse model as described herein. Likewise, patient may include either adults or juveniles (e.g., children). Moreover, patient may mean any living organism, preferably a mammal (e.g. , human or non-human). In one embodiment of the methods and systems provided herein, the mammal is a human.
[25] Preferred methods and materials are described below, although methods and materials similar or equivalent to those described herein can be used in practice or testing of the present disclosure. All publications, patent applications, patents and other references mentioned herein are incorporated by reference in their entirety. The materials, methods, and examples disclosed herein are illustrative only and not intended to be limiting.
2. Assessing Colon Preparation
[26] The present disclosure provides methods and systems to assess the status of a colon preparation in a subject. In some embodiments, the methods and system assess the status (e.g., determine end-point) of a colon preparation in a subject in real-time.
[27] Colon preparation is employed by a patient to cleanse their colon and digestive tract prior to a colon-related or gastrointestinal medical procedure, including, for example, colonoscopy, capsule endoscopy, single- and double-balloon enteroscopy, endo!ummal gastroplication, endoscopic ultrasound (EU8), esophagogastroduodenoscopy (EGD), endoscopic retrograde cholangiopancreatography (ERCP), esophageal pH exam, flexible sigmoidoscopy (Flex Sig), hydrogen breath test, liver biopsy, percutaneous endoscopic gastrostomy (PEG), biofeedback for anorectal dysfunction, intraoperative radiation therapy (TORT), diagnostic GI radiology, including barium enema, CT colonography, €T enterography, MR colonograpiry, and MR enterography; surgical procedures including, but not limited to laparoscopic cholecystectomy (Gallbladder Removal), colectomy, hysterectomy, hemorrhoidectomy, herniorrhaphy, and NOTES (natural orifice transluminal endoscopic surgery).
[28] There are a number of ways to cleanse the colon, each with advantages and disadvantages. Usually, patients are provided medications in the form of solutions and/or pills to take for up to two days prior to surgery. Purgatives can be based on magnesium salts, sodium phosphate, or buffered saline solution with polyethylene glycol (PEG). Bisacodyl is sometimes added to the regimen to stimulate colonic motility. The systems and methods disclosed herein may be incorporated with any type of colon preparation or gastrointestinal medical procedure. Suitable nonlimiting examples of colon preparations useful in the methods and systems disclosed herein include those disclosed in U.S. Pat. Nos. 8,778,306 and 10,555,970 and U.S. Pat. Application No. 16/786,541, each of which is herein incorporated by reference in its entirety.
[29] There are a number of aspects of bowel effluent used to assess cleansing of the colon, in some embodiments, assessment aspects include, but are not limited to, color of effluent, clarity of effluent, texture of the effluent presence of particulate matter or solid material in the effluent, and density of particulate matter or solid material in the effluent.
[30] in some embodiments, considerations in assessing the image may include if any edges at the bottom of a toilet bowl are visible, if any edges from toilet paper beneath surface are visible, if there is a color gradient at. toilet bowl edges descending to the bottom of the bowl, or if there is a contrast gradient with a flushable marker, in some embodiments, the observable edges or contrasts in the toilet comprise edges or contrasts along bottom of toilet bowl, edges or contrasts from the flushable marker, or a combination thereof. Specific examples of select aspects may be found in: So, H., et al., Intest Res 2015; 13(2): 153-159 and Fatima, H., et al., Clinical Endoscopy 2010; 71(7): 1244-1252, incorporated herein by reference in their entirety.
[31] in some embodiments, the systems and methods comprise one or more or each of: an imaging component, a communication component, an information processing component, and a protocol component. In some embodiments, the methods further comprise adding a flushable marker and/or an anti-foaming agent to the toilet. In some embodiments, the methods further comprise a clinician device. Illustrative embodiments of each of these components, their integration into the system, and their use in the methods is described below. a) Imaging device
[32] In some embodiments, the systems and methods comprise an imaging device. The imaging device facilitates capture of an image of bowel effluent in a toilet, and optionally an image of the toilet without bowel effluent, preferably taken immediately beforehand.
[33] The imagining device may include, for example, a camera, a cellular phone with an embedded camera, or a computer. Tire imaging device can comprise hardware such as the image sensor (e.g., CCD (charge coupled device), CMOS (complementary metal oxide semiconductor), etc.) and software for operating the image sensor and/or the imaging component, in some embodiments, the imaging device is incorporated or embedded in one of the other components of the system (e.g., the information processing component). In some embodiments, an imaging device is integrated into a toilet and automatically, or upon activation by a user, captures one or more images before and after (or during) generation of a bowel effluent. In some embodiments, sensors detect a toilet-related event (e.g., lifting of a lid, contact or depression of a handle, reduction in light due to movement of a person over the toilet, passage of effluent material into the toilet, etc.) in order to trigger the timing of image capture. b) Communication component
[34] In some embodiments, the systems and methods comprise a communication component. In some embodiments, the communication component communicates information from the imaging device to an information processing component. In some embodiments, the communication component communicates information to or from the information processing component (e.g., to or from the imaging device or a clinician device). In some embodiments, the communication component communicates information from any one component of the system (e.g., an imaging component), to any other component of the system, between two sub-components of the system, or between a component outside of the system (e.g,, a clinician device or an external device, for example, a wearable physiological tracker)).
[35] In some embodiments, a portion or ail of the communication component is wired. For example, in some embodiments, the communication component comprises wires or cables connecting the imaging device directly or indirectly to an information processing component (e.g,, computer, a computer processor within a phone, etc.).
[36] In some embodiments, a portion of or the entire communication component is wireless. Any desired wireless communication technology may be employed, including but not limited to, electromagnetic wireless telecommunications (e.g., wireless networking, cellular, satellite), and electromagnetic induction (such as light, magnetic, or electric fields or the use of sound). Where wireless networks are employed, any desired protocol can be used (e.g., ZigBee, EnOcean, Personal area networks, Bluetooth. TransferJet, ultra-wideband),
[37] In some embodiments, the imaging device comprises a wireless communication component such that signal generated from the imaging de vice is transmitted to an information processing component wirelessly in a HIPAA -compliant fashion. In some embodiments, the communication component communicates information comprising images and/or instructions to the information processing component. c) Information processing component
[38] In some embodiments, the systems and methods comprise an information processing component. The information processing component can provide a variety of functions, including but not limited to: receiving and processing images generated from the imaging device; receiving and processing data generated from an external device; displaying information to a subject; displaying instructions to a subject; storing information; storing, transmitting, executing, and/or displaying protocols; and presenting alarms.
[39] in some embodiments, the information processing component comprises one or more of a computer processor, computer readable medium, and software. Any of a variety of computing devices may be used as the information processing component, including but not limited to, a desktop computer, a mainframe computer, a laptop computer, a personal digital assistant (PDA), a portable computer (e.g., mobile devices such as telephones), a tablet computer (e.g., standard tablets, slates, mini tablets, phablets, customer handheld devices), and a wearable computer (e.g., eyeglass, wristwatch, clothing, helmet, etc.), in select embodiments, the information processing component comprises a tablet computer, a portable computer, or a wearable computer.
[40] in some embodiments, the information processing component or a de vice in electronic communication with the information processing component (e.g,, a video monitor) comprises a display, in some embodiments, the display displays textual and/or graphical information to a user (e.g., a subject completing a colon preparation), in some embodiments, the display is a touchscreen display, permitting the user to select and manage system functions via a graphical interface, in some embodiments, audio information is conveyed (e.g., via speakers, headphones, etc,).
[41] In some embodiments, the display displays information to the user related to instructions for or status of the colon preparation, in some embodiments, tire interface displays status identifiers (e.g,, ready, good progress, pause, not ready). In some embodiments, the interface provides an additional graphical interface of status (e.g., stop light indications).
[42] in some embodiments, the interface further provides textual instructions (e.g., stop taking prep, drink only clear liquids until procedure, wait 30 minutes, take another image of effluent, take another dose of prep medications). In some embodiments, the interface provides an additional graphical interface of instructions completed (e.g., thumbs up/thumbs down or check marks). The user interface may also pro vide step by step instructions of setting up, using, and managing the system ,
[43] in some embodiments, the information processing component, or a device in electronic communication with the information processing component, comprises a networking component. The networking component receives and/or transmits information to the communication component.
[44] In some embodiments, the information processing component comprises a database containing protocols, subject data, historic data, or other desired information. The protocols, subject data, historic data, or other desired information may be provided by computer processor, computer readable medium, software, or be available through a web-based platform via a web browser across the internet.
1451 in some embodiments, the information processing component is in communication with a clinician device in contact with a clinician. In some embodiments, the communication with the clinician device is via the networking component and/or the communication component.
[46] In some embodiments, the information processing component comprises an artificial intelligence component (c.g . embodied in software running on the processor). In some embodiments, the artificial intelligence component alters stored protocols in response to instructions received from another component of the system (e.g., protocol component) or from another device (e.g., clinician device).
[47] In some embodiments, the artificial intelligence component comprises image analysis software. In some embodiments the image analysis software evaluates the image obtained by the imaging component. The image analysis software may assess the status of tire bowel effluent. In some embodiments, the image analysis software may assess the observable edges or contrasts (e.g., a flushable maker) on the bottom of or in the toilet bowl.
[48] The image analysis software may include the ability to transform the images provided by the subject, creating enhanced images which may include highlighting, coloring, emphasis or de- emphasis of detail , digital filtering, among many other potential transformations. For example, the image analysis software may subtract out the background image without the bowel effluent or subtract out other foreign objects or abnormalities, such as toilet paper, glare, or shadows, from the bowel effluent image. The image analysis software may transform the image to align and correct the image to resemble the background image in brightness/contrast, size, and orientation (e.g., pan, tilt and rotation). The imaging software could be custom designed, licensed from third parties, or even commercially available software. Multiple software programs may be utilized together in order to fully analyze the image.
[49] The image analysis software may also generate results and/or reports based on die analysis of the image. In some embodiments, tire artificial intelligence component alters protocols or displays instructions based on the image analysis evaluation of the bowel effluent (e.g., utilizing a machine learning process). In some embodiments, the artificial intelligence component provides real-time feedback of the status of the colon cleanse to the subject based on the image analysis software. Consequently, the artificial intelligence component facilitates customization of protocols and prep medication dosing (e.g., increase or decrease in amount or frequency, continuation of dosing regimen, termination of dosing regimen) in real-time, based on active monitoring of the images unlike convention preparations utilizing a universal approach without a form of monitoring. In some embodiments, the artificial intelligence component instructs the information processing component to report the image results to a clinician device.
[50] The baseline toilet bowl image is analyzed with regard to lighting quality and focus. Additional processing may occur, including, for example: identification of the meniscus; determination of uniformity of lighting across the field within the meniscus; determination of the level of focus of edges within the area defined by the meniscus (the region of interest): determination of the color of the toilet bowl outside of the meniscus in comparison to the color just inside the meniscus; subtraction of the bowl color from the image in those instances when the toilet bowl color is not white; and identification of the greatest color variation between segments of the image just inside the meniscus and other sites within the region of interest, excluding edges.
[51] Subsequent images are analyzed comparing the baseline image with the newest image for focus, color analysis, edge analysis, visual texture and time analysis. Each image is analyzed as the baseline image to identify tire meniscus and determine if tire overall image is in focus, in some embodiments, the methods and systems comprise addition of an anti-foaming agent, such as simethicone and the like, to the toilet to allow for better focus, color analysis, edge analysis, and visual texture during image analysis.
[52] Color analysis may include: subtraction of the baseline image color from the image being analyzed, detection and determination of a color change in the region of interest; determination of the colors of the textons (particular objects creating texture) in the region of interest; and evaluation of the new image data using algorithms defining acceptable and optimal values for color of the toilet water and of the textons. In an example, but not limited by this example, the red color pixel intensity of the water in the grayscale image should have values of 125 to 255 to be acceptable. Red color pixel values of water below 125 indicate inadequate preparation in this example.
[53] Edge analysis includes determination if any of the previously defined edges within the area defined by the meniscus (the region of interest) still in view and if there any new edges within the region of interest, in some embodiments, edge analysis includes assessing observable contrast or edges from a flushable marker. Flushable markers include any agent or object useful in providing contrast to the image of the toilet, including, but not limited to, capsules, tablets, caplets, or pellets of any variety of sizes and shapes made of a flushable material in a color contrasting the toilet and/or effluent.
[54] Visual texture analysis includes determination of the sizes of the textons within the region of interest and the homogeneity in the sizes of the textons within the region of interest and evaluation of any observable three-dimensional texture within the region of interest. |S5] Once a second subsequent image is available, each image will be analyzed to determine if there was a progressive change in edge improvement, color dilution, or texton size/homogeneity from the previous image(s).
[56] Following the colon preparation and procedure, the artificial intelligence component will go through a machine learning process, both supervised and unsupervised. The machine learning process provides feedback the artificial intelligence uses to alter tire protocol component. The endoscopy electronic health record (U IR) provides images and other data to the software; the software uses the images coupled to other outcome parameters to provide feedback to the system.
The feedback includes, for example, success of preparation (Bos ton Bowel Preparation Scale (BBPS) 6 or better, with a 2 or better in every segment); level of intra-procedural work required to make preparation successful; quality of the preparation (high quality is considered BBPS 8 or better); quantity of intra-procedural work necessary to make preparation high quality; completion of colonoscopy; detection and quantification of adenomatous polyps; detection and quantification of serrated polyps; detection of colon cancer.
[57] As such, the machine learning process aids in the creation of thresholds for color, turbidity (ability to detect edge), and visual texture for both size and color of textons for each of the following conditions: successful preparation, high quality preparation, successful prep with limited work, where the user may specify the work limit; high quality preparation with limited work, where the user may specify the work limit; unsuccessful prep; and preparation complicated by bleeding event.
[58] Shown in FIGS. 3A-E is an example of toilet bowl images from a preparation, using artificial stool , FIG. 3A shows a high-quality baseline toilet bowl image. An image early m the preparation, FIG. 3B, shows textons (particular matter) too large to be acceptable. Midway through the preparation, the textons are much smaller however, no edges seen in the baseline photo can be observed and the color criteria have not been met (FIG. 3€). Nearing the end of the preparation (FIG. 3D), even though the fluid is clearer than FIG. 3C, no edges seen in the baseline image can be discerned, the textons other than toilet paper are larger than 2mm, and the color has a Green intensity of 108, below a criteria threshold of 160. Upon completion of the preparation (FIG. 3E), edges from the baseline image can be easily seen, no textons other than toilet paper are visible, and the color is acceptable with a Green intensity of 180.
[59] The disclosure also provides a pre-procedure preparation scale and methods of creating and using a pre -procedure preparation scale. In some embodiments, the machine learning process aids in the creation of a pre-procedure preparation scale and/or applies image analysis to classify or score the image based on a pre -procedure preparation scale, in some embodiments, the pre -procedure preparation scale is based on analysis of bow el effluent (e.g., color of effluent, clarity of effluent, presence of particulate mater or solid material, density of particulate matter or solid material, texture of the effluent, or combinations thereof) and/or observable edges or contrasts (e.g., from a flushable marker). The scale may be used to correlate the preparation or the status of the preparation with existing bowel cleanliness scales (e.g., Boston Bowel Preparation Scale, Aronc!iick Scale, Ottawa Bowel Preparation Scale, and Harefield Cleansing Scale). The threshold may be adjusted for the individual patient, the planned colonic procedure, or other clinical factors. For example, a standard colonoscopy may have a lower acceptable score than a wireless capsule colonoscopy which requires a very high level of cleanliness.
[60] The pre-procedure preparation scale may he updated based on ongoing data collection, including, but not limited to colonoscopic video during examinations, programs that monitor and score colonic cleanliness intra-proecdurallyy existing bowel cleanliness scales including the Boston Bowel Preparation Scale, Aronchick Scale, Ottawa Bow el Preparation Scale, Harefield Cleansing Scale, and clinically relevant outcome measures. Such clinical measures include adenoma detection rate, cleansing time, and overall procedure time. Such scale updates may he performed manually, by supervised artificial intelligence, or by unsupervised artificial intelligence. The described validation and update process would be performed in compliance with applicable FDA regulations.
[61] An exemplary pre-procedure preparation scale may use a numbered-sca!e as shown in Table 1 , The threshold for an acceptable prep based on this scale may be in the range of 5 to 6, which likely correlates to a score of 6 on the Boston Bowel Preparation Scale. The scores of any exemplary- scales can be validated in randomized, controlled, clinical trials before general use.
[ able 1. Exemplary Pre-Procedure Seale
Figure imgf000014_0001
Figure imgf000015_0001
[62] in some embodiments, the information processing component, the imaging component, the communication component, or any combination thereof are contained within a single device (e.g., a tablet computer, a mobile phone, a wristwatch computer, etc.). d) Protocol component
[63] in some embodiments, the systems and methods comprise a protocol component. The protocol component comprises instructions, typically embodied in software, for managing the methods and use of the system. The software comprises all non-transitory forms of software, or ail those forms of software except those based on a transitory, propagating signal, in some embodiments, the protocol component is stored m a computer readable medium. In some embodiments, the protocol component is embodied in the information processing component.
|64J in some embodiments, the protocol component directs the display of information, in some embodiments, the display comprises instructions (e.g., graphical, textual, audio, etc.) for use of the imaging component. For example, in some embodiments, the protocol component directs the subject to take an initial image or repeat an image if quality is not acceptable, in some embodiments, the protocol component displays information comprising tasks to be completed (e.g., how to take the medications, how7 to take the images, how to modify the prep based on instructions), knowledge of task completion, or status of colon preparation.
[65] The protocol component may comprise a scheduling function, such that the protocol can provide instructions prior to starting the colon cleanse (e.g., low residue diet instructions 5 days prior to cleanse, consume only clear liquids evening before colon cleanse). In some embodiments, the protocol component may display instructions for the day of the medical procedure or provide background information or answers to frequently asked questions regarding the specific medical procedure.
[66] in some embodiments, the format of the display is adjustable to accommodate any subject type, including those with impaired vision or hearing, impaired cognitive skills, color blindness, young age, varied language skills or knowledge, etc.
[67] in some embodiments, the protocol component comprises data storage and management capabilities. Data storage includes data storage and management for individual subjects, for example, to monitor bowel effluent over time, in some embodiments, data storage also includes storage and management for multiple subjects, including, but not limited to, colonoscopy outcomes, bowel cleanliness at the time of exam, adenoma detection, intraprocedura! cleansing effort required, relevant health history factors, and other relevant factors (e.g., body habitus, socio-demographic) that impact colon cleansing. These linked data may be used to make comparative analysis and/or improve artificial intelligence capabilities of the system which can then, in turn, be used to optimize the system and finally, applied to future patients using the system. This application of machine learning to optimize the management of future patients may be either supervised or unsupervised.
[68] in some embodiments, the protocol component comprises specific colon cleansing protocols. In some embodiments, the protocol component allows selection of specific colon cleansing protocols (e.g., specific medications or specific medical procedures) such that the instructions are tailored to the specific colon cleansing protocol or image analyses are completed within the colon cleansing specifications for a specific medical procedure. The protocol may be selected by the subject following instructions by the clinician or pre-selected for the subject by the clinician through the integration with the clinician device. The protocols employed can be updated and optimized for any desired cleansing protocol or medical procedure by the clinician. In some embodiments, the protocol instructs the processor to report the image results to a clinician device. In some embodiments, the protocol may compare data from previous measurements to determine whether the subject has progressed with the colon cleansing. The specific colon cleansing protocol (e.g., amount and frequency of dosing of prep medications, maintenance of dosing beyond original dosing schedule, early termination of dosing schedule) may be customized during the preparation (e.g., by the clinician or based on image analysis) in real-time.
[69] In some embodiments, the protocol component comprises a query function, such that the protocol component displays questions regarding symptoms or side effects that may be experienced during the colon preparation to the subject for a response. The query function may question the occurrence, absence, level or frequency of nausea, vomiting, thirst, light-headedness, abdominal pain, and the like. In some embodiments, the protocol component may adjust tire protocol instructions (e.g,, slow or pause colon cleansing protocol) based on the responses to the question(s). In some embodiments, the protocol component may send the responses to the information processing component which may adjust the instructions for the specific colon cleansing protocol based on the answers given to the questions regarding symptoms or side effects. Alternatively, the responses may be sent to the clinician device for review by the clinician and potential subsequent protocol adjustment. In some embodiments, the query' function may instruct a patient to capture data regarding physiological parameters (e.g., temperature, heart rate, and the like) from a connected device as described elsewhere herein (e.g., wearable devices, clothing with embedded monitoring devices), an external device (e.g., home-based devices, such as thermometers, blood sugar monitoring devices, home audio monitoring equipment (e.g., Siri and Alexa), a cell phone app which enables smartphones to monitor physiologic or other parameters directly or indirectly by linking to afferent sensing hardware, toilet-based sensors, or the like. In some embodiments, the information processing component may detect an anomaly or side-effect from a connected external de vice and trigger the query function within the protocol component. For example, the information processing component may detect tachycardia from a wearable device and trigger the query function of the protocol component to ask questions regarding patient distress or instruct the patient to capture a cardiac rhythm strip on the wearable device.
[70] In some embodiments, the protocol component comprises alarms to maximize the likelihood that the instructions will be followed and the system will be used optimally. For example, in some embodiments, the protocol component comprises system diagnostics and any identified anomaly is noted with an alarm. Alarms include audio, text, graphical or other desired warnings sent to the subject, the clinician device, and/or system manufacturer/distributor. In some embodiments, alarms are used to ensure proper compliance with instructions and/or protocols. For example, if the subject is not properly following the protocol, the display may indicate such and recommend the correct next step. Alternatively, if the subject fails to follow a protocol (e.g., fails to keep up with a colon cleansing protocol), a healthcare provider may be provided with an alarm so that the subject can be contacted (e.g., by phone, text, e-mail, etc.) to ensure that the subject stays compliant with the protocol.
[711 In some embodiments, the protocol component comprises a means for which the subject can send questions separately or in conjunction with an image to a clinician via a clinician device which is in communication with the system.
[72] The protocol component may be built on any desired hardware/software platform. In some embodiments, software components are provided via an application service provider (ASP) (e.g., are accessed by users within a web-based platform via a web browser across the internet; is bundled into a network -type appliance and run within an institution or an intranet; is provided as a software package and used as a stand-alone system; or is provided as downloadable software to an subject’s device(s). The software components may be built on a system that comprises appropriate privacy and security features to comply with legal regulations regarding sharing and transferring of patient data and medical information. e) Clinician device
|73] in some embodiments, a clinician device may be in contact and/or communication with the information processing device. The clinician device is in contact and/or communication with a clinician or other health care or health care-related worker (e.g., third party trained effluent evaluation experts may he employed). Collectively, any such party is referred to as a clinician herein. The clinician device allows the clinician to remain in contact with the subject during in-home prep, to monitor progress of the cleanse, or to answer any questions or address any concerns from the subject.
[74] in some embodiments, tire sy stem generates an alert and/or report of a new bowel effluent image or inquiry generated by the subject to a clinician device, in some embodiments, the image of the bowel effluent, and optionally the background image, is sent to a clinician device m contact with a clinician using a communication device within or in electronic communication with the information processing component, in some embodiments, a clinician evaluates the image(s) included in the alert and/or report on the clinician device and makes a decision regarding the status of the colon cleanse, in some embodiments, die clinician communicates die decision on die status of the colon cleanse with the clinician device, in some embodiments, the clinician device relays messages in the form of instructions or status identifiers to the subject via the information processing component of the system , In some embodiments, the clinician device can alter or adjust the protocol component as a result of the decision, in some embodiments, the clinician communicates the answer to the inquiry to the subject with the clinician device, in some embodiments, the clinician communicates the answer to the inquiry' to the subject via another means facilitated by the information processing component (e.g., phone, text, or email).
[75] in some embodiments, the clinician device allow s a clinician to know and/or determine the status of the colon cleanse prior to the subject appearing at the hospital or endoscopy clinic.
[76] The clinician device may comprise any of a variety of computing devices configured to receive communications from the system, including but not limited to, a desktop computer, a mainframe computer, a laptop computer, a personal digital assistant (PDA), a portable computer (e.g., mobile devices such as telephones), a tablet computer (e.g., standard tablets, slates, mini tablets, phablets, customer handheld devices), and a wearable computer (e.g., eyeglass, wristwatch, clothing, helmet, etc.).
[77] The clinician device may comprise a data collection, storage and analysis system. The data may be stored on the clinician device or on another device in communication with the clinician device, such as a remote secure server. This system may collect and analyze data on one patient over a single preparation to provide time course information of the preparation and allow' retrospective review of the preparation by a clinician. This system may collect and analyze data on one patient over multiple preparations such that previous preparations can be used to design a starting protocol or analyzed to select protocols which resulted in the most effective previous preparation. This system may collect and analyze data for multiple patients such that protocols can be optimized for best practices and/or procedure outcomes. Data from multiple patients may be used to alter or design protocols for a patient’s first colon preparation based on common medical history and/or risk factors for inadequate preps.
3. Preparation Kits
[78] The present disclosure also provides colonoscopy preparation kits including one or more of: at least one purgative; a plurality of tlushahle marker; an anti-foaming agent; and computer readable medium, software, or an interface (e.g., an internet or computer application) for using the system described herein. Description provided elsewhere for purgatives, flushable markers, anti- foaming agents and the components of the system apply to the kit as well, in some embodiments, die kits further comprise containers to collect fecal samples or used toilet paper and/or wipes throughout the preparation.
4, Examples
Example 1
[79] Colonoscopy preparation was performed under typical conditions in the home and images were captured with an Apple iPhone 10. FIGS. 4A is a baseline image, as the preparation commenced. FIG. 4B is an exemplary final image where preparation was still deemed incomplete (Not Ready), whereas FIG. 4C was the earliest image where the preparation was sufficient (Ready), based on the judgements of a colonoscopy preparation expert. These images demonstrate the time point in the preparation where the preparation quality makes the transition from inadequate to adequate.
[80] Image analysis using edge detection was applied to FIGS. 4A-4C, resulting m the images in FIGS. 4D-4F, respectively. The white edges in the box, capturing the bend in the bottom of the toilet, are apparent at Baseline (FIG. 4D). In the image of FIG. 4E, where the prep was NOT ready, these white edges cannot be seen. In the image of FIG. 4F, where the preparation was sufficient (Ready), die white edges in the box were seen once again.
[81] Image analysis using red pixel intensity, where intensity values 125 to 255 are white, was applied to FIGS. 4A-4C, resulting in the images in FIG. 4G-4I, respectively. The water in the baseline image (FIG. 4G) had pixel values greater than 125, except where a shadow' was cast on the bottom of the toilet. In the image of FIG. 4H, where the prep w as NOT ready, much of the water present had a pixel value less than 125, shown in black. In the image of FIG. 41, w here the preparation was sufficient (Ready), the water had a red pixel intensity greater than 125, shown in white, easily distinguishable from the image of FIG. 4H.
Example 2
[82] Several exemplary marker capsules are shown in FIG. 5. Other examples may differ in shape, color, and geometric design to optimize contrast in low-contrast settings, such as dark toilet howls. The impact of a marker capsule on edge detection is shown in FIGS. 6A-6D. FIG. 6.4 shows an image of a dark toilet drain at baseline. Image analysis using edge detection was applied to FIG. 6A and no distinct edges were detected on the bottom of the drain (FIG. 6C). lire addition of the marker capsule (FIG. 6B) provided substantial contrast at the botom of the drain. Thus, when image analysis using edge detection was applied to FIG. 6B, multiple edges for image analysis were detected at the bottom of the drain (FIG. 6D).
[83] It is understood that the foregoing detailed descriptions are merely illustrative and are not to be taken as limitations upon the scope of the disclosure, which is defined solely by the appended claims and their equivalents.
[84] All publications and patents mentioned in the above specification are herein incorporated by reference as if expressly set forth herein. Various changes and modifications to the disclosed embodiments will be apparent to those skilled in the art and may be made without departing from the spirit and scope thereof.

Claims

CLAIMS What is claimed is:
1. A method of assessing status of a colon preparation in a subject comprising: capturing an image of a bowel effluent in a toilet with an imaging de vice: and assessing the image for: one or more aspects of the bowel effluent including color of effluent, clarity of effluent, presence of particulate mater or solid material, density of particulate mater or solid material, texture of the effluent, or combinations thereof; observable edges or contrasts in the toilet; or any combination thereof.
2. The me thod of claim 1, further comprising capturing a background image of the toilet.
3. The method of claim 1 or 2, further comprising loading the image, and optionally the background image, into an information processing component from the imaging device.
4. The method of any of claims 1-3, wherein the image of the bowel effluent, and optionally the background image, is sent to a clinician device in contact with a clinician using a communication device within or in electronic communication with the information processing component.
5. The method of claim 4, wherein the clinician sends messages via the clinician device informed by the image or images to the information processing component directly or indirectly via the communication device, and a protocol component of the information processing component is modified by the messages from the clinician device to display the status of the colon preparation to the subject.
6. The method of any of claims 1-3, wherein the information processing component assesses the image and modifies a protocol component to display a status of the colon preparation to the subject .
7. The method of any of claims 1-6, further comprising scoring the colon preparation with a pre- procedure preparation scale.
8. The method of any of claims 1-7, further comprising adding a flushable marker to the toilet.
9. The method of claim 8, wherein the observable edges or contrasts in the toilet comprise edges or contrasts along botom of toilet bowl, edges or contrasts from the flushable marker, or a combination thereof,
10. The method of any of claims 1-9, further comprising adding an anti -foaming agent to the toilet.
11. The method of any of claim 1-10, wherein the method determines the status of a colon preparation in real time.
12. A system for assessing the status of a colon preparation in a subject, comprising: an imaging device; a communication component; an information processing component configured to analyze data from two or more images of bowel effluent; and a protocol component.
13. The system of claim 12, wherein the imaging device is a digital camera.
14. The system of claim 12 or claim 13, wherein the imaging device is integrated into the information processing component.
15. The system of any of claims 12-14, wherein said communication component is a wireless communication component.
16. The system of any of claims 12-15, wherein the information processing component is a tablet computer, a portable computer, or a wearable computer.
17. The system of any of claims 12-16, wherein the protocol component comprises one or more protocols for colon preparation.
18. The system of any of claims 12-17, wherein the protocol component displays instructions for the colon preparation, provides the status of the colon preparation, or a combination thereof.
19. The system of any of claims 12-18, wherein the protocol component comprises an alarm protocol to alert the subject to an instruction or status of the colon preparation.
20. The system of any of claims 12-19, wherein the protocol component comprises a query function to question the subject regarding symptoms or side effects or instruct the subject to capture additional physiological data.
21. The system of claim 20, wherein the information processing component or the protocol component alters protocols based on responses to the query function.
22. The system of any of claims 12-21, wherein the information processing component is in communication with a clinician device in contact with a clinician.
23. The system of claim 22, wherein the protocol component comprises an alarm protocol to alert the clinician device of an image, a message, or a report from the subject.
24. The system of any of claims 12-23, wherein the information processing component comprises image analysis software to analyze images received from the imaging device.
25. The system of claim 24, wherein the information processing component alters protocols based on the image analysis.
26. The system of claim 24 or 25, wherein the information processing component assigns a score to the colon preparation based on a pre-procedure preparation scale.
27. The system of any of claims 24-26, wherein the information processing component incorporates the image analysis with data from a coion-related or gastrointestinal medical procedure and an electronic health record to alter the protocol component.
28. The system of any of claims 12-27, further comprising a flashable marker.
29. Use of the system of any of claims 12-28 to assess tire status of a colon preparation in a subject.
30. A colonoscopy preparation kits comprising one or more of: at least one purgative; a plurality of flushable markers; an anti-foaming agent; and computer readable medium, software, or interface instructions for using the system of any of claims 12-29.
PCT/US2021/013433 2020-01-15 2021-01-14 Systems and methods for assessing colonoscopy preparation Ceased WO2021146420A1 (en)

Priority Applications (10)

Application Number Priority Date Filing Date Title
MX2022008698A MX2022008698A (en) 2020-01-15 2021-01-14 Systems and methods for assessing colonoscopy preparation.
KR1020227027442A KR20220143655A (en) 2020-01-15 2021-01-14 Systems and methods for evaluating colonoscopy readiness
CA3164381A CA3164381A1 (en) 2020-01-15 2021-01-14 Systems and methods for assessing colonoscopy preparation
AU2021208546A AU2021208546A1 (en) 2020-01-15 2021-01-14 Systems and methods for assessing colonoscopy preparation
US17/792,933 US20230070807A1 (en) 2020-01-15 2021-01-14 Systems and methods for assessing colonoscopy preparation
JP2022543124A JP2023510582A (en) 2020-01-15 2021-01-14 Systems and methods for evaluating colonoscopy preparation
IL294753A IL294753A (en) 2020-01-15 2021-01-14 Systems and methods for evaluating preparation for colonoscopy
CN202180009609.3A CN115516310A (en) 2020-01-15 2021-01-14 System and method for assessing colonoscopy preparation
EP21741031.5A EP4090968A4 (en) 2020-01-15 2021-01-14 Systems and methods for assessing colonoscopy preparation
BR112022013945A BR112022013945A2 (en) 2020-01-15 2021-01-14 SYSTEMS AND METHODS TO ASSESS COLONOSCOPY PREPARATION, SYSTEM USE AND COLONOSCOPY PREPARATION KITS

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US202062961482P 2020-01-15 2020-01-15
US62/961,482 2020-01-15

Publications (1)

Publication Number Publication Date
WO2021146420A1 true WO2021146420A1 (en) 2021-07-22

Family

ID=76864719

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2021/013433 Ceased WO2021146420A1 (en) 2020-01-15 2021-01-14 Systems and methods for assessing colonoscopy preparation

Country Status (11)

Country Link
US (1) US20230070807A1 (en)
EP (1) EP4090968A4 (en)
JP (1) JP2023510582A (en)
KR (1) KR20220143655A (en)
CN (1) CN115516310A (en)
AU (1) AU2021208546A1 (en)
BR (1) BR112022013945A2 (en)
CA (1) CA3164381A1 (en)
IL (1) IL294753A (en)
MX (1) MX2022008698A (en)
WO (1) WO2021146420A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116500048A (en) * 2023-06-28 2023-07-28 四川联畅信通科技有限公司 Cable clamp defect detection method, device, equipment and medium
JP2023105449A (en) * 2022-01-19 2023-07-31 株式会社Jmees Diagnostic imaging system, diagnostic imaging method, and diagnostic imaging program
CN117451728A (en) * 2023-12-26 2024-01-26 常州漫舒医疗科技有限公司 Ostomy product production inspection system based on visual inspection
US20240366193A1 (en) * 2023-05-05 2024-11-07 Cedars-Sinai Medical Center Systems and methods for stool characterization as non-invasive measures of disease activity

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022054043A1 (en) * 2020-09-08 2022-03-17 Given Imaging Ltd. Estimating the adequacy of a procedure
US12340644B2 (en) * 2022-12-01 2025-06-24 Throne Labs, Inc. Systems and methods for managing publicly accessible amenities
US20260007309A1 (en) * 2023-07-23 2026-01-08 Manta Implant LLC Device and method to assess rectal effluent
CN117351317B (en) * 2023-10-25 2024-04-09 中国人民解放军总医院第二医学中心 A method and system for automatically identifying images of last stool characteristics
CN119784685A (en) * 2024-12-03 2025-04-08 山东大学 Intelligent bowel preparation evaluation method, device, equipment, medium and program product

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140147924A1 (en) * 2011-11-30 2014-05-29 Eric B. Wheeldon Apparatus and Method for the Remote Sensing of Blood in Human Feces and Urine
KR20150114793A (en) * 2014-04-02 2015-10-13 인제대학교 산학협력단 Service system and method for Bowel preparation
US20180085098A1 (en) * 2015-02-25 2018-03-29 Outsense Diagnostics Ltd. Bodily emission analysis
WO2019193593A1 (en) * 2018-04-03 2019-10-10 Funds For Medical Research Development Of Infrastructure & Health Services, Barzilai Medical Center Device for assessing colon cleanliness

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040194206A1 (en) * 2003-04-01 2004-10-07 Kieturakis Maciej J. Screening methods and kits for gastrointestinal diseases
WO2008102340A2 (en) * 2007-02-20 2008-08-28 Svip 1 Llc Kits and methods for determining colon cleanliness
JP2009270951A (en) * 2008-05-08 2009-11-19 Toto Ltd Device for measuring intestinal condition
US9040095B2 (en) * 2009-10-14 2015-05-26 Gi Innovations, Pllc Colon cleansing of residual stool and secretions during colonoscopy
JP5861977B2 (en) * 2014-06-18 2016-02-16 関根 弘一 Fecal color detection device
WO2018042431A1 (en) * 2016-08-30 2018-03-08 Outsense Diagnostics Ltd. Bodily emission analysis
US12118725B2 (en) * 2019-02-18 2024-10-15 The Johns Hopkins University Analyzing image data to determine bowel preparation quality

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140147924A1 (en) * 2011-11-30 2014-05-29 Eric B. Wheeldon Apparatus and Method for the Remote Sensing of Blood in Human Feces and Urine
KR20150114793A (en) * 2014-04-02 2015-10-13 인제대학교 산학협력단 Service system and method for Bowel preparation
US20180085098A1 (en) * 2015-02-25 2018-03-29 Outsense Diagnostics Ltd. Bodily emission analysis
WO2019193593A1 (en) * 2018-04-03 2019-10-10 Funds For Medical Research Development Of Infrastructure & Health Services, Barzilai Medical Center Device for assessing colon cleanliness

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
JUNG JAE WON, PARK JONGHA, JEON GI JUNG, MOON YOUNG SOO, YANG SUNG YUON, KIM TAE OH, JUNG EUI TAY, KIM HEE-CHEOL: "The Effectiveness of Personalized Bowel Preparation Using a Smartphone Camera Application: A Randomized Pilot Study", GASTROENTEROLOGY RESEARCH AND PRACTICE, HINDAWI PUBLISHING CORPORATION, US, vol. 2017, 1 January 2017 (2017-01-01), us, pages 1 - 7, XP055849090, ISSN: 1687-6121, DOI: 10.1155/2017/4898914 *
See also references of EP4090968A4 *

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2023105449A (en) * 2022-01-19 2023-07-31 株式会社Jmees Diagnostic imaging system, diagnostic imaging method, and diagnostic imaging program
US20240366193A1 (en) * 2023-05-05 2024-11-07 Cedars-Sinai Medical Center Systems and methods for stool characterization as non-invasive measures of disease activity
CN116500048A (en) * 2023-06-28 2023-07-28 四川联畅信通科技有限公司 Cable clamp defect detection method, device, equipment and medium
CN116500048B (en) * 2023-06-28 2023-09-15 四川联畅信通科技有限公司 Cable clamp defect detection method, device, equipment and medium
CN117451728A (en) * 2023-12-26 2024-01-26 常州漫舒医疗科技有限公司 Ostomy product production inspection system based on visual inspection
CN117451728B (en) * 2023-12-26 2024-02-20 常州漫舒医疗科技有限公司 Ostomy product production inspection system based on visual inspection

Also Published As

Publication number Publication date
EP4090968A1 (en) 2022-11-23
KR20220143655A (en) 2022-10-25
CN115516310A (en) 2022-12-23
US20230070807A1 (en) 2023-03-09
EP4090968A4 (en) 2024-01-24
IL294753A (en) 2022-09-01
CA3164381A1 (en) 2021-07-22
AU2021208546A1 (en) 2022-09-01
BR112022013945A2 (en) 2022-10-04
JP2023510582A (en) 2023-03-14
MX2022008698A (en) 2022-12-06

Similar Documents

Publication Publication Date Title
US20230070807A1 (en) Systems and methods for assessing colonoscopy preparation
Kornbluth et al. Video capsule endoscopy in inflammatory bowel disease: past, present, and future
D’Haens et al. Safety and feasibility of using the second-generation Pillcam colon capsule to assess active colonic Crohn’s disease
US20170007126A1 (en) System for conducting a remote physical examination
JP2021524958A (en) Respiratory state management based on respiratory sounds
CN115517682B (en) Cognitive dysfunction prediction system based on gastrointestinal electric signals and construction method
Adler et al. Second-generation colon capsule endoscopy is feasible in the out-of-clinic setting
Krause et al. Diagnostic yield of ambulatory reflux monitoring systems for evaluation of chronic laryngeal symptoms
Young Population‐based screening for colorectal cancer: Australian research and implementation
CN109770881A (en) A kind of health monitor method and blood pressure measuring device based on blood pressure
Watts et al. Diagnostic accuracy of an esophageal screening protocol interpreted by the speech-language pathologist
Hobbs et al. The role of esophageal pH-impedance testing in clinical practice
Park et al. The value of early wireless esophageal pH monitoring in diagnosing functional heartburn in refractory gastroesophageal reflux disease
US20170053079A1 (en) System and methods for scoring data to differentiate between disorders
CN108937871A (en) A kind of alimentary canal micro-optics coherence tomography image analysis system and method
Fay et al. Paediatric urodynamic studies: emerging technologies and new frontiers
De Jonge et al. Capsule endoscopy for the detection of oesophageal mucosal disorders: a comparison of two different ingestion protocols
Kim et al. Advances in digital health for gastrointestinal nutrition
KR20110074264A (en) Terminal and its medical examination method
Chua et al. Use of a mobile application to monitor drain sites and surgical wounds after discharge from acute care-A feasibility study in Singapore
Fass et al. Functional Lumen Imaging Probe Panometry
Vergara et al. Contribution of wireless Wi-Fi intraoral cameras to the assessment of swallowing safety and efficiency
Kopey et al. Does a 3-sip test detect dysphagia in acute stroke rehabilitation patients?
JP7797067B1 (en) Telemedicine provision system and telemedicine provision device
US20090326334A1 (en) Health condition detection, storage, and presentation

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21741031

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 3164381

Country of ref document: CA

ENP Entry into the national phase

Ref document number: 2022543124

Country of ref document: JP

Kind code of ref document: A

REG Reference to national code

Ref country code: BR

Ref legal event code: B01A

Ref document number: 112022013945

Country of ref document: BR

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2021741031

Country of ref document: EP

Effective date: 20220816

ENP Entry into the national phase

Ref document number: 2021208546

Country of ref document: AU

Date of ref document: 20210114

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 112022013945

Country of ref document: BR

Kind code of ref document: A2

Effective date: 20220714

WWW Wipo information: withdrawn in national office

Ref document number: 294753

Country of ref document: IL