WO2018217431A1 - Robotic surgical system with automated guidance - Google Patents

Robotic surgical system with automated guidance Download PDF

Info

Publication number
WO2018217431A1
WO2018217431A1 PCT/US2018/031302 US2018031302W WO2018217431A1 WO 2018217431 A1 WO2018217431 A1 WO 2018217431A1 US 2018031302 W US2018031302 W US 2018031302W WO 2018217431 A1 WO2018217431 A1 WO 2018217431A1
Authority
WO
WIPO (PCT)
Prior art keywords
fiducials
fiducial
robot arm
instrument
port
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2018/031302
Other languages
French (fr)
Inventor
Matthew Chowaniec
Xingrui Chen
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Covidien LP
Original Assignee
Covidien LP
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Covidien LP filed Critical Covidien LP
Priority to US16/615,226 priority Critical patent/US11839441B2/en
Priority to CN201880034162.3A priority patent/CN110662507A/en
Priority to EP18806526.2A priority patent/EP3629980A4/en
Priority to JP2019564842A priority patent/JP2020520745A/en
Publication of WO2018217431A1 publication Critical patent/WO2018217431A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/30Surgical robots
    • A61B34/32Surgical robots operating autonomously
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/39Markers, e.g. radio-opaque or breast lesions markers
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/30Surgical robots
    • A61B2034/301Surgical robots for introducing or steering flexible instruments inserted into the body, e.g. catheters or endoscopes
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/30Surgical robots
    • A61B2034/302Surgical robots specifically adapted for manipulations within body cavities, e.g. within abdominal or thoracic cavities
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36Image-producing devices or illumination devices not otherwise provided for
    • A61B2090/363Use of fiducial points
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/39Markers, e.g. radio-opaque or breast lesions markers
    • A61B2090/397Markers, e.g. radio-opaque or breast lesions markers electromagnetic other than visible, e.g. microwave
    • A61B2090/3975Markers, e.g. radio-opaque or breast lesions markers electromagnetic other than visible, e.g. microwave active
    • A61B2090/3979Markers, e.g. radio-opaque or breast lesions markers electromagnetic other than visible, e.g. microwave active infrared
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36Image-producing devices or illumination devices not otherwise provided for

Definitions

  • Robotic surgical systems such as teleoperative systems are used to perform minimally invasive surgical procedures that offer many benefits over traditional open surgery techniques, including less pain, shorter hospital stays, quicker return to normal activities, minimal scarring, reduced recovery time, and less injury to tissue.
  • Robotic surgical systems can have a number of robotic arms that move attached instruments or tools, such as an image capturing device, a stapler, an electrosurgical instrument, etc., in response to movement of input devices by a surgeon viewing images captured by the image capturing device of a surgical site.
  • instruments or tools such as an image capturing device, a stapler, an electrosurgical instrument, etc.
  • each of the tools may be inserted through an opening, e.g., a laparoscopic port, into the patient and positioned to manipulate tissue at a surgical site.
  • the openings are placed about the patient's body so that the surgical instruments may be used to cooperatively perform the surgical procedure and the image capturing device may view the surgical site.
  • the tools are manipulated in multiple degrees of freedom by a clinician.
  • the clinician In order to manipulate the tool through the laparoscopic port, the clinician has to position the robotic arm correctly to facilitate insertion and/or removal of the tool.
  • obtaining the correct position may be a relatively time consuming step.
  • manual positioning of the robotic arm by the clinician adds further time and complexity to this step of the surgical procedure.
  • the present disclosure relates generally to guiding of a robotic surgical system and, in particular, guiding a robotic arm of the robotic surgical system to automatically insert and/or remove tools through an opening or laparoscopic port.
  • a robotic surgical system includes at least one robot arm, at least one instrument coupled to the robot arm, and a plurality of drive motors configured to drive the at least one robot arm and at least one instrument.
  • the system also includes a laparoscopic port having a plurality of fiducials and a sensor configured to detect the plurality of fiducials.
  • a controller that is configured to control the plurality of drive motors includes a processor configured to determine a current distance between each fiducial among the plurality of fiducials, determine a location of the laparoscopic port based on the distance between each fiducial, determine a position of the at least one robot arm and the at least one instrument relative to the location of the laparoscopic port, and control the plurality of drive motors to align the at least one robot arm or the at least one instrument with the laparoscopic port.
  • the processor is also configured to obtain a predetermined distance between each fiducial among the plurality of fiducials and obtain a predetermined distance between each fiducial and the laparoscopic port.
  • the processor may determine the location of the laparoscopic port based on the current distance between each fiducial among the plurality of fiducials, the predetermined distance between each fiducial among the plurality of fiducials, and the predetermined distance between each fiducial and the laparoscopic port.
  • the processor is configured to obtains a length of the at least one instrument and a length of the at least one robot arm.
  • Control of the plurality of drive motors may be based on the position of the at least one robot arm and the at least one instrument relative to the location of the laparoscopic port, the length of the at least one instrument, and the length of the at least one robot arm.
  • the plurality of fiducials is active light emitting diodes.
  • the robotic surgical system includes a light source configured to emit light directed at the plurality of fiducials.
  • the plurality of fiducials may include a reflective material and the light emitted from the light source may be reflected by the plurality of fiducials and detected by the sensor.
  • a method for guiding a robot arm and/or instrument toward a laparoscopic port includes determining a current distance between each fiducial among a plurality of fiducials disposed around the laparoscopic port and determining a location of the laparoscopic port based on the distance between each fiducial.
  • the method also includes determining a position of the robot arm and the instrument relative to the location of the laparoscopic port and controlling a plurality of drive motors associated with the robot arm and the instrument to align the robot arm or the instrument with the laparoscopic port.
  • the method includes obtaining a predetermined distance between each fiducial among the plurality of fiducials and obtaining a predetermined distance between each fiducial and the laparoscopic port.
  • the method also includes determining the location of the laparoscopic port based on the current distance between each fiducial among the plurality of fiducials, the predetermined distance between each fiducial among the plurality of fiducials, and the predetermined distance between each fiducial and the laparoscopic port.
  • the method includes obtaining a length of the instrument and obtaining a length of the robot arm. Controlling the plurality of drive motors is based on the position of the robot arm and the instrument relative to the location of the laparoscopic port, the length of the instrument, and the length of the robot arm.
  • FIG. 1 is a schematic illustration of a user interface and a robotic system of a robotic surgical system in accordance with the present disclosure
  • FIG. 2A is a top view of a laparoscopic port in accordance with the present disclosure
  • FIG. 2B is a perspective view of a portion of robotic arm of the robot system of Fig.
  • FIG. 3 A is a perspective view of an exemplary outside-looking-in optical system in accordance with the present disclosure
  • Fig. 3B is a perspective view of an exemplary inside-looking-out optical system in accordance with the present disclosure
  • FIG. 3C is a perspective view of an exemplary optical system in accordance with the present disclosure including sensors disposed about an operating theater;
  • Fig. 4 is a flowchart depicting operation of an automated guidance system of the present disclosure including an optical system of Fig. 3A, 3B, or 3C.
  • the present disclosure is directed to systems and methods for guiding one or more robotic arms in a robotic surgical system utilizing images captured during a surgical procedure.
  • Image data captured during a surgical procedure may be analyzed to guide a robotic arm having a device or tool coupled thereto to insert and/or remove the tool from a laparoscopic port.
  • one or more laparoscopic ports have three (3) fiducials, e.g., active infrared light emitting diodes (LEDs), with known distances between the fiducials and known distances between the fiducials and a center of the laparoscopic port.
  • fiducials e.g., active infrared light emitting diodes (LEDs)
  • each fiducial may be analyzed using motion analyzing techniques to establish a plane defined by the fiducials and establish the steps necessary to move the robot arm in position.
  • the position of the center of the laparoscopic port relative to the three (3) fiducials determines where to insert and/or remove the tool, and an orientation angle for the tool.
  • aligning and orienting the robotic arm to insert and/or remove the tool through the laparoscopic port relies on one or more variables.
  • the variable(s) may include, but is/are not limited to, distance(s) between three (3) or more fiducials, distance(s) between the fiducials and the center of the laparoscopic port, the port plane defined by the fiducials, and/or the length of the interchangeable tool and robotic arm.
  • the systems described herein permit quicker installation of robotic instrumentation into laparoscopic ports, less intervention on the part of a clinician during a surgical procedure, and/or potentially lower incidents of impact with a laparoscopic port site.
  • a robotic surgical system 100 may be employed with one or more consoles 102 that are next to the operating theater or located in a remote location.
  • one team of clinicians or nurses may prep the patient for surgery and configure the robotic surgical system 100 with one or more tools 104 while another clinician (or group of clinicians) remotely controls the instruments via the robotic surgical system.
  • a highly skilled clinician may perform multiple operations in multiple locations without leaving his/her remote console which can be both economically advantageous and a benefit to the patient or a series of patients.
  • the robotic arms 106 of the surgical system 100 are typically coupled to a pair of master handles 108 by a controller 110.
  • Controller 110 may be integrated with the console 102 or provided as a standalone device within the operating theater.
  • the handles 106 can be moved by the clinician to produce a corresponding movement of the working ends of any type of tools 104 (e.g., probes, mechanical or electrosurgical end effectors, graspers, knifes, scissors, etc.) attached to the robotic arms 106.
  • tools 104 e.g., probes, mechanical or electrosurgical end effectors, graspers, knifes, scissors, etc.
  • tool 104 may be a probe that includes an image capture device.
  • the console 102 includes a display device 112 which is configured to display two- dimensional or three-dimensional images.
  • the display device 112 displays the images of the surgical site which may include data captured by tool 104 positioned on the ends 114 of the arms 106 and/or include data captured by imaging devices that are positioned about the surgical theater (e.g., an imaging device positioned within the surgical site, an imaging device positioned adjacent the patient, imaging device positioned at a distal end of an imaging arm).
  • the imaging devices may capture visual images, infra-red images, ultrasound images, X-ray images, thermal images, and/or any other known real-time images of the surgical site.
  • the imaging devices transmit captured imaging data to the controller 110 which creates the images of the surgical site in realtime from the imaging data and transmits the images to the display device 112 for display.
  • the movement of the master handles 108 may be scaled so that the working ends have a corresponding movement that is different, smaller or larger, than the movement performed by the operating hands of the clinician.
  • the scale factor or gearing ratio may be adjustable so that the operator can control the resolution of the working ends of the surgical instrument(s) 104.
  • the master handles 108 are operated by a clinician to produce a corresponding movement of the robotic arms 106 and/or surgical instruments 104.
  • the master handles 108 provide a signal to the controller 110 which then provides a corresponding signal to one or more drive motors 114.
  • the one or more drive motors 114 are coupled to the robotic arms 106 in order to move the robotic arms 106 and/or surgical instruments 104.
  • the master handles 108 may include various haptics 116 to provide feedback to the clinician relating to various tissue parameters or conditions, e.g., tissue resistance due to manipulation, cutting or otherwise treating, pressure by the instrument onto the tissue, tissue temperature, tissue impedance, etc. As can be appreciated, such haptics 116 provide the clinician with enhanced tactile feedback simulating actual operating conditions.
  • the haptics 116 may include vibratory motors, electroactive polymers, piezoelectric devices, electrostatic devices, subsonic audio wave surface actuation devices, reverse-electrovibration, or any other device capable of providing a tactile feedback to a user.
  • the master handles 108 may also include a variety of different actuators (not shown) for delicate tissue manipulation or treatment further enhancing the clinician's ability to mimic actual operating conditions.
  • the controller 110 includes a transceiver 118 and a processor 120.
  • Transceiver 118 receives a signal from infrared sensors 122 which will be described in more detail below. The signal from infrared sensors may be transmitted to transceiver 118 via any conventional wired or wireless methods.
  • Transceiver 118 provides the signal to a motion analysis unit 124 in processor 120 which performs a motion analysis on the signal in order to control the one or more drive motors 114 to move the robotic arms 106 and/or surgical instruments 104 into the correct position and/or orientation.
  • a memory 126 may store an algorithm used to perform the motion analysis. In some embodiments, memory 126 may store a look up table (LUT) that includes information pertaining to instruments 104, robot arms 106, and laparoscopic ports discussed below.
  • LUT look up table
  • infrared sensors receive light from infrared light sources.
  • the infrared sensors may be disposed on the robotic arm 106, the surgical instrument 104, the laparoscopic port 130, or may be disposed anywhere in the surgical environment.
  • the infrared light sources may be incorporated in the robotic arm 106, the surgical instrument 104, the laparoscopic port 130, or may be disposed anywhere in the surgical environment.
  • the laparoscopic port 130 has at least three (3) port fiducials 132a-c positioned in a port plane about a port opening 131 of the laparoscopic port 130.
  • the port plane may be defined by an outer surface 133 (Fig. 3A) of the laparoscopic port 130.
  • the port fiducials 132a-c are positioned about the port opening 131 with distances D1-3 between the port fiducials 132a-c and distances P1-3 between the port fiducials 132a-c and a center "X" of the port opening 131 being known.
  • the robotic arm 106 has at least three (3) arm fiducials 107a- c positioned in an arm plane orthogonal to a longitudinal axis of the robotic arm 106.
  • the arm plane may be defined by a distal surface 103 of the robotic arm 106. Similar to the port fiducials 132a-c, distances between the arm fiducials 107a-c and distances between each of the arm fiducials 107a-c and the longitudinal axis of the robotic arm 106 are known.
  • Fig. 3 A an outside-looking-in optical system is shown according to an embodiment of the present disclosure including the robotic arm 106 and the laparoscopic port 130.
  • the port fiducials 132a-c of laparoscopic port 130 are infrared light sources (e.g., active infrared light emitting diodes (LEDs)) which each emit infrared light IL1-3 having a distinctive characteristic (e.g., wavelength, phase) and the arm fiducials 107a-c are infrared sensors (e.g., infrared cameras) in communication with the transceiver 118 (FIG. 1).
  • LEDs active infrared light emitting diodes
  • the arm fiducials 107a-c determine the time it takes for infrared light (e.g., IL1-3) from the port fiducials 132a-c to reach the respective arm fiducial 107a-c and provides a signal indicative of the time to motion analysis unit 124.
  • infrared light e.g., IL1-3
  • an inside-looking-out optical system is shown according to an embodiment of the present disclosure including the robotic arm 106 and the laparoscopic port 130.
  • the at least three (3) arm fiducials 107a-c are infrared light sources (e.g., active infrared light emitting diodes (LEDs)) which each emit infrared light EL1-3 having a distinctive characteristic (e.g., wavelength, phase) and the at least three (3) of laparoscopic port 130 are infrared sensors (e.g., infrared cameras) in communication with the transceiver 118 (FIG. 1).
  • LEDs active infrared light emitting diodes
  • the port fiducials 132a-c determine the time it takes for the infrared light (e.g., EL1-3) from the arm fiducials 107a-c to reach the respective port fiducial 132a-c and provides a signal indicative of the motion analysis unit 124.
  • the infrared light e.g., EL1-3
  • a fixed optical system is shown according to an embodiment of the present disclosure including the robotic arm 106 and the laparoscopic port 130.
  • at least three (3) infrared sensors 192a-c are positioned about the operating theater and are in communication with the transceiver 118 (FIG. 1).
  • the port fiducials 132a-c of laparoscopic port 130 are infrared light sources (e.g., active infrared light emitting diodes (LEDs)) which each emit infrared light IL1-3 having a distinctive characteristic (e.g., wavelength, phase) and the arm fiducials 107a-c and the arm fiducials 107a-c are infrared light sources (e.g., active infrared light emitting diodes (LEDs)) which each emit infrared light EL1-3 having a distinctive characteristic (e.g., wavelength, phase).
  • LEDs active infrared light emitting diodes
  • the positions of the infrared sensors 192a-c within the operating theater are known such that the position of the arm and port fiducials 107a-c, 132a-c relative to the infrared sensors 192a-c can be determined as detailed below.
  • the infrared sensors 192a-c determine the time it takes for infrared light (e.g., IL1-3 or ELi- 3) from the arm fiducials 107a-c and the port fiducials 132a-c to reach the respective infrared sensor 192a-c and provides a signal indicative of the time to motion analysis unit 124.
  • infrared light e.g., IL1-3 or ELi- 3
  • the motion analysis unit 124 determines the position of the robotic arm 106 relative to the laparoscopic port 130 based on signals from the fiducials 107a-c, 132a-c.
  • Fig. 4 will be described while making references to Figs. 1-3 A.
  • a user enters a laparoscopic port identification number in step s202.
  • the motion analysis unit queries the memory 126 in step s204 to obtain the distances between port fiducials 132a-c (Di, D 2 , and D 3 as shown in Fig.
  • an instrument identification number is obtained.
  • the instrument identification number of an instrument 104 coupled to the robotic arm 106 may be obtained via a user input or it may be obtained from an integrated circuit (IC) included in the instrument 104.
  • the length of the instrument 104 is obtained based on the instrument identification number, either from the memory 124 or the IC included in the instrument 104.
  • a robot arm identification number is obtained.
  • the robot arm identification number may be obtained via a user input or it may be obtained from an IC included in the robot arm 106.
  • the geometry of the robot arm 106 is obtained based on the robot arm identification number, either from memory 124 or the IC included in the robot arm 106.
  • step s214 the motion analysis unit 124 receives signals from the arm fiducials
  • the motion analysis unit 124 uses three-dimensional spherical trilateration to determine the distance between each of the port fiducials 132a-c and each of the arm fiducials 107a-c in step s216.
  • step s218 the distances between each of the port fiducials 132a-c relative to each of the arm fiducials 107a-c, the port plane defined by the port fiducials 132a-c is determined relative to the arm fiducials 107a-c.
  • the at least three port fiducials are required to define the port plane relative to the arm fiducials 107a-c which can be determined as follows:
  • the arm fiducials 107a-c are sensors and the port fiducials 132a- c are light sources.
  • the arm fiducials 107a-c can be light sources and the port fiducials 132a-c can be sensors in communication with the motion analysis unit 124.
  • the arm and port fiducials 107a-c, 132a-c can be light sources and the sensors 192a-c can be sensors in communication with the motion analysis unit 124.
  • the motion analysis unit 124 determines the port center "X" on the port plane from the position of the three arm fiducials 107a-c. To determine the port center "X”, the motion analysis unit 124 solves the following system of equations:
  • step s220 from the position of the port fiducials 132a-c and the port center "X", a vector "V" normal to the port plane defined by the port fiducials 132a-c and passing through the port center "X" provides the orientation of the port opening 131 relative to the arm fiducials 107a- c.
  • step s222 the motion analysis unit 124 determines the current position of the robot arm 106 and the instrument 104 relative to the laparoscopic port 130. To determine the current position of the instrument 104, the motion analysis unit 124 can use inverse kinematics based on the known geometry of links of the robot arm 106, the instrument 104, and measured angles between the links of the robot arm 106.
  • step s224 the length of the instalment 104 obtained in step s208, the geometry of the robot arm 106 obtained in steps s212, the location of the laparoscopic port 130 determined in step s220, and the current position of the robot arm 106 (e.g., angles between links) and the instrument 104 determined in step s222 are used to determine how to control the drive motors 114 in order to align the instrument 104 with the vector "V" so that the robot arm 106 and/or instrument 104 may be inserted and/or removed from the laparoscopic port 130.
  • step s226 the drive motors 114 are controlled to perform insertion and/or removal of the instrument 104.
  • a phrase in the form "A or B” means “(A), (B), or (A and B)".
  • a phrase in the form "at least one of A, B, or C” means “(A), (B), (C), (A and B), (A and C), (B and C), or (A, B and C)”.
  • a clinician may refer to a surgeon or any medical professional, such as a doctor, nurse, technician, medical assistant, or the like performing a medical procedure.
  • the systems described herein may also utilize one or more controllers to receive various information and transform the received information to generate an output.
  • the controller may include any type of computing device, computational circuit, or any type of processor or processing circuit capable of executing a series of instructions that are stored in a memory.
  • the controller may include multiple processors and/or multicore central processing units (CPUs) and may include any type of processor, such as a microprocessor, digital signal processor, microcontroller, or the like.
  • the controller may also include a memory to store data and/or algorithms to perform a series of instructions.
  • the systems described herein utilize optical or visual motion tracking technology; however, it is envisioned that other motion tracking technologies can be used in place of or in conjunction with the optical motion tracking technologies detailed above including, but not limited to, accelerometer, gyroscopic, ultrasound, magnetic, radio frequency, or other light based (e.g., laser) motion tracking technologies.
  • a "Programming Language” and “Computer Program” includes any language used to specify instructions to a computer, and includes (but is not limited to) these languages and their derivatives: Assembler, Basic, Batch files, BCPL, C, C+, C++, Delphi, Fortran, Java, JavaScript, Machine code, operating system command languages, Pascal, Perl, PL1, scripting languages, Visual Basic, metalanguages which themselves specify programs, and all first, second, third, fourth, and fifth generation computer languages. Also included are database and other data schemas, and any other metalanguages.
  • any of the herein described methods, programs, algorithms or codes may be contained on one or more machine-readable media or memory.
  • the term "memory" may include a mechanism that provides (e.g., stores and/or transmits) information in a form readable by a machine such a processor, computer, or a digital processing device.
  • a memory may include a read only memory (ROM), random access memory (RAM), magnetic disk storage media, optical storage media, flash memory devices, or any other volatile or non-volatile memory storage device.
  • Code or instructions contained thereon can be represented by carrier wave signals, infrared signals, digital signals, and by other like signals.

Landscapes

  • Health & Medical Sciences (AREA)
  • Surgery (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Medical Informatics (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Molecular Biology (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Robotics (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Pathology (AREA)
  • Manipulator (AREA)

Abstract

A robotic surgical system includes at least one robot arm, at least one instrument, and a plurality of drive motors configured to drive the at least one robot arm and at least one instrument. The system also includes a laparoscopic port having a plurality of fiducials, a sensor configured to detect the plurality of fiducials, and a controller configured to control the plurality of drive motors. The controller includes a processor that determines a current distance between each fiducial among the plurality of fiducials, determines a location of the laparoscopic port based on the distance between each fiducial, determines a position of the at least one robot arm and the at least one instrument relative to the location of the laparoscopic port, and controls the plurality of drive motors to align the at least one robot arm or the at least one instrument with the laparoscopic port.

Description

ROBOTIC SURGICAL SYSTEM WITH AUTOMATED GUIDANCE BACKGROUND
[1] Robotic surgical systems such as teleoperative systems are used to perform minimally invasive surgical procedures that offer many benefits over traditional open surgery techniques, including less pain, shorter hospital stays, quicker return to normal activities, minimal scarring, reduced recovery time, and less injury to tissue.
[2] Robotic surgical systems can have a number of robotic arms that move attached instruments or tools, such as an image capturing device, a stapler, an electrosurgical instrument, etc., in response to movement of input devices by a surgeon viewing images captured by the image capturing device of a surgical site. During a surgical procedure, each of the tools may be inserted through an opening, e.g., a laparoscopic port, into the patient and positioned to manipulate tissue at a surgical site. The openings are placed about the patient's body so that the surgical instruments may be used to cooperatively perform the surgical procedure and the image capturing device may view the surgical site.
[3] During the surgical procedure, the tools are manipulated in multiple degrees of freedom by a clinician. In order to manipulate the tool through the laparoscopic port, the clinician has to position the robotic arm correctly to facilitate insertion and/or removal of the tool. However, obtaining the correct position may be a relatively time consuming step. Further, manual positioning of the robotic arm by the clinician adds further time and complexity to this step of the surgical procedure. [4] Accordingly, there is a need for guiding the robotic arms of the robotic surgical system to reduce the complexity and duration of a surgical procedure, as well as increase the outcome and/or results of the surgical procedure.
SUMMARY
[5] The present disclosure relates generally to guiding of a robotic surgical system and, in particular, guiding a robotic arm of the robotic surgical system to automatically insert and/or remove tools through an opening or laparoscopic port.
[6] In an aspect of the present disclosure, a robotic surgical system is provided. The system includes at least one robot arm, at least one instrument coupled to the robot arm, and a plurality of drive motors configured to drive the at least one robot arm and at least one instrument. The system also includes a laparoscopic port having a plurality of fiducials and a sensor configured to detect the plurality of fiducials. A controller that is configured to control the plurality of drive motors includes a processor configured to determine a current distance between each fiducial among the plurality of fiducials, determine a location of the laparoscopic port based on the distance between each fiducial, determine a position of the at least one robot arm and the at least one instrument relative to the location of the laparoscopic port, and control the plurality of drive motors to align the at least one robot arm or the at least one instrument with the laparoscopic port.
[7] In embodiments, the processor is also configured to obtain a predetermined distance between each fiducial among the plurality of fiducials and obtain a predetermined distance between each fiducial and the laparoscopic port. The processor may determine the location of the laparoscopic port based on the current distance between each fiducial among the plurality of fiducials, the predetermined distance between each fiducial among the plurality of fiducials, and the predetermined distance between each fiducial and the laparoscopic port.
[8] In embodiments, the processor is configured to obtains a length of the at least one instrument and a length of the at least one robot arm. Control of the plurality of drive motors may be based on the position of the at least one robot arm and the at least one instrument relative to the location of the laparoscopic port, the length of the at least one instrument, and the length of the at least one robot arm.
[9] In some embodiments, the plurality of fiducials is active light emitting diodes.
[10] In some embodiments, the robotic surgical system includes a light source configured to emit light directed at the plurality of fiducials. The plurality of fiducials may include a reflective material and the light emitted from the light source may be reflected by the plurality of fiducials and detected by the sensor.
[11] In another aspect of the present disclosure, a method for guiding a robot arm and/or instrument toward a laparoscopic port is provided. The method includes determining a current distance between each fiducial among a plurality of fiducials disposed around the laparoscopic port and determining a location of the laparoscopic port based on the distance between each fiducial. The method also includes determining a position of the robot arm and the instrument relative to the location of the laparoscopic port and controlling a plurality of drive motors associated with the robot arm and the instrument to align the robot arm or the instrument with the laparoscopic port. [12] In embodiments, the method includes obtaining a predetermined distance between each fiducial among the plurality of fiducials and obtaining a predetermined distance between each fiducial and the laparoscopic port. The method also includes determining the location of the laparoscopic port based on the current distance between each fiducial among the plurality of fiducials, the predetermined distance between each fiducial among the plurality of fiducials, and the predetermined distance between each fiducial and the laparoscopic port.
[13] In embodiments, the method includes obtaining a length of the instrument and obtaining a length of the robot arm. Controlling the plurality of drive motors is based on the position of the robot arm and the instrument relative to the location of the laparoscopic port, the length of the instrument, and the length of the robot arm.
BRIEF DESCRIPTION OF THE DRAWINGS
[14] Various aspects of the present disclosure are described hereinbelow with reference to the drawings, which are incorporated in and constitute a part of this specification, wherein:
[15] Fig. 1 is a schematic illustration of a user interface and a robotic system of a robotic surgical system in accordance with the present disclosure;
[16] Fig. 2A is a top view of a laparoscopic port in accordance with the present disclosure;
[17] Fig. 2B is a perspective view of a portion of robotic arm of the robot system of Fig.
1 with a surgical instrument attached to the robotic arm;
[18] Fig. 3 A is a perspective view of an exemplary outside-looking-in optical system in accordance with the present disclosure; [19] Fig. 3B is a perspective view of an exemplary inside-looking-out optical system in accordance with the present disclosure;
[20] Fig. 3C is a perspective view of an exemplary optical system in accordance with the present disclosure including sensors disposed about an operating theater; and
[21] Fig. 4 is a flowchart depicting operation of an automated guidance system of the present disclosure including an optical system of Fig. 3A, 3B, or 3C.
DETAILED DESCRIPTION
[22] The present disclosure is directed to systems and methods for guiding one or more robotic arms in a robotic surgical system utilizing images captured during a surgical procedure. Image data captured during a surgical procedure may be analyzed to guide a robotic arm having a device or tool coupled thereto to insert and/or remove the tool from a laparoscopic port. In the systems described herein, one or more laparoscopic ports have three (3) fiducials, e.g., active infrared light emitting diodes (LEDs), with known distances between the fiducials and known distances between the fiducials and a center of the laparoscopic port. The positions of each fiducial may be analyzed using motion analyzing techniques to establish a plane defined by the fiducials and establish the steps necessary to move the robot arm in position. The position of the center of the laparoscopic port relative to the three (3) fiducials determines where to insert and/or remove the tool, and an orientation angle for the tool.
[23] In the systems described herein, aligning and orienting the robotic arm to insert and/or remove the tool through the laparoscopic port relies on one or more variables. The variable(s) may include, but is/are not limited to, distance(s) between three (3) or more fiducials, distance(s) between the fiducials and the center of the laparoscopic port, the port plane defined by the fiducials, and/or the length of the interchangeable tool and robotic arm.
[24] The systems described herein permit quicker installation of robotic instrumentation into laparoscopic ports, less intervention on the part of a clinician during a surgical procedure, and/or potentially lower incidents of impact with a laparoscopic port site.
[25] Turning to Fig. 1, a robotic surgical system 100 may be employed with one or more consoles 102 that are next to the operating theater or located in a remote location. In this instance, one team of clinicians or nurses may prep the patient for surgery and configure the robotic surgical system 100 with one or more tools 104 while another clinician (or group of clinicians) remotely controls the instruments via the robotic surgical system. As can be appreciated, a highly skilled clinician may perform multiple operations in multiple locations without leaving his/her remote console which can be both economically advantageous and a benefit to the patient or a series of patients.
[26] The robotic arms 106 of the surgical system 100 are typically coupled to a pair of master handles 108 by a controller 110. Controller 110 may be integrated with the console 102 or provided as a standalone device within the operating theater. The handles 106 can be moved by the clinician to produce a corresponding movement of the working ends of any type of tools 104 (e.g., probes, mechanical or electrosurgical end effectors, graspers, knifes, scissors, etc.) attached to the robotic arms 106. For example, tool 104 may be a probe that includes an image capture device.
[27] The console 102 includes a display device 112 which is configured to display two- dimensional or three-dimensional images. The display device 112 displays the images of the surgical site which may include data captured by tool 104 positioned on the ends 114 of the arms 106 and/or include data captured by imaging devices that are positioned about the surgical theater (e.g., an imaging device positioned within the surgical site, an imaging device positioned adjacent the patient, imaging device positioned at a distal end of an imaging arm). The imaging devices may capture visual images, infra-red images, ultrasound images, X-ray images, thermal images, and/or any other known real-time images of the surgical site. The imaging devices transmit captured imaging data to the controller 110 which creates the images of the surgical site in realtime from the imaging data and transmits the images to the display device 112 for display.
[28] The movement of the master handles 108 may be scaled so that the working ends have a corresponding movement that is different, smaller or larger, than the movement performed by the operating hands of the clinician. The scale factor or gearing ratio may be adjustable so that the operator can control the resolution of the working ends of the surgical instrument(s) 104.
[29] During operation of the surgical system 100, the master handles 108 are operated by a clinician to produce a corresponding movement of the robotic arms 106 and/or surgical instruments 104. The master handles 108 provide a signal to the controller 110 which then provides a corresponding signal to one or more drive motors 114. The one or more drive motors 114 are coupled to the robotic arms 106 in order to move the robotic arms 106 and/or surgical instruments 104.
[30] The master handles 108 may include various haptics 116 to provide feedback to the clinician relating to various tissue parameters or conditions, e.g., tissue resistance due to manipulation, cutting or otherwise treating, pressure by the instrument onto the tissue, tissue temperature, tissue impedance, etc. As can be appreciated, such haptics 116 provide the clinician with enhanced tactile feedback simulating actual operating conditions. The haptics 116 may include vibratory motors, electroactive polymers, piezoelectric devices, electrostatic devices, subsonic audio wave surface actuation devices, reverse-electrovibration, or any other device capable of providing a tactile feedback to a user. The master handles 108 may also include a variety of different actuators (not shown) for delicate tissue manipulation or treatment further enhancing the clinician's ability to mimic actual operating conditions.
[31] The controller 110 includes a transceiver 118 and a processor 120. Transceiver 118 receives a signal from infrared sensors 122 which will be described in more detail below. The signal from infrared sensors may be transmitted to transceiver 118 via any conventional wired or wireless methods. Transceiver 118 provides the signal to a motion analysis unit 124 in processor 120 which performs a motion analysis on the signal in order to control the one or more drive motors 114 to move the robotic arms 106 and/or surgical instruments 104 into the correct position and/or orientation. A memory 126 may store an algorithm used to perform the motion analysis. In some embodiments, memory 126 may store a look up table (LUT) that includes information pertaining to instruments 104, robot arms 106, and laparoscopic ports discussed below.
[32] As will be discussed in more detail below, infrared sensors receive light from infrared light sources. The infrared sensors may be disposed on the robotic arm 106, the surgical instrument 104, the laparoscopic port 130, or may be disposed anywhere in the surgical environment. The infrared light sources may be incorporated in the robotic arm 106, the surgical instrument 104, the laparoscopic port 130, or may be disposed anywhere in the surgical environment. [33] With reference to Fig. 2A, the laparoscopic port 130 has at least three (3) port fiducials 132a-c positioned in a port plane about a port opening 131 of the laparoscopic port 130. The port plane may be defined by an outer surface 133 (Fig. 3A) of the laparoscopic port 130. The port fiducials 132a-c are positioned about the port opening 131 with distances D1-3 between the port fiducials 132a-c and distances P1-3 between the port fiducials 132a-c and a center "X" of the port opening 131 being known.
[34] Referring to Fig. 2B, the robotic arm 106 has at least three (3) arm fiducials 107a- c positioned in an arm plane orthogonal to a longitudinal axis of the robotic arm 106. The arm plane may be defined by a distal surface 103 of the robotic arm 106. Similar to the port fiducials 132a-c, distances between the arm fiducials 107a-c and distances between each of the arm fiducials 107a-c and the longitudinal axis of the robotic arm 106 are known.
[35] Turning to Fig. 3 A, an outside-looking-in optical system is shown according to an embodiment of the present disclosure including the robotic arm 106 and the laparoscopic port 130. In such an embodiment, the port fiducials 132a-c of laparoscopic port 130 are infrared light sources (e.g., active infrared light emitting diodes (LEDs)) which each emit infrared light IL1-3 having a distinctive characteristic (e.g., wavelength, phase) and the arm fiducials 107a-c are infrared sensors (e.g., infrared cameras) in communication with the transceiver 118 (FIG. 1). The arm fiducials 107a-c determine the time it takes for infrared light (e.g., IL1-3) from the port fiducials 132a-c to reach the respective arm fiducial 107a-c and provides a signal indicative of the time to motion analysis unit 124.
[36] Referring to Fig. 3B, an inside-looking-out optical system is shown according to an embodiment of the present disclosure including the robotic arm 106 and the laparoscopic port 130. The at least three (3) arm fiducials 107a-c are infrared light sources (e.g., active infrared light emitting diodes (LEDs)) which each emit infrared light EL1-3 having a distinctive characteristic (e.g., wavelength, phase) and the at least three (3) of laparoscopic port 130 are infrared sensors (e.g., infrared cameras) in communication with the transceiver 118 (FIG. 1). The port fiducials 132a-c determine the time it takes for the infrared light (e.g., EL1-3) from the arm fiducials 107a-c to reach the respective port fiducial 132a-c and provides a signal indicative of the motion analysis unit 124.
[37] Referring to Fig. 3C, a fixed optical system is shown according to an embodiment of the present disclosure including the robotic arm 106 and the laparoscopic port 130. In such an embodiment, at least three (3) infrared sensors 192a-c (e.g., infrared cameras) are positioned about the operating theater and are in communication with the transceiver 118 (FIG. 1). The port fiducials 132a-c of laparoscopic port 130 are infrared light sources (e.g., active infrared light emitting diodes (LEDs)) which each emit infrared light IL1-3 having a distinctive characteristic (e.g., wavelength, phase) and the arm fiducials 107a-c and the arm fiducials 107a-c are infrared light sources (e.g., active infrared light emitting diodes (LEDs)) which each emit infrared light EL1-3 having a distinctive characteristic (e.g., wavelength, phase). The positions of the infrared sensors 192a-c within the operating theater are known such that the position of the arm and port fiducials 107a-c, 132a-c relative to the infrared sensors 192a-c can be determined as detailed below. The infrared sensors 192a-c determine the time it takes for infrared light (e.g., IL1-3 or ELi- 3) from the arm fiducials 107a-c and the port fiducials 132a-c to reach the respective infrared sensor 192a-c and provides a signal indicative of the time to motion analysis unit 124.
[38] As detailed below with reference to FIG. 4, the motion analysis unit 124 (FIG. 1) determines the position of the robotic arm 106 relative to the laparoscopic port 130 based on signals from the fiducials 107a-c, 132a-c. Fig. 4 will be described while making references to Figs. 1-3 A. As shown in Fig. 4, a user enters a laparoscopic port identification number in step s202. Based on the laparoscopic port identification number, the motion analysis unit queries the memory 126 in step s204 to obtain the distances between port fiducials 132a-c (Di, D2, and D3 as shown in Fig. 2A) and the distances between each port fiducial 132a-c and the port center "X" of the port opening 131 (Pi, P2, and P3 as shown in Fig. 2A) that correspond to the laparoscopic port 130. In step s206, an instrument identification number is obtained. The instrument identification number of an instrument 104 coupled to the robotic arm 106 may be obtained via a user input or it may be obtained from an integrated circuit (IC) included in the instrument 104. In step s208, the length of the instrument 104 is obtained based on the instrument identification number, either from the memory 124 or the IC included in the instrument 104. In step s210, a robot arm identification number is obtained. The robot arm identification number may be obtained via a user input or it may be obtained from an IC included in the robot arm 106. In step s212, the geometry of the robot arm 106 is obtained based on the robot arm identification number, either from memory 124 or the IC included in the robot arm 106.
[39] In step s214, the motion analysis unit 124 receives signals from the arm fiducials
107a-c representing the time that the respective infrared light (e.g., ILi-3) from a respective one of the port fiducials 132a-c reached a respective arm fiducial 107a-c. Based on the signals from the arm fiducials 107a-c, the motion analysis unit 124 uses three-dimensional spherical trilateration to determine the distance between each of the port fiducials 132a-c and each of the arm fiducials 107a-c in step s216.
[40] For a detailed discussion of three-dimensional spherical trilateration used to determine the location of points in three dimensions, reference can be made to MURPHY JR., WILLIAM S. & HEREMAN, WILLY, DETERMINATION OF A POSITION IN THREE DIMENSIONS USING TRILATERATION AND APPROXIMATE DISTANCES, November 28, 1999, available at http://inside. mines. edu/~whereman/papers/Mu hy-Hereman-Trilaterati on- 1995.pdf, the entire contents of which are hereby incorporated by reference.
[41] In step s218, the distances between each of the port fiducials 132a-c relative to each of the arm fiducials 107a-c, the port plane defined by the port fiducials 132a-c is determined relative to the arm fiducials 107a-c.
[42] It will be appreciated that the at least three port fiducials (e.g., port fiducials 132a- c) are required to define the port plane relative to the arm fiducials 107a-c which can be determined as follows:
1. Solving for the vector from 132a, 132b and the vector from 132a, 132c as follows:
AB = (xB - xA) 7 + yB - yA)7 + (zB - zA) k
AC = (xc - xA) 7 + yc - yA)7 + (zc - zA) k
2. Determining the normal vector as follows: ί J
ABxAC = (xB - xA) (yB - yA) (zB - zA)
.Xc - XA) (VC - VA) (zC - ¾).
3. Determine the equation of the plane from the normal vector as follows:
((χβ - xA) + (xc - xA))x + (( fl - yA) + (yc - j) y + ((zB - zA) + (zc - zA))z + d = 0
4. Use any known point on the plane to solve for d. [43] As detailed above, the arm fiducials 107a-c are sensors and the port fiducials 132a- c are light sources. Alternatively, the arm fiducials 107a-c can be light sources and the port fiducials 132a-c can be sensors in communication with the motion analysis unit 124. In addition, as detailed above, the arm and port fiducials 107a-c, 132a-c can be light sources and the sensors 192a-c can be sensors in communication with the motion analysis unit 124.
[44] In addition, during step s218, the motion analysis unit 124 determines the port center "X" on the port plane from the position of the three arm fiducials 107a-c. To determine the port center "X", the motion analysis unit 124 solves the following system of equations:
(XX-XA)2+(YX-YA)2+(ZX-ZA)2=RA2
(XX-XB)2+(YX-YB)2+(ZX-ZB)2=RB2
(Xx-Xc)2+(Yx-Yc)2+(Zx-Zc)2=Rc2 where RA-C are the distances each port fiduciary 132a-c is from a given one of the arm fiduciaries
107a-c.
[45] In step s220, from the position of the port fiducials 132a-c and the port center "X", a vector "V" normal to the port plane defined by the port fiducials 132a-c and passing through the port center "X" provides the orientation of the port opening 131 relative to the arm fiducials 107a- c.
[46] In step s222, the motion analysis unit 124 determines the current position of the robot arm 106 and the instrument 104 relative to the laparoscopic port 130. To determine the current position of the instrument 104, the motion analysis unit 124 can use inverse kinematics based on the known geometry of links of the robot arm 106, the instrument 104, and measured angles between the links of the robot arm 106. [47] In step s224, the length of the instalment 104 obtained in step s208, the geometry of the robot arm 106 obtained in steps s212, the location of the laparoscopic port 130 determined in step s220, and the current position of the robot arm 106 (e.g., angles between links) and the instrument 104 determined in step s222 are used to determine how to control the drive motors 114 in order to align the instrument 104 with the vector "V" so that the robot arm 106 and/or instrument 104 may be inserted and/or removed from the laparoscopic port 130. It will be appreciated that by determining the vector "V" relative to the arm fiducials 107a-c the movement of the robot arm 106, and thus instrument 104, are relative to the port fiducials 132a-c. In step s226, the drive motors 114 are controlled to perform insertion and/or removal of the instrument 104.
[48] The embodiments disclosed herein are examples of the disclosure and may be embodied in various forms. Specific structural and functional details disclosed herein are not to be interpreted as limiting, but as a basis for the claims and as a representative basis for teaching one skilled in the art to variously employ the present disclosure in virtually any appropriately detailed structure. Like reference numerals may refer to similar or identical elements throughout the description of the figures.
[49] The phrases "in an embodiment," "in embodiments," "in some embodiments," or
"in other embodiments," which may each refer to one or more of the same or different embodiments in accordance with the present disclosure. A phrase in the form "A or B" means "(A), (B), or (A and B)". A phrase in the form "at least one of A, B, or C" means "(A), (B), (C), (A and B), (A and C), (B and C), or (A, B and C)". A clinician may refer to a surgeon or any medical professional, such as a doctor, nurse, technician, medical assistant, or the like performing a medical procedure. [50] The systems described herein may also utilize one or more controllers to receive various information and transform the received information to generate an output. The controller may include any type of computing device, computational circuit, or any type of processor or processing circuit capable of executing a series of instructions that are stored in a memory. The controller may include multiple processors and/or multicore central processing units (CPUs) and may include any type of processor, such as a microprocessor, digital signal processor, microcontroller, or the like. The controller may also include a memory to store data and/or algorithms to perform a series of instructions.
[51] The systems described herein utilize optical or visual motion tracking technology; however, it is envisioned that other motion tracking technologies can be used in place of or in conjunction with the optical motion tracking technologies detailed above including, but not limited to, accelerometer, gyroscopic, ultrasound, magnetic, radio frequency, or other light based (e.g., laser) motion tracking technologies.
[52] Any of the herein described methods, programs, algorithms, or codes may be converted to, or expressed in, a programming language or computer program. A "Programming Language" and "Computer Program" includes any language used to specify instructions to a computer, and includes (but is not limited to) these languages and their derivatives: Assembler, Basic, Batch files, BCPL, C, C+, C++, Delphi, Fortran, Java, JavaScript, Machine code, operating system command languages, Pascal, Perl, PL1, scripting languages, Visual Basic, metalanguages which themselves specify programs, and all first, second, third, fourth, and fifth generation computer languages. Also included are database and other data schemas, and any other metalanguages. No distinction is made between languages which are interpreted, compiled, or use both compiled and interpreted approaches. No distinction is also made between compiled and source versions of a program. Thus, reference to a program, where the programming language could exist in more than one state (such as source, compiled, object, or linked) is a reference to any and all such states. Reference to a program may encompass the actual instructions and/or the intent of those instructions.
[53] Any of the herein described methods, programs, algorithms or codes may be contained on one or more machine-readable media or memory. The term "memory" may include a mechanism that provides (e.g., stores and/or transmits) information in a form readable by a machine such a processor, computer, or a digital processing device. For example, a memory may include a read only memory (ROM), random access memory (RAM), magnetic disk storage media, optical storage media, flash memory devices, or any other volatile or non-volatile memory storage device. Code or instructions contained thereon can be represented by carrier wave signals, infrared signals, digital signals, and by other like signals.
[54] It should be understood that the foregoing description is only illustrative of the present disclosure. Various alternatives and modifications can be devised by those skilled in the art without departing from the disclosure. For instance, any of the augmented images described herein can be combined into a single augmented image to be displayed to a clinician. Accordingly, the present disclosure is intended to embrace all such alternatives, modifications and variances. The embodiments described with reference to the attached drawing figures are presented only to demonstrate certain examples of the disclosure. Other elements, steps, methods, and techniques that are insubstantially different from those described above and/or in the appended claims are also intended to be within the scope of the disclosure.

Claims

WHAT IS CLAIMED IS:
1. A robotic surgical system comprising:
at least one robot arm;
at least one instrument coupled to the robot arm;
a plurality of drive motors configured to drive the at least one robot arm;
a laparoscopic port;
a plurality of fiducials;
a plurality of sensors configured to detect the plurality of fiducials; and
a controller configured to control the plurality of drive motors, the controller including a processor configured to:
determine a current distance between each sensor of the plurality of sensors and each fiducial of the plurality of fiducials;
determine a port plane based on the distance between the each sensor and each fiducial;
determine a vector normal to the port plane passing through a center of the laparoscopic port based on the distance between each sensor and each fiducial; determine a position of the at least one robot arm and the at least one instrument relative to the vector; and
control the plurality of drive motors to align the at least one robot arm or the at least one instrument with the vector.
2. The robotic surgical system of claim 1, wherein the processor is also configured to:
obtain a predetermined distance between each fiducial among the plurality of fiducials; and obtain a predetermined distance between each fiducial and the center of the laparoscopic port.
3. The robotic surgical system of claim 2, wherein the processor determines the port plane based on the current distance between each fiducial among the plurality of fiducials, the predetermined distance between each fiducial among the plurality of fiducials, and the predetermined distance between each fiducial and the center of the laparoscopic port.
4. The robotic surgical system of claim 3, wherein the processor is configured to obtain a length of the at least one instrument.
5. The robotic surgical system of claim 4, wherein the processor is configured to obtain a geometry of the at least one robot arm.
6. The robotic surgical system of claim 5, wherein controlling the plurality of drive motors is based on the position of the at least one robot arm and the at least one instrument relative to the vector, the length of the at least one instrument, and the geometry of the at least one robot arm.
7. The robotic surgical system of claim 1, wherein the plurality of fiducials are active light emitting diodes.
8. The robotic surgical system of claim 1, wherein the plurality of sensors are disposed on the robot arm.
9. The robotic surgical system of claim 1, wherein the plurality of fiducials are disposed on the laparoscopic port.
10. The robotic surgical system of claim 1, wherein the plurality of fiducials are disposed on the robot arm.
11. The robotic surgical system of claim 1, wherein the plurality of sensors are disposed on the laparoscopic port.
12. The robotic surgical system of claim 1, wherein the plurality of drive motors are configured to drive the at least one instrument.
13. A method for guiding a robot arm and/or instrument toward a laparoscopic port, the method comprising:
determining a position of each fiducial among a plurality of fiducials disposed around the laparoscopic port;
determining a port plane of the laparoscopic port based on the position of each fiducial; determining a vector normal to the port plane passing through a center of the laparoscopic port based on the position of each fiducial;
determining a position of the robot arm and the instrument relative to the vector; and controlling a plurality of drive motors associated with the robot arm and the instrument to align the robot arm or the instrument with the vector.
14. The method of claim 13, further comprising: obtaining a predetermined distance between each fiducial among the plurality of fiducials; and
obtaining a predetermined distance between each fiducial and the center of the laparoscopic port.
15. The method of claim 14, further comprising determining the vector based on the position of each fiducial among the plurality of fiducials, the predetermined distance between each fiducial among the plurality of fiducials, and the predetermined distance between each fiducial and center of the laparoscopic port.
16. The method of claim 15, further comprising obtaining a length of the instrument.
17. The method of claim 16, further comprising obtaining a length of the robot arm.
18. The method of claim 17, wherein controlling the plurality of drive motors is based on the position of the robot arm and the instrument relative to the vector, the length of the instrument, and the length of the robot arm.
19. The method of claim 13, wherein determining the position of each fiducial among a plurality of fiducials includes determining a distance between each sensor of a plurality of sensors and each fiducial of the plurality of fiducials.
PCT/US2018/031302 2017-05-25 2018-05-07 Robotic surgical system with automated guidance Ceased WO2018217431A1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
US16/615,226 US11839441B2 (en) 2017-05-25 2018-05-07 Robotic surgical system with automated guidance
CN201880034162.3A CN110662507A (en) 2017-05-25 2018-05-07 Robotic surgical system with automatic guidance
EP18806526.2A EP3629980A4 (en) 2017-05-25 2018-05-07 Robotic surgical system with automated guidance
JP2019564842A JP2020520745A (en) 2017-05-25 2018-05-07 Robotic surgical system with automatic guidance

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201762510938P 2017-05-25 2017-05-25
US62/510,938 2017-05-25

Publications (1)

Publication Number Publication Date
WO2018217431A1 true WO2018217431A1 (en) 2018-11-29

Family

ID=64396676

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2018/031302 Ceased WO2018217431A1 (en) 2017-05-25 2018-05-07 Robotic surgical system with automated guidance

Country Status (5)

Country Link
US (1) US11839441B2 (en)
EP (1) EP3629980A4 (en)
JP (1) JP2020520745A (en)
CN (1) CN110662507A (en)
WO (1) WO2018217431A1 (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020150165A1 (en) * 2019-01-14 2020-07-23 Intuitive Surgical Operations, Inc. System and method for automated docking
WO2021086409A1 (en) 2019-10-31 2021-05-06 Verb Surgical Inc. Systems and methods for visual sensing of and docking with a trocar
CN115500071A (en) * 2020-07-28 2022-12-20 直观外科手术操作公司 System and method for selecting assignments for components of a computer-assisted device
EP4454826A4 (en) * 2021-12-22 2025-12-17 Kawasaki Heavy Ind Ltd SURGICAL ASSISTANCE SYSTEM, SURGICAL ASSISTANCE ROBOT AND CONTROL METHOD FOR SURGICAL ASSISTANCE SYSTEM
WO2026078059A1 (en) * 2024-10-10 2026-04-16 Carl Zeiss Meditec Ag Method for positioning a robot tip on a trocar, surgical robot system

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112603546A (en) * 2020-12-24 2021-04-06 哈尔滨思哲睿智能医疗设备有限公司 Remote operation system based on laparoscopic operation robot and control method

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007088206A2 (en) * 2006-02-03 2007-08-09 The European Atomic Energy Community (Euratom), Represented By The European Commission Medical robotic system with manipulator arm of the cylindrical coordinate type
US20100241079A1 (en) * 2009-03-20 2010-09-23 Abrams Michael E Access port including centering feature
US20130066335A1 (en) * 2010-05-25 2013-03-14 Ronny Bärwinkel Method for moving an instrument arm of a laparoscopy robot into a predeterminable relative position with respect to a trocar
US20140276007A1 (en) * 2013-03-15 2014-09-18 Synaptive Medical (Barbados) Inc. Surgical Pointer Having Constant Pressure
US20170007349A1 (en) * 2010-06-10 2017-01-12 Matthew S. Solar Trajectory guide, access port, and fiducial marker alignment

Family Cites Families (234)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5762458A (en) 1996-02-20 1998-06-09 Computer Motion, Inc. Method and apparatus for performing minimally invasive cardiac procedures
US5868673A (en) 1995-03-28 1999-02-09 Sonometrics Corporation System for carrying out surgery, biopsy and ablation of a tumor or other physical anomaly
DE19529950C1 (en) * 1995-08-14 1996-11-14 Deutsche Forsch Luft Raumfahrt Guiding method for stereo laparoscope in minimal invasive surgery
US5855583A (en) 1996-02-20 1999-01-05 Computer Motion, Inc. Method and apparatus for performing minimally invasive cardiac procedures
US5792135A (en) 1996-05-20 1998-08-11 Intuitive Surgical, Inc. Articulated surgical instrument for performing minimally invasive surgery with enhanced dexterity and sensitivity
US6364888B1 (en) 1996-09-09 2002-04-02 Intuitive Surgical, Inc. Alignment of master and slave in a minimally invasive surgical apparatus
US7666191B2 (en) 1996-12-12 2010-02-23 Intuitive Surgical, Inc. Robotic surgical system with sterile surgical adaptor
US7699855B2 (en) 1996-12-12 2010-04-20 Intuitive Surgical Operations, Inc. Sterile surgical adaptor
US8529582B2 (en) 1996-12-12 2013-09-10 Intuitive Surgical Operations, Inc. Instrument interface of a robotic surgical system
US8206406B2 (en) 1996-12-12 2012-06-26 Intuitive Surgical Operations, Inc. Disposable sterile surgical adaptor
US6331181B1 (en) 1998-12-08 2001-12-18 Intuitive Surgical, Inc. Surgical robotic tools, data architecture, and use
US8182469B2 (en) 1997-11-21 2012-05-22 Intuitive Surgical Operations, Inc. Surgical accessory clamp and method
US7727244B2 (en) 1997-11-21 2010-06-01 Intuitive Surgical Operation, Inc. Sterile surgical drape
US6132368A (en) 1996-12-12 2000-10-17 Intuitive Surgical, Inc. Multi-component telepresence system and method
US6714839B2 (en) 1998-12-08 2004-03-30 Intuitive Surgical, Inc. Master having redundant degrees of freedom
US6246200B1 (en) 1998-08-04 2001-06-12 Intuitive Surgical, Inc. Manipulator positioning linkage for robotic surgery
US8600551B2 (en) 1998-11-20 2013-12-03 Intuitive Surgical Operations, Inc. Medical robotic system with operatively couplable simulator unit for surgeon training
US6459926B1 (en) 1998-11-20 2002-10-01 Intuitive Surgical, Inc. Repositioning and reorientation of master/slave relationship in minimally invasive telesurgery
US6659939B2 (en) 1998-11-20 2003-12-09 Intuitive Surgical, Inc. Cooperative minimally invasive telesurgical system
US6951535B2 (en) 2002-01-16 2005-10-04 Intuitive Surgical, Inc. Tele-medicine system that transmits an entire state of a subsystem
US6799065B1 (en) 1998-12-08 2004-09-28 Intuitive Surgical, Inc. Image shifting apparatus and method for a telerobotic system
US7125403B2 (en) 1998-12-08 2006-10-24 Intuitive Surgical In vivo accessories for minimally invasive robotic surgery
US6493608B1 (en) 1999-04-07 2002-12-10 Intuitive Surgical, Inc. Aspects of a control system of a minimally invasive surgical apparatus
US6770081B1 (en) 2000-01-07 2004-08-03 Intuitive Surgical, Inc. In vivo accessories for minimally invasive robotic surgery and methods
US6394998B1 (en) 1999-01-22 2002-05-28 Intuitive Surgical, Inc. Surgical tools for use in minimally invasive telesurgical applications
US6424885B1 (en) 1999-04-07 2002-07-23 Intuitive Surgical, Inc. Camera referenced control in a minimally invasive surgical apparatus
US6594552B1 (en) 1999-04-07 2003-07-15 Intuitive Surgical, Inc. Grip strength with tactile feedback for robotic surgery
US8944070B2 (en) 1999-04-07 2015-02-03 Intuitive Surgical Operations, Inc. Non-force reflecting method for providing tool force information to a user of a telesurgical system
US6565554B1 (en) 1999-04-07 2003-05-20 Intuitive Surgical, Inc. Friction compensation in a minimally invasive surgical apparatus
US6793652B1 (en) 1999-06-02 2004-09-21 Power Medical Interventions, Inc. Electro-mechanical surgical device
US6315184B1 (en) 1999-06-02 2001-11-13 Powermed, Inc. Stapling device for use with an electromechanical driver device for use with anastomosing, stapling, and resecting instruments
US7695485B2 (en) 2001-11-30 2010-04-13 Power Medical Interventions, Llc Surgical device
US6716233B1 (en) 1999-06-02 2004-04-06 Power Medical Interventions, Inc. Electromechanical driver and remote surgical instrument attachment having computer assisted control capabilities
US8768516B2 (en) 2009-06-30 2014-07-01 Intuitive Surgical Operations, Inc. Control of medical robotic system manipulator about kinematic singularities
US7594912B2 (en) 2004-09-30 2009-09-29 Intuitive Surgical, Inc. Offset remote center manipulator for robotic surgery
US8004229B2 (en) 2005-05-19 2011-08-23 Intuitive Surgical Operations, Inc. Software center and highly configurable robotic systems for surgery and other uses
US10188471B2 (en) 1999-09-17 2019-01-29 Intuitive Surgical Operations, Inc. Tele-operative surgical systems and methods of control at joint limits using inverse kinematics
US6491691B1 (en) 1999-10-08 2002-12-10 Intuitive Surgical, Inc. Minimally invasive surgical hook apparatus and method for using same
US6312435B1 (en) 1999-10-08 2001-11-06 Intuitive Surgical, Inc. Surgical instrument with extended reach for use in minimally invasive surgery
US6206903B1 (en) 1999-10-08 2001-03-27 Intuitive Surgical, Inc. Surgical tool with mechanical advantage
DE10025285A1 (en) * 2000-05-22 2001-12-06 Siemens Ag Fully automatic, robot-assisted camera guidance using position sensors for laparoscopic interventions
US6645196B1 (en) 2000-06-16 2003-11-11 Intuitive Surgical, Inc. Guided tool change
US6902560B1 (en) 2000-07-27 2005-06-07 Intuitive Surgical, Inc. Roll-pitch-roll surgical tool
US6746443B1 (en) 2000-07-27 2004-06-08 Intuitive Surgical Inc. Roll-pitch-roll surgical tool
US6840938B1 (en) 2000-12-29 2005-01-11 Intuitive Surgical, Inc. Bipolar cauterizing instrument
US6994708B2 (en) 2001-04-19 2006-02-07 Intuitive Surgical Robotic tool with monopolar electro-surgical scissors
US6783524B2 (en) 2001-04-19 2004-08-31 Intuitive Surgical, Inc. Robotic surgical tool with ultrasound cauterizing and cutting instrument
US7824401B2 (en) 2004-10-08 2010-11-02 Intuitive Surgical Operations, Inc. Robotic tool with wristed monopolar electrosurgical end effectors
US7607440B2 (en) 2001-06-07 2009-10-27 Intuitive Surgical, Inc. Methods and apparatus for surgical planning
US6817974B2 (en) 2001-06-29 2004-11-16 Intuitive Surgical, Inc. Surgical tool having positively positionable tendon-actuated multi-disk wrist joint
ATE547992T1 (en) 2001-06-29 2012-03-15 Intuitive Surgical Operations JOINT MECHANISM FOR PLATFORM CONNECTION
US6676684B1 (en) 2001-09-04 2004-01-13 Intuitive Surgical, Inc. Roll-pitch-roll-yaw surgical tool
US6728599B2 (en) 2001-09-07 2004-04-27 Computer Motion, Inc. Modularity system for computer assisted surgery
EP1450683A4 (en) * 2001-11-08 2009-11-11 Univ Johns Hopkins Med SYSTEM AND METHOD FOR ROBOT TARGETING BY FLUOROSCOPY BASED ON IMAGE ENHANCEMENT
AU2002365604A1 (en) 2001-12-04 2003-06-17 Power Medical Interventions Inc. System and method for calibrating a surgical instrument
US6839612B2 (en) 2001-12-07 2005-01-04 Institute Surgical, Inc. Microwrist system for surgical procedures
US6793653B2 (en) 2001-12-08 2004-09-21 Computer Motion, Inc. Multifunctional handle for a medical robotic system
EP3498213A3 (en) 2002-12-06 2019-07-03 Intuitive Surgical Operations, Inc. Flexible wrist for surgical tool
US7386365B2 (en) 2004-05-04 2008-06-10 Intuitive Surgical, Inc. Tool grip calibration for robotic surgery
US8882657B2 (en) 2003-03-07 2014-11-11 Intuitive Surgical Operations, Inc. Instrument having radio frequency identification systems and methods for use
US7410483B2 (en) 2003-05-23 2008-08-12 Novare Surgical Systems, Inc. Hand-actuated device for remote manipulation of a grasping tool
US9002518B2 (en) 2003-06-30 2015-04-07 Intuitive Surgical Operations, Inc. Maximum torque driving of robotic surgical tools in robotic surgical systems
US7379790B2 (en) 2004-05-04 2008-05-27 Intuitive Surgical, Inc. Tool memory-based software upgrades for robotic surgery
US7947034B2 (en) 2004-07-30 2011-05-24 Tyco Healthcare Group Lp Flexible shaft extender and method of using same
US9261172B2 (en) 2004-09-30 2016-02-16 Intuitive Surgical Operations, Inc. Multi-ply strap drive trains for surgical robotic arms
US9700334B2 (en) 2004-11-23 2017-07-11 Intuitive Surgical Operations, Inc. Articulating mechanisms and link systems with torque transmission in remote manipulation of instruments and tools
US8465474B2 (en) 2009-05-19 2013-06-18 Intuitive Surgical Operations, Inc. Cleaning of a surgical instrument force sensor
US8496647B2 (en) 2007-12-18 2013-07-30 Intuitive Surgical Operations, Inc. Ribbed force sensor
US8147503B2 (en) 2007-09-30 2012-04-03 Intuitive Surgical Operations Inc. Methods of locating and tracking robotic instruments in robotic surgical systems
US10555775B2 (en) 2005-05-16 2020-02-11 Intuitive Surgical Operations, Inc. Methods and system for performing 3-D tool tracking by fusion of sensor and/or camera derived data during minimally invasive robotic surgery
US8108072B2 (en) 2007-09-30 2012-01-31 Intuitive Surgical Operations, Inc. Methods and systems for robotic instrument tool tracking with adaptive fusion of kinematics information and image information
US8398541B2 (en) 2006-06-06 2013-03-19 Intuitive Surgical Operations, Inc. Interactive user interfaces for robotic minimally invasive surgical systems
US11259870B2 (en) 2005-06-06 2022-03-01 Intuitive Surgical Operations, Inc. Interactive user interfaces for minimally invasive telesurgical systems
EP3395508A1 (en) 2005-06-30 2018-10-31 Intuitive Surgical Operations Inc. Indicator for tool state communication in multi-arm robotic telesurgery
US8273076B2 (en) 2005-06-30 2012-09-25 Intuitive Surgical Operations, Inc. Indicator for tool state and communication in multi-arm robotic telesurgery
US8079950B2 (en) 2005-09-29 2011-12-20 Intuitive Surgical Operations, Inc. Autofocus and/or autoscaling in telesurgery
US7741802B2 (en) 2005-12-20 2010-06-22 Intuitive Surgical Operations, Inc. Medical robotic system with programmably controlled constraints on error dynamics
US8182470B2 (en) 2005-12-20 2012-05-22 Intuitive Surgical Operations, Inc. Telescoping insertion axis of a robotic surgical system
US7819859B2 (en) 2005-12-20 2010-10-26 Intuitive Surgical Operations, Inc. Control system for reducing internally generated frictional and inertial resistance to manual positioning of a surgical manipulator
ATE547059T1 (en) 2005-12-20 2012-03-15 Intuitive Surgical Operations INSTRUMENT INTERFACE OF A ROBOTIC SURGERY SYSTEM
US7762825B2 (en) 2005-12-20 2010-07-27 Intuitive Surgical Operations, Inc. Electro-mechanical interfaces to mount robotic surgical arms
WO2007111749A2 (en) 2005-12-20 2007-10-04 Intuitive Surgical, Inc. Method for handling an operator command exceeding a medical device state limitation in a medical robotic system
US7453227B2 (en) 2005-12-20 2008-11-18 Intuitive Surgical, Inc. Medical robotic system with sliding mode control
US7689320B2 (en) 2005-12-20 2010-03-30 Intuitive Surgical Operations, Inc. Robotic surgical system with joint motion controller adapted to reduce instrument tip vibrations
US8054752B2 (en) 2005-12-22 2011-11-08 Intuitive Surgical Operations, Inc. Synchronous data communication
US7756036B2 (en) 2005-12-22 2010-07-13 Intuitive Surgical Operations, Inc. Synchronous data communication
US7757028B2 (en) 2005-12-22 2010-07-13 Intuitive Surgical Operations, Inc. Multi-priority messaging
US7907166B2 (en) 2005-12-30 2011-03-15 Intuitive Surgical Operations, Inc. Stereo telestration for robotic surgery
US7930065B2 (en) 2005-12-30 2011-04-19 Intuitive Surgical Operations, Inc. Robotic surgery system including position sensors using fiber bragg gratings
US8628518B2 (en) 2005-12-30 2014-01-14 Intuitive Surgical Operations, Inc. Wireless force sensor on a distal portion of a surgical instrument and method
US7835823B2 (en) 2006-01-05 2010-11-16 Intuitive Surgical Operations, Inc. Method for tracking and reporting usage events to determine when preventive maintenance is due for a medical robotic system
US8597182B2 (en) 2006-04-28 2013-12-03 Intuitive Surgical Operations, Inc. Robotic endoscopic retractor for use in minimally invasive surgery
EP2038712B2 (en) 2006-06-13 2019-08-28 Intuitive Surgical Operations, Inc. Control system configured to compensate for non-ideal actuator-to-joint linkage characteristics in a medical robotic system
US8597280B2 (en) 2006-06-13 2013-12-03 Intuitive Surgical Operations, Inc. Surgical instrument actuator
US20080064927A1 (en) 2006-06-13 2008-03-13 Intuitive Surgical, Inc. Minimally invasrive surgery guide tube
US9718190B2 (en) 2006-06-29 2017-08-01 Intuitive Surgical Operations, Inc. Tool position and identification indicator displayed in a boundary area of a computer display screen
US10008017B2 (en) 2006-06-29 2018-06-26 Intuitive Surgical Operations, Inc. Rendering tool information as graphic overlays on displayed images of tools
US20090192523A1 (en) 2006-06-29 2009-07-30 Intuitive Surgical, Inc. Synthetic representation of a surgical instrument
US8151661B2 (en) 2006-06-30 2012-04-10 Intuituve Surgical Operations, Inc. Compact capstan
US7391173B2 (en) 2006-06-30 2008-06-24 Intuitive Surgical, Inc Mechanically decoupled capstan drive
US7736254B2 (en) 2006-10-12 2010-06-15 Intuitive Surgical Operations, Inc. Compact cable tension tender device
US7935130B2 (en) 2006-11-16 2011-05-03 Intuitive Surgical Operations, Inc. Two-piece end-effectors for robotic surgical tools
US9226648B2 (en) 2006-12-21 2016-01-05 Intuitive Surgical Operations, Inc. Off-axis visualization systems
US9084623B2 (en) 2009-08-15 2015-07-21 Intuitive Surgical Operations, Inc. Controller assisted reconfiguration of an articulated instrument during movement into and out of an entry guide
US9096033B2 (en) 2007-06-13 2015-08-04 Intuitive Surgical Operations, Inc. Surgical system instrument sterile adapter
US8620473B2 (en) 2007-06-13 2013-12-31 Intuitive Surgical Operations, Inc. Medical robotic system with coupled control modes
US8903546B2 (en) 2009-08-15 2014-12-02 Intuitive Surgical Operations, Inc. Smooth control of an articulated instrument across areas with different work space conditions
US9138129B2 (en) 2007-06-13 2015-09-22 Intuitive Surgical Operations, Inc. Method and system for moving a plurality of articulated instruments in tandem back towards an entry guide
US8082064B2 (en) 2007-08-24 2011-12-20 Elite Engineering Corporation Robotic arm and control system
US8224484B2 (en) 2007-09-30 2012-07-17 Intuitive Surgical Operations, Inc. Methods of user interface with alternate tool mode for robotic surgical tools
US8012170B2 (en) 2009-04-27 2011-09-06 Tyco Healthcare Group Lp Device and method for controlling compression of tissue
US8561473B2 (en) 2007-12-18 2013-10-22 Intuitive Surgical Operations, Inc. Force sensor temperature compensation
US8155479B2 (en) 2008-03-28 2012-04-10 Intuitive Surgical Operations Inc. Automated panning and digital zooming for robotic surgical systems
US8808164B2 (en) 2008-03-28 2014-08-19 Intuitive Surgical Operations, Inc. Controlling a robotic surgical tool with a display monitor
US9895813B2 (en) 2008-03-31 2018-02-20 Intuitive Surgical Operations, Inc. Force and torque sensing in a surgical robot setup arm
US7843158B2 (en) 2008-03-31 2010-11-30 Intuitive Surgical Operations, Inc. Medical robotic system adapted to inhibit motions resulting in excessive end effector forces
US7886743B2 (en) 2008-03-31 2011-02-15 Intuitive Surgical Operations, Inc. Sterile drape interface for robotic surgical instrument
US9265567B2 (en) 2008-06-30 2016-02-23 Intuitive Surgical Operations, Inc. Vessel sealing instrument with stepped jaw
US8540748B2 (en) 2008-07-07 2013-09-24 Intuitive Surgical Operations, Inc. Surgical instrument wrist
US9204923B2 (en) 2008-07-16 2015-12-08 Intuitive Surgical Operations, Inc. Medical instrument electronically energized using drive cables
US8821480B2 (en) 2008-07-16 2014-09-02 Intuitive Surgical Operations, Inc. Four-cable wrist with solid surface cable channels
US8315720B2 (en) 2008-09-26 2012-11-20 Intuitive Surgical Operations, Inc. Method for graphically providing continuous change of state directions to a user of a medical robotic system
US9687986B2 (en) 2008-11-11 2017-06-27 Intuitive Surgical Operations, Inc. Robotic linkage
US8161838B2 (en) 2008-12-22 2012-04-24 Intuitive Surgical Operations, Inc. Method and apparatus for reducing at least one friction force opposing an axial force exerted through an actuator element
US8335590B2 (en) 2008-12-23 2012-12-18 Intuitive Surgical Operations, Inc. System and method for adjusting an image capturing device attribute using an unused degree-of-freedom of a master control device
US8594841B2 (en) 2008-12-31 2013-11-26 Intuitive Surgical Operations, Inc. Visual force feedback in a minimally invasive surgical procedure
US8374723B2 (en) 2008-12-31 2013-02-12 Intuitive Surgical Operations, Inc. Obtaining force information in a minimally invasive surgical procedure
US8858547B2 (en) 2009-03-05 2014-10-14 Intuitive Surgical Operations, Inc. Cut and seal instrument
US8423182B2 (en) 2009-03-09 2013-04-16 Intuitive Surgical Operations, Inc. Adaptable integrated energy control system for electrosurgical tools in robotic surgical systems
US8418073B2 (en) 2009-03-09 2013-04-09 Intuitive Surgical Operations, Inc. User interfaces for electrosurgical tools in robotic surgical systems
US8120301B2 (en) 2009-03-09 2012-02-21 Intuitive Surgical Operations, Inc. Ergonomic surgeon control console in robotic surgical systems
US8423186B2 (en) 2009-06-30 2013-04-16 Intuitive Surgical Operations, Inc. Ratcheting for master alignment of a teleoperated minimally-invasive surgical instrument
US20110118708A1 (en) 2009-11-13 2011-05-19 Intuitive Surgical Operations, Inc. Double universal joint
KR102077004B1 (en) 2009-11-13 2020-02-13 인튜어티브 서지컬 오퍼레이션즈 인코포레이티드 End effector with redundant closing mechanisms
EP2594222B1 (en) 2009-11-13 2018-10-03 Intuitive Surgical Operations, Inc. Surgical tool with a compact wrist
US8668638B2 (en) 2010-02-11 2014-03-11 Intuitive Surgical Operations, Inc. Method and system for automatically maintaining an operator selected roll orientation at a distal tip of a robotic endoscope
US8644988B2 (en) 2010-05-14 2014-02-04 Intuitive Surgical Operations, Inc. Drive force control in medical instrument providing position measurements
US9019345B2 (en) 2010-07-02 2015-04-28 Intuitive Surgical Operations, Inc. Imaging mode blooming suppression
EP2590586B1 (en) 2010-07-09 2014-08-06 Intuitive Surgical Operations, Inc. Electrosurgical tool cover
DE102010040987A1 (en) * 2010-09-17 2012-03-22 Siemens Aktiengesellschaft Method for placing a laparoscopic robot in a predeterminable relative position to a trocar
CN105748152B (en) 2010-11-15 2018-06-26 直观外科手术操作公司 Instrument shaft rolling is decoupled in operation instrument and end effector actuates
US9241766B2 (en) 2010-12-22 2016-01-26 Intuitive Surgical Operations, Inc. Alternate instrument removal
US9393017B2 (en) 2011-02-15 2016-07-19 Intuitive Surgical Operations, Inc. Methods and systems for detecting staple cartridge misfire or failure
EP2675367B1 (en) 2011-02-15 2018-03-07 Intuitive Surgical Operations, Inc. Systems for indicating a clamping prediction
EP2675365B1 (en) 2011-02-15 2018-04-25 Intuitive Surgical Operations, Inc. Systems for detecting clamping or firing failure
EP2675366B1 (en) 2011-02-15 2018-04-04 Intuitive Surgical Operations, Inc. Indicator for knife location in a stapling or vessel sealing instrument
EP2675387B1 (en) 2011-02-15 2018-04-25 Intuitive Surgical Operations, Inc. Seals and sealing methods for a surgical instrument having an articulated end effector actuated by a drive shaft
JP6518403B2 (en) 2011-02-18 2019-05-22 インテュイティブ サージカル オペレーションズ, インコーポレイテッド Fusion and cutting surgical instruments and related methods
US9259277B2 (en) 2011-05-13 2016-02-16 Intuitive Surgical Operations, Inc. Instrument actuation interface
CN103607968B (en) 2011-05-31 2017-07-04 直观外科手术操作公司 Active Control of End Effectors of Robotic Surgical Instruments
WO2012166817A2 (en) 2011-05-31 2012-12-06 Intuitive Surgical Operations, Inc. Surgical instrument with single drive input for two end effector mechanisms
US9314307B2 (en) 2011-10-21 2016-04-19 Intuitive Surgical Operations, Inc. Grip force control for robotic surgical instrument end effector
US8912746B2 (en) 2011-10-26 2014-12-16 Intuitive Surgical Operations, Inc. Surgical instrument motor pack latch
US9503713B2 (en) 2011-11-02 2016-11-22 Intuitive Surgical Operations, Inc. Method and system for stereo gaze tracking
US9144456B2 (en) 2012-04-09 2015-09-29 Intuitive Surgical Operations, Inc. Surgical instrument control
US9280158B2 (en) 2012-06-07 2016-03-08 Koninklijke Philips N.V. System and method for guiding a robot cleaner along a path
US10231791B2 (en) 2012-06-21 2019-03-19 Globus Medical, Inc. Infrared signal based position recognition system for use with a robot-assisted surgery
JP6255403B2 (en) 2012-08-15 2017-12-27 インテュイティブ サージカル オペレーションズ, インコーポレイテッド Phantom degrees of freedom in joint estimation and control
CN107961076B (en) 2012-08-15 2020-07-07 直观外科手术操作公司 User initiated breakaway clutching of surgical mounting platform
EP3789164B1 (en) 2012-08-15 2024-07-31 Intuitive Surgical Operations, Inc. Movable surgical mounting platform controlled by manual motion of robotic arms
KR102335797B1 (en) 2012-09-17 2021-12-07 인튜어티브 서지컬 오퍼레이션즈 인코포레이티드 Methods and systems for assigning input devices to teleoperated surgical instrument functions
CN110279427B (en) 2012-12-10 2024-01-16 直观外科手术操作公司 Collision avoidance during controlled movement of movable arm of image acquisition device and steerable device
CN104902826B (en) 2012-12-31 2017-10-27 直观外科手术操作公司 Surgical staple cartridge with increased knife clearance
US10277097B2 (en) 2013-01-14 2019-04-30 Intuitive Surgical Operations, Inc. Motor assembly
EP3670112B1 (en) 2013-02-15 2025-10-29 Intuitive Surgical Operations, Inc. Systems and methods for synchronizing nodes of a robotic system
US10507066B2 (en) 2013-02-15 2019-12-17 Intuitive Surgical Operations, Inc. Providing information of tools by filtering image areas adjacent to or on displayed images of the tools
US9839481B2 (en) 2013-03-07 2017-12-12 Intuitive Surgical Operations, Inc. Hybrid manual and robotic interventional instruments and methods of use
US9948852B2 (en) 2013-03-15 2018-04-17 Intuitive Surgical Operations, Inc. Intelligent manual adjustment of an image control element
CN105050531B (en) 2013-03-15 2018-02-13 直观外科手术操作公司 Surgical Patient Side Cart with Control Interface
US9615883B2 (en) 2013-05-15 2017-04-11 Intuitive Surgical Operations, Inc. Surgical patient side cart with suspension system
EP2996620B1 (en) 2013-05-15 2020-09-16 Intuitive Surgical Operations, Inc. Force transmission mechanism for teleoperated surgical system
CN105431103B (en) 2013-08-09 2018-08-17 直观外科手术操作公司 Medical robotic system with remote current controller for controlling multiple motors housed distally
WO2015023834A1 (en) 2013-08-15 2015-02-19 Intuitive Surgical Operations, Inc. Instrument sterile adapter drive features
WO2015023853A1 (en) 2013-08-15 2015-02-19 Intuitive Surgical Operations, Inc. Robotic instrument driven element
US10127060B2 (en) 2013-08-16 2018-11-13 Intuitive Surgical Operations, Inc. System and method for replay of data and events provided by heterogeneous devices
US9446517B2 (en) 2013-10-17 2016-09-20 Intuitive Surgical Operations, Inc. Fault reaction, fault isolation, and graceful degradation in a robotic system
EP4184483B1 (en) 2013-12-20 2024-09-11 Intuitive Surgical Operations, Inc. Simulator system for medical procedure training
JP5850962B2 (en) 2014-02-13 2016-02-03 ファナック株式会社 Robot system using visual feedback
EP3107479B1 (en) 2014-02-21 2025-08-27 Intuitive Surgical Operations, Inc. Mechanical joints, and related systems
WO2015126752A1 (en) 2014-02-21 2015-08-27 Intuitive Surgical Operations, Inc. Articulatable members having constrained motion, and related devices and methods
US10561469B2 (en) * 2014-02-28 2020-02-18 Sony Corporation Robot arm apparatus and robot arm control method
CN106102636B (en) 2014-03-17 2020-04-07 直观外科手术操作公司 Command shaping to suppress vibration during mode transitions
EP3610820B1 (en) * 2014-03-17 2023-08-02 Intuitive Surgical Operations, Inc. Methods and devices for table pose tracking using fiducial markers
CN106102549B (en) 2014-03-17 2018-12-04 直观外科手术操作公司 Systems and methods for controlling the orientation of an imaging device
US9918800B2 (en) 2014-03-17 2018-03-20 Intuitive Surgical Operations, Inc. Surgical system with obstacle indication system
JP6548662B2 (en) 2014-03-17 2019-07-24 インテュイティブ サージカル オペレーションズ, インコーポレイテッド Instrument control input position / orientation recovery during restart during treatment
KR102677390B1 (en) 2014-03-17 2024-06-24 인튜어티브 서지컬 오퍼레이션즈 인코포레이티드 Wheeled cart with vibration reduction device, and related systems and methods
EP3119316B1 (en) 2014-03-17 2020-05-27 Intuitive Surgical Operations, Inc. Sterile drape with sterile adapter comprising mounting datum for surgical instrument
WO2015142955A1 (en) 2014-03-17 2015-09-24 Intuitive Surgical Operations, Inc. Automated structure with pre-established arm positions in a teleoperated medical system
CN117653293A (en) 2014-03-17 2024-03-08 直观外科手术操作公司 Surgical cannula mounts and related systems and methods
KR102356213B1 (en) 2014-03-17 2022-01-28 인튜어티브 서지컬 오퍼레이션즈 인코포레이티드 Guided setup for teleoperated medical device
WO2015142786A1 (en) 2014-03-17 2015-09-24 Intuitive Surgical Operations, Inc. Constant force spring with active bias
EP4049611B1 (en) 2014-03-17 2023-12-13 Intuitive Surgical Operations, Inc. Surgical drape and systems including surgical drape and attachment sensor
JP6644699B2 (en) 2014-03-19 2020-02-12 インテュイティブ サージカル オペレーションズ, インコーポレイテッド Medical devices, systems and methods using gaze tracking
JP6689203B2 (en) 2014-03-19 2020-04-28 インテュイティブ サージカル オペレーションズ, インコーポレイテッド Medical system integrating eye tracking for stereo viewer
US10335116B2 (en) * 2014-04-17 2019-07-02 The Johns Hopkins University Robot assisted ultrasound system
WO2016013636A1 (en) 2014-07-24 2016-01-28 アドバンストヘルスケア株式会社 Trocar, port, surgery assistance system
CA2959222C (en) 2014-08-28 2017-11-07 Synaptive Medical (Barbados) Inc. Port tracking tool
WO2016044574A1 (en) 2014-09-17 2016-03-24 Intuitive Surgical Operations, Inc. Systems and methods for utilizing augmented jacobian to control manipulator joint movement
US10123846B2 (en) 2014-11-13 2018-11-13 Intuitive Surgical Operations, Inc. User-interface control using master controller
CN112274250B (en) 2015-03-17 2024-12-31 直观外科手术操作公司 System and method for presenting screen identification of instruments in a teleoperated medical system
US10033308B2 (en) 2015-03-17 2018-07-24 Intuitive Surgical Operations, Inc. Systems and methods for motor torque compensation
KR102523779B1 (en) 2015-06-09 2023-04-20 인튜어티브 서지컬 오퍼레이션즈 인코포레이티드 Construction of a Surgical System with a Surgical Procedure Atlas
CN113397709B (en) 2015-06-10 2024-09-20 直观外科手术操作公司 Master-slave orientation mapping when misaligned
WO2016201313A1 (en) 2015-06-11 2016-12-15 Intuitive Surgical Operations, Inc. Systems and methods for instrument engagement
KR20180068336A (en) 2015-11-12 2018-06-21 인튜어티브 서지컬 오퍼레이션즈 인코포레이티드 Surgical system with training or auxiliary functions
US10973517B2 (en) 2015-11-13 2021-04-13 Intuitive Surgical Operations, Inc. Stapler with composite cardan and screw drive
EP3373831B1 (en) 2015-11-13 2024-01-03 Intuitive Surgical Operations, Inc. Push-pull stapler with two degree of freedom wrist
US9949798B2 (en) 2016-01-06 2018-04-24 Ethicon Endo-Surgery, Llc Methods, systems, and devices for controlling movement of a robotic surgical system
JP6914942B2 (en) 2016-01-29 2021-08-04 インテュイティブ サージカル オペレーションズ, インコーポレイテッド Systems and methods for variable speed surgical instruments
JP6902044B2 (en) 2016-03-17 2021-07-14 インテュイティブ サージカル オペレーションズ, インコーポレイテッド Systems and methods for instrument insertion control
KR102520799B1 (en) 2016-07-01 2023-04-12 인튜어티브 서지컬 오퍼레이션즈 인코포레이티드 Computer-assisted medical systems and methods
CN109069215B (en) 2016-07-14 2022-07-15 直观外科手术操作公司 Systems and methods for controlling surgical instruments
WO2018013214A1 (en) 2016-07-14 2018-01-18 Intuitive Surgical Operations, Inc. Automatic manipulator assembly deployment for draping
US11020138B2 (en) 2016-09-09 2021-06-01 Intuitive Surgical Operations, Inc. Push-pull surgical instrument end effector actuation using flexible tension member
KR102544993B1 (en) 2016-09-09 2023-06-20 인튜어티브 서지컬 오퍼레이션즈 인코포레이티드 stapler beam structure
EP3509511B1 (en) 2016-09-09 2022-11-02 Intuitive Surgical Operations, Inc. Wrist architecture
WO2018052810A1 (en) 2016-09-15 2018-03-22 Intuitive Surgical Operations, Inc. Medical device drive system
WO2018052795A1 (en) 2016-09-19 2018-03-22 Intuitive Surgical Operations, Inc. Base positioning system for a controllable arm and related methods
KR20240135866A (en) 2016-09-19 2024-09-12 인튜어티브 서지컬 오퍼레이션즈 인코포레이티드 Positioning indicator system for a remotely controllable arm and related methods
US11291513B2 (en) 2016-10-03 2022-04-05 Intuitive Surgical Operations, Inc. Surgical instrument with retaining feature for cutting element
WO2018071497A1 (en) 2016-10-11 2018-04-19 Intuitive Surgical Operations, Inc. Stapler cartridge with an integral knife
KR102546565B1 (en) 2016-10-14 2023-06-23 인튜어티브 서지컬 오퍼레이션즈 인코포레이티드 Preload Tensioning System for Surgical Instruments and Related Methods
CN109890314B (en) 2016-11-02 2021-11-16 直观外科手术操作公司 Robotic surgical stapler assembly configured to be reloaded using a stapler
US11241274B2 (en) 2016-11-04 2022-02-08 Intuitive Surgical Operations, Inc. Electrically insulative electrode spacers, and related devices, systems, and methods
US11040189B2 (en) 2016-11-04 2021-06-22 Intuitive Surgical Operations, Inc. Electrode assemblies with electrically insulative electrode spacers, and related devices, systems, and methods
CN115349951A (en) 2016-11-21 2022-11-18 直观外科手术操作公司 Medical devices with constant cable length
WO2018148030A1 (en) 2017-02-08 2018-08-16 Intuitive Surgical Operations, Inc. Control of computer-assisted tele-operated systems
US10357321B2 (en) 2017-02-24 2019-07-23 Intuitive Surgical Operations, Inc. Splayed cable guide for a medical instrument
WO2019023020A1 (en) 2017-07-27 2019-01-31 Intuitive Surgical Operations, Inc. Association processes and related systems for manipulators
US11161243B2 (en) 2017-11-10 2021-11-02 Intuitive Surgical Operations, Inc. Systems and methods for controlling a robotic manipulator or associated tool
US11173597B2 (en) 2017-11-10 2021-11-16 Intuitive Surgical Operations, Inc. Systems and methods for controlling a robotic manipulator or associated tool
US10952801B2 (en) 2017-11-10 2021-03-23 Intuitive Surgical Operations, Inc. Systems and methods for controlling a robotic manipulator or associated tool
US11191596B2 (en) 2017-11-15 2021-12-07 Intuitive Surgical Operations, Inc. Foot controller

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007088206A2 (en) * 2006-02-03 2007-08-09 The European Atomic Energy Community (Euratom), Represented By The European Commission Medical robotic system with manipulator arm of the cylindrical coordinate type
US20100241079A1 (en) * 2009-03-20 2010-09-23 Abrams Michael E Access port including centering feature
US20130066335A1 (en) * 2010-05-25 2013-03-14 Ronny Bärwinkel Method for moving an instrument arm of a laparoscopy robot into a predeterminable relative position with respect to a trocar
US20170007349A1 (en) * 2010-06-10 2017-01-12 Matthew S. Solar Trajectory guide, access port, and fiducial marker alignment
US20140276007A1 (en) * 2013-03-15 2014-09-18 Synaptive Medical (Barbados) Inc. Surgical Pointer Having Constant Pressure

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3629980A4 *

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020150165A1 (en) * 2019-01-14 2020-07-23 Intuitive Surgical Operations, Inc. System and method for automated docking
US12329470B2 (en) 2019-01-14 2025-06-17 Intuitive Surgical Operations, Inc. System and method for automated docking
WO2021086409A1 (en) 2019-10-31 2021-05-06 Verb Surgical Inc. Systems and methods for visual sensing of and docking with a trocar
CN114615950A (en) * 2019-10-31 2022-06-10 威博外科公司 Systems and methods for visual sensing and interfacing with a trocar
EP4051158A4 (en) * 2019-10-31 2024-01-03 Verb Surgical Inc. Systems and methods for visual sensing of and docking with a trocar
US11911910B2 (en) 2019-10-31 2024-02-27 Verb Surgical Inc. Systems and methods for sensing of and docking with a trocar
US12330314B2 (en) 2019-10-31 2025-06-17 Verb Surgical Inc. Systems and methods for docking with a trocar
CN115500071A (en) * 2020-07-28 2022-12-20 直观外科手术操作公司 System and method for selecting assignments for components of a computer-assisted device
EP4454826A4 (en) * 2021-12-22 2025-12-17 Kawasaki Heavy Ind Ltd SURGICAL ASSISTANCE SYSTEM, SURGICAL ASSISTANCE ROBOT AND CONTROL METHOD FOR SURGICAL ASSISTANCE SYSTEM
WO2026078059A1 (en) * 2024-10-10 2026-04-16 Carl Zeiss Meditec Ag Method for positioning a robot tip on a trocar, surgical robot system

Also Published As

Publication number Publication date
US20200163730A1 (en) 2020-05-28
US11839441B2 (en) 2023-12-12
JP2020520745A (en) 2020-07-16
EP3629980A4 (en) 2021-03-10
CN110662507A (en) 2020-01-07
EP3629980A1 (en) 2020-04-08

Similar Documents

Publication Publication Date Title
US12290328B2 (en) Surgical robot systems comprising robotic telemanipulators and integrated laparoscopy
CN112384339B (en) System and method for host/tool registration and control for intuitive motion
US11839441B2 (en) Robotic surgical system with automated guidance
KR102437404B1 (en) Systems and methods for controlling surgical instruments
EP3182921B1 (en) Systems and methods for adaptive input mapping
US11013567B2 (en) Systems and methods for instrument insertion control
CN109452930B (en) Registration system and method for medical devices using reduced search space
EP3932628A1 (en) Collision avoidance during controlled movement of image capturing device and manipulatable device movable arms
US11944395B2 (en) 3D visualization enhancement for depth perception and collision avoidance
JP2017525499A (en) System and method for medical device force detection
US11553984B2 (en) Robotic surgical system with an embedded imager
EP4154837A1 (en) Surgical robotic system setup
US12318164B2 (en) Systems and methods for controlling a robotic manipulator or associated tool
US20200315740A1 (en) Identification and assignment of instruments in a surgical system using camera recognition
WO2024157113A1 (en) Surgical robotic system and method for assisted access port placement

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18806526

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2019564842

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2018806526

Country of ref document: EP

Effective date: 20200102