EP3785228B8 - System, verfahren und softwareprogramm zur unterstützung der positionierung einer kamera in bezug auf objekte in einem op-saal - Google Patents

System, verfahren und softwareprogramm zur unterstützung der positionierung einer kamera in bezug auf objekte in einem op-saal Download PDF

Info

Publication number
EP3785228B8
EP3785228B8 EP19728763.4A EP19728763A EP3785228B8 EP 3785228 B8 EP3785228 B8 EP 3785228B8 EP 19728763 A EP19728763 A EP 19728763A EP 3785228 B8 EP3785228 B8 EP 3785228B8
Authority
EP
European Patent Office
Prior art keywords
aiding
objects
positioning
software program
camera relative
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP19728763.4A
Other languages
English (en)
French (fr)
Other versions
EP3785228A1 (de
EP3785228B1 (de
Inventor
Jason Karl Otto
Matthew Thompson
Mark Nadzadi
Roberto Montane
Jonathan Morgan
Bojan Gospavic
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Mako Surgical Corp
Original Assignee
Mako Surgical Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mako Surgical Corp filed Critical Mako Surgical Corp
Publication of EP3785228A1 publication Critical patent/EP3785228A1/de
Publication of EP3785228B1 publication Critical patent/EP3785228B1/de
Application granted granted Critical
Publication of EP3785228B8 publication Critical patent/EP3785228B8/de
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G06T7/74—Determining position or orientation of objects or cameras using feature-based methods involving reference images or patches
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B90/361—Image-producing devices, e.g. surgical cameras
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B90/37—Surgical systems with images on a monitor during operation
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2046—Tracking techniques
    • A61B2034/2055—Optical tracking systems
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2046—Tracking techniques
    • A61B2034/2055—Optical tracking systems
    • A61B2034/2057—Details of tracking cameras
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2046—Tracking techniques
    • A61B2034/2065—Tracking using image or pattern recognition
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B2090/364—Correlation of different images or relation of image positions in respect to the body
    • A61B2090/365—Correlation of different images or relation of image positions in respect to the body augmented reality, i.e. correlating a live optical image with another image
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B90/37—Surgical systems with images on a monitor during operation
    • A61B2090/372—Details of monitor hardware
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/50—Supports for surgical instruments, e.g. articulated arms
    • A61B2090/502—Headgear, e.g. helmet, spectacles
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/25—User interfaces for surgical systems
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/30—Surgical robots
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/70—Manipulators specially adapted for use in surgery
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30008—Bone
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30204—Marker

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Surgery (AREA)
  • Engineering & Computer Science (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Veterinary Medicine (AREA)
  • Public Health (AREA)
  • General Health & Medical Sciences (AREA)
  • Animal Behavior & Ethology (AREA)
  • Molecular Biology (AREA)
  • Biomedical Technology (AREA)
  • Medical Informatics (AREA)
  • Pathology (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Robotics (AREA)
  • Gynecology & Obstetrics (AREA)
  • Radiology & Medical Imaging (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • User Interface Of Digital Computer (AREA)
  • Manipulator (AREA)
  • Length Measuring Devices By Optical Means (AREA)
EP19728763.4A 2018-04-23 2019-04-22 System, verfahren und softwareprogramm zur unterstützung der positionierung einer kamera in bezug auf objekte in einem op-saal Active EP3785228B8 (de)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201862661354P 2018-04-23 2018-04-23
PCT/US2019/028530 WO2019209725A1 (en) 2018-04-23 2019-04-22 System, method and software program for aiding in positioning of a camera relative to objects in a surgical environment

Publications (3)

Publication Number Publication Date
EP3785228A1 EP3785228A1 (de) 2021-03-03
EP3785228B1 EP3785228B1 (de) 2023-12-13
EP3785228B8 true EP3785228B8 (de) 2024-01-24

Family

ID=66770531

Family Applications (1)

Application Number Title Priority Date Filing Date
EP19728763.4A Active EP3785228B8 (de) 2018-04-23 2019-04-22 System, verfahren und softwareprogramm zur unterstützung der positionierung einer kamera in bezug auf objekte in einem op-saal

Country Status (4)

Country Link
US (4) US11166781B2 (de)
EP (1) EP3785228B8 (de)
AU (3) AU2019261299B2 (de)
WO (1) WO2019209725A1 (de)

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AU2019261299B2 (en) 2018-04-23 2024-07-25 Mako Surgical Corp. System, method and software program for aiding in positioning of a camera relative to objects in a surgical environment
WO2020186075A1 (en) * 2019-03-12 2020-09-17 Micro C, LLC Method of fluoroscopic surgical registration
CN111110348B (zh) * 2019-12-28 2021-01-05 元化智能科技(深圳)有限公司 定位方法、定位装置、定位系统及计算机可读存储介质
US11382699B2 (en) * 2020-02-10 2022-07-12 Globus Medical Inc. Extended reality visualization of optical tool tracking volume for computer assisted navigation in surgery
US11510750B2 (en) * 2020-05-08 2022-11-29 Globus Medical, Inc. Leveraging two-dimensional digital imaging and communication in medicine imagery in three-dimensional extended reality applications
US12171500B2 (en) 2020-06-04 2024-12-24 Baxter Medical Systems Gmbh & Co. Kg Locating system for medical devices
US11593931B2 (en) * 2020-06-09 2023-02-28 Howmedica Osteonics Corp. Surgical kit inspection systems and methods for inspecting surgical kits having parts of different types
CN112641510B (zh) 2020-12-18 2021-08-17 北京长木谷医疗科技有限公司 关节置换手术机器人导航定位系统及方法
CN113100939A (zh) * 2021-04-06 2021-07-13 德智鸿(上海)机器人有限责任公司 骨科手术导航方法、装置、计算机设备、系统和存储介质
US12026912B2 (en) * 2021-09-13 2024-07-02 Wen Li Apparatus and methodology for aiming point and aiming device 6DOF detection using image registration
EP4385448A4 (de) * 2021-09-14 2024-12-04 Wuhan United Imaging Healthcare Surgical Technology Co., Ltd. Verfahren und system zur berechnung der räumlichen registrierungspose eines chirurgischen roboters
EP4186456A1 (de) * 2021-11-26 2023-05-31 Technische Universität München Mehrdimensionale werkzeugeinstellung basierend auf einem akustischen signal
EP4212103A1 (de) * 2022-01-14 2023-07-19 Koninklijke Philips N.V. Unterstützungsgerät für eine medizinische bildaufnahmeeinheit
JP2024094769A (ja) * 2022-12-28 2024-07-10 川崎重工業株式会社 手術支援システムおよび手術支援システムの制御方法
US20240285348A1 (en) * 2023-02-28 2024-08-29 Mazor Robotics Ltd. Automated movement of optical localizer for optimal line of sight with optical trackers

Family Cites Families (39)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5251127A (en) 1988-02-01 1993-10-05 Faro Medical Technologies Inc. Computer-aided surgery apparatus
US6675040B1 (en) 1991-01-28 2004-01-06 Sherwood Services Ag Optical object tracking system
US6187018B1 (en) 1999-10-27 2001-02-13 Z-Kat, Inc. Auto positioner
GB0101990D0 (en) 2001-01-25 2001-03-14 Finsbury Dev Ltd Surgical system
JP2003158662A (ja) * 2001-11-20 2003-05-30 Fujitsu General Ltd 遠隔操作カメラ
US8010180B2 (en) 2002-03-06 2011-08-30 Mako Surgical Corp. Haptic guidance system and method
DE10215808B4 (de) 2002-04-10 2005-02-24 Siemens Ag Verfahren zur Registrierung für navigationsgeführte Eingriffe
US7660623B2 (en) 2003-01-30 2010-02-09 Medtronic Navigation, Inc. Six degree of freedom alignment display for medical procedures
US7492930B2 (en) 2003-02-04 2009-02-17 Aesculap Ag Method and apparatus for capturing information associated with a surgical procedure performed using a localization device
WO2005076033A1 (de) * 2004-02-05 2005-08-18 Synthes Ag Chur Vorrichtung zur kontrollierten bewegung einer kamera
US20060161052A1 (en) 2004-12-08 2006-07-20 Perception Raisonnement Action En Medecine Computer assisted orthopaedic surgery system for ligament graft reconstruction
US20060241405A1 (en) 2005-03-09 2006-10-26 Aesculap Ag & Co. Kg Method and apparatus for performing an orthodepic stability test using a surgical navigation system
US7594933B2 (en) 2006-08-08 2009-09-29 Aesculap Ag Method and apparatus for positioning a bone prosthesis using a localization system
US8214016B2 (en) 2006-12-12 2012-07-03 Perception Raisonnement Action En Medecine System and method for determining an optimal type and position of an implant
DE102007055205A1 (de) 2007-11-19 2009-05-20 Kuka Roboter Gmbh Verfahren zum Ermitteln eines Aufstellortes und zum Aufstellen einer Erfassungsvorrichtung eines Navigationssystems
WO2012103169A2 (en) 2011-01-25 2012-08-02 Smith & Nephew, Inc. Targeting operation sites
US9572682B2 (en) 2011-09-29 2017-02-21 Arthromeda, Inc. System and method for precise prosthesis positioning in hip arthroplasty
US9314188B2 (en) 2012-04-12 2016-04-19 Intellijoint Surgical Inc. Computer-assisted joint replacement surgery and navigation systems
US20150133945A1 (en) 2012-05-02 2015-05-14 Stryker Global Technology Center Handheld tracking system and devices for aligning implant systems during surgery
EP2852348B1 (de) 2012-05-22 2019-08-28 Mako Surgical Corp. Weichgewebeschneideinstrument
US11896446B2 (en) 2012-06-21 2024-02-13 Globus Medical, Inc Surgical robotic automation with tracking markers
CA2879414A1 (en) 2012-08-03 2014-02-06 Stryker Corporation Systems and methods for robotic surgery
US9247998B2 (en) 2013-03-15 2016-02-02 Intellijoint Surgical Inc. System and method for intra-operative leg position measurement
US9408557B2 (en) 2013-03-18 2016-08-09 Orthosensor Inc. System and method to change a contact point of the muscular-skeletal system
EP2984623B1 (de) * 2013-04-12 2018-01-10 Aselsan Elektronik Sanayi ve Ticaret Anonim Sirketi System und verfahren zur optimierung von bezugsmarkern und kamerapositionen/-ausrichtungen
EP3033024A1 (de) 2013-08-13 2016-06-22 Brainlab AG Bestimmung der positionsinformationen charakteristischer punkte eines beins zur osteotomie
AU2014336974B2 (en) 2013-10-14 2016-02-25 Navbit Holdings Pty Ltd Alignment apparatus for use in hip arthroplasty
CN105939687B (zh) * 2013-12-31 2019-08-30 马科外科公司 定制触觉边界的方法和计算机辅助外科手术系统
US10441366B2 (en) * 2014-10-22 2019-10-15 Think Surgical, Inc. Actively controlled optical tracker with a robot
WO2016065458A1 (en) 2014-10-29 2016-05-06 Intellijoint Surgical Inc. Systems and devices including a surgical navigation camera with a kinematic mount and a surgical drape with a kinematic mount adapter
JP6748088B2 (ja) * 2015-02-25 2020-08-26 マコ サージカル コーポレーション 外科手術中の追跡中断を低減するナビゲーションシステム及び方法
KR102418370B1 (ko) * 2015-11-13 2022-07-08 큐렉소 주식회사 정형외과 수술로봇 시스템의 트래커 및 마커 위치 가이드 장치 및 그 방법
CN108472086B (zh) 2016-02-26 2021-07-09 直观外科手术操作公司 使用虚拟边界避免碰撞的系统和方法
US10265854B2 (en) * 2016-08-04 2019-04-23 Synaptive Medical (Barbados) Inc. Operating room safety zone
WO2018112025A1 (en) 2016-12-16 2018-06-21 Mako Surgical Corp. Techniques for modifying tool operation in a surgical robotic system based on comparing actual and commanded states of the tool relative to a surgical site
DE102017211038A1 (de) * 2017-06-29 2019-01-03 Robert Bosch Gmbh Verfahren zum Einstellen einer Kamera
US10535427B2 (en) * 2018-01-10 2020-01-14 Medtronic, Inc. System for planning implantation of a cranially mounted medical device
US11490969B2 (en) 2018-03-22 2022-11-08 Medtech S.A. Optical camera positioning tool
AU2019261299B2 (en) 2018-04-23 2024-07-25 Mako Surgical Corp. System, method and software program for aiding in positioning of a camera relative to objects in a surgical environment

Also Published As

Publication number Publication date
US20220022994A1 (en) 2022-01-27
AU2026201389A1 (en) 2026-03-12
AU2019261299B2 (en) 2024-07-25
US20190321126A1 (en) 2019-10-24
US20240081940A1 (en) 2024-03-14
EP3785228A1 (de) 2021-03-03
WO2019209725A1 (en) 2019-10-31
US12514672B2 (en) 2026-01-06
EP3785228B1 (de) 2023-12-13
US11166781B2 (en) 2021-11-09
AU2019261299A1 (en) 2020-10-29
AU2024227521A1 (en) 2024-11-14
AU2024227521B2 (en) 2025-12-04
US11864957B2 (en) 2024-01-09
US20260083527A1 (en) 2026-03-26

Similar Documents

Publication Publication Date Title
EP3785228B8 (de) System, verfahren und softwareprogramm zur unterstützung der positionierung einer kamera in bezug auf objekte in einem op-saal
ZA202006639B (en) Method and system for use in colourisation of a point cloud
EP3649558B8 (de) Verfahren und system für ein verteiltes datenverarbeitungssystem
EP3265884A4 (de) System und verfahren zur auftragsabwicklung mithilfe von robotern
IL261214B (en) A method and system for securing computer software using a distributed hash table and a blockchain
EP3317802A4 (de) System und verfahren zur sicheren verbindung mit einem peripherievorrichtung
EP3345160A4 (de) Kamerasystem und verfahren zum ausrichten von bildern und präsentieren einer reihe von ausgerichteten bildern
EP3251301A4 (de) System und verfahren für ein globales virtuelles netzwerk
EP3454088B8 (de) System und verfahren zur bereitstellung eines asil-qualifiers für gnss-position und zugehörige werte
EP3261523A4 (de) Verfahren und system zum herunterladen und starten für eine am körper tragbare, medizinische vorrichtung
EP2981945A4 (de) Verfahren und vorrichtung zur bestimmung von kamerastandortinformationen und/oder kamerapositionsinformationen gemäss einem globalen koordinatensystem
EP3639174A4 (de) System und verfahren zur softwareaktivierung und lizenzverfolgung
GB202217038D0 (en) System and method for providing a computer-generated environment
EP3195823A4 (de) Optisches spurfolgeverfahren und koordinatenabstimmungsverfahren für optisches spurfolgesystem
EP3175381A4 (de) Verfahren und system zur bereitstellung eines perimeters eines virtuellen vermögenswertes
EP3218771A4 (de) System und verfahren zur adaptiven positionierung eines werkstückes
EP3400533A4 (de) Verfahren und system zur darstellung einer gemeinsam genutzten digitalen virtuellen »absoluten leinwand
EP3635486A4 (de) Fotografiesystem und -verfahren
PL3392767T3 (pl) Sposób przetwarzania szybkich sygnałów analogowych w czasie rzeczywistym i układ do stosowania tego sposobu
EP3169970A4 (de) System und verfahren zur holographischen bildgebung einer einzelebene eines objekts
EP3347207A4 (de) System und verfahren zur positionierung mehrerer objekte zur mehrseitigen verarbeitung
GB201510465D0 (en) A method and system for processing data using an augmented natural language processing engine
GB201800595D0 (en) Management of software bugs in a data processing system
HK40042153A (en) Method and system for use in colourisation of a point cloud
AU2018901452A0 (en) Method and system for use in colourisation of a point cloud

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20201027

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

RIC1 Information provided on ipc code assigned before grant

Ipc: A61B 90/50 20160101ALI20230628BHEP

Ipc: A61B 90/00 20160101ALI20230628BHEP

Ipc: A61B 34/20 20160101ALI20230628BHEP

Ipc: G06T 7/73 20170101AFI20230628BHEP

INTG Intention to grant announced

Effective date: 20230718

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20231103

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R081

Ref document number: 602019043207

Country of ref document: DE

Owner name: MAKO SURGICAL CORP., WESTON, US

Free format text: FORMER OWNER: MAKO SURGICAL CORP., FORT LAUDERDALE, FL, US

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602019043207

Country of ref document: DE

REG Reference to a national code

Ref country code: CH

Ref legal event code: PK

Free format text: BERICHTIGUNG B8

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

RAP4 Party data changed (patent owner data changed or rights of a patent transferred)

Owner name: MAKO SURGICAL CORP.

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20240314

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231213

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20231213

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231213

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231213

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20240314

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231213

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20240313

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1641098

Country of ref document: AT

Kind code of ref document: T

Effective date: 20231213

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231213

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231213

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231213

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20240313

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231213

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231213

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231213

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20240413

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231213

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231213

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231213

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231213

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231213

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231213

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231213

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20240413

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231213

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231213

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231213

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20240415

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231213

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20240415

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231213

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602019043207

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231213

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231213

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231213

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231213

26N No opposition filed

Effective date: 20240916

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231213

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231213

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20240422

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20240430

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20240422

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20240430

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20240430

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20240422

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20250305

Year of fee payment: 7

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: CH

Payment date: 20250501

Year of fee payment: 7

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20190422

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20190422

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231213

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20260313

Year of fee payment: 8

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20260309

Year of fee payment: 8