EP2553929A1 - Dispositif stéréo optique et procédé d'autofocus s'y rapportant - Google Patents

Dispositif stéréo optique et procédé d'autofocus s'y rapportant

Info

Publication number
EP2553929A1
EP2553929A1 EP11709649A EP11709649A EP2553929A1 EP 2553929 A1 EP2553929 A1 EP 2553929A1 EP 11709649 A EP11709649 A EP 11709649A EP 11709649 A EP11709649 A EP 11709649A EP 2553929 A1 EP2553929 A1 EP 2553929A1
Authority
EP
European Patent Office
Prior art keywords
eye image
focus position
feature
displacement
left eye
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP11709649A
Other languages
German (de)
English (en)
Inventor
Ludwig Laxhuber
Joachim Luber
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Forstgarten International Holding GmbH
Original Assignee
Forstgarten International Holding GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Forstgarten International Holding GmbH filed Critical Forstgarten International Holding GmbH
Priority to EP11709649A priority Critical patent/EP2553929A1/fr
Publication of EP2553929A1 publication Critical patent/EP2553929A1/fr
Withdrawn legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/239—Image signal generators using stereoscopic image cameras using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/97—Determining parameters from multiple pictures
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/67—Focus control based on electronic image sensor signals
    • H04N23/675—Focus control based on electronic image sensor signals comprising setting of focusing regions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/207—Image signal generators using stereoscopic image cameras using a single two-dimensional [2D] image sensor
    • H04N13/236—Image signal generators using stereoscopic image cameras using a single two-dimensional [2D] image sensor using varifocal lenses or mirrors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/246—Calibration of cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/25—Image signal generators using stereoscopic image cameras using two or more image sensors with different characteristics other than in their location or field of view, e.g. having different resolutions or colour pickup characteristics; using image signals from one sensor to control the characteristics of another sensor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/296—Synchronisation thereof; Control thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/61—Control of cameras or camera modules based on recognised objects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10004—Still image; Photographic image
    • G06T2207/10012—Stereo images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10056—Microscopic image

Definitions

  • the invention relates to an optical stereo device and an autofocus method therefor.
  • the invention relates to a stereo camera or stereo microscope as well as a method of automatically focussing such optical stereo devices.
  • optical stereo devices such as stereo cameras
  • stereo cameras and/or stereo microscopes are increasingly employed for assisting medical professionals in performing such tasks as medical surgeries, examinations and the like.
  • stereo cameras or microscopes can provide a three dimensional view of and, thus, further information about an object of interest.
  • optical stereo devices provide for the possibility of zooming into a picture by means of a special lens system, such as a pancratic lens system.
  • Some sophisticated stereo microscopes or stereo cameras include an autofocus mechanism, i.e. the ability to automatically bring the object of interest into focus.
  • control unit is configured to adjust the focus position by increasing the focus position in case the displacement of the identified feature is a shift to the right or decreasing the focus position in case the displacement of the identified feature is a shift to the left.
  • control unit is configured to use an analytical representation of the relationship between the direction and/or magnitude of the displacement vector and the difference between a current focus position and the best focus position to bring the optical stereo device into focus.
  • control unit is configured to use a look-up table describing the relationship between the direction and/or magnitude of the displacement vector and the difference between a current focus position and the best focus position to bring the optical stereo device into focus.
  • the present invention provides for a method of automatically focusing an optical stereo device having imaging means operatively connected to a control unit and configured to provide a stereo image of an object of interest by combining a right eye image and a left eye image.
  • the method comprises the steps of: (a) imaging the object of interest at a first focus position with the imaging means providing for the right eye image and the left eye image; (b) identifying a feature in the right eye image and identifying the same feature in the left eye image; (c) determining the direction and/or the magnitude of a displacement vector defined by the displacement of the feature identified in the right eye image relative to the same feature identified in the left eye image; and (d) adjusting the focus position relative to the identified feature on the basis of the direction and/or the magnitude of the displacement vector.
  • steps (a) to (d) can be repeated iteratively.
  • FIGURE 3 shows a flow diagram describing different steps of a preferred embodiment of an autofocus method according to the present invention.
  • the upper row of figure 2 shows schematically the left eye image, the right eye image and the composite image of an identified, preferably unique feature of the object of interest 20 for the case when the distance between the first and second imaging units 12, 14 and the identified feature of the object of interest 20 is less than the focal length of the first and second imaging units 12, 14.
  • the identified feature of the object of interest 20 will be located at different positions in the right eye image and the left eye Image, as can be taken more clearly from the composite image for this case shown in the right hand column of figure 2. More specifically, for this case, i.e.
  • the identified feature of the object of interest 20 in the right eye image is shifted or displaced to the left relative to the identified feature of the object of interest 20 in the left eye image, as indicated by the displacement vector 30' shown in the composite image for this case.
  • control unit 16 of the optical stereo device 10 according to the present invention is, moreover, configured to determine the best focus position on the basis of the direction and the magnitude of the displacement vector 30, 30' defined by the displacement of the identified feature of the object of interest 20 in the right eye image relative to the same feature in the left eye image.
  • control unit 16 of the optical stereo device 10 according to the present invention is, moreover, configured to determine on the basis of the direction and the magnitude of the displacement vector 30, 30' the change of focus position that is necessary to bring the identified feature of the object of interest 20 into focus.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Automatic Focus Adjustment (AREA)
  • Focusing (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Studio Devices (AREA)
  • Stereoscopic And Panoramic Photography (AREA)

Abstract

L'invention concerne un dispositif stéréo optique ayant une caractéristique d'autofocus, ainsi qu'un procédé d'autofocus correspondant pour dispositifs stéréo optiques. Le dispositif stéréo optique comprend un moyen d'imagerie conçu pour fournir une image stéréo d'un objet présentant un intérêt en combinant une image d'œil droit et une image d'œil gauche, et une unité de commande connectée fonctionnellement au moyen d'imagerie et conçue pour recevoir l'image d'œil droit et l'image d'œil gauche et pour ajuster la position focale du moyen d'imagerie. L'unité de commande est en outre conçue pour : (i) identifier une caractéristique dans l'image d'œil droit et identifier la même caractéristique dans l'image d'œil gauche; (ii) déterminer la direction et/ou la magnitude d'un vecteur de déplacement défini par le déplacement de la caractéristique identifiée dans l'image d'œil droit par rapport à la même caractéristique identifiée dans l'image d'œil gauche; et (iii) ajuster la position focale par rapport à la caractéristique identifiée en fonction de la direction et/ou de la magnitude du vecteur de déplacement. Dans des modes de réalisation préférés, le moyen d'imagerie comprend des première et seconde unités d'imagerie, et l'unité de commande est en outre conçue pour ajuster la position focale en augmentant la position focale dans le cas où le déplacement de la caractéristique identifiée est un décalage vers la droite, ou en diminuant la position focale dans le cas où le déplacement est un décalage vers la gauche.
EP11709649A 2010-03-29 2011-03-21 Dispositif stéréo optique et procédé d'autofocus s'y rapportant Withdrawn EP2553929A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP11709649A EP2553929A1 (fr) 2010-03-29 2011-03-21 Dispositif stéréo optique et procédé d'autofocus s'y rapportant

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
EP10003380A EP2373043A1 (fr) 2010-03-29 2010-03-29 Dispositif stéréo-optique et son procédé d'autofocus
PCT/EP2011/001388 WO2011120645A1 (fr) 2010-03-29 2011-03-21 Dispositif stéréo optique et procédé d'autofocus s'y rapportant
EP11709649A EP2553929A1 (fr) 2010-03-29 2011-03-21 Dispositif stéréo optique et procédé d'autofocus s'y rapportant

Publications (1)

Publication Number Publication Date
EP2553929A1 true EP2553929A1 (fr) 2013-02-06

Family

ID=42289529

Family Applications (2)

Application Number Title Priority Date Filing Date
EP10003380A Withdrawn EP2373043A1 (fr) 2010-03-29 2010-03-29 Dispositif stéréo-optique et son procédé d'autofocus
EP11709649A Withdrawn EP2553929A1 (fr) 2010-03-29 2011-03-21 Dispositif stéréo optique et procédé d'autofocus s'y rapportant

Family Applications Before (1)

Application Number Title Priority Date Filing Date
EP10003380A Withdrawn EP2373043A1 (fr) 2010-03-29 2010-03-29 Dispositif stéréo-optique et son procédé d'autofocus

Country Status (7)

Country Link
EP (2) EP2373043A1 (fr)
JP (1) JP5886827B2 (fr)
KR (1) KR20130009996A (fr)
CN (1) CN102948155B (fr)
BR (1) BR112012025607A2 (fr)
RU (1) RU2576485C2 (fr)
WO (1) WO2011120645A1 (fr)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102012108039B4 (de) * 2012-08-30 2022-05-05 Renfert Gmbh Dentaltechnikbilderfassungsvorrichtung
JP2015102602A (ja) * 2013-11-21 2015-06-04 キヤノン株式会社 立体撮像装置、立体撮像システム、立体撮像装置の制御方法、プログラム、および、記憶媒体
CN106031148B (zh) 2014-03-21 2020-07-24 华为技术有限公司 成像设备，成像设备中自动对焦的方法以及对应计算机程序
WO2017081542A2 (fr) * 2015-11-11 2017-05-18 Scopio Lab Ltd. Microscopes de calcul et procédés de génération d'une image dans des conditions d'éclairage différentes
DE102017110816A1 (de) 2017-05-18 2018-07-12 Carl Zeiss Meditec Ag Optisches Beobachtungsgerät und Verfahren zum effizienten Ausführen eines automatischen Fokussieralgorithmus
WO2020121456A1 (fr) * 2018-12-12 2020-06-18 株式会社ニコン Microscope, dispositif de réglage pour microscope, système de microscope, procédé de commande de microscope et programme
CN118614863B (zh) * 2024-08-09 2024-12-06 万灵帮桥医疗器械(广州)有限责任公司 裂隙灯设备的虹膜对焦方法、装置、电子设备和存储介质
DE102024123116B3 (de) * 2024-08-13 2025-12-24 Carl Zeiss Meditec Ag Disparität-basierte autofokus-techniken für medizinisches visualisierungssystem

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2136230A1 (fr) * 2008-06-18 2009-12-23 Sony Corporation Binoculaires électroniques

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4601053A (en) * 1983-11-21 1986-07-15 Grumman Aerospace Corporation Automatic TV ranging system
JP2685619B2 (ja) * 1989-04-28 1997-12-03 池上通信機株式会社 立体カメラのビューファインダ装置
US5864359A (en) * 1995-05-30 1999-01-26 Smith & Nephew, Inc. Stereoscopic autofocusing based on comparing the left and right eye images
JPH10155104A (ja) * 1996-11-22 1998-06-09 Canon Inc 複眼撮像方法及び装置並びに記憶媒体
RU2160463C2 (ru) * 1999-02-24 2000-12-10 Тверской государственный технический университет Электронная фотокамера
DE10113084A1 (de) * 2001-03-17 2002-09-19 Leica Microsystems Autofokus-Mikroskopsystem
JP2003296740A (ja) * 2002-04-08 2003-10-17 Victor Co Of Japan Ltd オブジェクト監視方法及びオブジェクト監視カメラ装置
JP2004309930A (ja) * 2003-04-09 2004-11-04 Olympus Corp 立体観察システム
DE102005063503B4 (de) * 2005-03-10 2011-05-19 Inaba, Minoru, Oyama 3D-Display und 3D-Projektor
US7729530B2 (en) * 2007-03-03 2010-06-01 Sergey Antonov Method and apparatus for 3-D data input to a personal computer with a multimedia oriented operating system
US7683962B2 (en) * 2007-03-09 2010-03-23 Eastman Kodak Company Camera using multiple lenses and image sensors in a rangefinder configuration to provide a range map
JP5294794B2 (ja) * 2007-12-14 2013-09-18 キヤノン株式会社 撮像装置及び画像表示方法

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2136230A1 (fr) * 2008-06-18 2009-12-23 Sony Corporation Binoculaires électroniques

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
KROTKOV E ET AL: "STEREO RANGING WITH VERGING CAMERAS", IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, IEEE COMPUTER SOCIETY, USA, vol. 12, no. 12, 1 December 1990 (1990-12-01), pages 1200 - 1205, XP000168821, ISSN: 0162-8828, DOI: 10.1109/34.62610 *
See also references of WO2011120645A1 *

Also Published As

Publication number Publication date
EP2373043A1 (fr) 2011-10-05
CN102948155B (zh) 2016-11-09
KR20130009996A (ko) 2013-01-24
JP5886827B2 (ja) 2016-03-16
RU2012145888A (ru) 2014-05-10
BR112012025607A2 (pt) 2019-04-02
JP2013528006A (ja) 2013-07-04
WO2011120645A1 (fr) 2011-10-06
RU2576485C2 (ru) 2016-03-10
CN102948155A (zh) 2013-02-27

Similar Documents

Publication Publication Date Title
US9479759B2 (en) Optical stereo device and autofocus method therefor
EP2373043A1 (fr) Dispositif stéréo-optique et son procédé d'autofocus
US9046688B2 (en) Surgical microscope with enlarged working distance
US7869139B2 (en) Modular afocal variator optical system providing focus with constant magnification
US10674136B2 (en) Device for capturing a stereoscopic image
US12498555B2 (en) Continuous zoom stereoscopic microscope with adjustable stereoscopic angle
CN114080565B (zh) 用于获得超微距图像的系统和方法
TW201235728A (en) High-speed zoom lens
JP5093979B2 (ja) 観察装置用対物レンズ、顕微鏡ならびに対物レンズの調節方法
US10429632B2 (en) Microscopy system, microscopy method, and computer-readable recording medium
US7583434B2 (en) Stereomicroscope
CN110082895B (zh) 用于机器视觉高光学扩展量模块化变焦镜头
KR101608404B1 (ko) 입체 이미지를 촬영하기 위한 단안식 현미경
Bae et al. Development of a miniature single lens dual-aperture stereo imaging system towards stereo endoscopic imaging application
US11686931B2 (en) Three-dimensional viewing device
JP6063662B2 (ja) 撮像装置及び撮像方法
CN116699820B (zh) 手术显微镜的成像镜组
US20120281277A1 (en) Imaging optical system and microscope apparatus
US11774732B2 (en) Continuous zoom afocal lens assembly
Hoegele Afocal zoom lenses for stereo surgical microscopes
RU2429509C1 (ru) Способ оптической обработки изображения и оптическая система для него
Wang A design of ultra-high definition dual-lens optical system with long back focal length
EP3961284A1 (fr) Système d'imagerie d'un objet, microscope, support et procédé d'imagerie d'un objet
Yuan et al. Root canal imaging based on active vision

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20121008

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAX Request for extension of the european patent (deleted)
17Q First examination report despatched

Effective date: 20151007

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20171003