WO2012012607A2 - Procédés et systèmes pour des systèmes hiérarchiques de temps de vol (tof) d'anti-repliement - Google Patents
Procédés et systèmes pour des systèmes hiérarchiques de temps de vol (tof) d'anti-repliement Download PDFInfo
- Publication number
- WO2012012607A2 WO2012012607A2 PCT/US2011/044800 US2011044800W WO2012012607A2 WO 2012012607 A2 WO2012012607 A2 WO 2012012607A2 US 2011044800 W US2011044800 W US 2011044800W WO 2012012607 A2 WO2012012607 A2 WO 2012012607A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- phase
- dealiasing
- frequencies
- modulation
- modulation frequency
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
- G01S17/06—Systems determining position data of a target
- G01S17/08—Systems determining position data of a target for measuring distance only
- G01S17/32—Systems determining position data of a target for measuring distance only using transmission of continuous waves, whether amplitude-, frequency-, or phase-modulated, or unmodulated
- G01S17/36—Systems determining position data of a target for measuring distance only using transmission of continuous waves, whether amplitude-, frequency-, or phase-modulated, or unmodulated with phase comparison between the received signal and the contemporaneously transmitted signal
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C3/00—Measuring distances in line of sight; Optical rangefinders
- G01C3/02—Details
- G01C3/06—Use of electric means to obtain final indication
- G01C3/08—Use of electric radiation detectors
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
- G01S17/04—Systems determining the presence of a target
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/88—Lidar systems specially adapted for specific applications
- G01S17/89—Lidar systems specially adapted for specific applications for mapping or imaging
- G01S17/894—Three-dimensional [3D] imaging with simultaneous measurement of time-of-flight at a two-dimensional [2D] array of receiver pixels, e.g. time-of-flight cameras or flash lidar
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/491—Details of non-pulse systems
- G01S7/4912—Receivers
- G01S7/4915—Time delay measurement, e.g. operational details for pixel components; Phase measurement
Definitions
- the present invention is directed to disambiguating (or dealiasing) the inherent ambiguity between detected values of phase shift ⁇ and distance Z, especially in the presence of noise.
- Modern time-of-f light (TOF) systems can ascertain depth distances (Z) to a target object by emitting modulated optical energy of a known phase ( ⁇ ), and examining phase-shift in the optical signal reflected from the target object back to the TOF system.
- phase-type TOF systems are described in several U.S. patents received by Canesta, Inc., and now assigned to Microsoft, Inc. Such patents include US patent numbers 6,515,740 "Methods for CMOS- Compatible Three-Dimensional Imaging Sensing Using Quantum Efficiency
- Fig. 1 A is based upon the above-referenced patents, e.g. the ⁇ 86 patent, and depicts an exemplary phase-type TOF system.
- exemplary phase-shift TOF depth imaging system 100 may be fabricated on an IC 1 10 that includes a two-dimensional array 130 of pixel detectors 140, which pixel detectors may be single-ended or differential in operation.
- each of the pixel detectors 140 has dedicated circuitry 150 for processing detection charge output by the associated detector.
- IC 1 10 preferably also includes a microprocessor or microcontroller unit 160, memory 170 (which preferably includes random access memory or RAM and read-only memory or ROM), a high speed distributable clock 180, and various computing and input/output (I/O) circuitry 190.
- controller unit 160 may perform distance to object and object velocity calculations.
- optical energy source 120 is periodically energized by an exciter 1 15, and emits modulated optical energy toward an object target 20.
- Emitter 120 preferably is at least one LED or laser diode(s) emitting low power (e.g., perhaps 1 W) periodic waveform, producing optical energy emissions of known frequency (perhaps a few dozen MHz) for a time period known as the shutter time (perhaps 10 ms).
- emitter 120 operates in the near IR, with a wavelength of perhaps 800 nm.
- a lens 125 is commonly used to focus the emitted optical energy.
- phase shift ⁇ can be processed to yield desired Z depth information.
- pixel detection current can be integrated to accumulate a meaningful detection signal, used to form a depth image. In this fashion, TOF system 100 can capture and provide Z depth information at each pixel detector 140 in sensor array 130 for each frame of acquired data.
- phase-type TOF systems such as system 100 is described more fully later herein with respect to Fig. 2B, but in brief, pixel detection infornnation is captured at at least two discrete phases, preferably 0° and 90°, and is processed to yield Z data.
- System 100 yields a phase shift ⁇ at distance Z due to time-of-flight given by:
- Fig. 1 D is a mapping of detected phase ⁇ versus distance Z for system 100. Assume that system 100 determines a phase angle ⁇ ' for target object 20, where this phase information was acquired with a modulation frequency fi of say 50 MHz. As shown by Fig. 1 D, there are several distances, e.g., ⁇ i, z 2 , z 4 , z 5 , etc. that could be represented by this particular phase angle ... but which is the correct distance? In Fig. 1 D, Z A IRI represents the Z distance aliasing interval range associated with z data acquired at frequency fi, and is the distance from zi to z 2 , or z 2 to z 4 , or z 4 to z 5 , etc.
- Fig. 1 D also shows, in bold line, phase data acquired for a lower modulation frequency f 2 .
- f 2 is perhaps 20 MHz, in that the slope d0 /dz for the f 2 waveform is less than about half the slope for the fi waveform, where the slope d0 /dz is proportional to modulation frequency f m .
- data is captured from pixel detectors at at least two discrete phases, e.g., 0° and 180°.
- the aliasing interval range Z A IR 2 has advantageously increased from a short range Z A IRI (associated with faster modulation frequency fi) to a greater range ZAIR2-
- the ratio of the aliasing interval range increase will be the ratio f 2 /f i .
- acquiring phase data with lower modulation frequency f 2 yields a Z value with less precision or resolution than if acquired with higher modulation frequency fi . This imprecision occurs because the slope of the curve for frequency f 2 is about half the slope for modulation frequency fi .
- dealiasing a TOF system would achieve the unambiguous range for a low modulation frequency, while providing the distance resolution for a high modulation frequency. But dealiasing in the presence of noise can be
- the present invention provides a method and system for dealiasing in phase-type TOF systems.
- Embodiments of the present invention hierarchically dealias the depth distance Z acquired by a phase-type time of flight (TOF) system.
- Depth data is acquired by the TOF system using preferably at least three modulation
- n intermediate frequencies f DE1 ,f DE2 , - OEU are generated sorted by order of f DE1 ⁇ f DE2 ⁇ ... ⁇ f DEn and their corresponding phases are computed from the data acquired separately using three or more modulation frequencies f 1 ,f 2 , - , f m -
- Hierarchical dealiasing may be carried out one step at a time, if desired.
- high modulation frequency f E is a function of all modulation frequencies fi> f2> - > fm > and the function may be, without limitation, an arithmetic mean of fi, f 2 , - , fm, or a weighted average of fc,f 2 , ... , f m .
- the selection of the intermediate frequencies ⁇ DEI > ⁇ DE2> - > fDEn can be based on a ratio between two not necessarily
- hierarchical dealiasing may be carried out in a stepped sequence that includes first de-aliasing phase data of f DE1 using phase of fjj , and then dealiasing phase of f DE2 using phase of f DE1 . If desired, at each step, the phase of f DE(k +i ) is dealiased using the phase of f DEk until a last step, at which phase f E is dealiased using the phase of f DEn to yield an unwrapped phase of f E .
- the unwrapped phase of f E is computable by using at a last step of hierarchical de-aliasing, the dealiasing phase of each modulation frequency f 1 , f 2 , - , f m using f DEn to get unwrapped phase of each modulation frequency, and then computing unwrapped phase of f E using a function between f E and /i, / 2 , ... , f m .
- °f fDE k -i f rom a previous de-aliasing step is used to find a correct phase cycle of oi ?(f e+i) within a cycle of f DEk . This then enables the correct cycle of / D£(fe+1) within a total unambiguous range Z D , or the cycle of f D , to be found.
- the present invention recognizes that the difficulty of successfully dealiasing data increases as the ratio f E /fo increases because noise in ⁇ ⁇ is amplified by this ratio when 0 E used to computer 0 D s- Consequently for high modulation frequency, which corresponds to a large effective frequency , or for a very large unambiguous range, which corresponds to small difference frequency fo, such amplified noise would produce erroneous results in estimating a dealiasing interval K. The result could cause aliasing the middle of an
- Embodiments of the present invention may be implemented in hardware and/or software, which hardware and/or software may be part of the TOF system with which the invention is practiced.
- Hierarchical dealiasing according to the embodiments of the present invention is preferably relatively low loss.
- FIG. 1 A is a block diagram depicting a phase-type time-of-flight three- dimensional imaging system, according to the prior art
- FIGS. 1 B and 1 C depict emitted and reflected optical energy waveforms associated with the imaging system of Fig. 1 A, according to the prior art
- FIG. 1 D depicts acquired phase-vs-distance Z for two modulation frequencies and demonstrates aliasing intervals, and distance ambiguity, according to the prior art
- FIG. 1 E is a polar representation of acquired phase data as a function of modulation frequency, according to the prior art
- FIG. 2A depicts a phase-type time-of-flight three-dimensional imaging system with dealiasing, according to embodiments of the 12/459,033 application;
- FIG. 2B depicts details of exemplary phase capture at 0° and 180°, 90° and
- FIG 3 acquired phase-vs-distance Z for two close modulation frequencies, and for virtual frequencies fo, , and fos, and resultant large aliasing interval Z A IR, according to embodiments of the 12/459,033 application;
- FIG. 4A depicts a sequence of eight different captures from one pixel detector, as well as resultant phase shift and frame construction, according to an embodiment of the 12/459,033 application;
- FIG. 4B depicts a sequence in which four adjacent pixel detectors acquire four phases in a single capture, as well as resultant phase shift and frame construction, according to an embodiment of the 12/459,033 application;
- FIG. 4C depicts a sequence in which captures for each phase are offset- cancelled using data from the same pixel detector, as well as resultant phase shift and frame construction, according to an embodiment of the 12/459,033
- FIG. 4D depicts a sequence for which direct computation of ⁇ is made, as well as depicting resultant phase shift and frame construction, according to an embodiment of the 12/459,033 application;
- FIGS. 5A and 5B depict target object locations, real and phantom, determined using two modulation frequencies, according to a least common multiple dealiasing embodiment of 12/459,033 application. .
- FIG. 6 depicts a phase-type time-of-flight three-dimensional imaging system with hierarchical dealiasing, according to embodiments of the present invention.
- FIG. 7A-7C depict phase-vs-distance Z for various steps in hierarchical dealiasing, according to embodiments of the present invention.
- Embodiments of the present invention implement methods and systems to hierarchically dealias time-of-flight (TOF) phase using at least three frequencies, and will be described with reference to Figs. 6-7D.
- Conventional de-aliasing relies upon use of two frequencies. However using three or more frequencies can advantageously substantially increase the unambiguous distance of the TOF system, without significantly amplifying noise.
- Aspects of the present invention can address hierarchical dealiasing, including aspects of probability distribution of phase, and elliptical correction.
- Fig. 2A depicts a phase-type TOF system 200 similar to that described with respect to Figs. 1 A-1 C, except that additional components 210 and software 220 are included to implement embodiments of the 12/459,033 application.
- software 220 and 210 may be considered as a dealiasing subsystem for TOF system 200.
- Output DATA' may include information provided as DATA by TOF system 100 in Fig. 1 A.
- a TOF system such as system 100 (Fig. 1A) or 200 (Fig. 2A) normally is operable at some maximum modulation frequency f m , perhaps 100 MHz.
- f m denotes the highest modulation frequency at which the system is normally operable, and not the highest modulation frequency at which it can be operated.
- Fig. 2B shows two of the many photodetectors (PD) in array 130, namely photodetectors 140-1 , and 140-N, as well as some of their associated electronics, namely 150-1 , 150-N.
- This particular embodiment employs quantum efficiency (QE) modulated differential photodetectors or pixels 140, whose pixel detection information is captured at at least two discrete phases 0° and 90°, and more preferably four discrete phases 0° and 180°, and 90° and 270°.
- QE quantum efficiency
- phase shift data ⁇ that is sought to be detected is shift between emitted optical energy S ou t from emitter 120, and pixel detectors 140 in array 130 (see Fig. 2A).
- the detection phase data that is captured at the discrete phases is denoted herein as captures C° and C 180 , C 90 and C 270 and is processed to implement dealiasing according to the 12/459,033 application. Acquisition using four phases is preferred so as to remove so-called fixed pattern offset.
- the C° acquisition yields data but may include an error offset from zero, e.g., the value C° may not be zero when there is no signal to be detected.
- the C 180 acquisition should have the same, but inverted, data and will have the same fixed pattern offset.
- phase and Z data information is preserved but the fixed pattern offset is canceled out.
- embodiments of the 12/459,033 application may be used to dealias multiphase TOF data that is obtained from single-ended phase detectors, as well as from detection systems that do not employ QE modulation detection.
- Phase angle ⁇ can be computed from captures C°, C 90 , C 180 , C 270 , as follows:
- Fig. 2B The configuration and operation of what is shown in Fig. 2B is similar to what was described with respect to a fixed phase delay embodiment (Fig. 10) in earlier-referenced U.S. patent nos. 6,580,496 and 7,906,793.
- detection-generated photocurrent from each QE-modulated differential pixel detector e.g., 140-1 , is differentially detected (DIF.
- a fixed discrete 0° or 90° phase shift delay (DELAY), and more preferably a fixed 0° or 180 or 90° or 270° phase shift is switchably insertable responsive to a phase select control signal (PHASE SELECT) that can be commanded by clock unit 180'.
- Phase data e.g., C° and C 180 , C 90 and C 270 , is acquired or captured from the pixel detectors at these discrete phases.
- phase detection may be found in the above- referenced patents, but without limitation, the fixed discrete phase shifts may be inserted by clock unit 180', whose signal is used to drive detector array 130, or may be introduced by modulator 1 15; see Fig. 2B.
- modulation frequencies fi and h each typically less than the system maximum modulation frequency (f m ) are combined.
- the resultant phase data acquired from each, denoted ⁇ i and ⁇ 2 is used to provide two goals: (1 ) obtaining the equivalent of a high modulation frequency measurement from system 200 that yields a low level of Z resolution uncertainty, and (2) obtaining the equivalent of a low modulation frequency measurement from system 200 that provides a long aliasing interval Z range. In this fashion the approximate Z range is determined from the long aliasing interval, while more precise determination of the Z value is determined from the high modulation frequency measurement.
- System 200 is thus caused to operate using at least first and second frequencies fi , f2, where fi >f2, fi is close to f m , preferably within about 40% or less of f m , and f2 is within about 35% of fi and preferably closer.
- fi may be said to lie in a range of about 60% to 100% of the frequency of f m such that if f m were say 100 MHz, then fi would have a frequency of about 60 MHz to as high as 100 MHz.
- the range of f 2 is about 65% to about 99% the frequency such that if fi was say 90 MHz, then f 2 would have a frequency of about 58.5 MHz to about 89.1 MHz.
- modulation frequencies fi and f 2 advantageously produced good resolution precision of Z measurements as though system 200 were collecting phase data operating with a high effective modulation frequency close to f m , perhaps (fi + f 2 )/2 or other combination of fi and f 2 . It is noted that the frequencies (fi - f 2 ), (fi + f 2 )/2 and other combinations of these modulation frequencies are really mathematical constructs or virtual frequencies, and system 200 does not physically operate at those virtual frequencies. Of course it is understood that more than two modulation
- frequencies fi , f 2 may be used, which different modulation frequencies preferably are close in frequency to each other and to f m .
- Using multiple modulation frequencies also results in Z resolution certainty or precision better than would be achieved if the TOF system processed data acquired solely while operating at modulation frequency fi and disregarded data acquired at modulation frequency f 2 , or operated at modulation frequency f 2 and disregarded data acquired at modulation frequency fi .
- embodiments of the 12/459,033 application operated system 200 at high frequency, preferably close to f m , which maintains high operating system efficiency.
- phase information captured by pixel detectors 140 at one modulation frequency may be shared with data frames captured at the other modulation frequency (or frequencies, if more than two modulation frequencies are employed).
- Fig. 3 is a plot of phase versus distance Z, according to the 12/459,033 application.
- a waveform is shown for phase data acquired using first modulation frequency fi , which data is denoted ⁇ .
- fi is about 50 MHz.
- Fig. 3 also shows a plot of phase data acquired using a slightly lower second modulation frequency h, data for which is denoted ⁇ 2.
- h is about 31 MHz, and according its slope is less than that of the fi waveform, and its period (or aliasing interval range) is longer.
- a typical value of f m for system 200 might be 70 MHz.
- the h waveform is drawn with a heavier line than the fi waveform to promote clarity in the figure.
- the wrap-around somewhat complicates the calculations of ⁇ and 0DS as noted later herein.
- one aspect or goal of the 12/459,033 application was to provide a large aliasing interval range Z A IR by making it appear as though system 200 acquire phased phase data using a relatively low modulation frequency.
- an exemplary function for f D may be a difference function (a-f b-f2), where a and b may be weighting factors.
- phase delay ⁇ may be expressed in terms of absolute target distance Z as:
- Equation (8) shows that Z can be determined from ⁇ ⁇ , which is 0D or (or ⁇ 1 - ⁇ 2 ) and from ⁇ 1 Note that this is the same equation one would use to
- fi and f 2 could be used to achieve this goal, and one could employ more than two modulation frequencies, e.g., fi , f 2 , h, ⁇
- the highest of these modulation frequencies fi would be close to the system highest maximum modulation frequency f m and at least within 40% of f m .
- at least the closest together of the various modulation frequencies would be within about ⁇ 35% of each other, and preferably closer together than that.
- maximum modulation frequency f m is close to the optimal operating point for TOF system 200. This means that f m is near a maximum of operating efficiency, and therefore curve of system operating efficiency is relatively flat in the vicinity of f m . Generally this maximum is quite flat and therefore operating frequencies fi and f 2 will also be close to the optimal operating conditions for system 200.
- phase data from all modulation frequencies used averages noise in the phase data measurements, and advantageously results in lower noise than would be obtained using data acquired solely from fi or f 2 alone.
- modulation frequencies fi and f 2 are preferably relatively close to maximum modulation frequency f m , each measurement is obtained with relatively high precision and lowered noise.
- system 200 performance will be somewhat similar.
- uncertainty obtained after combining data from frequency fi and f 2 will be about 0.7 times the uncertainty when phase data acquired using modulation frequency fi or modulation frequency f 2 was used alone .
- this second aspect of the 12/459,033 application relates to combining phase data acquired by system 200 operating at different (but preferably close to each other) modulation frequencies so as to emulate system operation at a high modulation frequency that yields a low Z resolution uncertainty. While some specific methods of combining data will now be described, it is understood that many other combinations could also be used.
- one approach is to combine that raw data readings from pixel detectors 140 in array 130 (see Figs. 2A and 2B) from captures (C 1 o, Ci 90 , Ci 180 , Ci 270 ) obtained at modulation frequency fi and add this raw data to data readings (C 2 °, C 2 °, C 2 180 , C 2 180 ) obtained at a frequency f 2 to produce (Ci 0 +C 2 °, Ci 90 +C 2 °, Ci 180 +C 2 180 , Ci 270 +C 2 180 ).
- This exemplary combination is equivalent to adding the respective phase vectors together in a polar representation and obtaining the phase angle for the sum vector.
- Vi (p, ⁇ )
- V 2 (p, ⁇ 2 ) for captures at modulation frequencies fi , f 2 respectively.
- modulation contrast denotes a measure of collection efficiency within pixel detectors 140, e.g., how well incoming photon energy from signal S in is captured and converted into a detection signal. A high modulation contrast is desirable.
- V! + V 2 (2p. sin((0 1 -0 2 )/2),(0 1 + ⁇ 2 )/2) (9)
- phase angles ( ⁇ + 0 2 )/2 of the phase angles is used, although other combinations of the actual phase angles are possible.
- ⁇ and 0D may be determined in a variety of way. Regardless of the specific method used to obtain these values, preferably 0 E and 0D are both used to determine distance Z, as shown by Fig. 3.
- Angle 0DS corresponds to the same frequency as 0 E and thus has the same slope as 0 E as shown in Fig. 3.
- angle 0 D s is mathematically derived from 0D , it advantageously has the same large aliasing interval as 0D, denoted Z A IR.
- both 0 D and ⁇ ⁇ are adjusted to take account the foldover or wrap around repetitions of ⁇ and ⁇ 2 .
- ⁇ ⁇ ⁇ 2 it is known that ⁇ 1 must have wrapped around, and hence ⁇ must be added to ⁇ ⁇ .
- Such trigonometric corrections are well known in the art and are assumed to have been performed on the data.
- ⁇ 2 ⁇ represents the dealiased value of ⁇ ⁇ . It is of course assumed that the target object is at a distance less than the aliasing interval for f D . It is understood that other equivalent mathematical approaches to determine suitable values for K may also be employed.
- difference frequency fo it is important to select an appropriate difference frequency fo. If fp is too big, the corresponding dealiasing interval for f D may be too small. Conversely, if f D is too small, then resolution certainty in Z measurements at f D can become too large. Thus, difference frequency fo should be as small as possible, subject to the noise constraints affecting resolution uncertainty.
- the aliasing interval index K should be determined with high certainty to ensure the proper dealiasing interval is selected.
- a frame represents a complete Z image acquired by sensor array 130, which is to say that each pixel detector 140 in the array is associated with a corresponding Z value from target object 20. Assume first that pixel detectors 140 in system 200 can only achieve one capture at a time. Under this assumption, some exemplary sequences are as follows.
- FIG. 4A A first case is depicted in Fig. 4A, where it is assumed that the same pixel detector is sequenced though eight different captures to acquire the desired phase shift data ⁇ , ⁇ 2 .
- a sequence of captures Ci°, Ci 90 , Ci 180 , Ci 270 is acquired over time.
- a sequence of captures C2 0 , C2 90 , C2 180 , C2 270 is acquired, after which the system is returned to operating at modulation frequency fi and a sequence of captures Ci°, C1 90 , Ci 180 , C1 270 is made, and so on.
- the phase information displayed beneath the relevant sequence of captures is the phase data acquired by system 200 operating at the associated modulation frequency.
- subscript 1 denotes captures associated with modulation frequency fi
- subscript 2 denotes captures associated with modulation frequency f 2 .
- the frame information displayed beneath the phase information shows how frames are preferably constructed, according to the sequence shown. Once ⁇ 1 and ⁇ 2 have been determined, ⁇ E can be calculated from ( ⁇ + ⁇ 2 )/2.
- Fig. 4B depicts another sequencing example, in which four adjacent pixel detectors, shown as a block, in the pixel array are used to acquire all four phases in a single capture.
- the eight capture sequence of Fig. 4A is susceptible to motion blur due to the length of time to acquire all eight captures, the sequence shown in Fig. 4B should inherently exhibit lower motion blur.
- the C°-C 180 offset cancellation is done with data from different pixels and performance can suffer in that offsets are not fully cancelled.
- ⁇ E is calculated from ( ⁇ + ⁇ 2 )/2.
- 4C depicts yet another sequencing example, one in which captures for each phase are cancelled with respect to C°-C 180 offset with the same pixel detector, shown as a block. In this configuration, performance is quite good, and motion blur is acceptable.
- ⁇ E is calculated from ( ⁇ + ⁇ 2 )/2.
- Fig. 4D depicts an alternative embodiment in which phase ⁇ and phase ⁇ 2 are not C°-C 180 offset corrected.
- data quality is somewhat poor, but advantageously ⁇ ⁇ is computed directly from the captures Ci° - C 2 180 and Ci 90 - C 2 270 .
- the method is as described previously, where C 2 180 is substituted for C 2 ° and where C 2 270 is substituted for C 2 90 .
- ⁇ ⁇ is calculated from ( ⁇ + ⁇ 2 )/2.
- Figs. 5A and 5B A lossy so-called least common multiple (LCM) dealiasing embodiment will now be described reference to Figs. 5A and 5B.
- LCM least common multiple
- a single modulation frequency fi of 25 MHz is used to acquire data
- the Z distance of the object is either 1 m, 4 m, 7 m, or 12 m as suggested by the cross-hatched rectangular regions in Fig. 5A.
- the above-two results are combined, leading to the conclusion that the target object must be at a distance of 7 m.
- the target object is drawn in Figs. 5A and 5B with heavy bold lines to distinguish from phantom locations, which are drawn in phantom.
- the true location of the target object could still be confused with another location at 19 M, but compared to the one-modulation frequency case, the use of two modulation frequencies has extended the unambiguous interval range substantially.
- the effective unambiguous interval range is increased according to the LCM least common multiple of Z A IRI and Z MR2 .
- One strategy in selecting modulation frequencies is to maximize the LCM of the corresponding unambiguous interval ranges by choosing two frequencies close to each other.
- a relatively very low modulation frequency may be used to determine whether a target object is within a first or a second Z range or bin, e.g., perhaps between a 0 m to 50 m range, or perhaps between a 50 m to 100 m range. If TOF system 200 determines that the target object is within say 0 m to 50 m, then software 200 can cause clock 180' to double the modulation frequency to determine whether the target object lies within a 0 m to 25 m sub-range (or narrower bin), or within a 25 m to 50 m sub-range (or narrow bin).
- a similar analysis and modulation frequency change is performed should the object initially have been found to lie with a 50 m to 100 m range.
- This method of estimating distance range for the target object and then changing modulation frequency to better ascertain the distance range is repeated preferably until the range is determined with a desired range granularity. Again this method is preferably carried out automatically under command of software 220.
- this example assumed the various alternate ranges or bins were 2X apart, other ratios may be used.
- branch and bound hierarchical dealiasing it may be desirable to minimize the number of bins for each relatively low modulation frequency.
- the hierarchical modulation frequency sweep process tends to maximize the effective system TOF modulation frequency by keeping the resolution requirement at each lower modulation frequency as small as feasible.
- a branch and bound embodiment may be combined with lossless dealiasing embodiment at one or more steps in the hierarchical process.
- f c (1 10 MHz + 100 MHz/100)
- dealiasing according to embodiments of the 12/459,033 application is lossless, and provided a relatively large aliasing interval range commensurate with a low modulation frequency. These embodiments also provide high precision certainty with respect to a given Z value, commensurate with a modulation frequency close to the highest modulation frequency f m . Dealiasing could be carried out relatively losslessly or with loss, depending upon the embodiment.
- TOF system 300 implements the present invention.
- TOF system 300 includes a clock unit 180" that may be modified over clock unit 180 in Fig. 1 A and, or alternatively, includes hardware 310 and/or software 320.
- Software 320 may but need not be executed by processor 160. This hardware and/or software implement the various
- Embodiments of the present invention preferably employ an n- step hierarchical dealiasing approach to avoid aliasing problems caused by very large amplification of the noise in B E .
- f E g 0 (f 1 , f 2 , - , f m ) is a function of the modulation
- frequencies f x , f 2 , - , f m preferably an arithmetic mean or a weighted average.
- embodiments of the present invention preferably generate a set of N— 1 intermediate frequencies f DE1 , f DE2 , - , f DE ⁇ N-i) , where f D ⁇ f DE1 ⁇ f DE2 ⁇
- the number of the intermediate frequencies N— 1 and the ratio 1) between frequencies in each consecutive pair preferably are determined by the uncertainty of the depth.
- the uncertainty of the amplifying factor at each step is sufficiently small such that the probability of choosing m k incorrectly is low.
- this method achieves the desired large ratio
- Figs. 7A-7D Exemplary algorithm details for two-step hierarchical dealiasing will now be described with reference to Figs. 7A-7D. It is understood that these steps are preferably carried out with TOF system 300, e.g., by clock unit 180", and/or modules 310, 320.
- Fig. 7C shows that 0 D E and 0, are likely to wrap around at different distances.
- 6DE- TO dealias 6DS as shown in Fig. 7A, one would have to dealias ⁇ 0 ⁇ for all of the four cycles shown in the figure.
- ⁇ 1 be the phase of / 1; let ⁇ 2 be the phase of f 2 , and let ⁇ 3 to be the phase of 3 .
- an "offset compensation" method is used to avoid adding additional constraints that limit the choices of frequencies.
- the offset-corrected phase e° ffset will always start at zero phase at the beginning of each cycle of 6 D ES-
- ⁇ Q° set + ⁇ 2 ⁇ + ⁇ 2 ⁇
- the present invention provides hierarchical dealiasing for a TOF system that functions even in the presence of noise.
- a number N, N > 3 of frequencies that are close to each other are used to create a slow dealiasing frequency and at least one intermediate frequency that can be used to dealias a long distance hierarchically.
- embodiments of the present invention rather than amplifying noise by a very large ratio as in two-frequency dealiasing, embodiments of the present invention only amplify noise by a small ratio at each dealiasing step.
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Electromagnetism (AREA)
- Remote Sensing (AREA)
- General Physics & Mathematics (AREA)
- Radar, Positioning & Navigation (AREA)
- Computer Networks & Wireless Communication (AREA)
- Optical Radar Systems And Details Thereof (AREA)
- Measurement Of Optical Distance (AREA)
- Image Processing (AREA)
- Studio Devices (AREA)
- Measurement Of Velocity Or Position Using Acoustic Or Ultrasonic Waves (AREA)
- Radar Systems Or Details Thereof (AREA)
Abstract
Priority Applications (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP11810389.4A EP2596321B1 (fr) | 2010-07-21 | 2011-07-21 | Procédés et systèmes pour des systèmes hiérarchiques de temps de vol (tof) d'anti-repliement |
| KR1020137001577A KR101824753B1 (ko) | 2010-07-21 | 2011-07-21 | Tof 시스템의 계층적 디앨리어싱을 위한 방법 및 시스템 |
| JP2013520860A JP5918763B2 (ja) | 2010-07-21 | 2011-07-21 | 階層的な飛行時間(tof)システムのディエリアシング方法およびシステム |
| IL224134A IL224134A (en) | 2010-07-21 | 2013-01-08 | Methods and systems for eliminating hierarchical curve scaling in tof systems |
Applications Claiming Priority (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US40006110P | 2010-07-21 | 2010-07-21 | |
| US61/400,061 | 2010-07-21 | ||
| US13/021,484 | 2011-02-04 | ||
| US13/021,484 US8629976B2 (en) | 2007-10-02 | 2011-02-04 | Methods and systems for hierarchical de-aliasing time-of-flight (TOF) systems |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| WO2012012607A2 true WO2012012607A2 (fr) | 2012-01-26 |
| WO2012012607A3 WO2012012607A3 (fr) | 2012-05-10 |
Family
ID=44341396
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/US2011/044800 Ceased WO2012012607A2 (fr) | 2010-07-21 | 2011-07-21 | Procédés et systèmes pour des systèmes hiérarchiques de temps de vol (tof) d'anti-repliement |
Country Status (7)
| Country | Link |
|---|---|
| US (1) | US8629976B2 (fr) |
| EP (1) | EP2596321B1 (fr) |
| JP (1) | JP5918763B2 (fr) |
| KR (1) | KR101824753B1 (fr) |
| CN (1) | CN102393515B (fr) |
| IL (1) | IL224134A (fr) |
| WO (1) | WO2012012607A2 (fr) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107636488A (zh) * | 2015-07-20 | 2018-01-26 | 谷歌有限责任公司 | 用于提高飞行时间像素阵列的分辨率的方法和设备 |
| US10398006B2 (en) | 2016-03-16 | 2019-08-27 | Ricoh Company, Ltd. | Object detection apparatus and moveable apparatus |
| US10397552B2 (en) | 2013-12-24 | 2019-08-27 | Sony Depthsensing Solutions Sa/Nv | Time-of-flight camera system |
| US10481263B2 (en) | 2016-03-10 | 2019-11-19 | Ricoh Company, Ltd. | Range finding apparatus, moveable apparatus, robot, three dimensional measurement apparatus, method of measuring three dimensional information, and storage medium |
| US10545239B2 (en) | 2015-07-31 | 2020-01-28 | Panasonic Intellectual Property Management Co., Ltd. | Distance-measuring imaging device and solid-state imaging device |
| US10775502B2 (en) | 2016-11-10 | 2020-09-15 | Ricoh Company, Ltd | Distance-measuring apparatus, mobile object, robot, three-dimensional measuring device, surveillance camera, and distance-measuring method |
| US12248101B2 (en) | 2018-08-17 | 2025-03-11 | Sense Photonics, Inc. | Methods and systems for increasing the range of time-of-flight systems by unambiguous range toggling |
| US12498467B2 (en) | 2020-03-18 | 2025-12-16 | Ricoh Company, Ltd. | Distance-measuring apparatus and distance-measuring method |
Families Citing this family (59)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8629976B2 (en) * | 2007-10-02 | 2014-01-14 | Microsoft Corporation | Methods and systems for hierarchical de-aliasing time-of-flight (TOF) systems |
| KR101483462B1 (ko) * | 2008-08-27 | 2015-01-16 | 삼성전자주식회사 | 깊이 영상 획득 장치 및 방법 |
| US9753128B2 (en) * | 2010-07-23 | 2017-09-05 | Heptagon Micro Optics Pte. Ltd. | Multi-path compensation using multiple modulation frequencies in time of flight sensor |
| US9857469B2 (en) * | 2010-10-22 | 2018-01-02 | Heptagon Micro Optics Pte. Ltd. | System and method for multi TOF camera operation using phase hopping |
| US20120120285A1 (en) * | 2010-11-16 | 2012-05-17 | Texas Instruments Incorporated | Method and apparatus for reconfiguring time of flight shot mode |
| KR20140057625A (ko) * | 2012-01-10 | 2014-05-13 | 소프트키네틱 센서스 엔브이 | 이동거리시간차 신호들을 프로세싱하는데 있어서 또는 프로세싱과 관련된 개선들 |
| US20140049767A1 (en) * | 2012-08-15 | 2014-02-20 | Microsoft Corporation | Methods and systems for geometric phase unwrapping in time of flight systems |
| US8879050B2 (en) * | 2012-12-04 | 2014-11-04 | Texas Instruments Incorporated | Method for dynamically adjusting the operating parameters of a TOF camera according to vehicle speed |
| US9869768B2 (en) * | 2013-01-09 | 2018-01-16 | Lg Electronics Inc. | Device for detecting distance and apparatus for processing images comprising same |
| DE102013003186B3 (de) * | 2013-02-26 | 2014-05-08 | Audi Ag | Verfahren zur Ermittlung eines Abstands eines Objekts zu einem Kraftfahrzeug und PMD-Sensor |
| US9019480B2 (en) | 2013-02-26 | 2015-04-28 | Jds Uniphase Corporation | Time-of-flight (TOF) system, sensor pixel, and method |
| LU92173B1 (en) * | 2013-03-20 | 2014-09-22 | Iee Sarl | Distance determination method |
| KR102040152B1 (ko) * | 2013-04-08 | 2019-12-05 | 삼성전자주식회사 | 3차원 영상 획득 장치 및 3차원 영상 획득 장치에서의 깊이 영상 생성 방법 |
| US9329272B2 (en) * | 2013-05-02 | 2016-05-03 | Infineon Technologies Ag | 3D camera and method of image processing 3D images |
| US9584790B2 (en) * | 2013-06-03 | 2017-02-28 | Microsoft Technology Licensing, Llc | Edge preserving depth filtering |
| AU2014342114B2 (en) * | 2013-11-01 | 2019-06-20 | Irobot Corporation | Scanning range finder |
| US10291329B2 (en) * | 2013-12-20 | 2019-05-14 | Infineon Technologies Ag | Exchanging information between time-of-flight ranging devices |
| KR102159994B1 (ko) | 2014-01-22 | 2020-09-25 | 삼성전자주식회사 | 티오에프 카메라 장치 및 이의 구동 방법 |
| EP2966475B1 (fr) * | 2014-07-09 | 2016-05-25 | Softkinetic Sensors N.V. | Procédé pour classifier des données de temps de vol |
| US9702976B2 (en) | 2014-10-27 | 2017-07-11 | Microsoft Technology Licensing, Llc | Time of flight camera |
| US9823352B2 (en) * | 2014-10-31 | 2017-11-21 | Rockwell Automation Safety Ag | Absolute distance measurement for time-of-flight sensors |
| CN107533139B (zh) | 2015-03-17 | 2022-02-08 | 康奈尔大学 | 景深成像设备、方法和应用 |
| JP2017009339A (ja) | 2015-06-18 | 2017-01-12 | 株式会社リコー | センサ、センシング装置及び距離計測方法 |
| JP6558122B2 (ja) * | 2015-07-30 | 2019-08-14 | 株式会社デンソー | 光飛行型測距装置 |
| CN106527761A (zh) | 2015-09-10 | 2017-03-22 | 义明科技股份有限公司 | 非接触式光学感测装置及三维空间物件深度位置感测方法 |
| TWI575248B (zh) * | 2015-09-10 | 2017-03-21 | 義明科技股份有限公司 | 非接觸式光學感測裝置及感測三維空間之物件深度位置的方法 |
| JPWO2017085916A1 (ja) | 2015-11-16 | 2018-09-06 | パナソニックIpマネジメント株式会社 | 撮像装置、及びそれに用いられる固体撮像素子 |
| WO2017138033A1 (fr) * | 2016-02-08 | 2017-08-17 | Denso Corporation | Dispositif de mesure de distance par temps de vol et procédé de détection d'erreur multivoie |
| US10598783B2 (en) | 2016-07-07 | 2020-03-24 | Microsoft Technology Licensing, Llc | Multi-frequency unwrapping |
| JP6261681B2 (ja) * | 2016-08-05 | 2018-01-17 | ソフトキネティック センサーズ エヌブイ | タイムオブフライト信号の処理における又はこれに関する改良 |
| KR102752035B1 (ko) | 2016-08-22 | 2025-01-09 | 삼성전자주식회사 | 거리 정보를 획득하는 방법 및 디바이스 |
| CN106772414B (zh) * | 2016-10-14 | 2019-08-16 | 北醒(北京)光子科技有限公司 | 一种提高tof相位法测距雷达测距精度的方法 |
| US10425628B2 (en) | 2017-02-01 | 2019-09-24 | Microsoft Technology Licensing, Llc | Alternating frequency captures for time of flight depth sensing |
| US10810753B2 (en) | 2017-02-27 | 2020-10-20 | Microsoft Technology Licensing, Llc | Single-frequency time-of-flight depth computation using stereoscopic disambiguation |
| US10754033B2 (en) | 2017-06-30 | 2020-08-25 | Waymo Llc | Light detection and ranging (LIDAR) device range aliasing resilience by multiple hypotheses |
| US10627492B2 (en) | 2017-08-01 | 2020-04-21 | Waymo Llc | Use of extended detection periods for range aliasing detection and mitigation in a light detection and ranging (LIDAR) system |
| US10382736B1 (en) * | 2018-02-09 | 2019-08-13 | Infineon Technologies Ag | Two frequency time-of-flight three-dimensional image sensor and method of measuring object depth |
| KR102473650B1 (ko) * | 2018-04-13 | 2022-12-02 | 엘지이노텍 주식회사 | 카메라 모듈 및 그의 깊이 정보 추출 방법 |
| US10607352B2 (en) * | 2018-05-17 | 2020-03-31 | Microsoft Technology Licensing, Llc | Reduced power operation of time-of-flight camera |
| WO2020023489A1 (fr) | 2018-07-24 | 2020-01-30 | Sense Photonics, Inc. | Bruit de phase et procédés de correction dans un lidar en mode multifréquence |
| CN109031333B (zh) * | 2018-08-22 | 2020-08-21 | Oppo广东移动通信有限公司 | 距离测量方法和装置、存储介质、电子设备 |
| US10916023B2 (en) | 2018-09-14 | 2021-02-09 | Facebook Technologies, Llc | Depth measurement assembly with a structured light source and a time of flight camera |
| US10861165B2 (en) | 2019-01-11 | 2020-12-08 | Microsoft Technology Licensing, Llc | Subject tracking with aliased time-of-flight data |
| US11500091B2 (en) * | 2019-03-13 | 2022-11-15 | Wisconsin Alumni Research Foundation | Non-line-of-sight imaging system for distant measurement |
| US11287517B2 (en) * | 2019-04-19 | 2022-03-29 | Sense Photonics, Inc. | Single frame distance disambiguation |
| US10878589B2 (en) | 2019-05-02 | 2020-12-29 | Samsung Electronics Co., Ltd. | Time-of-flight depth measurement using modulation frequency adjustment |
| US11619723B2 (en) * | 2019-09-23 | 2023-04-04 | Microsoft Technology Licensing, Llc | Multiple-mode frequency sharing for time-of-flight camera |
| WO2021077358A1 (fr) * | 2019-10-24 | 2021-04-29 | 华为技术有限公司 | Procédé de télémétrie, dispositif de télémétrie et support de stockage lisible par ordinateur |
| JP7517349B2 (ja) * | 2019-12-18 | 2024-07-17 | ソニーグループ株式会社 | 信号処理装置、信号処理方法、および、測距装置 |
| JP7567492B2 (ja) * | 2020-03-18 | 2024-10-16 | 株式会社リコー | 距離計測装置及び距離計測方法 |
| JP2021148608A (ja) * | 2020-03-19 | 2021-09-27 | 株式会社リコー | 撮像装置、測距装置及び撮像プログラム |
| US11675067B2 (en) * | 2020-05-15 | 2023-06-13 | Microsoft Technology Licensing, Llc | Phase unwrapping with multiple wavelengths on a flat torus |
| US11520052B2 (en) * | 2020-06-26 | 2022-12-06 | Microsoft Technology Licensing, Llc | Adaptive processing in time of flight imaging |
| CN111798506B (zh) * | 2020-06-30 | 2024-07-23 | 上海数迹智能科技有限公司 | 一种图像处理方法、终端及计算机可读存储介质 |
| WO2022113637A1 (fr) * | 2020-11-26 | 2022-06-02 | ソニーセミコンダクタソリューションズ株式会社 | Dispositif de traitement de signal, dispositif de mesure de distance, procédé de mesure de distance et capteur d'image |
| EP4264323A1 (fr) * | 2020-12-15 | 2023-10-25 | Sony Semiconductor Solutions Corporation | Circuit de capteur d'image de temps de vol et procédé de commande de circuit de capteur d'image de temps de vol |
| EP4057030B1 (fr) * | 2021-03-10 | 2022-12-14 | Sick Ag | Dispositif optoélectronique et procédé de mesure de la distance |
| CN114095713A (zh) * | 2021-11-23 | 2022-02-25 | 京东方科技集团股份有限公司 | 成像模组及其处理方法、系统、装置、介质 |
| US12407804B2 (en) * | 2022-03-14 | 2025-09-02 | Microsoft Technology Licensing, Llc | Motion correction for time-of-flight depth imaging |
Family Cites Families (172)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4288078A (en) * | 1979-11-20 | 1981-09-08 | Lugo Julio I | Game apparatus |
| JPS56132580A (en) * | 1980-03-10 | 1981-10-16 | Tokyo Optical Co Ltd | Light wave rangemeter |
| US4695953A (en) * | 1983-08-25 | 1987-09-22 | Blair Preston E | TV animation interactively controlled by the viewer |
| US4630910A (en) * | 1984-02-16 | 1986-12-23 | Robotic Vision Systems, Inc. | Method of measuring in three-dimensions at high speed |
| US4627620A (en) * | 1984-12-26 | 1986-12-09 | Yang John P | Electronic athlete trainer for improving skills in reflex, speed and accuracy |
| US4645458A (en) * | 1985-04-15 | 1987-02-24 | Harald Phillip | Athletic evaluation and training apparatus |
| US4702475A (en) * | 1985-08-16 | 1987-10-27 | Innovating Training Products, Inc. | Sports technique and reaction training system |
| US4843568A (en) * | 1986-04-11 | 1989-06-27 | Krueger Myron W | Real time perception of and response to the actions of an unencumbered participant/user |
| US4711543A (en) * | 1986-04-14 | 1987-12-08 | Blair Preston E | TV animation interactively controlled by the viewer |
| US4796997A (en) * | 1986-05-27 | 1989-01-10 | Synthetic Vision Systems, Inc. | Method and system for high-speed, 3-D imaging of an object at a vision station |
| US5184295A (en) * | 1986-05-30 | 1993-02-02 | Mann Ralph V | System and method for teaching physical skills |
| US4751642A (en) * | 1986-08-29 | 1988-06-14 | Silva John M | Interactive sports simulation system with physiological sensing and psychological conditioning |
| US4809065A (en) * | 1986-12-01 | 1989-02-28 | Kabushiki Kaisha Toshiba | Interactive system and related method for displaying data to produce a three-dimensional image of an object |
| US4817950A (en) * | 1987-05-08 | 1989-04-04 | Goo Paul E | Video game control unit and attitude sensor |
| JPH0224590A (ja) * | 1988-07-13 | 1990-01-26 | Fujitsu Ltd | 振幅変調形測距装置 |
| US5239464A (en) * | 1988-08-04 | 1993-08-24 | Blair Preston E | Interactive video system providing repeated switching of multiple tracks of actions sequences |
| US5239463A (en) * | 1988-08-04 | 1993-08-24 | Blair Preston E | Method and apparatus for player interaction with animated characters and objects |
| US4901362A (en) * | 1988-08-08 | 1990-02-13 | Raytheon Company | Method of recognizing patterns |
| US4893183A (en) * | 1988-08-11 | 1990-01-09 | Carnegie-Mellon University | Robotic vision system |
| JPH02199526A (ja) * | 1988-10-14 | 1990-08-07 | David G Capper | 制御インターフェース装置 |
| US4925189A (en) * | 1989-01-13 | 1990-05-15 | Braeunig Thomas F | Body-mounted video game exercise device |
| US5229756A (en) * | 1989-02-07 | 1993-07-20 | Yamaha Corporation | Image control apparatus |
| US5469740A (en) * | 1989-07-14 | 1995-11-28 | Impulse Technology, Inc. | Interactive video testing and training system |
| JPH03103822U (fr) * | 1990-02-13 | 1991-10-29 | ||
| US5101444A (en) * | 1990-05-18 | 1992-03-31 | Panacea, Inc. | Method and apparatus for high speed object location |
| US5148154A (en) * | 1990-12-04 | 1992-09-15 | Sony Corporation Of America | Multi-dimensional user interface |
| US5534917A (en) * | 1991-05-09 | 1996-07-09 | Very Vivid, Inc. | Video image based control system |
| US5417210A (en) * | 1992-05-27 | 1995-05-23 | International Business Machines Corporation | System and method for augmentation of endoscopic surgery |
| US5295491A (en) * | 1991-09-26 | 1994-03-22 | Sam Technology, Inc. | Non-invasive human neurocognitive performance capability testing method and system |
| US6054991A (en) * | 1991-12-02 | 2000-04-25 | Texas Instruments Incorporated | Method of modeling player position and movement in a virtual reality system |
| WO1993010708A1 (fr) | 1991-12-03 | 1993-06-10 | French Sportech Corporation | Systeme pour tester et entrainer les capacites physiques d'un sujet utilisant la video et du type interactif |
| US5875108A (en) * | 1991-12-23 | 1999-02-23 | Hoffberg; Steven M. | Ergonomic man-machine interface incorporating adaptive pattern recognition based control system |
| JPH07325934A (ja) | 1992-07-10 | 1995-12-12 | Walt Disney Co:The | 仮想世界に向上したグラフィックスを提供する方法および装置 |
| US5999908A (en) | 1992-08-06 | 1999-12-07 | Abelow; Daniel H. | Customer-based product design module |
| US5320538A (en) * | 1992-09-23 | 1994-06-14 | Hughes Training, Inc. | Interactive aircraft training system and method |
| IT1257294B (it) * | 1992-11-20 | 1996-01-12 | Dispositivo atto a rilevare la configurazione di un'unita' fisiologicadistale,da utilizzarsi in particolare come interfaccia avanzata per macchine e calcolatori. | |
| US5495576A (en) * | 1993-01-11 | 1996-02-27 | Ritchey; Kurtis J. | Panoramic image based virtual reality/telepresence audio-visual system and method |
| US5690582A (en) * | 1993-02-02 | 1997-11-25 | Tectrix Fitness Equipment, Inc. | Interactive exercise apparatus |
| JP2799126B2 (ja) * | 1993-03-26 | 1998-09-17 | 株式会社ナムコ | ビデオゲーム装置及びゲーム用入力装置 |
| US5405152A (en) * | 1993-06-08 | 1995-04-11 | The Walt Disney Company | Method and apparatus for an interactive video game with physical feedback |
| US5454043A (en) * | 1993-07-30 | 1995-09-26 | Mitsubishi Electric Research Laboratories, Inc. | Dynamic and static hand gesture recognition through low-level image analysis |
| US5423554A (en) * | 1993-09-24 | 1995-06-13 | Metamedia Ventures, Inc. | Virtual reality game method and apparatus |
| US5980256A (en) * | 1993-10-29 | 1999-11-09 | Carmein; David E. E. | Virtual reality system with enhanced sensory apparatus |
| JP3419050B2 (ja) * | 1993-11-19 | 2003-06-23 | 株式会社日立製作所 | 入力装置 |
| US5347306A (en) * | 1993-12-17 | 1994-09-13 | Mitsubishi Electric Research Laboratories, Inc. | Animated electronic meeting place |
| JP2552427B2 (ja) * | 1993-12-28 | 1996-11-13 | コナミ株式会社 | テレビ遊戯システム |
| US5577981A (en) * | 1994-01-19 | 1996-11-26 | Jarvik; Robert | Virtual reality exercise machine and computer controlled video system |
| US5580249A (en) * | 1994-02-14 | 1996-12-03 | Sarcos Group | Apparatus for simulating mobility of a human |
| US5597309A (en) * | 1994-03-28 | 1997-01-28 | Riess; Thomas | Method and apparatus for treatment of gait problems associated with parkinson's disease |
| US5385519A (en) * | 1994-04-19 | 1995-01-31 | Hsu; Chi-Hsueh | Running machine |
| US5524637A (en) * | 1994-06-29 | 1996-06-11 | Erickson; Jon W. | Interactive system for measuring physiological exertion |
| US5563988A (en) * | 1994-08-01 | 1996-10-08 | Massachusetts Institute Of Technology | Method and system for facilitating wireless, full-body, real-time user interaction with a digitally represented visual environment |
| US5589928A (en) * | 1994-09-01 | 1996-12-31 | The Boeing Company | Method and apparatus for measuring distance to a target |
| US6714665B1 (en) | 1994-09-02 | 2004-03-30 | Sarnoff Corporation | Fully automated iris recognition system utilizing wide and narrow fields of view |
| US5516105A (en) * | 1994-10-06 | 1996-05-14 | Exergame, Inc. | Acceleration activated joystick |
| US5638300A (en) * | 1994-12-05 | 1997-06-10 | Johnson; Lee E. | Golf swing analysis system |
| JPH08161292A (ja) * | 1994-12-09 | 1996-06-21 | Matsushita Electric Ind Co Ltd | 混雑度検知方法およびそのシステム |
| US5594469A (en) * | 1995-02-21 | 1997-01-14 | Mitsubishi Electric Information Technology Center America Inc. | Hand gesture machine control system |
| US5682229A (en) * | 1995-04-14 | 1997-10-28 | Schwartz Electro-Optics, Inc. | Laser range camera |
| US5913727A (en) * | 1995-06-02 | 1999-06-22 | Ahdoot; Ned | Interactive movement and contact simulation game |
| US6229913B1 (en) * | 1995-06-07 | 2001-05-08 | The Trustees Of Columbia University In The City Of New York | Apparatus and methods for determining the three-dimensional shape of an object using active illumination and relative blurring in two-images due to defocus |
| US5682196A (en) * | 1995-06-22 | 1997-10-28 | Actv, Inc. | Three-dimensional (3D) video presentation system providing interactive 3D presentation with personalized audio responses for multiple viewers |
| US5702323A (en) * | 1995-07-26 | 1997-12-30 | Poulton; Craig K. | Electronic exercise enhancer |
| US6098458A (en) | 1995-11-06 | 2000-08-08 | Impulse Technology, Ltd. | Testing and training system for assessing movement and agility skills without a confining field |
| US6308565B1 (en) * | 1995-11-06 | 2001-10-30 | Impulse Technology Ltd. | System and method for tracking and assessing movement skills in multidimensional space |
| US6073489A (en) * | 1995-11-06 | 2000-06-13 | French; Barry J. | Testing and training system for assessing the ability of a player to complete a task |
| US6430997B1 (en) | 1995-11-06 | 2002-08-13 | Trazer Technologies, Inc. | System and method for tracking and assessing movement skills in multidimensional space |
| US6176782B1 (en) * | 1997-12-22 | 2001-01-23 | Philips Electronics North America Corp. | Motion-based command generation technology |
| US5933125A (en) * | 1995-11-27 | 1999-08-03 | Cae Electronics, Ltd. | Method and apparatus for reducing instability in the display of a virtual environment |
| US5641288A (en) * | 1996-01-11 | 1997-06-24 | Zaenglein, Jr.; William G. | Shooting simulating process and training device using a virtual reality display screen |
| US6152856A (en) * | 1996-05-08 | 2000-11-28 | Real Vision Corporation | Real time simulation using position sensing |
| US6173066B1 (en) * | 1996-05-21 | 2001-01-09 | Cybernet Systems Corporation | Pose determination and tracking by matching 3D objects to a 2D sensor |
| US5989157A (en) * | 1996-08-06 | 1999-11-23 | Walton; Charles A. | Exercising system with electronic inertial game playing |
| JP2001504605A (ja) * | 1996-08-14 | 2001-04-03 | ラティポフ,ヌラフメド,ヌリスラモビチ | 空間内のユーザの位置及び方向性を追跡及び表示するための方法、ユーザに対し仮想環境を提示するための方法及びこれらの方法を実現するためのシステム |
| JP3064928B2 (ja) * | 1996-09-20 | 2000-07-12 | 日本電気株式会社 | 被写体抽出方式 |
| ATE232621T1 (de) * | 1996-12-20 | 2003-02-15 | Hitachi Europ Ltd | Verfahren und system zur erkennung von handgesten |
| US6009210A (en) * | 1997-03-05 | 1999-12-28 | Digital Equipment Corporation | Hands-free interface to a virtual reality environment using head tracking |
| US6100896A (en) * | 1997-03-24 | 2000-08-08 | Mitsubishi Electric Information Technology Center America, Inc. | System for designing graphical multi-participant environments |
| US5877803A (en) * | 1997-04-07 | 1999-03-02 | Tritech Mircoelectronics International, Ltd. | 3-D image detector |
| US6215898B1 (en) * | 1997-04-15 | 2001-04-10 | Interval Research Corporation | Data processing system and method |
| JP3077745B2 (ja) * | 1997-07-31 | 2000-08-14 | 日本電気株式会社 | データ処理方法および装置、情報記憶媒体 |
| US6188777B1 (en) * | 1997-08-01 | 2001-02-13 | Interval Research Corporation | Method and apparatus for personnel detection and tracking |
| US6720949B1 (en) | 1997-08-22 | 2004-04-13 | Timothy R. Pryor | Man machine interfaces and applications |
| US6289112B1 (en) * | 1997-08-22 | 2001-09-11 | International Business Machines Corporation | System and method for determining block direction in fingerprint images |
| AUPO894497A0 (en) * | 1997-09-02 | 1997-09-25 | Xenotech Research Pty Ltd | Image processing method and apparatus |
| EP0905644A3 (fr) * | 1997-09-26 | 2004-02-25 | Matsushita Electric Industrial Co., Ltd. | Dispositif de reconnaissance de gestes de la main |
| US6141463A (en) * | 1997-10-10 | 2000-10-31 | Electric Planet Interactive | Method and system for estimating jointed-figure configurations |
| US6130677A (en) * | 1997-10-15 | 2000-10-10 | Electric Planet, Inc. | Interactive computer vision system |
| US6384819B1 (en) * | 1997-10-15 | 2002-05-07 | Electric Planet, Inc. | System and method for generating an animatable character |
| US6101289A (en) * | 1997-10-15 | 2000-08-08 | Electric Planet, Inc. | Method and apparatus for unencumbered capture of an object |
| WO1999019828A1 (fr) | 1997-10-15 | 1999-04-22 | Electric Planet, Inc. | Procede et appareil pour realiser la soustraction d'un objet d'un arriere-plan avec des contours nets |
| US6072494A (en) * | 1997-10-15 | 2000-06-06 | Electric Planet, Inc. | Method and apparatus for real-time gesture recognition |
| US6181343B1 (en) * | 1997-12-23 | 2001-01-30 | Philips Electronics North America Corp. | System and method for permitting three-dimensional navigation through a virtual reality environment using camera-based gesture inputs |
| US6159100A (en) * | 1998-04-23 | 2000-12-12 | Smith; Michael D. | Virtual reality game |
| US6077201A (en) * | 1998-06-12 | 2000-06-20 | Cheng; Chau-Yang | Exercise bicycle |
| US6950534B2 (en) | 1998-08-10 | 2005-09-27 | Cybernet Systems Corporation | Gesture-controlled interfaces for self-service machines and other applications |
| US7036094B1 (en) | 1998-08-10 | 2006-04-25 | Cybernet Systems Corporation | Behavior recognition system |
| US20010008561A1 (en) | 1999-08-10 | 2001-07-19 | Paul George V. | Real-time object tracking system |
| US6681031B2 (en) | 1998-08-10 | 2004-01-20 | Cybernet Systems Corporation | Gesture-controlled interfaces for self-service machines and other applications |
| US7121946B2 (en) | 1998-08-10 | 2006-10-17 | Cybernet Systems Corporation | Real-time head tracking system for computer games and other applications |
| US6801637B2 (en) | 1999-08-10 | 2004-10-05 | Cybernet Systems Corporation | Optical body tracker |
| IL126284A (en) * | 1998-09-17 | 2002-12-01 | Netmor Ltd | System and method for three dimensional positioning and tracking |
| DE69936620T2 (de) * | 1998-09-28 | 2008-05-21 | Matsushita Electric Industrial Co., Ltd., Kadoma | Verfahren und Vorrichtung zum Segmentieren von Handgebärden |
| AU1930700A (en) | 1998-12-04 | 2000-06-26 | Interval Research Corporation | Background estimation and segmentation based on range and color |
| US6147678A (en) * | 1998-12-09 | 2000-11-14 | Lucent Technologies Inc. | Video hand image-three-dimensional computer interface with multiple degrees of freedom |
| JP4578686B2 (ja) | 1998-12-16 | 2010-11-10 | マイクロソフト インターナショナル ホールディングス ビイ.ヴイ. | 3dカメラ |
| US6570555B1 (en) | 1998-12-30 | 2003-05-27 | Fuji Xerox Co., Ltd. | Method and apparatus for embodied conversational characters with multimodal input/output in an interface device |
| US6363160B1 (en) * | 1999-01-22 | 2002-03-26 | Intel Corporation | Interface using pattern recognition and tracking |
| US7003134B1 (en) | 1999-03-08 | 2006-02-21 | Vulcan Patents Llc | Three dimensional object pose estimation which employs dense depth information |
| US6299308B1 (en) * | 1999-04-02 | 2001-10-09 | Cybernet Systems Corporation | Low-cost non-imaging eye tracker system for computer control |
| US6503195B1 (en) * | 1999-05-24 | 2003-01-07 | University Of North Carolina At Chapel Hill | Methods and systems for real-time structured light depth extraction and endoscope using real-time structured light depth extraction |
| US6476834B1 (en) * | 1999-05-28 | 2002-11-05 | International Business Machines Corporation | Dynamic creation of selectable items on surfaces |
| US6873723B1 (en) | 1999-06-30 | 2005-03-29 | Intel Corporation | Segmenting three-dimensional video images using stereo |
| US6738066B1 (en) | 1999-07-30 | 2004-05-18 | Electric Plant, Inc. | System, method and article of manufacture for detecting collisions between video images generated by a camera and an object depicted on a display |
| US7113918B1 (en) | 1999-08-01 | 2006-09-26 | Electric Planet, Inc. | Method for video enabled electronic commerce |
| US7050606B2 (en) | 1999-08-10 | 2006-05-23 | Cybernet Systems Corporation | Tracking and gesture recognition system particularly suited to vehicular control applications |
| KR100320520B1 (ko) * | 1999-12-28 | 2002-01-16 | 이계안 | 자동변속기 셀렉터 레버 쉬프트 록 장치 |
| US6663491B2 (en) | 2000-02-18 | 2003-12-16 | Namco Ltd. | Game apparatus, storage medium and computer program that adjust tempo of sound |
| US6633294B1 (en) | 2000-03-09 | 2003-10-14 | Seth Rosenthal | Method and apparatus for using captured high density motion for animation |
| EP1152261A1 (fr) | 2000-04-28 | 2001-11-07 | CSEM Centre Suisse d'Electronique et de Microtechnique SA | Dispositif et procédé de détection avec résolution spatiale et démodulation d'ondes électromagnétiques modulées |
| US6640202B1 (en) | 2000-05-25 | 2003-10-28 | International Business Machines Corporation | Elastic sensor mesh system for 3-dimensional measurement, mapping and kinematics applications |
| US6731799B1 (en) | 2000-06-01 | 2004-05-04 | University Of Washington | Object segmentation with background extraction and moving boundary techniques |
| US6587186B2 (en) * | 2000-06-06 | 2003-07-01 | Canesta, Inc. | CMOS-compatible three-dimensional image sensing using reduced peak energy |
| US6788809B1 (en) | 2000-06-30 | 2004-09-07 | Intel Corporation | System and method for gesture recognition in three dimensions using stereo imaging and color vision |
| US7227526B2 (en) | 2000-07-24 | 2007-06-05 | Gesturetek, Inc. | Video-based image control system |
| US7058204B2 (en) | 2000-10-03 | 2006-06-06 | Gesturetek, Inc. | Multiple camera control system |
| US7039676B1 (en) | 2000-10-31 | 2006-05-02 | International Business Machines Corporation | Using video image analysis to automatically transmit gestures over a network in a chat or instant messaging session |
| US6906793B2 (en) * | 2000-12-11 | 2005-06-14 | Canesta, Inc. | Methods and devices for charge management for three-dimensional sensing |
| EP1356664A4 (fr) * | 2000-12-11 | 2009-07-22 | Canesta Inc | Prise d'image tridimensionnelle compatible avec cmos faisant appel a une modulation du rendement quantique |
| US6539931B2 (en) | 2001-04-16 | 2003-04-01 | Koninklijke Philips Electronics N.V. | Ball throwing assistant |
| US8035612B2 (en) | 2002-05-28 | 2011-10-11 | Intellectual Ventures Holding 67 Llc | Self-contained interactive video display system |
| US7259747B2 (en) | 2001-06-05 | 2007-08-21 | Reactrix Systems, Inc. | Interactive video display system |
| JP3420221B2 (ja) | 2001-06-29 | 2003-06-23 | 株式会社コナミコンピュータエンタテインメント東京 | ゲーム装置及びプログラム |
| US6937742B2 (en) | 2001-09-28 | 2005-08-30 | Bellsouth Intellectual Property Corporation | Gesture activated home appliance |
| EP1497160B2 (fr) | 2002-04-19 | 2010-07-21 | IEE INTERNATIONAL ELECTRONICS & ENGINEERING S.A. | Dispositif de securite pour vehicule |
| US7710391B2 (en) | 2002-05-28 | 2010-05-04 | Matthew Bell | Processing an image utilizing a spatially varying pattern |
| US7170492B2 (en) | 2002-05-28 | 2007-01-30 | Reactrix Systems, Inc. | Interactive video display system |
| US7348963B2 (en) | 2002-05-28 | 2008-03-25 | Reactrix Systems, Inc. | Interactive video display system |
| US7489812B2 (en) | 2002-06-07 | 2009-02-10 | Dynamic Digital Depth Research Pty Ltd. | Conversion and encoding techniques |
| EP1576385A2 (fr) | 2002-11-26 | 2005-09-21 | James F. Munro | Procedes et appareil de mesure de haute precision de la distance et de la vitesse |
| US7576727B2 (en) | 2002-12-13 | 2009-08-18 | Matthew Bell | Interactive directed light/sound system |
| JP4235729B2 (ja) | 2003-02-03 | 2009-03-11 | 国立大学法人静岡大学 | 距離画像センサ |
| EP1477924B1 (fr) | 2003-03-31 | 2007-05-02 | HONDA MOTOR CO., Ltd. | Appareil, procédé et logiciel de reconnaissance des gestes |
| US8072470B2 (en) | 2003-05-29 | 2011-12-06 | Sony Computer Entertainment Inc. | System and method for providing a real-time three-dimensional interactive environment |
| US7372977B2 (en) | 2003-05-29 | 2008-05-13 | Honda Motor Co., Ltd. | Visual tracking using depth data |
| JP4546956B2 (ja) | 2003-06-12 | 2010-09-22 | 本田技研工業株式会社 | 奥行き検出を用いた対象の向きの推定 |
| WO2005041579A2 (fr) | 2003-10-24 | 2005-05-06 | Reactrix Systems, Inc. | Procede et systeme pour traiter des informations d'image capturee dans un systeme d'affichage video interactif |
| US7379563B2 (en) | 2004-04-15 | 2008-05-27 | Gesturetek, Inc. | Tracking bimanual movements |
| US7308112B2 (en) | 2004-05-14 | 2007-12-11 | Honda Motor Co., Ltd. | Sign based human-machine interaction |
| US7704135B2 (en) | 2004-08-23 | 2010-04-27 | Harrison Jr Shelton E | Integrated game system, method, and device |
| KR20060070280A (ko) | 2004-12-20 | 2006-06-23 | 한국전자통신연구원 | 손 제스처 인식을 이용한 사용자 인터페이스 장치 및 그방법 |
| JP2008537190A (ja) | 2005-01-07 | 2008-09-11 | ジェスチャー テック,インコーポレイテッド | 赤外線パターンを照射することによる対象物の三次元像の生成 |
| JP5080273B2 (ja) | 2005-01-07 | 2012-11-21 | クアルコム,インコーポレイテッド | オプティカルフローに基づく傾きセンサー |
| ES2791718T3 (es) | 2005-01-07 | 2020-11-05 | Qualcomm Inc | Detección y seguimiento de objetos en imágenes |
| US7598942B2 (en) | 2005-02-08 | 2009-10-06 | Oblong Industries, Inc. | System and method for gesture based control system |
| JP4686595B2 (ja) | 2005-03-17 | 2011-05-25 | 本田技研工業株式会社 | クリティカルポイント解析に基づくポーズ推定 |
| BRPI0613165A2 (pt) | 2005-05-17 | 2010-12-21 | Gesturetek Inc | saìda de sinal sensìvel à orientação |
| ATE412882T1 (de) | 2005-08-12 | 2008-11-15 | Mesa Imaging Ag | Hochempfindliches, schnelles pixel für anwendung in einem bildsensor |
| US20080026838A1 (en) | 2005-08-22 | 2008-01-31 | Dunstan James E | Multi-player non-role-playing virtual world games: method for two-way interaction between participants and multi-player virtual world games |
| US7450736B2 (en) | 2005-10-28 | 2008-11-11 | Honda Motor Co., Ltd. | Monocular tracking of 3D human motion with a coordinated mixture of factor analyzers |
| EP1793243A1 (fr) * | 2005-12-05 | 2007-06-06 | Leica Geosystems AG | Procédé destiné à la résolution d'une ambiguïté de phase |
| JP4828245B2 (ja) * | 2006-02-02 | 2011-11-30 | 株式会社 ソキア・トプコン | 光波距離計 |
| WO2008005516A2 (fr) * | 2006-07-06 | 2008-01-10 | Canesta, Inc. | Procédé et système d'étalonnage rapide pour capteurs tridimensionnels (3d) |
| US7701439B2 (en) | 2006-07-13 | 2010-04-20 | Northrop Grumman Corporation | Gesture recognition simulation system and method |
| EP1901093B1 (fr) | 2006-09-15 | 2018-11-14 | Triple-IN Holding AG | Réception d'images distantes |
| JP5395323B2 (ja) | 2006-09-29 | 2014-01-22 | ブレインビジョン株式会社 | 固体撮像素子 |
| US7791715B1 (en) * | 2006-10-02 | 2010-09-07 | Canesta, Inc. | Method and system for lossless dealiasing in time-of-flight (TOF) systems |
| US7412077B2 (en) | 2006-12-29 | 2008-08-12 | Motorola, Inc. | Apparatus and methods for head pose estimation and head gesture detection |
| US7729530B2 (en) | 2007-03-03 | 2010-06-01 | Sergey Antonov | Method and apparatus for 3-D data input to a personal computer with a multimedia oriented operating system |
| US7852262B2 (en) | 2007-08-16 | 2010-12-14 | Cybernet Systems Corporation | Wireless mobile indoor/outdoor tracking system |
| US8629976B2 (en) * | 2007-10-02 | 2014-01-14 | Microsoft Corporation | Methods and systems for hierarchical de-aliasing time-of-flight (TOF) systems |
| CN101254344B (zh) | 2008-04-18 | 2010-06-16 | 李刚 | 场地方位与显示屏点阵按比例相对应的游戏装置和方法 |
-
2011
- 2011-02-04 US US13/021,484 patent/US8629976B2/en active Active
- 2011-07-21 CN CN2011102170164A patent/CN102393515B/zh not_active Expired - Fee Related
- 2011-07-21 JP JP2013520860A patent/JP5918763B2/ja active Active
- 2011-07-21 WO PCT/US2011/044800 patent/WO2012012607A2/fr not_active Ceased
- 2011-07-21 EP EP11810389.4A patent/EP2596321B1/fr not_active Not-in-force
- 2011-07-21 KR KR1020137001577A patent/KR101824753B1/ko active Active
-
2013
- 2013-01-08 IL IL224134A patent/IL224134A/en active IP Right Grant
Non-Patent Citations (1)
| Title |
|---|
| None |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10397552B2 (en) | 2013-12-24 | 2019-08-27 | Sony Depthsensing Solutions Sa/Nv | Time-of-flight camera system |
| US10638118B2 (en) | 2013-12-24 | 2020-04-28 | Sony Depthsensing Solutions Sa/Nv | Time-of-flight camera system |
| US11172186B2 (en) | 2013-12-24 | 2021-11-09 | Sony Depthsensing Solutions Sa/Nv | Time-Of-Flight camera system |
| US11863734B2 (en) | 2013-12-24 | 2024-01-02 | Sony Depthsensing Solutions Sa/Nv | Time-of-flight camera system |
| US12219119B2 (en) | 2013-12-24 | 2025-02-04 | Sony Depthsensing Solutions Sa/Nv | Time-of-flight camera system |
| CN107636488A (zh) * | 2015-07-20 | 2018-01-26 | 谷歌有限责任公司 | 用于提高飞行时间像素阵列的分辨率的方法和设备 |
| US10545239B2 (en) | 2015-07-31 | 2020-01-28 | Panasonic Intellectual Property Management Co., Ltd. | Distance-measuring imaging device and solid-state imaging device |
| US10481263B2 (en) | 2016-03-10 | 2019-11-19 | Ricoh Company, Ltd. | Range finding apparatus, moveable apparatus, robot, three dimensional measurement apparatus, method of measuring three dimensional information, and storage medium |
| US10398006B2 (en) | 2016-03-16 | 2019-08-27 | Ricoh Company, Ltd. | Object detection apparatus and moveable apparatus |
| US10775502B2 (en) | 2016-11-10 | 2020-09-15 | Ricoh Company, Ltd | Distance-measuring apparatus, mobile object, robot, three-dimensional measuring device, surveillance camera, and distance-measuring method |
| US12248101B2 (en) | 2018-08-17 | 2025-03-11 | Sense Photonics, Inc. | Methods and systems for increasing the range of time-of-flight systems by unambiguous range toggling |
| US12498467B2 (en) | 2020-03-18 | 2025-12-16 | Ricoh Company, Ltd. | Distance-measuring apparatus and distance-measuring method |
Also Published As
| Publication number | Publication date |
|---|---|
| JP2013538342A (ja) | 2013-10-10 |
| CN102393515A (zh) | 2012-03-28 |
| EP2596321A4 (fr) | 2015-11-25 |
| US8629976B2 (en) | 2014-01-14 |
| EP2596321B1 (fr) | 2017-10-11 |
| EP2596321A2 (fr) | 2013-05-29 |
| CN102393515B (zh) | 2013-11-06 |
| IL224134A (en) | 2016-09-29 |
| KR20150007192A (ko) | 2015-01-20 |
| KR101824753B1 (ko) | 2018-02-01 |
| JP5918763B2 (ja) | 2016-05-18 |
| US20110188028A1 (en) | 2011-08-04 |
| WO2012012607A3 (fr) | 2012-05-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP2596321B1 (fr) | Procédés et systèmes pour des systèmes hiérarchiques de temps de vol (tof) d'anti-repliement | |
| US7791715B1 (en) | Method and system for lossless dealiasing in time-of-flight (TOF) systems | |
| CN103998949B (zh) | 对飞行时间信号处理的改进或与之相关的改进 | |
| US11536804B2 (en) | Glare mitigation in LIDAR applications | |
| Thiel et al. | Performance capabilities of laser scanners–an overview and measurement principle analysis | |
| US10852402B2 (en) | Phase anti-aliasing using spread-spectrum techniques in an optical distance measurement system | |
| CN106133551B (zh) | 信号谐波误差取消方法和装置 | |
| JP6261681B2 (ja) | タイムオブフライト信号の処理における又はこれに関する改良 | |
| CN112601972A (zh) | 通过无模糊范围切换增大飞行时间系统范围的方法及系统 | |
| US20120123718A1 (en) | Method and apparatus for controlling time of flight confidence map based depth noise and depth coverage range | |
| US11360214B2 (en) | Techniques for ghosting mitigation in coherent lidar systems | |
| EP3835819A1 (fr) | Appareil de calcul de plage optique et procédé de calcul de plage | |
| US11579269B2 (en) | Determining the distance of an object | |
| CN113267786A (zh) | 光学距离计算装置和扩展可测量范围的方法 | |
| US12411244B2 (en) | Time of flight sensing | |
| HK1183936A (en) | Methods and systems for hierarchical de-aliasing time-of-flight (tof) systems | |
| HK1183936B (en) | Methods and systems for hierarchical de-aliasing time-of-flight (tof) systems | |
| US20240248182A1 (en) | Method of detecting and correcting multi-path interference component in tof camera | |
| JP2006201037A (ja) | 形状測定装置 | |
| CN112630790B (zh) | 根据间接飞行时间距离计算技术计算相位角的间接飞行时间距离计算装置和方法 | |
| CN117337401A (zh) | 利用同相/正交相位(iq)处理的用于减轻相干lidar系统中的重影的技术 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 11810389 Country of ref document: EP Kind code of ref document: A2 |
|
| REEP | Request for entry into the european phase |
Ref document number: 2011810389 Country of ref document: EP |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 224134 Country of ref document: IL Ref document number: 2011810389 Country of ref document: EP |
|
| ENP | Entry into the national phase |
Ref document number: 2013520860 Country of ref document: JP Kind code of ref document: A Ref document number: 20137001577 Country of ref document: KR Kind code of ref document: A |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |