WO2019225224A1 - 時間計測装置 - Google Patents
時間計測装置 Download PDFInfo
- Publication number
- WO2019225224A1 WO2019225224A1 PCT/JP2019/016254 JP2019016254W WO2019225224A1 WO 2019225224 A1 WO2019225224 A1 WO 2019225224A1 JP 2019016254 W JP2019016254 W JP 2019016254W WO 2019225224 A1 WO2019225224 A1 WO 2019225224A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- light
- pulse
- pulses
- unit
- measuring device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/483—Details of pulse systems
- G01S7/486—Receivers
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/88—Lidar systems specially adapted for specific applications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/483—Details of pulse systems
- G01S7/486—Receivers
- G01S7/4861—Circuits for detection, sampling, integration or read-out
- G01S7/4863—Detector arrays, e.g. charge-transfer gates
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C3/00—Measuring distances in line of sight; Optical rangefinders
- G01C3/02—Details
- G01C3/06—Use of electric means to obtain final indication
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
- G01S17/06—Systems determining position data of a target
- G01S17/08—Systems determining position data of a target for measuring distance only
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
- G01S17/06—Systems determining position data of a target
- G01S17/08—Systems determining position data of a target for measuring distance only
- G01S17/10—Systems determining position data of a target for measuring distance only using transmission of interrupted, pulse-modulated waves
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/88—Lidar systems specially adapted for specific applications
- G01S17/89—Lidar systems specially adapted for specific applications for mapping or imaging
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/88—Lidar systems specially adapted for specific applications
- G01S17/89—Lidar systems specially adapted for specific applications for mapping or imaging
- G01S17/894—Three-dimensional [3D] imaging with simultaneous measurement of time-of-flight at a two-dimensional [2D] array of receiver pixels, e.g. time-of-flight cameras or flash lidar
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/483—Details of pulse systems
- G01S7/484—Transmitters
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/483—Details of pulse systems
- G01S7/486—Receivers
- G01S7/4865—Time delay measurement, e.g. time-of-flight measurement, time of arrival measurement or determining the exact position of a peak
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/483—Details of pulse systems
- G01S7/486—Receivers
- G01S7/4868—Controlling received signal intensity or exposure of sensor
Definitions
- This disclosure relates to a time measuring device that measures the time from the timing of emitting light to the timing of detecting light.
- the TOF Time Of Flight
- the TOF method light is emitted and reflected light reflected by the measurement object is detected.
- the distance to the measurement object is measured by measuring the time difference between the timing of emitting light and the timing of detecting reflected light (for example, Patent Document 1).
- the first time measurement device includes a pixel, a timing detection unit, a pulse number detection unit, and a control unit.
- the pixel has a light receiving element, and can generate a pulse signal including a logic pulse based on a light reception result in the light receiving element.
- the timing detector can detect the light reception timing in the light receiving element based on the pulse signal.
- the pulse number detection unit can detect the number of logic pulses included in the pulse signal.
- the control unit is capable of controlling the operation of the light source that emits a plurality of light pulses based on the number of pulses.
- the second time measurement device includes a first pixel, a second pixel, a timing detection unit, a pulse number detection unit, and a control unit.
- the first pixel includes a first light receiving element, and can generate a first pulse signal including a logic pulse based on a light reception result in the first light receiving element.
- the second pixel has a second light receiving element, and can generate a second pulse signal including a logic pulse based on a light reception result in the second light receiving element.
- the timing detector can detect the light reception timing of the first light receiving element based on the first pulse signal.
- the pulse number detection unit can detect the number of logic pulses included in the second pulse signal.
- the control unit is capable of controlling the operation of the light source that emits a plurality of light pulses based on the number of pulses.
- a pulse signal including a logic pulse is generated based on the light reception result in the light receiving element, and the light reception timing in the light receiving element is detected based on the pulse signal.
- the number of logic pulses included in the pulse signal is detected, and the operation of the light source that emits a plurality of light pulses is controlled based on the number of pulses.
- a first pulse signal including a logic pulse is generated based on a light reception result in the first light receiving element, and based on the first pulse signal.
- the light receiving timing in the first light receiving element is detected.
- a second pulse signal including a logic pulse is generated based on the light reception result in the second light receiving element.
- the number of logic pulses included in the second pulse signal is detected, and the operation of the light source that emits a plurality of light pulses is controlled based on the number of pulses.
- the operation of the light source is controlled based on the number of logic pulses included in the pulse signal. Electric power can be reduced.
- the effect described here is not necessarily limited, and there may be any effect described in the present disclosure.
- FIG. 3 is a circuit diagram illustrating a configuration example of a pixel array illustrated in FIG. 2.
- FIG. 4 is a circuit diagram illustrating a configuration example of an inverter illustrated in FIG. 3.
- FIG. 3 is an explanatory diagram illustrating an example of a histogram generated by the histogram generation circuit illustrated in FIG. 2.
- FIG. 3 is an explanatory diagram illustrating an operation example of the light intensity measurement unit illustrated in FIG. 2. It is explanatory drawing showing the other operation example of the light intensity measurement part shown in FIG.
- FIG. 3 is a timing waveform diagram illustrating an operation example of the time measuring device illustrated in FIG. 1. It is a timing diagram showing an example of operation of a time measuring device in a dark environment. It is a timing diagram showing an operation example of the time measuring device in a bright environment. It is explanatory drawing showing an example of the histogram in a dark environment. It is explanatory drawing showing an example of the histogram in a bright environment. It is explanatory drawing showing an example of the histogram which concerns on a comparative example.
- FIG. 17 is a block diagram illustrating a configuration example of a sensor unit illustrated in FIG. 16. It is a block diagram showing the example of 1 structure of the time measuring device which concerns on another modification.
- FIG. 19 is a block diagram illustrating a configuration example of a sensor unit illustrated in FIG. 18. It is a block diagram showing the example of 1 structure of the sensor part which concerns on another modification. It is a block diagram showing the example of 1 structure of the sensor part which concerns on another modification.
- FIG. 30 is a block diagram illustrating a configuration example of an imaging unit illustrated in FIG. 29.
- FIG. 31 is an explanatory diagram illustrating an exemplary arrangement of pixels in the pixel array illustrated in FIG. 30.
- FIG. 1 illustrates a configuration example of a time measuring device (time measuring device 1) according to the first embodiment.
- the time measuring device 1 emits light, detects reflected light reflected by the measurement object, and measures a time difference between the timing when the light is emitted and the timing when the reflected light is detected.
- the time measuring device 1 includes a light source 11, a light source driving unit 12, a lens 13, and a sensor unit 20.
- the light source 11 emits the light pulse L1 toward the measurement object, and is configured using, for example, a pulse laser light source.
- the light source driving unit 12 drives the light source 11 based on an instruction from the sensor unit 20. Specifically, the light source driving unit 12 causes the light source 11 to emit light at a timing corresponding to the trigger pulse included in the light emission trigger signal S1, based on the light emission trigger signal S1 supplied from the sensor unit 20. To control the operation.
- the light source driving unit 12 has a function of controlling the light intensity of the light pulse L1 emitted from the light source 11 based on the light intensity control signal S2 supplied from the sensor unit 20.
- the lens 13 forms an image on the sensor surface of the sensor unit 20.
- a light pulse (reflected light pulse L2) reflected by the measurement object is incident on the lens 13.
- the sensor unit 20 generates a depth image (depth image) PIC having information on the distance to the measurement object by detecting the reflected light pulse L2. Each of the plurality of pixel values included in the depth image PIC indicates a value about the depth (depth value D).
- the sensor unit 20 outputs the generated depth image PIC.
- the sensor unit 20 also has a function of generating the light emission trigger signal S1 and the light intensity control signal S2, and supplying the light emission trigger signal S1 and the light intensity control signal S2 to the light source driving unit 12.
- FIG. 2 shows a configuration example of the sensor unit 20.
- the sensor unit 20 includes a pixel array 21, a selection signal generation unit 22, a counter unit 123, a time measurement unit 124, a histogram generation unit 125, a processing unit 26, and a control unit 27.
- the pixel array 21 has a plurality of pixels PZ arranged in a matrix.
- FIG. 3 shows a configuration example of the pixel array 21.
- the pixel array 21 has a plurality of selection lines SEL and a plurality of signal lines SGL. Each of the plurality of selection lines SEL extends in the vertical direction in FIGS. 2 and 3, and one end is connected to the selection signal generation unit 22 as illustrated in FIG. 2.
- a selection signal SSEL is applied to the selection line SEL by the selection signal generator 22.
- Each of the plurality of signal lines SGL extends in the horizontal direction in FIGS. 2 and 3, and one end is connected to the counter unit 123 and the time measurement unit 124 as illustrated in FIG. 2.
- the pixel PZ includes a light receiving element 31, transistors 32 and 33, and an inverter 34.
- the light receiving element 31 is a photodiode that detects light, and is configured using, for example, a single photon avalanche diode (SPAD).
- the cathode of the light receiving element 31 is connected to the drains of the transistors 32 and 33 and the input terminal of the inverter 34, and a predetermined bias voltage Vbias is supplied to the anode.
- the transistor 32 is a P-type MOS (Metal Oxide Semiconductor) transistor, the power supply voltage Vdd is supplied to the source, the voltage Vg1 is supplied to the gate, the drain is the cathode of the light receiving element 31, the drain of the transistor 33, And connected to the input terminal of the inverter 34.
- the transistor 32 functions as a constant current source that causes a predetermined current corresponding to the voltage Vg1 to flow through the light receiving element 31. Further, when the pixel array 21 does not operate, the voltage Vg1 is at a high level, whereby the transistor 32 is set to an off state.
- the transistor 33 is an N-type MOS transistor, the source is grounded, the gate is supplied with the voltage Vg2, and the drain is connected to the cathode of the light receiving element 31, the drain of the transistor 32, and the input terminal of the inverter 34. .
- the voltage Vg2 is at a low level, thereby setting the transistor 33 in the off state.
- the voltage Vg2 is at a high level, so that the transistor 33 is set to an on state.
- the inverter 34 inverts the voltage at the input terminal and outputs the inverted voltage from the output terminal.
- the inverter 34 also has a function of setting the output impedance to high impedance based on the selection signal SSEL input to the control terminal.
- the input terminal of the inverter 34 is connected to the cathode of the light receiving element 31 and the drains of the transistors 32 and 33, the control terminal is connected to the selection line SEL, and the output terminal is connected to the signal line SGL.
- FIG. 4 shows a configuration example of the inverter 34.
- the inverter 34 includes transistors 35 to 38 and an inverter 39.
- Transistors 35 and 36 are P-type MOS transistors.
- the power supply voltage Vdd is supplied to the source of the transistor 35, the gate is connected to the output terminal of the inverter 39, and the drain is connected to the source of the transistor 36.
- the source of the transistor 36 is connected to the drain of the transistor 35, the gate is connected to the input terminal of the inverter 34, and the drain is connected to the output terminal of the inverter 34.
- the transistors 37 and 38 are N-type MOS transistors. The drain of the transistor 37 is connected to the output terminal of the inverter 34, the gate is connected to the input terminal of the inverter 34, and the source is connected to the drain of the transistor 38.
- the drain of the transistor 38 is connected to the source of the transistor 37, the gate is connected to the control terminal of the inverter 34, and the source is grounded.
- the input terminal of the inverter 39 is connected to the control terminal of the inverter 34, and the output terminal is connected to the gate of the transistor 35.
- the inverter 34 inverts the voltage at the input terminal and outputs the inverted voltage from the output terminal. Further, the inverter 34 sets the output impedance to a high impedance when the voltage of the selection signal SSEL input to the control terminal is at a low level.
- the pixels PZ for one column among the plurality of pixels PZ are selected based on the selection signal SSEL.
- the selection signal generator 22 sets the voltage of one selection signal SSEL among the plurality of selection signals SSEL to a high level, so that the selection line SEL to which the selection signal SSEL at the high level is supplied.
- a row of pixels PZ connected to is selected.
- the selected pixel PZ when a light pulse (reflected light pulse L2) enters the light receiving element 31, a current flows through the light receiving element 31, and the voltage at the cathode of the light receiving element 31 decreases transiently.
- the inverter 34 outputs the pulse PU from the output terminal based on the voltage at the cathode of the light receiving element 31.
- the selected pixel PZ outputs the pixel signal SIG including the pulse PU corresponding to the incident reflected light pulse L2.
- the selection signal generation unit 22 (FIG. 2) generates a plurality of selection signals SSEL based on the control signal supplied from the control unit 27, and uses the plurality of selection signals SSEL as a plurality of pixels PZ in the pixel array 21. Are supplied to each of the columns.
- the selection signal generator 22 sequentially selects the plurality of pixels PZ in units of columns by sequentially setting the voltage of one selection signal SSEL among the plurality of selection signals SSEL to a high level.
- the counter unit 123 includes a plurality of counters 23 (counters 23 (1), 23 (2), 23 (3),).
- the plurality of counters 23 are respectively connected to the plurality of signal lines SGL in the pixel array 21.
- Each of the plurality of counters 23 counts the number of pulses PU included in the pixel signal SIG supplied from the pixel array 21 via the signal line SGL based on the control signal supplied from the control unit 27. .
- the counter unit 123 supplies the count results (count values CNT) in the plurality of counters 23 to the control unit 27.
- the time measuring unit 124 includes a plurality of TDCs (Time-to-Digital Converters) 24 (TDCs 24 (1), 24 (2), 24 (3), etc.
- the plurality of TDCs 24 are respectively connected to the plurality of signal lines SGL in the pixel array 21.
- Each of the plurality of TDCs 24 measures the timing of the pulse PU included in the pixel signal SIG supplied from the pixel array 21 via the signal line SGL based on the control signal supplied from the control unit 27.
- the TDC 24 starts counting the clock pulses of the clock signal CK supplied from the control unit 27 based on the start signal STT supplied from the control unit 27.
- the TDC 24 outputs the count value at that time.
- the timing indicated by the start signal STT corresponds to the light emission timing of the light source 11. Therefore, the count value output by the TDC 24 corresponds to the time difference between the timing at which the light source 11 emits the light pulse L1 and the timing at which the pixel PZ detects the reflected light pulse L2, in other words, with the time measuring device 1. It corresponds to the distance between the measurement object. That is, the count value output by the TDC 24 is the depth value D. In this way, the time measuring unit 124 outputs the depth value D every time the pulse PU appears in the pixel signal SIG.
- the histogram generation unit 125 includes a plurality of histogram generation circuits 25 (histogram generation circuits 25 (1), 25 (2), 25 (3),).
- the plurality of histogram generation circuits 25 are provided corresponding to the plurality of TDCs 24, respectively.
- the histogram generation circuit 25 (1) generates a histogram HY of the depth value D supplied from the TDC 24 (1) based on the control signal supplied from the control unit 27.
- the histogram generation circuit 25 (2) generates the histogram HY of the depth value D supplied from the TDC 24 (2) based on the control signal supplied from the control unit 27. The same applies to the other histogram generation circuits 25.
- FIG. 5 shows an example of the histogram HY generated by the histogram generation circuit 25.
- the horizontal axis indicates the depth value D, and the vertical axis indicates the frequency at which the depth value D appears.
- the histogram HY has a peak W1 and a floor W2 other than that.
- the peak W1 is based on the pulse PU corresponding to the reflected light pulse L2.
- the center value D1 of the peak W1 corresponds to the time difference between the timing at which the light source 11 emits the light pulse L1 and the timing at which the pixel PZ detects the reflected light pulse L2, for example.
- the center value D1 is a desired depth value D that the time measuring device 1 should measure.
- the height of the peak W1 can be increased by increasing the light intensity of the light pulse L1 emitted from the light source 11, for example.
- the floor W2 is based on the pulse PU generated at random timing. That is, since the ambient light is incident on each pixel PZ in addition to the reflected light pulse L2, each pixel PZ generates a pulse PU corresponding to the ambient light. Further, in each pixel PZ, even when light is not incident, for example, a pulse PU corresponding to a so-called dark current may be generated. Since these pulses PU are generated at random timings, they appear as a floor W2 in the histogram HY as shown in FIG. For example, the floor W2 is low in a dark environment, and the floor W2 is high in a bright environment. When the position of the peak W1 is detected, the floor W2 becomes noise, so it is desirable that the floor W2 is low. In the time measuring device 1, as will be described later, the light intensity of the light pulse L1 is set so that the height of the peak W1 exceeds the floor W2 and the height of the peak W1 is not too high compared to the floor W2. Is to be adjusted.
- Each of the plurality of histogram generation circuits 25 generates such a histogram HY.
- the histogram generation unit 125 supplies information about the histogram HY generated by the histogram generation circuit 25 (for example, the center value D1 of each histogram HY) to the processing unit 26.
- the processing unit 26 generates the depth image PIC based on the control signal supplied from the control unit 27 and the information about the plurality of histograms HY supplied from the histogram generation unit 125. Each of the plurality of pixel values included in the depth image PIC indicates a value about the depth (depth value D). The processing unit 26 outputs the generated depth image PIC.
- the control unit 27 supplies control signals to the selection signal generation unit 22, the counter unit 123, the time measurement unit 124, the histogram generation unit 125, and the processing unit 26, and the light emission trigger signal S ⁇ b> 1 to the light source driving unit 12. Further, the operation of the time measuring device 1 is controlled by supplying the light intensity control signal S2.
- the control unit 27 includes a light emission timing setting unit 28 and a light intensity setting unit 29.
- the light emission timing setting unit 28 generates a light emission trigger signal S1 that indicates the light emission timing of the light source 11.
- the light emission trigger signal S1 includes a plurality of trigger pulses.
- the control unit 27 supplies the light emission trigger signal S1 to the light source driving unit 12 so that the light source 11 emits light at a timing corresponding to the trigger pulse included in the light emission trigger signal S1. It comes to control.
- the light intensity setting unit 29 generates a light intensity control signal S2 that indicates the light intensity of the light pulse L1 based on the plurality of count values CNT supplied from the counter unit 123.
- the count value CNT includes not only the number of pulses PU corresponding to the reflected light pulse L2, but also the number of pulses PU corresponding to ambient light or dark current. Therefore, when the count value CNT is small, the floor W2 is low, and when the count value CNT is large, the floor W2 is high.
- the light intensity setting unit 29 generates a light intensity control signal S2 that indicates the light intensity of the light pulse L1 based on such a count value CNT.
- the control unit 27 supplies the light intensity control signal S2 to the light source driving unit 12, so that the light source 11 emits a light pulse L1 having a light intensity corresponding to the light intensity control signal S2. It is designed to control the operation.
- the light intensity setting unit 29 sets the light intensity of the light pulse L1 based on, for example, the maximum value (maximum count value CNTmax) of the plurality of count values CNT for all the pixels PZ.
- FIG. 6A shows an operation example of the light intensity setting unit 29.
- the horizontal axis represents the maximum count value CNTmax
- the vertical axis represents the light intensity of the light pulse L1.
- the maximum count value CNTmax is not less than the value C1 and not more than the value C2
- the light intensity increases linearly as the maximum count value CNTmax increases.
- the light intensity does not change when the maximum count value CNTmax is smaller than the value C1, and similarly, does not change when the maximum count value CNTmax is larger than the value C2.
- FIG. 6B and 6C show another example of the operation of the light intensity setting unit 29.
- the light intensity may be increased stepwise as the maximum count value increases.
- the relationship between the light intensity and the maximum count value CNTmax may be a relationship other than a linear function.
- the light intensity setting unit 29 decreases the light intensity of the light pulse L1 when the maximum count value CNTmax is small, and increases the light intensity of the light pulse L1 when the maximum count value CNTmax is large. Thereby, in the time measuring device 1, for example, when the floor W2 is low, the light intensity of the light pulse L1 can be reduced, and when the floor W2 is high, the light intensity of the light pulse L1 can be increased.
- the height of the peak W1 exceeds the floor W2, and the height of the peak W1 reaches the floor W2.
- the light intensity of the light pulse L1 is adjusted so as not to be too high. Thereby, in the time measuring device 1, power consumption can be reduced effectively.
- FIG. 7 shows an example of mounting the sensor unit 20.
- the sensor unit 20 is formed on two semiconductor substrates 111 and 112.
- a plurality of light receiving elements 31 included in the pixel array 21 are formed on the semiconductor substrate 111, and elements other than the plurality of light receiving elements 31 in the pixel array 21, a counter unit 123, a time measuring unit 124, a histogram are formed on the semiconductor substrate 112.
- a generation unit 125, a processing unit 26, and a control unit 27 are formed.
- the semiconductor substrates 111 and 112 are overlapped with each other and are electrically connected to each other through, for example, a so-called TCV (Through Chip Via).
- the sensor unit 20 is formed on the two semiconductor substrates 111 and 112.
- the present invention is not limited to this.
- the sensor unit 20 and the light source driving unit 12 may be replaced with 2 It may be formed on a single semiconductor substrate 111, 112.
- the light source driving unit 12 can be formed on the semiconductor substrate 112, for example.
- the sensor unit 20 may be formed on one semiconductor substrate.
- the pixel PZ corresponds to a specific example of “pixel” in the present disclosure.
- the pixel signal SIG corresponds to a specific example of “pulse signal” in the present disclosure.
- the time measurement unit 124 corresponds to a specific example of “timing detection unit” in the present disclosure.
- the counter unit 123 corresponds to a specific example of a “pulse number detection unit” in the present disclosure.
- the control unit 27 corresponds to a specific example of “control unit” in the present disclosure.
- the light source 11 emits a light pulse L1 toward the measurement object.
- the light source drive unit 12 controls the operation of the light source 11 based on the light emission trigger signal S1 supplied from the sensor unit 20 so that the light source 11 emits light at a timing corresponding to the trigger pulse included in the light emission trigger signal S1.
- the light source driving unit 12 controls the light intensity of the light pulse L1 emitted from the light source 11 based on the light intensity control signal S2 supplied from the sensor unit 20.
- the sensor unit 20 generates a depth image PIC by detecting the reflected light pulse L2.
- the selection signal generation unit 22 generates a plurality of selection signals SSEL based on the control signal supplied from the control unit 27, thereby sequentially selecting the plurality of pixels PZ in units of columns.
- the selected pixel PZ of the pixel array 21 outputs a pixel signal SIG including a pulse PU corresponding to the incident reflected light pulse L2.
- the counter 23 of the counter unit 123 counts the number of pulses PU included in the pixel signal SIG based on the control signal supplied from the control unit 27.
- the TDC 24 of the time measuring unit 124 generates the depth value D by measuring the timing of the pulse PU included in the pixel signal SIG based on the control signal supplied from the control unit 27.
- the histogram generation circuit 25 of the histogram generation unit 125 generates a histogram HY of the depth value D supplied from the TDC 24 based on the control signal supplied from the control unit 27.
- the processing unit 26 generates the depth image PIC based on the control signal supplied from the control unit 27 and the information about the plurality of histograms HY supplied from the histogram generation unit 125.
- the control unit 27 supplies control signals to the selection signal generation unit 22, the counter unit 123, the time measurement unit 124, the histogram generation unit 125, and the processing unit 26, and the light emission trigger signal S ⁇ b> 1 to the light source driving unit 12. Further, the operation of the time measuring device 1 is controlled by supplying the light intensity control signal S2.
- FIG. 8 shows an example of the operation of the time measuring device 1, (A) shows the waveform of the emitted light emitted from the light source 11, and (B) shows the pixels in the first column from the left in the pixel array 21.
- the operation of PZ (1) is shown
- (C) shows the operation of the pixel PZ (2) in the second column from the left in the pixel array 21, and
- (D) shows the pixel PZ (in the third column from the left in the pixel array 21).
- 3E illustrates the operation of the pixel PZ (N) in the rightmost column (Nth column) in the pixel array 21, and
- FIG. 5F illustrates the operation of the counter unit 123.
- the shaded portion indicates that the pixel PZ is selected, and the non-shaded portion indicates that the pixel PZ is not selected.
- the shaded portion indicates that the counter unit 123 is performing a counting operation, and the unshaded portion indicates that the counter unit 123 is not performing a counting operation. Show.
- the selection signal generation unit 22 selects the pixel PZ (1) in the first column in the period from the timing t1 to the timing t3 (FIG. 8B). Then, the light source driving unit 12 emits the light pulse L1 a plurality of times (for example, 1000 times) at a predetermined light emission period (light emission period T) during the period from the timing t1 to t3 based on the light emission trigger signal S1. Thus, the operation of the light source 11 is controlled (FIG. 8A). Thereby, the pixel PZ (1) outputs the pixel signal SIG including the pulse PU corresponding to the incident reflected light pulse L2.
- the TDC 24 of the time measuring unit 124 generates a depth value D every time a pulse PU appears in the pixel signal SIG.
- the histogram generation circuit 25 of the histogram generation unit 125 generates a histogram HY of the depth value D supplied from the TDC 24 and supplies information about the histogram HY to the processing unit 26.
- the counter 23 of the counter unit 123 counts the number of pulses PU included in the pixel signal SIG during the period from timing t1 to t2.
- the length of the count period (period t1 to t2) in which the counter 23 performs the count operation is set to a time longer than the time corresponding to the period (light emission period T) at which the light source 11 emits the light pulse L1.
- the counter unit 123 supplies the count results (count value CNT) in the plurality of counters 23 to the light intensity setting unit 29 of the control unit 27.
- FIG. 9 illustrates an operation example of the time measuring device 1 when the time measuring device 1 is operated in a dark environment
- FIG. 10 illustrates a case where the time measuring device 1 is operated in a bright environment.
- An example of the operation of the time measuring device 1 is shown. 9 and 10, (A) shows the histogram HY, (B) shows the waveform of the emitted light emitted from the light source 11, and (C) shows the waveform of the pixel signal SIG.
- the light source 11 emits the light pulse L1 at the timing t11
- the pixel PZ detects the reflected light pulse L2 at the timing t12, and generates a pulse PU (pulse PU1) corresponding to the reflected light pulse L2.
- the histogram HY has a peak W1 at the position of the depth value D corresponding to the timing t12.
- the pixel PZ In the period from the timing t11 to t13, the pixel PZ generates a pulse PU corresponding to the ambient light or dark current at random timing.
- the time measuring device 1 since the time measuring device 1 is operated in a dark environment, the appearance frequency of the pulse PU corresponding to ambient light or dark current is low.
- the time measuring device 1 is operated in a bright environment. Since it is operated, the appearance frequency of the pulse PU corresponding to the ambient light and dark current is high. Thereby, in the example of FIG. 9, the floor W2 becomes low, and in the example of FIG. 10, the floor W2 becomes high.
- the selection signal generator 22 selects the pixel PZ (2) in the second column (FIG. 8C). Then, the light source driving unit 12 emits the light pulse L1 a plurality of times (for example, 1000 times) at a predetermined light emission period (light emission period T) during the period from the timing t3 to t5 based on the light emission trigger signal S1. Thus, the operation of the light source 11 is controlled (FIG. 8A). Thereby, the pixel PZ (2) outputs the pixel signal SIG including the pulse PU corresponding to the incident reflected light pulse L2. The TDC 24 generates a depth value D every time a pulse PU appears in the pixel signal SIG. The histogram generation circuit 25 generates a histogram HY of the depth value D supplied from the TDC 24 and supplies information about the histogram HY to the processing unit 26.
- the counter 23 of the counter unit 123 counts the number of pulses PU included in the pixel signal SIG during the period from the timing t3 to t4. Then, the counter unit 123 supplies the count results (count value CNT) in the plurality of counters 23 to the light intensity setting unit 29 of the control unit 27.
- the sensor unit 20 sequentially selects a plurality of pixels PZ in units of columns in the period from the timing t1 to the time t7 (frame period F), and the histogram generation unit 125 selects all the pixels PZ in the pixel array 21.
- the counter H123 generates a count value CNT for all the pixels PZ in the pixel array 21.
- the process part 26 produces
- the light intensity setting unit 29 of the control unit 27 generates a light intensity control signal S2 based on the count values CNT for all the pixels PZ and supplies the light intensity control signal S2 to the light source driving unit 12. As a result, as shown in FIG. 8A, the light intensity of the light pulse L1 emitted in the next frame period F starting from the timing t7 is set.
- the light intensity setting unit 29 sets the light intensity of the light pulse L1 based on the plurality of count values CNT. Specifically, as shown in FIG. 6A, the light intensity setting unit 29 reduces the light intensity of the light pulse L1 when the maximum count value CNTmax is small, and when the maximum count value CNTmax is large, The light intensity of the light pulse L1 is increased. Thereby, in the time measuring device 1, power consumption can be reduced effectively. This operation will be described in detail below.
- FIG. 11 shows a histogram HY when the time measuring device 1 is operated in a dark environment
- FIG. 12 shows a histogram HY when the time measuring device 1 is operated in a bright environment.
- the light intensity setting unit 29 obtains the maximum value (maximum count value CNTmax) of the count values CNT based on the count values CNT for all the pixels PZ obtained in a certain frame period F. This maximum count value CNTmax is smaller than the maximum count value CNTmax when the time measuring device 1 is operated in a bright environment.
- the light intensity setting unit 29 sets the light intensity of the light pulse L1 in the next frame period F based on the maximum count value CNTmax.
- the light intensity setting unit 29 decreases the light intensity of the light pulse L1, as shown in FIG. 6A. Thereby, in the time measuring device 1, as shown in FIG. 11, the height of the peak W1 can be prevented from becoming too high compared to the floor W2.
- the light intensity setting unit 29 obtains the maximum value (maximum count value CNTmax) of the count values CNT based on the count values CNT for all the pixels PZ obtained in a certain frame period F.
- the maximum count value CNTmax is larger than the maximum count value CNTmax when the time measuring device 1 is operated in a dark environment.
- the light intensity setting unit 29 sets the light intensity of the light pulse L1 in the next frame period F based on the maximum count value CNTmax.
- the light intensity setting unit 29 increases the light intensity of the light pulse L1, as shown in FIG. 6A. Thereby, in the time measuring device 1, as shown in FIG. 12, the height of the peak W1 is made to exceed the floor W2.
- the light intensity of the light pulse L1 is adjusted based on the count value CNT supplied from the counter unit 123. Specifically, as shown in FIG. 6A, for example, the light intensity setting unit 29 reduces the light intensity of the light pulse L1 when the maximum count value CNTmax is small, and reduces the light intensity when the maximum count value CNTmax is large. The light intensity of the pulse L1 was increased. Thereby, in the time measuring device 1, the light intensity of the light pulse L1 is adjusted so that the height of the peak W1 exceeds the floor W2 and the height of the peak W1 does not become too high compared to the floor W2. can do. As a result, the time measuring device 1 can effectively reduce power consumption.
- the time measuring device 1 when the time measuring device 1 is operated in a dark environment, when the light intensity of the light pulse L1 is the same as that in the bright environment, as shown in FIG.
- the height of the peak W1 may be too high with respect to W2.
- the light source 11 consumes a lot of power.
- the light intensity of the light pulse L1 is adjusted based on the plurality of count values CNT supplied from the counter unit 123. Therefore, as shown in FIG. Can be prevented from becoming too high compared to the floor W2.
- the time measuring device 1 since the light intensity of the light pulse L1 can be set to the minimum necessary light intensity according to the floor W2, the power consumed in the light source 11 can be suppressed, As a result, power consumption can be effectively reduced.
- the light intensity setting unit 29 adjusts the light intensity of the light pulse L1 based on the maximum value (maximum count value CNTmax) of the count value CNT for all the pixels PZ.
- the pixel PZ related to the maximum count value CNTmax is often the pixel PZ having the highest floor W2 among all the pixels PZ. Therefore, by adjusting the light intensity of the light pulse L1 to the maximum count value CNTmax, it is possible to reduce the possibility that the peak W1 is buried in the floor W2 in the histogram HY related to some pixels PZ.
- the light intensity of the light pulse is adjusted based on the count value supplied from the counter unit, so that the power consumption can be effectively reduced.
- the possibility that the peak is buried in the floor in the histogram HY can be reduced.
- the sensor unit 20 controls the operation of the light source 11 by supplying the light emission trigger signal S1 to the light source driving unit 12.
- the light source driving unit may supply a trigger signal for instructing the operation timing to the sensor unit.
- This time measuring device 1A includes a light source driving unit 12A and a sensor unit 20A.
- the light source driving unit 12A generates a trigger signal S3 that instructs the operation timing of the sensor unit 20A, and supplies the trigger signal S3 to the sensor unit 20A.
- the sensor unit 20A operates based on the trigger signal S3.
- the light intensity of the light pulse L1 is adjusted based on the maximum value (maximum count value CNTmax) of the count value CNT for all the pixels PZ.
- the present invention is not limited to this.
- the light intensity setting unit 29 adjusts the light intensity of the light pulse L1 based on the average value of the count values CNT for all the pixels PZ. May be. In this case, for example, even when there is a defective pixel PZ, the influence on the light intensity of the defective pixel PZ can be suppressed.
- the same number of counters 23 as the number of the plurality of signal lines SGL are provided to obtain the count values CNT for all the pixels PZ.
- the present invention is not limited to this. Instead of this, for example, a smaller number of counters 23 may be provided to obtain count values CNT relating to some of the pixels PZ.
- the number of the counters 23 may be plural, or may be one, for example, like a sensor unit 20C illustrated in FIG.
- the sensor unit 20C includes a counter 23 and a control unit 27C.
- the counter 23 is connected to one of the plurality of signal lines SGL (in this example, the uppermost signal line SGL) of the pixel array 21, and based on the control signal supplied from the control unit 27 ⁇ / b> C, the pixel array 21. From this, the number of pulses PU included in the pixel signal SIG supplied via the signal line SGL is counted. Thereby, the counter 23 obtains the count value CNT concerning the plurality of pixels PZ connected to the signal line SGL. Then, the counter 23 supplies these count values CNT to the control unit 27C.
- the control unit 27C has a light intensity setting unit 29C.
- the light intensity setting unit 29C generates a light intensity control signal S2 that indicates the light intensity of the light pulse L1 based on the plurality of count values CNT supplied from the counter 23.
- the sensor unit 20 supplies the light intensity control signal S2 to the light source driving unit 12, but the present invention is not limited to this. Hereinafter, the present modification will be described with some examples.
- FIG. 16 illustrates a configuration example of the time measuring device 1D according to the present modification.
- the time measuring device 1D includes a light source driving unit 12D and a sensor unit 20D.
- the light source drive unit 12D has a light intensity setting unit 17D.
- the light intensity setting unit 17D sets the light intensity of the light pulse L1 emitted from the light source 11 based on the count value CNT supplied from the sensor unit 20D, similarly to the light intensity setting unit 29 according to the above embodiment. Is.
- FIG. 17 illustrates a configuration example of the sensor unit 20D.
- the sensor unit 20D includes a counter 23 and a control unit 27D.
- the counter 23 is connected to one of the plurality of signal lines SGL (in this example, the uppermost signal line SGL) of the pixel array 21, and based on the control signal supplied from the control unit 27 ⁇ / b> C, the pixel array 21. From this, the number of pulses PU included in the pixel signal SIG supplied via the signal line SGL is counted. Thereby, the counter 23 obtains the count value CNT concerning the plurality of pixels PZ connected to the signal line SGL. The counter 23 supplies these count values CNT to the light intensity setting unit 17D of the light source driving unit 12D.
- the control unit 27D is obtained by omitting the light intensity setting unit 29 from the control unit 27 according to the above embodiment.
- FIG. 18 shows a configuration example of the time measuring device 1E according to this modification.
- the time measuring device 1E includes a light source driving unit 12E and a sensor unit 20E.
- the light source drive unit 12E includes a counter 16E and a light intensity setting unit 17D.
- the counter 16E counts the number of pulses PU included in the pixel signal SIG, similarly to the counter 23 according to the above embodiment.
- the counter 16E supplies the count result (count value CNT) to the light intensity setting unit 17D.
- the light intensity setting unit 17D sets the light intensity of the light pulse L1 emitted from the light source 11 based on the count value CNT supplied from the counter 16E.
- FIG. 19 shows a configuration example of the sensor unit 20E.
- the sensor unit 20E has a control unit 27E.
- the sensor unit 20E supplies one of the plurality of pixel signals SIG generated by the pixel array 21 to the counter 16E of the light source driving unit 12E.
- the control unit 27E is obtained by omitting the light intensity setting unit 29 and the function of controlling the operation of the counter 23 from the control unit 27 according to the above embodiment.
- the pixel signal SIG generated by the pixel PZ for obtaining the depth value D is supplied to the counter 23, but the present invention is not limited to this. Instead of this, for example, a pixel signal SIG generated by a pixel other than the pixel PZ for obtaining the depth value D may be supplied to the counter 23 as in the sensor unit 20F shown in FIG.
- the sensor unit 20F includes a pixel array 21F and a counter 23.
- the pixel array 21F has a plurality of dummy pixels PDM.
- the circuit configuration of the dummy pixel PDM is the same as the circuit configuration of the pixel PZ (FIG. 3).
- the plurality of dummy pixels PDM are connected to one signal line SGL.
- the pixel PZ corresponds to a specific example of “first pixel” in the present disclosure.
- the dummy pixel PDM corresponds to a specific example of “second pixel” in the present disclosure.
- the counter 23 is connected to a signal line SGL to which a plurality of dummy pixels PDM are connected. The counter 23 counts the number of pulses PU included in the pixel signal SIG supplied from the dummy pixel PDM.
- a plurality of counters 23 are provided, and the light intensity of the light pulse L1 is set based on the count value CNT in these counters 23.
- the present invention is not limited to this. Instead, for example, the light intensity of the light pulse L1 may be set based on the histogram HY generated by the histogram generation circuit 25 as in the sensor unit 20G illustrated in FIG.
- the sensor unit 20G includes a histogram generation unit 125G and a control unit 27G.
- the histogram generator 125G has a function of supplying information about the floor W2 in the histogram HY generated by the plurality of histogram generators 25 to the controller 27G.
- the control unit 27G has a light intensity setting unit 29G.
- the light intensity setting unit 29G sets the light intensity of the light pulse L1 based on the information about the floor W2 supplied from the histogram generation unit 125G. Specifically, the light intensity setting unit 29G sets the light intensity of the light pulse L1 based on, for example, the highest floor W2 among the floors W2 included in the plurality of histograms HY. For example, the light intensity setting unit 29G decreases the light intensity of the light pulse L1 when the floor W2 is low, and increases the light intensity of the light pulse L1 when the floor W2 is high.
- the light intensity setting unit 29G generates a light intensity control signal S2 that indicates the light intensity of the light pulse L1 based on the set light intensity of the light pulse L1.
- the histogram generation unit 125G corresponds to a specific example of a “pulse number detection unit” in the present disclosure.
- the pixels PZ are selected in units of one column in the pixel array 21, but the present invention is not limited to this. Instead, for example, like the sensor unit 20H illustrated in FIG. 22, the pixels PZ may be selected in units of multiple columns (in this example, in units of two columns).
- the sensor unit 20H has a pixel array 21H.
- the pixel array 21H includes a plurality of selection lines SEL, a plurality of signal lines SGL, and a plurality of pixels PZ.
- the plurality of pixels PZ in the first column from the left and the plurality of pixels PZ in the second column are connected to the first selection line SEL from the left.
- the plurality of pixels PZ in the third column and the plurality of pixels PZ in the fourth column are connected to the second selection line SEL.
- the pixel PZ belonging to the odd column and the pixel PZ belonging to the even column among the plurality of pixels PZ in the first row are connected to different signal lines SGL.
- the second and subsequent lines are selected in units of two columns.
- the counter unit 123 and the time measuring unit 124 operate in the same period, but the present invention is not limited to this. Instead, for example, the counter unit 123 operates in advance to set the light intensity of the light pulse L1, and then the light source 11 generates the light pulse L1 based on the set light intensity.
- the time measuring device 1 may generate the depth image PIC.
- the time measuring device 2 according to the second embodiment will be described.
- the number of light pulses L1 is adjusted based on a plurality of count values CNT.
- symbol is attached
- FIG. 23 shows a configuration example of the time measuring device 2.
- the time measuring device 2 includes a light source driving unit 42 and a sensor unit 40.
- the light source driving unit 42 drives the light source 11 based on an instruction from the sensor unit 40. Specifically, the light source driving unit 42, based on the light emission trigger signal S1 supplied from the sensor unit 40, causes the light source 11 to emit light at a timing corresponding to the trigger pulse included in the light emission trigger signal S1. To control the operation. In this example, the number of trigger pulses changes. Thereby, in the time measuring device 2, the number of the light pulses L1 is changed.
- the sensor unit 40 generates a depth image PIC having information on the distance to the measurement object by detecting the reflected light pulse L2.
- the sensor unit 40 also has a function of generating a light emission trigger signal S1 and supplying the light emission trigger signal S1 to the light source driving unit 42.
- FIG. 24 shows a configuration example of the sensor unit 40.
- the sensor unit 40 has a control unit 47.
- the control unit 47 supplies control signals to the selection signal generation unit 22, the counter unit 123, the time measurement unit 124, the histogram generation unit 125, and the processing unit 26, and emits a light emission trigger signal S ⁇ b> 1 to the light source driving unit 42. Is used to control the operation of the time measuring device 2.
- the control unit 47 includes an optical pulse number setting unit 49 and a light emission timing setting unit 48.
- the light pulse number setting unit 49 sets the number of light pulses L1 emitted from the light source 11 based on the plurality of count values CNT supplied from the counter unit 123. Specifically, for example, the optical pulse number setting unit 49 sets the next frame based on the maximum value (maximum count value CNTmax) of the plurality of count values CNT for all the pixels PZ obtained in a certain frame period F. The number of light pulses L1 in the period F is set. For example, the light pulse number setting unit 49 reduces the number of light pulses L1 when the maximum count value CNTmax is small, and increases the number of light pulses L1 when the maximum count value CNTmax is large. .
- the light emission timing setting unit 48 generates a light emission trigger signal S1 for instructing the light emission timing in the light source 11 based on the number of light pulses L1 set by the light pulse number setting unit 49.
- FIG. 25 shows an example of the light pulse L1 generated by the light source 11 of the time measuring device 2.
- the light source 11 in the first frame period F (timing t21 to t22), the light source 11 emits the light pulse L1 at a predetermined light emission period.
- the optical pulse number setting unit 49 sets the number of optical pulses L1 to a small number.
- the light emission timing setting unit 48 sets the light emission timing in the light source 11 based on the number of light pulses L1 set by the light pulse number setting unit 49 so as to thin out the light pulses L1.
- the light source 11 emits a smaller number of light pulses L1 than the timings t21 to t22 in the next frame period F (timing t22 to t23).
- the optical pulse number setting unit 49 adjusts the number of the optical pulses L1 based on the count value CNT supplied from the counter unit 123. Specifically, the light pulse number setting unit 49 decreases the number of light pulses L1 when the maximum count value CNTmax is small, and increases the number of light pulses L1 when the maximum count value CNTmax is large. Thereby, in the time measuring device 2, like the time measuring device 1, the height of the peak W1 exceeds the floor W2, and the height of the peak W1 does not become too high compared to the floor W2. The number of light pulses L1 can be adjusted. As a result, the time measuring device 2 can effectively reduce the power consumption in the light source 11.
- the operation time of the counter unit 123 and the time measurement unit 124 is shortened, and the calculation amount in the histogram generation unit 155 and the processing unit 26 is reduced.
- the power consumption in the counter part 123, the time measurement part 124, the histogram generation part 125, and the process part 26 can be reduced effectively.
- the number of optical pulses is adjusted based on the count value supplied from the counter unit, so that power consumption can be effectively reduced.
- a time measuring device 3 according to a third embodiment will be described.
- the operation of the light source 11 is stopped when the height of the peak W1 in the histogram HY reaches the threshold value TH corresponding to the floor W2.
- symbol is attached
- the time measuring device 3 has a sensor unit 50.
- the sensor unit 50 generates a depth image PIC having information on the distance to the measurement object by detecting the reflected light pulse L2.
- the sensor unit 50 also has a function of generating a light emission trigger signal S1 and supplying the light emission trigger signal S1 to the light source driving unit 42.
- FIG. 26 shows a configuration example of the sensor unit 50.
- the sensor unit 50 includes a histogram generation unit 155 and a control unit 57.
- the histogram generation unit 155 includes a plurality of histogram generation circuits 25 (histogram generation circuits 25 (1), 25 (2), 25 (3),). Based on the threshold value TH supplied from the control unit 57, the histogram generation unit 155 determines whether or not the height of the peak W1 in the histogram HY generated by the plurality of histogram generation circuits 25 has reached this threshold value TH. Confirm. The histogram generation unit 155 generates the stop signal STP when the heights of the peaks W1 in all the histograms HY related to the pixels PZ for one column reach this threshold value TH. The histogram generation unit 155 supplies the stop signal STP to the control unit 57.
- the control unit 57 supplies control signals to the selection signal generation unit 22, the counter unit 123, the time measurement unit 124, the histogram generation unit 155, and the processing unit 26, and the light emission trigger signal S 1 to the light source driving unit 42. Is used to control the operation of the time measuring device 3.
- the control unit 57 includes a threshold setting unit 59 and a light emission timing setting unit 58.
- the threshold value setting unit 59 generates a threshold value TH based on the plurality of count values CNT supplied from the counter unit 123. Specifically, for example, the threshold setting unit 59 sets the next frame based on the maximum value (maximum count value CNTmax) of the plurality of count values CNT for all the pixels PZ obtained in a certain frame period F. The threshold value TH used in the period F is set. For example, the threshold value setting unit 59 lowers the threshold value TH when the maximum count value CNTmax is small, and increases the threshold value TH when the maximum count value CNTmax is large.
- the light emission timing setting unit 58 generates a light emission trigger signal S1 that indicates the light emission timing in the light source 11.
- the light emission timing setting unit 58 stops generation of the light emission trigger signal S1 based on the stop signal STP supplied from the histogram generation unit 155.
- FIG. 27 shows a histogram HY when the time measuring device 3 is operated in a dark environment
- FIG. 28 shows a histogram HY when the time measuring device 3 is operated in a bright environment.
- the threshold value setting unit 59 lowers the threshold value TH as shown in FIG.
- the histogram generation unit 155 causes the heights of the peaks W1 in all the histograms HY related to the pixels PZ in the first column to reach this threshold value TH.
- a stop signal STP is generated.
- the light source 11 stops generating the light pulse L1.
- the height of the peak W1 can be prevented from becoming too high compared to the floor W2.
- the time measuring device 3 when the time measuring device 3 is operated in a bright environment, the count value CNT is large, so that the threshold value setting unit 59 increases the threshold value TH as shown in FIG. Then, in the next frame period F, as shown in FIG. 28, the histogram generator 155 reaches the threshold TH with the heights of the peaks W1 in all the histograms HY related to the pixels PZ in the first column. When this happens, a stop signal STP is generated. As a result, the light source 11 stops generating the light pulse L1. The same applies to the second and subsequent columns. Thereby, in the time measuring device 3, as shown in FIG. 28, the height of the peak W1 can be made to exceed the floor W2.
- the threshold value TH is set based on the count value CNT supplied from the counter unit 123. Specifically, the threshold setting unit 59 decreases the threshold TH when the maximum count value CNTmax is small, and increases the threshold TH when the maximum count value CNTmax is large.
- the generation of the light pulse L1 is stopped when the height of the peak W1 in the histogram HY reaches the threshold value TH.
- the height of the peak W1 exceeds the floor W2, and the height of the peak W1 does not become too high compared to the floor W2.
- the number of light pulses L1 can be adjusted. As a result, the time measuring device 3 can effectively reduce the power consumption in the light source 11.
- the operation time of the counter unit 123 and the time measurement unit 124 is shortened, and the calculation amount in the histogram generation unit 155 and the processing unit 26 is reduced.
- the power consumption in the counter part 123, the time measurement part 124, the histogram generation part 155, and the process part 26 can be reduced effectively.
- a threshold value is set based on the count value supplied from the counter unit, and when the peak height in the histogram reaches this threshold value, an optical pulse is generated. Since the operation is stopped, the power consumption can be effectively reduced.
- FIG. 29 illustrates a configuration example of the imaging device 9.
- This imaging device 9 is obtained by applying the technology related to the time measuring device 1 according to the first embodiment to an imaging device. Note that the present invention is not limited to this, and the technology related to the time measuring device 2 according to the second embodiment and the technology related to the time measuring device 3 according to the third embodiment are applied to the imaging device. Also good.
- the imaging device 9 includes an imaging unit 60.
- the imaging unit 60 generates a captured image PIC2 by performing an imaging operation.
- the imaging unit 60 also has a function of generating a depth image PIC by detecting the reflected light pulse L2 when the light source 11 is operated.
- the imaging unit 60 outputs the generated captured image PIC2 and depth image PIC. Further, when generating the depth image PIC, the imaging unit 60 generates a light emission trigger signal S1 and a light intensity control signal S2, and supplies the light emission trigger signal S1 and the light intensity control signal S2 to the light source driving unit 12. It also has.
- FIG. 30 illustrates a configuration example of the imaging unit 60.
- the imaging unit 60 includes a pixel array 61, a counter unit 163, and a processing unit 66.
- the pixel array 61 has a plurality of pixels P.
- the plurality of pixels P include a plurality of red pixels PR, a plurality of green pixels PG, a plurality of blue pixels PB, and a plurality of pixels PZ.
- the red pixel PR is for detecting red light
- the green pixel PG is for detecting green light
- the blue pixel PB is for detecting blue light.
- the circuit configuration of the red pixel PR, the green pixel PG, and the blue pixel PB is the same as the circuit configuration of the pixel PZ (FIG. 3).
- a red color filter is formed on the red pixel PR
- a green color filter is formed on the green pixel PG
- a blue color filter is formed on the blue pixel PB.
- FIG. 31 illustrates an arrangement example of the red pixel PR, the green pixel PG, the blue pixel PB, and the pixel PZ in the pixel array 61.
- the pixel array 61 four pixels (units U) arranged in 2 rows and 2 columns are repeatedly arranged.
- the green pixel PG is arranged at the upper left
- the blue pixel PB is arranged at the lower left
- the red pixel PR is arranged at the upper right
- the pixel PZ is arranged at the lower right.
- the pixel array 61 includes a plurality of selection lines SEL, a plurality of signal lines SGL, and a plurality of signal lines SGL2.
- Each of the plurality of signal lines SGL extends in the horizontal direction in FIG. 30, and one end is connected to the time measuring unit 124 as illustrated in FIG. 30.
- Each of the plurality of signal lines SGL2 extends in the horizontal direction in FIG. 30, and one end is connected to the counter unit 163 as illustrated in FIG. 30.
- the green pixel PG and the blue pixel PB are connected to the same selection line SEL, and the red pixel PR and the pixel PZ are different from the selection line SEL to which the green pixel PG and the blue pixel PB are connected. Connected to SEL.
- the green pixel PG and the red pixel PR are connected to the same signal line SGL2
- the blue pixel PB is a signal line SGL2 different from the signal line SGL2 to which the green pixel PG and the red pixel PR are connected. Connected to.
- the pixel PZ is connected to the signal line SGL.
- the counter unit 163 includes a plurality of counters 63 (counters 63 (1), 63 (2), 63 (3), 63 (4),).
- the plurality of counters 63 are connected to the plurality of signal lines SGL2 in the pixel array 21, respectively.
- Each of the plurality of counters 63 counts the number of pulses PU included in the pixel signal SIG supplied from the pixel array 61 via the signal line SGL2 based on the control signal supplied from the control unit 27. .
- the counter unit 163 supplies the count results of the plurality of counters 63 to the processing unit 66.
- the counter unit 163 also has a function of supplying count results (count values CNT) from the counters 63 to the light intensity setting unit 29 of the control unit 27.
- the processing unit 66 generates the captured image PIC2 based on the count result supplied from the counter unit 163. Then, the processing unit 66 outputs the generated captured image PIC2.
- the pixel PZ corresponds to a specific example of “first pixel” in the present disclosure.
- the red pixel PR, the green pixel PG, and the blue pixel PB correspond to a specific example of “second pixel” in the present disclosure.
- a plurality of red pixels PR, green pixels PG, and blue pixels PB in the pixel array 61 output the pixel signal SIG
- the plurality of counters 63 of the counter unit 163 outputs the pulse PU included in the pixel signal SIG.
- Count the number.
- the processing unit 66 generates the captured image PIC2 based on the count results in the plurality of counters 63.
- the counter unit 163 supplies the count results (count values CNT) in the plurality of counters 63 to the light intensity setting unit 29 of the control unit 27.
- the light intensity setting unit 29 sets the light intensity of the light pulse L1 based on the plurality of count values CNT supplied from the counter unit 163.
- the light source 11 generates the light pulse L1 based on the set light intensity.
- the pixel PZ in the pixel array 61 outputs a pixel signal SIG including a pulse PU corresponding to the reflected light pulse L2.
- the TDC 24 of the time measuring unit 124 generates the depth value D by measuring the timing of the pulse PU included in the pixel signal SIG based on the control signal supplied from the control unit 27.
- the histogram generation circuit 25 of the histogram generation unit 125 generates a histogram HY of the depth value D supplied from the TDC 24 based on the control signal supplied from the control unit 27.
- the processing unit 26 generates the depth image PIC based on the control signal supplied from the control unit 27 and the information about the plurality of histograms HY supplied from the histogram generation unit 125.
- the imaging device 9 can acquire the count value CNT using the counter unit 163 used in the imaging operation, and can set the light intensity of the light pulse L1 based on the count value CNT. Accordingly, it is not necessary to provide the counter unit 123 shown in FIG. 2 separately from the counter unit 163, and the circuit scale can be reduced.
- the time measuring device is configured using a plurality of pixels PZ.
- the present invention is not limited to this, and instead, for example, the time measuring device using one pixel PZ. May be configured. Even in this case, the time difference between the timing of emitting the light and the timing of detecting the reflected light can be measured by emitting the light and detecting the reflected light reflected by the measurement object.
- a pixel having a light receiving element capable of generating a pulse signal including a logic pulse based on a light reception result in the light receiving element;
- a timing detector capable of detecting a light receiving timing in the light receiving element based on the pulse signal;
- a pulse number detection unit capable of detecting the number of logic pulses included in the pulse signal;
- a control unit capable of controlling the operation of a light source that emits a plurality of light pulses based on the number of pulses.
- the control unit can set the light intensity to the first light intensity, and the number of pulses is larger than the first number of pulses.
- the control unit is capable of controlling the number of light pulses of the plurality of light pulses based on the number of pulses.
- the control unit can set the optical pulse number to the first optical pulse number, and the pulse number is greater than the first pulse number.
- the time measuring device (4), wherein the second optical pulse number can be set to a second optical pulse number larger than the first optical pulse number when the second optical pulse number is larger than the first optical pulse number.
- the time measuring device (1), further including a histogram generation unit capable of generating a histogram for the light reception timing based on the light reception timing.
- the control unit can stop the operation of the light source when a peak value of the histogram reaches a threshold value corresponding to the number of pulses.
- the control unit can set the threshold value to the first threshold value, and the pulse number is greater than the first pulse number.
- the time measuring device can be set to a second threshold value larger than the first threshold value when the number of second pulses is larger.
- the pulse number detection unit can detect the number of pulses based on the pulse signal.
- the pulse number detection unit can detect the pulse number by generating a histogram of the light reception timing based on the light reception timing.
- Time measuring device. (11) The time measuring device according to any one of (1) to (10), wherein the timing detection unit can detect the light reception timing with reference to a light emission timing of the light pulse.
- the time measuring device according to any one of (1) to (11), further including the light source.
- a pulse number detection unit capable of detecting the number of pulses of the logic pulse included in the second pulse signal;
- a control unit capable of controlling the operation of a light source that emits a plurality of light pulses based on the number of pulses.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Electromagnetism (AREA)
- Optical Radar Systems And Details Thereof (AREA)
- Measurement Of Optical Distance (AREA)
Abstract
Description
1.第1の実施の形態
2.第2の実施の形態
3.第3の実施の形態
4.応用例(撮像装置への応用)
[構成例]
図1は、第1の実施の形態に係る時間計測装置(時間計測装置1)の一構成例を表すものである。時間計測装置1は、光を射出するとともに、測定対象物により反射された反射光を検出し、光を射出したタイミングおよび反射光を検出したタイミングの間の時間差を計測するものである。時間計測装置1は、光源11と、光源駆動部12と、レンズ13と、センサ部20とを備えている。
続いて、本実施の形態の時間計測装置1の動作および作用について説明する。
まず、図1を参照して、時間計測装置1の全体動作概要を説明する。光源11は、測定対象物に向かって光パルスL1を射出する。光源駆動部12は、センサ部20から供給された発光トリガ信号S1に基づいて、光源11が発光トリガ信号S1に含まれるトリガパルスに応じたタイミングで発光するように、光源11の動作を制御する。また、光源駆動部12は、センサ部20から供給された光強度制御信号S2に基づいて、光源11が射出する光パルスL1の光強度を制御する。
図8は、時間計測装置1の一動作例を表すものであり、(A)は光源11から射出された射出光の波形を示し、(B)は画素アレイ21における左から1列目の画素PZ(1)の動作を示し、(C)は画素アレイ21における左から2列目の画素PZ(2)の動作を示し、(D)は画素アレイ21における左から3列目の画素PZ(3)の動作を示し、(E)は画素アレイ21における一番右の列(N列目)の画素PZ(N)の動作を示し、(F)はカウンタ部123の動作を示す。図8(B)~(E)において、網掛けされた部分は、画素PZが選択されていることを示し、網掛けされていない部分は、画素PZが選択されていないことを示す。また、図8(F)において、網掛けされた部分は、カウンタ部123がカウント動作を行っていることを示し、網掛けされていない部分は、カウンタ部123がカウント動作を行っていないことを示す。
光強度設定部29は、例えば、複数のカウント値CNTに基づいて、光パルスL1の光強度を設定する。具体的には、光強度設定部29は、図6Aに示したように、最大カウント値CNTmaxが小さい場合には、光パルスL1の光強度が小さくし、最大カウント値CNTmaxが大きい場合には、光パルスL1の光強度を大きくする。これにより、時間計測装置1では、消費電力を効果的に低減することができる。以下に、この動作について詳細に説明する。
以上のように本実施の形態では、カウンタ部から供給されたカウント値に基づいて、光パルスの光強度を調節するようにしたので、消費電力を効果的に低減することができる。
上記実施の形態では、センサ部20が光源駆動部12に対して発光トリガ信号S1を供給することにより、センサ部20が光源11の動作を制御したが、これに限定されるものではない。これに代えて、例えば図14に示す時間計測装置1Aのように、光源駆動部がセンサ部に対して、動作タイミングを指示するトリガ信号を供給してもよい。この時間計測装置1Aは、光源駆動部12Aと、センサ部20Aとを備えている。光源駆動部12Aは、センサ部20Aの動作タイミングを指示するトリガ信号S3を生成し、このトリガ信号S3をセンサ部20Aに供給する。センサ部20Aは、このトリガ信号S3に基づいて動作を行う。
上記実施の形態では、全ての画素PZについてのカウント値CNTの最大値(最大カウント値CNTmax)に基づいて光パルスL1の光強度を調節したが、これに限定されるものではない。例えば、全ての画素PZについてのカウント値CNTが、互いにほぼ等しい場合には、光強度設定部29は、全ての画素PZについてのカウント値CNTの平均値に基づいて光パルスL1の光強度を調節してもよい。この場合には、例えば、故障している画素PZがある場合でも、その故障している画素PZの光強度への影響を抑えることができる。
上記実施の形態では、複数の信号線SGLの数と同じ数の複数のカウンタ23を設け、全ての画素PZに係るカウント値CNTを得るようにしたが、これに限定されるものではない。これに代えて、例えば、より少ない数のカウンタ23を設け、一部の画素PZに係るカウント値CNTを得るようにしてもよい。カウンタ23の数は、複数であってもよいし、例えば図15に示すセンサ部20Cのように、1つであってもよい。このセンサ部20Cは、カウンタ23と、制御部27Cとを有している。カウンタ23は、画素アレイ21の複数の信号線SGLのうちの1つ(この例では一番上の信号線SGL)に接続され、制御部27Cから供給された制御信号に基づいて、画素アレイ21からこの信号線SGLを介して供給された画素信号SIGに含まれるパルスPUの数をカウントする。これにより、カウンタ23は、その信号線SGLに接続された複数の画素PZに係るカウント値CNTを得る。そして、カウンタ23は、これらのカウント値CNTを制御部27Cに供給する。制御部27Cは、光強度設定部29Cを有している。光強度設定部29Cは、このカウンタ23から供給された複数のカウント値CNTに基づいて光パルスL1の光強度を指示する光強度制御信号S2を生成する。
上記実施の形態では、センサ部20が光源駆動部12に対して光強度制御信号S2を供給したが、これに限定されるものではない。以下に、本変形例について、いくつか例を挙げて説明する。
上記実施の形態では、深度値Dを求めるための画素PZが生成した画素信号SIGを、カウンタ23に供給したが、これに限定されるものではない。これに代えて、例えば、図20に示すセンサ部20Fのように、深度値Dを求めるための画素PZ以外の画素が生成した画素信号SIGをカウンタ23に供給してもよい。センサ部20Fは、画素アレイ21Fと、カウンタ23とを有している。画素アレイ21Fは、複数のダミー画素PDMを有している。ダミー画素PDMの回路構成は、画素PZの回路構成(図3)と同じである。複数のダミー画素PDMは、1つの信号線SGLに接続されている。ここで、画素PZは、本開示における「第1の画素」の一具体例に対応する。ダミー画素PDMは、本開示における「第2の画素」の一具体例に対応する。カウンタ23は、複数のダミー画素PDMが接続された信号線SGLに接続される。カウンタ23は、ダミー画素PDMから供給された画素信号SIGに含まれるパルスPUの数をカウントする。
上記実施の形態では、複数のカウンタ23を設け、これらのカウンタ23におけるカウント値CNTに基づいて光パルスL1の光強度を設定したが、これに限定されるものではない。これに代えて、例えば、図21に示すセンサ部20Gのように、ヒストグラム生成回路25が生成したヒストグラムHYに基づいて、光パルスL1の光強度を設定してもよい。センサ部20Gは、ヒストグラム生成部125Gと、制御部27Gを有している。ヒストグラム生成部125Gは、複数のヒストグラム生成回路25が生成したヒストグラムHYにおけるフロアW2についての情報を制御部27Gに供給する機能を有している。制御部27Gは、制御部27Gは、光強度設定部29Gを有している。光強度設定部29Gは、ヒストグラム生成部125Gから供給された、フロアW2についての情報に基づいて、光パルスL1の光強度を設定する。具体的には、光強度設定部29Gは、例えば、複数のヒストグラムHYに含まれるフロアW2のうちの一番高いフロアW2に基づいて、光パルスL1の光強度を設定する。光強度設定部29Gは、例えば、フロアW2が低い場合には、光パルスL1の光強度を小さくし、フロアW2が高い場合には、光パルスL1の光強度を大きくする。そして、光強度設定部29Gは、設定した光パルスL1の光強度に基づいて、光パルスL1の光強度を指示する光強度制御信号S2を生成するようになっている。ここで、ヒストグラム生成部125Gは、本開示における「パルス数検出部」の一具体例に対応する。
上記実施の形態では、画素アレイ21において、1列単位で画素PZを選択したが、これに限定されるものではない。これに代えて、例えば、図22に示すセンサ部20Hのように、複数列単位(この例では2列単位)で画素PZを選択してもよい。センサ部20Hは、画素アレイ21Hを有している。画素アレイ21Hは、複数の選択線SELと、複数の信号線SGLと、複数の画素PZとを有している。例えば、左から1列目の複数の画素PZおよび2列目の複数の画素PZは、左から1本目の選択線SELに接続される。また、3列目の複数の画素PZおよび4列目の複数の画素PZは、2本目の選択線SELに接続される。5列目以降についても同様である。また、例えば1行目の複数の画素PZのうちの奇数列に属する画素PZと、偶数列に属する画素PZは、互いに異なる信号線SGLに接続される。2行目以降についても同様である。この構成により、センサ部20Hでは、画素PZが2列単位で選択される。
上記実施の形態では、カウンタ部123および時間計測部124が同じ期間に動作を行うようにしたが、これに限定されるものではない。これに代えて、例えば、あらかじめ、カウンタ部123が動作を行うことにより光パルスL1の光強度を設定し、その後に、設定された光強度に基づいて光源11が光パルスL1を生成することにより、時間計測装置1が深度画像PICを生成してもよい。
また、これらの変形例のうちの2以上を組み合わせてもよい。
次に、第2の実施の形態に係る時間計測装置2について説明する。本実施の形態は、複数のカウント値CNTに基づいて光パルスL1の数を調節するものである。なお、上記第1の実施の形態に係る時間計測装置1と実質的に同一の構成部分には同一の符号を付し、適宜説明を省略する。
上記実施の形態に係る時間計測装置2に、上記第1の実施の形態の各変形例を適用してもよい。
次に、第3の実施の形態に係る時間計測装置3について説明する。本実施の形態は、ヒストグラムHYにおけるピークW1の高さが、フロアW2に応じたしきい値THに到達したときに、光源11の動作を停止するものである。なお、上記第1の実施の形態に係る時間計測装置1と実質的に同一の構成部分には同一の符号を付し、適宜説明を省略する。
次に、上記実施の形態に係る時間計測装置の応用例について説明する。
前記パルス信号に基づいて前記受光素子における受光タイミングを検出可能なタイミング検出部と、
前記パルス信号に含まれる前記論理パルスのパルス数を検出可能なパルス数検出部と、
前記パルス数に基づいて、複数の光パルスを射出する光源の動作を制御可能な制御部と
を備えた時間計測装置。
(2)前記制御部は、前記パルス数に基づいて、前記複数の光パルスのそれぞれの光強度を制御可能である
前記(1)に記載の時間計測装置。
(3)前記制御部は、前記パルス数が第1のパルス数である場合に、前記光強度を第1の光強度に設定可能であり、前記パルス数が前記第1のパルス数よりも多い第2のパルス頻度である場合に、前記光強度を前記第1の光強度よりも強い第2の光強度に設定可能である
前記(2)に記載の時間計測装置。
(4)前記制御部は、前記パルス数に基づいて、前記複数の光パルスの光パルス数を制御可能である
前記(1)に記載の時間計測装置。
(5)前記制御部は、前記パルス数が第1のパルス数である場合に、前記光パルス数を第1の光パルス数に設定可能であり、前記パルス数が前記第1のパルス数よりも多い第2のパルス数である場合に、前記光パルス数を前記第1の光パルス数よりも多い第2の光パルス数に設定可能である
前記(4)に記載の時間計測装置。
(6)前記受光タイミングに基づいて、前記受光タイミングについてのヒストグラムを生成可能なヒストグラム生成部をさらに備えた
前記(1)に記載の時間計測装置。
(7)前記制御部は、前記ヒストグラムのピーク値が、前記パルス数に応じたしきい値に到達したときに、前記光源の動作を停止可能である
前記(6)に記載の時間計測装置。
(8)前記制御部は、前記パルス数が第1のパルス数である場合に、前記しきい値を第1のしきい値に設定可能であり、前記パルス数が前記第1のパルス数よりも多い第2のパルス数である場合に、前記しきい値を前記第1のしきい値よりも大きい第2のしきい値に設定可能である
前記(7)に記載の時間計測装置。
(9)前記パルス数検出部は、前記パルス信号に基づいて、前記パルス数を検出可能である
前記(1)から(8)のいずれかに記載の時間計測装置。
(10)前記パルス数検出部は、前記受光タイミングに基づいて、前記受光タイミングについてのヒストグラムを生成することにより、前記パルス数を検出可能である
前記(1)から(8)のいずれかに記載の時間計測装置。
(11)前記タイミング検出部は、前記光パルスの発光タイミングを基準として、前記受光タイミングを検出可能である
前記(1)から(10)のいずれかに記載の時間計測装置。
(12)前記光源をさらに備えた
前記(1)から(11)のいずれかに記載の時間計測装置。
(13)第1の受光素子を有し、前記第1の受光素子における受光結果に基づいて論理パルスを含む第1のパルス信号を生成可能な第1の画素と、
第2の受光素子を有し、前記第2の受光素子における受光結果に基づいて論理パルスを含む第2のパルス信号を生成可能な第2の画素と、
前記第1のパルス信号に基づいて前記第1の受光素子における受光タイミングを検出可能なタイミング検出部と、
前記第2のパルス信号に含まれる前記論理パルスのパルス数を検出可能なパルス数検出部と、
前記パルス数に基づいて、複数の光パルスを射出する光源の動作を制御可能な制御部と
を備えた時間計測装置。
(14)前記第2の受光素子は、所定色の光を受光可能である
前記(12)に記載の時間計測装置。
Claims (14)
- 受光素子を有し、前記受光素子における受光結果に基づいて論理パルスを含むパルス信号を生成可能な画素と、
前記パルス信号に基づいて前記受光素子における受光タイミングを検出可能なタイミング検出部と、
前記パルス信号に含まれる前記論理パルスのパルス数を検出可能なパルス数検出部と、
前記パルス数に基づいて、複数の光パルスを射出する光源の動作を制御可能な制御部と
を備えた時間計測装置。 - 前記制御部は、前記パルス数に基づいて、前記複数の光パルスのそれぞれの光強度を制御可能である
請求項1に記載の時間計測装置。 - 前記制御部は、前記パルス数が第1のパルス数である場合に、前記光強度を第1の光強度に設定可能であり、前記パルス数が前記第1のパルス数よりも多い第2のパルス頻度である場合に、前記光強度を前記第1の光強度よりも強い第2の光強度に設定可能である
請求項2に記載の時間計測装置。 - 前記制御部は、前記パルス数に基づいて、前記複数の光パルスの光パルス数を制御可能である
請求項1に記載の時間計測装置。 - 前記制御部は、前記パルス数が第1のパルス数である場合に、前記光パルス数を第1の光パルス数に設定可能であり、前記パルス数が前記第1のパルス数よりも多い第2のパルス数である場合に、前記光パルス数を前記第1の光パルス数よりも多い第2の光パルス数に設定可能である
請求項4に記載の時間計測装置。 - 前記受光タイミングに基づいて、前記受光タイミングについてのヒストグラムを生成可能なヒストグラム生成部をさらに備えた
請求項1に記載の時間計測装置。 - 前記制御部は、前記ヒストグラムのピーク値が、前記パルス数に応じたしきい値に到達したときに、前記光源の動作を停止可能である
請求項6に記載の時間計測装置。 - 前記制御部は、前記パルス数が第1のパルス数である場合に、前記しきい値を第1のしきい値に設定可能であり、前記パルス数が前記第1のパルス数よりも多い第2のパルス数である場合に、前記しきい値を前記第1のしきい値よりも大きい第2のしきい値に設定可能である
請求項7に記載の時間計測装置。 - 前記パルス数検出部は、前記パルス信号に基づいて、前記パルス数を検出可能である
請求項1に記載の時間計測装置。 - 前記パルス数検出部は、前記受光タイミングに基づいて、前記受光タイミングについてのヒストグラムを生成することにより、前記パルス数を検出可能である
請求項1に記載の時間計測装置。 - 前記タイミング検出部は、前記光パルスの発光タイミングを基準として、前記受光タイミングを検出可能である
請求項1に記載の時間計測装置。 - 前記光源をさらに備えた
請求項1に記載の時間計測装置。 - 第1の受光素子を有し、前記第1の受光素子における受光結果に基づいて論理パルスを含む第1のパルス信号を生成可能な第1の画素と、
第2の受光素子を有し、前記第2の受光素子における受光結果に基づいて論理パルスを含む第2のパルス信号を生成可能な第2の画素と、
前記第1のパルス信号に基づいて前記第1の受光素子における受光タイミングを検出可能なタイミング検出部と、
前記第2のパルス信号に含まれる前記論理パルスのパルス数を検出可能なパルス数検出部と、
前記パルス数に基づいて、複数の光パルスを射出する光源の動作を制御可能な制御部と
を備えた時間計測装置。 - 前記第2の受光素子は、所定色の光を受光可能である
請求項13に記載の時間計測装置。
Priority Applications (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US17/056,525 US12405379B2 (en) | 2018-05-24 | 2019-04-16 | Time measurement apparatus |
| JP2020521095A JP7290632B2 (ja) | 2018-05-24 | 2019-04-16 | 時間計測装置 |
| KR1020207032717A KR102772093B1 (ko) | 2018-05-24 | 2019-04-16 | 시간 계측 장치 |
| EP19806385.1A EP3805795A4 (en) | 2018-05-24 | 2019-04-16 | TIMING DEVICE |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2018-099515 | 2018-05-24 | ||
| JP2018099515 | 2018-05-24 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2019225224A1 true WO2019225224A1 (ja) | 2019-11-28 |
Family
ID=68617078
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/JP2019/016254 Ceased WO2019225224A1 (ja) | 2018-05-24 | 2019-04-16 | 時間計測装置 |
Country Status (7)
| Country | Link |
|---|---|
| US (1) | US12405379B2 (ja) |
| EP (1) | EP3805795A4 (ja) |
| JP (1) | JP7290632B2 (ja) |
| KR (1) | KR102772093B1 (ja) |
| CN (2) | CN110531343B (ja) |
| TW (1) | TWI826448B (ja) |
| WO (1) | WO2019225224A1 (ja) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2021153162A1 (ja) * | 2020-01-30 | 2021-08-05 | ソニーセミコンダクタソリューションズ株式会社 | 測距装置及び測距方法 |
| JP2021124293A (ja) * | 2020-01-31 | 2021-08-30 | 株式会社ニコンビジョン | 距離検出装置、距離検出方法、及びプログラム |
| CN113840105A (zh) * | 2020-06-08 | 2021-12-24 | 意法半导体(R&D)有限公司 | 用于dtof传感器的路由 |
| JP2023172507A (ja) * | 2022-05-24 | 2023-12-06 | キヤノン株式会社 | 測距装置 |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3805795A4 (en) * | 2018-05-24 | 2021-08-11 | Sony Semiconductor Solutions Corporation | TIMING DEVICE |
| US11215712B2 (en) | 2020-04-27 | 2022-01-04 | Facebook Technologies, Llc | Time-to-digital converter for depth sensing |
| JP2023117941A (ja) * | 2022-02-14 | 2023-08-24 | 富士フイルムビジネスイノベーション株式会社 | 光源装置、発光装置及び計測装置 |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2010091377A (ja) | 2008-10-07 | 2010-04-22 | Toyota Motor Corp | 光学式測距装置及び方法 |
| WO2015075926A1 (ja) * | 2013-11-20 | 2015-05-28 | パナソニックIpマネジメント株式会社 | 測距撮像システム |
| JP2016151458A (ja) * | 2015-02-17 | 2016-08-22 | 株式会社デンソー | 演算装置 |
| US20170097417A1 (en) * | 2015-10-21 | 2017-04-06 | Samsung Electronics Co., Ltd. | Apparatus for and method of range sensor based on direct time-of-flight and triangulation |
| JP2017083243A (ja) * | 2015-10-27 | 2017-05-18 | 株式会社村田製作所 | 距離センサ及びそれを備えたシステム |
| JP2018077071A (ja) * | 2016-11-08 | 2018-05-17 | 株式会社リコー | 測距装置、監視カメラ、3次元計測装置、移動体、ロボット、光源駆動条件設定方法及び測距方法 |
| JP2018099515A (ja) | 2012-12-26 | 2018-06-28 | ベクトン・ディキンソン・アンド・カンパニーBecton, Dickinson And Company | ペン針アセンブリ |
Family Cites Families (24)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP3940806B2 (ja) * | 1998-05-15 | 2007-07-04 | 株式会社ニコン | 光波測距装置 |
| US7639347B2 (en) | 2007-02-14 | 2009-12-29 | Leica Geosystems Ag | High-speed laser ranging system including a fiber laser |
| US8339058B2 (en) * | 2008-12-12 | 2012-12-25 | Microchip Technology Incorporated | Three-color RGB LED color mixing and control by variable frequency modulation |
| US8610808B2 (en) * | 2008-12-22 | 2013-12-17 | Koninklijke Philips N.V. | Color CMOS imager with single photon counting capability |
| WO2010149593A1 (en) | 2009-06-22 | 2010-12-29 | Toyota Motor Europe Nv/Sa | Pulsed light optical rangefinder |
| DE102010015941A1 (de) * | 2010-03-03 | 2011-09-08 | Vorwerk & Co. Interholding Gmbh | Verfahren zur Abstandsmessung auf Lichtbasis |
| JP5544231B2 (ja) | 2010-07-15 | 2014-07-09 | 富士フイルム株式会社 | 内視鏡光源装置及び内視鏡システム |
| CN102404901A (zh) * | 2010-09-14 | 2012-04-04 | 扬光绿能股份有限公司 | 照明装置及其控制方法 |
| JP2012118313A (ja) | 2010-12-01 | 2012-06-21 | Mitsumi Electric Co Ltd | 輝度制御装置、該輝度制御装置を備えた表示装置、及び照明装置 |
| US9523765B2 (en) | 2014-07-14 | 2016-12-20 | Omnivision Technologies, Inc. | Pixel-level oversampling for a time of flight 3D image sensor with dual range measurements |
| JP6520053B2 (ja) | 2014-11-06 | 2019-05-29 | 株式会社デンソー | 光飛行型測距装置 |
| US9564897B1 (en) | 2015-10-06 | 2017-02-07 | Samsung Electronics Co., Ltd | Apparatus for low power high speed integrated clock gating cell |
| CN108474849B (zh) | 2016-02-17 | 2021-12-21 | 松下知识产权经营株式会社 | 距离测量装置 |
| US10641872B2 (en) | 2016-02-18 | 2020-05-05 | Aeye, Inc. | Ladar receiver with advanced optics |
| WO2017208673A1 (ja) | 2016-06-02 | 2017-12-07 | シャープ株式会社 | 光センサ、電子機器 |
| US10823826B2 (en) * | 2016-06-14 | 2020-11-03 | Stmicroelectronics, Inc. | Adaptive laser power and ranging limit for time of flight sensor |
| US20180113216A1 (en) * | 2016-10-25 | 2018-04-26 | Innoviz Technologies Ltd. | Methods Circuits Devices Assemblies Systems and Functionally Associated Machine Executable Code for Active Optical Scanning of a Scene |
| EP3516415B1 (en) * | 2016-09-22 | 2024-12-04 | Apple Inc. | Adaptive transmission power control for a lidar |
| CN106328088A (zh) * | 2016-10-31 | 2017-01-11 | 上海天马微电子有限公司 | 一种驱动电路、驱动方法以及半反半透液晶显示器 |
| CN206442567U (zh) * | 2016-11-17 | 2017-08-25 | 深圳市光峰光电技术有限公司 | 一种光源亮度控制系统、光源系统及投影设备 |
| CN106603852B (zh) * | 2016-12-22 | 2021-03-23 | 惠州Tcl移动通信有限公司 | 一种移动终端待机控制方法及系统 |
| CN107807364B (zh) | 2017-09-22 | 2019-11-15 | 中国科学院西安光学精密机械研究所 | 一种三维成像光子计数系统及其动态偏压控制方法 |
| WO2019194550A1 (ko) * | 2018-04-02 | 2019-10-10 | 엘지전자 주식회사 | 구속 방지 필터를 구비하는 로봇 청소기 |
| EP3805795A4 (en) | 2018-05-24 | 2021-08-11 | Sony Semiconductor Solutions Corporation | TIMING DEVICE |
-
2019
- 2019-04-16 EP EP19806385.1A patent/EP3805795A4/en not_active Withdrawn
- 2019-04-16 US US17/056,525 patent/US12405379B2/en active Active
- 2019-04-16 JP JP2020521095A patent/JP7290632B2/ja active Active
- 2019-04-16 KR KR1020207032717A patent/KR102772093B1/ko active Active
- 2019-04-16 WO PCT/JP2019/016254 patent/WO2019225224A1/ja not_active Ceased
- 2019-04-28 CN CN201910349785.6A patent/CN110531343B/zh active Active
- 2019-04-28 CN CN201920602586.7U patent/CN210166496U/zh active Active
- 2019-05-17 TW TW108117015A patent/TWI826448B/zh active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2010091377A (ja) | 2008-10-07 | 2010-04-22 | Toyota Motor Corp | 光学式測距装置及び方法 |
| JP2018099515A (ja) | 2012-12-26 | 2018-06-28 | ベクトン・ディキンソン・アンド・カンパニーBecton, Dickinson And Company | ペン針アセンブリ |
| WO2015075926A1 (ja) * | 2013-11-20 | 2015-05-28 | パナソニックIpマネジメント株式会社 | 測距撮像システム |
| JP2016151458A (ja) * | 2015-02-17 | 2016-08-22 | 株式会社デンソー | 演算装置 |
| US20170097417A1 (en) * | 2015-10-21 | 2017-04-06 | Samsung Electronics Co., Ltd. | Apparatus for and method of range sensor based on direct time-of-flight and triangulation |
| JP2017083243A (ja) * | 2015-10-27 | 2017-05-18 | 株式会社村田製作所 | 距離センサ及びそれを備えたシステム |
| JP2018077071A (ja) * | 2016-11-08 | 2018-05-17 | 株式会社リコー | 測距装置、監視カメラ、3次元計測装置、移動体、ロボット、光源駆動条件設定方法及び測距方法 |
Non-Patent Citations (1)
| Title |
|---|
| See also references of EP3805795A4 |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2021153162A1 (ja) * | 2020-01-30 | 2021-08-05 | ソニーセミコンダクタソリューションズ株式会社 | 測距装置及び測距方法 |
| JP2021124293A (ja) * | 2020-01-31 | 2021-08-30 | 株式会社ニコンビジョン | 距離検出装置、距離検出方法、及びプログラム |
| JP7344803B2 (ja) | 2020-01-31 | 2023-09-14 | 株式会社ニコンビジョン | 距離検出装置、距離検出方法、及びプログラム |
| US12085671B2 (en) | 2020-01-31 | 2024-09-10 | Nikon Vision Co., Ltd. | Distance detector, distance detection method, and computer-readable medium |
| CN113840105A (zh) * | 2020-06-08 | 2021-12-24 | 意法半导体(R&D)有限公司 | 用于dtof传感器的路由 |
| EP4254000A3 (en) * | 2020-06-08 | 2023-11-15 | STMicroelectronics (Research & Development) Limited | Routing for dtof sensors |
| JP2023172507A (ja) * | 2022-05-24 | 2023-12-06 | キヤノン株式会社 | 測距装置 |
Also Published As
| Publication number | Publication date |
|---|---|
| KR20210011917A (ko) | 2021-02-02 |
| CN210166496U (zh) | 2020-03-20 |
| KR102772093B1 (ko) | 2025-02-21 |
| EP3805795A4 (en) | 2021-08-11 |
| CN110531343B (zh) | 2026-02-13 |
| TW202004219A (zh) | 2020-01-16 |
| CN110531343A (zh) | 2019-12-03 |
| US20210208280A1 (en) | 2021-07-08 |
| JP7290632B2 (ja) | 2023-06-13 |
| EP3805795A1 (en) | 2021-04-14 |
| JPWO2019225224A1 (ja) | 2021-05-27 |
| TWI826448B (zh) | 2023-12-21 |
| US12405379B2 (en) | 2025-09-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7290632B2 (ja) | 時間計測装置 | |
| TWI628785B (zh) | 具有像素級偏壓控制之單光子崩潰二極體陣列 | |
| US8748951B2 (en) | Solid-state image sensing device | |
| US12477840B2 (en) | Control circuit and distance measuring system | |
| CN113923384A (zh) | 光传感器及其感测方法 | |
| US11953597B2 (en) | Distance sensor, distance measurement device, and image sensor | |
| CN211979200U (zh) | 传感器 | |
| US20220003876A1 (en) | Distance image obtaining method and distance detection device | |
| EP3646013B1 (en) | Photo-detection pixel circuit, detector panel, and photoelectric detection apparatus | |
| JPWO2019225224A5 (ja) | ||
| JP2016151458A (ja) | 演算装置 | |
| JP2020107980A (ja) | 光検出装置および撮像システム | |
| US12392895B2 (en) | Control circuit and distance measurement system to improve sensitivity characteristics of SPAD element | |
| US12028631B2 (en) | Photoelectric conversion apparatus | |
| US20220163642A1 (en) | Current generation circuit and ranging system | |
| US20250386114A1 (en) | Range image generation device and equipment | |
| KR20260054311A (ko) | 이미지 센싱 장치 | |
| CN117812477A (zh) | 图像传感器、图像处理系统及图像传感器的操作方法 | |
| JP2024035722A (ja) | 光センサ | |
| WO2020183842A1 (ja) | 制御回路および測距システム |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 19806385 Country of ref document: EP Kind code of ref document: A1 |
|
| ENP | Entry into the national phase |
Ref document number: 2020521095 Country of ref document: JP Kind code of ref document: A |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| ENP | Entry into the national phase |
Ref document number: 2019806385 Country of ref document: EP Effective date: 20210111 |
|
| WWG | Wipo information: grant in national office |
Ref document number: 17056525 Country of ref document: US |
|
| WWW | Wipo information: withdrawn in national office |
Ref document number: 2019806385 Country of ref document: EP |