WO2019135303A1 - 固体撮像素子、撮像装置および固体撮像素子の制御方法 - Google Patents
固体撮像素子、撮像装置および固体撮像素子の制御方法 Download PDFInfo
- Publication number
- WO2019135303A1 WO2019135303A1 PCT/JP2018/034437 JP2018034437W WO2019135303A1 WO 2019135303 A1 WO2019135303 A1 WO 2019135303A1 JP 2018034437 W JP2018034437 W JP 2018034437W WO 2019135303 A1 WO2019135303 A1 WO 2019135303A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- current
- pixels
- threshold
- solid
- state imaging
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/40—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled
- H04N25/44—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled by partially reading an SSIS array
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/47—Image sensors with pixel address output; Event-driven image sensors; Selection of pixels to be read out based on image data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/50—Control of the SSIS exposure
- H04N25/57—Control of the dynamic range
- H04N25/571—Control of the dynamic range involving a non-linear response
- H04N25/573—Control of the dynamic range involving a non-linear response the logarithmic type
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
- H04N25/703—SSIS architectures incorporating pixels for producing signals other than image signals
- H04N25/706—Pixels for exposure or ambient light measuring
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
- H04N25/703—SSIS architectures incorporating pixels for producing signals other than image signals
- H04N25/707—Pixels for event detection
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
- H04N25/76—Addressed sensors, e.g. MOS or CMOS sensors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
- H04N25/76—Addressed sensors, e.g. MOS or CMOS sensors
- H04N25/766—Addressed sensors, e.g. MOS or CMOS sensors comprising control or output lines used for a plurality of functions, e.g. for pixel output, driving, reset or power
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
- H04N25/76—Addressed sensors, e.g. MOS or CMOS sensors
- H04N25/77—Pixel circuitry, e.g. memories, A/D converters, pixel amplifiers, shared circuits or shared components
Definitions
- the present technology relates to a solid-state imaging device, an imaging device, and a control method of the solid-state imaging device. Specifically, the present invention relates to a solid-state imaging device that detects a change in luminance, an imaging device, and a control method of the solid-state imaging device.
- synchronous solid-state imaging devices that capture image data in synchronization with synchronization signals such as vertical synchronization signals have been used in imaging devices and the like.
- image data can be acquired only for each cycle of the synchronization signal (for example, 1/60 seconds), so faster processing is possible in the fields related to traffic, robots, etc. It will be difficult to respond when requested. Therefore, an asynchronous solid-state imaging device has been proposed which detects an address event for each pixel using a fixed threshold (see, for example, Patent Document 1).
- the address event means that the luminance of a pixel changes at a certain pixel address, and the amount of change exceeds a threshold.
- a solid-state imaging device that detects an address event for each pixel is called a dynamic vision sensor (DVS).
- the present technology is created in view of such a situation, and it is an object of the present invention to suppress false detection due to flicker in a solid-state imaging device that detects an address event.
- the present technology has been made to solve the above-mentioned problems, the first aspect of which is: A plurality of pixels each comparing the amount of change in voltage according to the photocurrent with a predetermined threshold, a current detection unit detecting the sum of the photocurrent of each of the plurality of pixels as a total current, and the total current
- a solid-state imaging device including a threshold value control unit that controls the predetermined threshold value to a value corresponding to the value d. This brings about the effect that the threshold is controlled to a value corresponding to the total current.
- the threshold control unit adjusts the total current and outputs the adjusted current as an adjusted current, an offset current source that generates a predetermined offset current, the adjusted current, and the predetermined current.
- a converter that converts the sum or the difference with the offset current into the predetermined threshold and supplies it to each of the plurality of pixels may be provided. This brings about the effect that the sum or the difference between the current adjusted for the total current and the offset current is converted to the threshold.
- the offset current source distributes the predetermined reference current at a plurality of different ratios to generate a plurality of divided currents, and the reference current source generating the predetermined reference current.
- a first distribution circuit may be provided, and a first decoder that controls the first distribution circuit to output a predetermined number of sums of the plurality of distribution currents as the predetermined offset current. This brings about the effect
- the adjustment unit controls a second distribution circuit that distributes the total current at a plurality of different ratios to generate a plurality of distribution currents, and controls the second distribution circuit.
- a second decoder may be provided to output a sum of a predetermined number of the plurality of distributed currents as the adjustment current. This brings about the effect that the sum of the distribution current which distributed the total current is outputted as adjustment current.
- the conversion unit connects a plurality of resistance elements and a predetermined number of the plurality of resistance elements in parallel, and the adjustment current flows in the combined resistance of the predetermined number of resistance elements.
- a third decoder for outputting the voltage generated as a predetermined threshold value. This brings about the effect
- the current detection unit can also detect the sum of the photocurrent of each of some of the plurality of pixels as the total current. This brings about the effect
- the threshold control unit may control the predetermined threshold to a higher value as the total current is larger. This brings about the effect that the threshold is controlled to a higher value as the total current is larger.
- the predetermined threshold includes an upper threshold and a lower threshold that are different from each other, and each of the plurality of pixels detects that the change amount exceeds the upper threshold as an on event.
- the fact that the amount of change falls below the lower limit threshold may be detected as an off event. This brings about the effect that the on event and the off event are detected for each pixel.
- a total current of a plurality of pixels each of which compares a change amount of voltage according to a photocurrent with a predetermined threshold, and the photocurrent of each of the plurality of pixels
- a threshold control unit for controlling the predetermined threshold value to a value according to the total current
- a signal processing unit for processing a signal composed of comparison results of the plurality of pixels. It is an imaging device. This brings about the effect
- the effect described here is not necessarily limited, and may be any effect described in the present disclosure.
- FIG. 1 is a block diagram illustrating an exemplary configuration of an imaging device according to a first embodiment of the present technology. It is a figure for demonstrating the laminated structure of the solid-state image sensor in 1st Embodiment of this technique.
- 1 is a block diagram showing an example of configuration of a solid-state imaging device according to a first embodiment of the present technology. It is a block diagram showing an example of 1 composition of a pixel array part in a 1st embodiment of this art. It is a circuit diagram showing an example of 1 composition of a pixel in a 1st embodiment of this art. It is a graph which shows an example of the input-and-output characteristic of the comparator in a 1st embodiment of this art.
- AER Address Event Representation
- FIG. 1 is a block diagram showing an exemplary configuration of an imaging device 100 according to a first embodiment of the present technology.
- the imaging apparatus 100 is an apparatus for capturing image data, and includes an optical unit 110, a solid-state imaging device 200, and a DSP (Digital Signal Processing) circuit 120.
- the imaging apparatus 100 further includes a display unit 130, an operation unit 140, a bus 150, a frame memory 160, a storage unit 170, and a power supply unit 180.
- a camera mounted on an industrial robot, an on-vehicle camera, etc. are assumed.
- the optical unit 110 condenses light from a subject and guides the light to the solid-state imaging device 200.
- the solid-state imaging device 200 detects, as an address event, the fact that the absolute value of the amount of change in luminance exceeds the absolute value of the threshold for each pixel.
- the address event includes, for example, an on-event indicating that a positive change amount of luminance exceeds a positive threshold, and an off-event indicating that a negative change amount falls below a negative threshold.
- the solid-state imaging device 200 generates image data representing the presence or absence of the on event and the off event by 2-bit data for each pixel, and supplies the image data to the DSP circuit 120 through the signal line 209.
- the DSP circuit 120 executes predetermined signal processing on image data from the solid-state imaging device 200.
- the DSP circuit 120 outputs the processed image data and event data to the frame memory 160 or the like via the bus 150.
- the DSP circuit 120 is an example of a signal processing unit described in the claims.
- the display unit 130 displays image data and event data.
- a liquid crystal panel or an organic EL (Electro Luminescence) panel is assumed.
- the operation unit 140 generates an operation signal in accordance with the user's operation.
- the bus 150 is a common path for the optical unit 110, the solid-state imaging device 200, the DSP circuit 120, the display unit 130, the operation unit 140, the frame memory 160, the storage unit 170, and the power supply unit 180 to exchange data with one another.
- the frame memory 160 holds image data.
- the storage unit 170 stores various data such as image data.
- the power supply unit 180 supplies power to the solid-state imaging device 200, the DSP circuit 120, the display unit 130, and the like.
- a plurality of solid state imaging devices 200 may be provided, and a plurality of solid hearing devices called cochlea may be provided.
- FIG. 2 is a view showing an example of a laminated structure of the solid-state imaging device 200 according to the first embodiment of the present technology.
- the solid-state imaging device 200 includes a light receiving chip 201 and a circuit chip 202 stacked on the light receiving chip 201.
- FIG. 3 is a block diagram showing a configuration example of the solid-state imaging device 200 according to the first embodiment of the present technology.
- the solid-state imaging device 200 includes a column arbiter 213, a column AER circuit 220, a column address encoder 214, a pixel array unit 300, and a state machine 215.
- the solid-state imaging device 200 further includes a row address encoder 216, a row AER circuit 260, a row arbiter 600, a current detection unit 410, and a threshold control unit 420. Then, in the pixel array unit 300, a plurality of pixels are arranged in a two-dimensional lattice.
- a set of pixels arranged in a predetermined direction in the pixel array unit 300 will be referred to as a “row”, and a set of pixels arranged in a direction perpendicular to the row will be referred to as a “column”.
- Each of the pixels in the pixel array unit 300 generates a differential signal indicating the amount of change in voltage according to the photocurrent, and compares the level of the signal with a predetermined threshold.
- the comparison result indicates the detection result of the address event.
- the threshold value for comparison with the differential signal includes two different threshold values, the larger one of which is the upper limit threshold, and the smaller one which is the lower limit threshold.
- the address event includes an on event and an off event
- the detection result includes a detection result of one bit of the on event and a detection result of one bit of the off event. The on event is detected when the derivative signal exceeds the upper threshold, and the off event is detected when the derivative signal falls below the lower threshold.
- the pixel When an address event is detected, the pixel performs transmission and reception of requests and responses (hereinafter referred to as “handshake”) with the row AER circuit 260 in order to externally output the detection result of the address event. The pixel then performs a handshake with the column AER circuit 220.
- handshake requests and responses
- the column arbiter 213 arbitrates the request from the column AER circuit 220 and transmits a response to the column AER circuit 220 based on the arbitration result.
- the column AER circuit 220 transmits / receives (handshakes) a request for requesting an external output of the detection result of the address event and a response between each of the columns, the column arbiter 213, and the state machine 215.
- the column address encoder 214 encodes the address of the column in which the address event has occurred and transmits it to the state machine 215.
- the row address encoder 216 encodes the address of the row in which the address event has occurred and transmits the encoded address to the state machine 215.
- the row arbiter 600 arbitrates the request from the row AER circuit 260 and sends a response to the row AER circuit 260 based on the arbitration result.
- the row AER circuit 260 transmits / receives (handshakes) a request and a response requesting an external output of the detection result of the address event between each of the rows, the row arbiter 600, and the state machine 215.
- the state machine 215 performs handshaking with the column AER circuit 220 and the row AER circuit 260.
- the state machine 215 receives the request from the column AER circuit 220 and the row AER circuit 260, it decodes the data from the column address encoder 214 and the row address encoder 216 to specify the detected address of the address event.
- Image data is generated by arranging detection results of address events for each pixel in a two-dimensional grid.
- the state machine 215 supplies the image data to the DSP circuit 120.
- the current detection unit 410 detects the sum of the photocurrents of all the pixels as a total current, and supplies the total current to the threshold control unit 420.
- the threshold control unit 420 controls the upper threshold and the lower threshold to values corresponding to the total current. For example, those thresholds are controlled to higher values as the total current increases.
- FIG. 4 is a block diagram showing a configuration example of the pixel array unit 300 according to the first embodiment of the present technology.
- a plurality of pixels 310 are arranged in a two-dimensional grid.
- the respective pixels 310 are commonly connected to the current detection unit 410 via the signal line 419.
- the signal line 419 branches for each row, and further branches for each column and is connected to each of the pixels 310.
- Each of the pixels 310 photoelectrically converts incident light to generate a photocurrent, and supplies the photocurrent to the current detection unit 410 through the signal line 419. Since the signal line 419 branches for each row and each column, the current of each row and each column merges at the branch source, and the total current Ipix_tot which is the sum thereof is supplied to the current detection unit 410.
- each of the pixels 310 is commonly connected to the threshold control unit 420 via the signal line 429.
- the threshold control unit 420 supplies the upper threshold Von and the lower threshold Voff to each of the pixels 310 via the signal line 429.
- FIG. 5 is a circuit diagram showing a configuration example of the pixel 310 in the first embodiment of the present technology.
- the pixel 310 includes a logarithmic response unit 320, a buffer 330, a differentiating circuit 340, a comparator 350, and an AER logic circuit 360.
- the logarithmic response unit 320 includes nMOS (negative channel MOS) transistors 321 and 323, a photodiode 322, and a pMOS (positive channel MOS) transistor 324.
- the photodiode 322 generates a photocurrent by photoelectric conversion of incident light.
- the pMOS transistor 324 and the nMOS transistor 323 are connected in series between the power supply and the ground terminal.
- the gate of the nMOS transistor 321 is connected to the connection point of the pMOS transistor 324 and the nMOS transistor 323, the source is connected to the photodiode 322, and the drain is connected to the current detection unit 410.
- the bias voltage Vblog is applied to the gate of the pMOS transistor 324. By such connection, the photocurrent flowing to the photodiode 322 is logarithmically converted to the voltage Vp.
- the photodiode 322 and the nMOS transistors 321 and 323 are disposed in the light receiving chip 201.
- the circuit after the pMOS transistor 324 is disposed in the circuit chip 202.
- Buffer 330 also includes pMOS transistors 331 and 332 connected in series between the power supply and ground terminals.
- the gate of the pMOS transistor 332 on the ground side is connected to the logarithmic response unit 320, and the bias voltage Vbsf is applied to the gate of the pMOS transistor 331 on the power supply side.
- the connection point of the pMOS transistors 331 and 332 is connected to the differentiating circuit 340. By this connection, impedance conversion for Vp is performed.
- the differentiating circuit 340 includes capacitors 341 and 343, pMOS transistors 342 and 344, and an nMOS transistor 345.
- One end of the capacitor 341 is connected to the buffer 330, and the other end is connected to one end of the capacitor 343 and the gate of the pMOS transistor 344.
- the reset signal xrst is input to the gate of the pMOS transistor 342, and the source and drain are connected to both ends of the capacitor 343.
- the pMOS transistor 344 and the nMOS transistor 345 are connected in series between the power supply and the ground terminal. Also, the other end of the capacitor 343 is connected to the connection point of the pMOS transistor 344 and the nMOS transistor 345.
- the bias voltage Vba is applied to the gate of the ground side nMOS transistor 345, and the connection point of the pMOS transistor 344 and the nMOS transistor 345 is also connected to the comparator 350. By such connection, a differential signal is generated and output to the comparator 350. Also, the differential signal is initialized by the reset signal xrst.
- the comparator 350 includes pMOS transistors 351 and 353 and nMOS transistors 352 and 354.
- the pMOS transistor 351 and the nMOS transistor 352 are connected in series between the power supply and the ground terminal, and the pMOS transistor 353 and the nMOS transistor 354 are also connected in series between the power supply and the ground terminal.
- the gates of the pMOS transistors 351 and 353 are connected to the differentiating circuit 340.
- the upper limit threshold Von from the threshold control unit 420 is applied to the gate of the nMOS transistor 352, and the lower limit threshold Voff from the threshold control unit 420 is applied to the gate of the nMOS transistor 354.
- connection point of the pMOS transistor 351 and the nMOS transistor 352 is connected to the AER logic circuit 360, and the voltage at this connection point is output as the comparison result VCH.
- the connection point of the pMOS transistor 353 and the nMOS transistor 354 is also connected to the AER logic circuit 360, and the voltage at this connection point is output as the comparison result VCL.
- the comparator 350 outputs the comparison result VCH of high level when the differential signal exceeds the upper limit threshold Von, and outputs the comparison result VCL of low level when the differential signal falls below the lower limit threshold Voff. Do.
- the comparison result VCH indicates the on-event detection result
- the comparison result VCL indicates the off-event detection result.
- the comparator 350 detects both the on event and the off event, but may detect only one. For example, when only the on event is detected, only the corresponding pMOS transistor 351 and nMOS transistor 352 are arranged.
- the AER logic circuit 360 performs handshake based on the comparison results VCH and VCL.
- the AER logic circuit 360 performs handshake with the row AER circuit 260 when an address event occurs.
- the AER logic circuit 360 performs handshake with the column AER circuit 220, and resets the differentiating circuit 340 by the reset signal xrst.
- the circuit disposed in each chip is not limited to this configuration.
- the photodiode 322 may be disposed in the light receiving chip 201, and the other may be disposed in the circuit chip 202.
- the logarithmic response unit 320 may be disposed in the light receiving chip 201, and the other may be disposed in the circuit chip 202.
- the logarithmic response unit 320 and the buffer 330 may be disposed in the light receiving chip 201, and the other components may be disposed in the circuit chip 202.
- the logarithmic response unit 320, the buffer 330, and the capacitor 341 can be disposed in the light receiving chip 201, and the other components can be disposed in the circuit chip 202.
- the logarithmic response unit 320, the buffer 330, the differentiating circuit 340, and the comparator 350 may be disposed in the light receiving chip 201, and the others may be disposed in the circuit chip 202.
- FIG. 6 is a graph showing an example of input / output characteristics of the comparator 350 in the first embodiment of the present technology.
- the vertical axis in the figure indicates the level of the output signal (VCH or VCL) of the comparator 350, and the horizontal axis indicates the level of the input signal (differential signal) of the comparator 350.
- the solid line indicates the trajectory of the comparison result VCH, and the one-dot chain line indicates the trajectory of the comparison result VCL.
- the comparison result VCH changes from the low level to the high level, and the on event is detected.
- the differential signal falls below the lower limit threshold Voff, the comparison result VCL changes from high level to low level, and an off event is detected.
- FIG. 7 is a block diagram showing a configuration example of the current detection unit 410 and the threshold control unit 420 in the first embodiment of the present technology.
- the current detection unit 410 includes a pMOS transistor 411.
- the threshold control unit 420 includes a positive side pMOS parallel circuit 430, a positive side nMOS parallel circuit 440, a negative side pMOS parallel circuit 450, a negative side nMOS parallel circuit 460, a positive side offset current source 421 and a negative side offset current source 422.
- the pMOS transistor 411 detects the total current Ipix_tot.
- the gate of the pMOS transistor 411 is connected to the positive pMOS parallel circuit 430 and the negative pMOS parallel circuit 450, the source is connected to the power supply, and the drain is connected to the pixel array unit 300. Also, the gate and drain of the pMOS transistor 411 are shorted.
- the positive side pMOS parallel circuit 430 adjusts the total current Ipix_tot and outputs it to the positive side nMOS parallel circuit 440 as an adjusted current Ipix_ctl +.
- the positive side offset current source 421 generates a constant current as the offset current Iofs + and supplies it to the positive side nMOS parallel circuit 440.
- the positive side nMOS parallel circuit 440 converts the sum of the adjustment current Ipix_ctl + and the offset current Iofs + into a voltage, and supplies the voltage to the pixel array unit 300 as the upper limit threshold Von.
- the negative side pMOS parallel circuit 450 adjusts the total current Ipix_tot and outputs it to the negative side nMOS parallel circuit 460 as an adjusted current Ipix_ctl-.
- the negative offset current source 422 generates a constant current as the offset current Iofs ⁇ .
- the positive side pMOS parallel circuit 430 and the negative side pMOS parallel circuit 450 are an example of the adjustment unit in the claims.
- the positive side offset current source 421 and the negative side offset current source 422 are examples of the offset current source described in the claims.
- the negative side nMOS parallel circuit 460 converts the difference between the adjustment current Ipix_ctl ⁇ and the offset current Iofs ⁇ into a voltage, and supplies the voltage to the pixel array unit 300 as the lower limit threshold Voff.
- the positive side nMOS parallel circuit 440 and the negative side nMOS parallel circuit 460 are an example of the conversion unit described in the claims.
- the threshold control unit 420 controls the upper threshold Von and the lower threshold Voff to be higher as the total current Ipix_tot is larger.
- the pixels in the pixel array unit 300 detect both the on event and the off event, only one of them may be detected. For example, when the pixel detects only the on event, only the corresponding positive side pMOS parallel circuit 430, the positive side nMOS parallel circuit 440, and the positive side offset current source 421 are arranged in the threshold value control unit 420.
- the current detection unit 410 detects the sum of the photocurrents of all the pixels as the total current Ipix_tot, it may also detect the sum of the photocurrents of some pixels in the pixel array unit 300 as the total current Ipix_tot. it can.
- the pixel array unit 300 may be divided into a plurality of areas each having two or more pixels, and for each area, only one pixel in the area may output the photocurrent to the current detection unit 410. .
- the number of branch points of the signal line 419 can be reduced as compared with the case of detecting the sum of the photocurrents of all the pixels.
- FIG. 8 is a circuit diagram showing a configuration example of the positive side pMOS parallel circuit 430 according to the first embodiment of the present technology.
- the positive side pMOS parallel circuit 430 includes m + 1 (m is an integer) switches 431, m + 1 pMOS transistors 432, m ⁇ 1 pMOS transistors 433, and a decoder 434.
- the configuration of the negative side pMOS parallel circuit 450 is the same as the configuration of the positive side pMOS parallel circuit 430.
- the switches 431 are associated with different pMOS transistors 432.
- the switch 431 opens and closes the path between the source of the corresponding transistor and the power supply according to the control of the decoder 434.
- Each gate of the pMOS transistor 432 is connected to the gate of the pMOS transistor 411 in the current detection unit 410.
- the drains of the pMOS transistors 432 are commonly connected to the positive side nMOS parallel circuit 440.
- Each gate of the pMOS transistor 433 is connected to the drain of the pMOS transistor 411 in the current detection unit 410.
- the source and drain of the m-th pMOS transistor 433 are connected to the drain of each of the m-th and m + 1-th pMOS transistors 432.
- the decoder 434 controls each of the switches 431 in accordance with a predetermined set value previously stored in a register or the like.
- Each of the pMOS transistors 432 forms a current mirror circuit with the pMOS transistor 411. These current mirror circuits can distribute the total current to generate a plurality of distributed currents by the distribution ratio according to the respective gate widths and gate lengths of the transistors.
- a circuit including m + 1 switches 431, m + 1 pMOS transistors 432, and m-1 pMOS transistors 433 is an example of a second distribution circuit described in the claims.
- the gate width W and the gate length L of each of the pMOS transistor 411 and the first to m-th pMOS transistors 432 are set to values satisfying the following equation.
- W / L (N-1) ⁇ ⁇ formula 1
- the gate width W and gate length L of the (m + 1) th pMOS transistor 432 are set to values satisfying the following equation.
- W / L ⁇ ⁇ Formula 2
- the gate width W and the gate length L of the pMOS transistor 433 are set to values satisfying the following equation.
- W / L N ⁇ ⁇ / (N ⁇ 1) formula 3
- I m + 1 Ipix_tot / ⁇ N m-1 (N-1) ⁇ equation 5
- the adjustment current Ipix_ctl + can be controlled on the order of sub-picoamperes based on Equation 4 and Equation 5 by the decoder 434 opening and closing the switch 431 according to the set value. For example, the first and m + 1-th switch 431 in the closed state, when the remainder in the open state, it is possible to control the regulated current Ipix_ctl + the sum of the distributed current I 1 and I m + 1.
- the decoder 434 is an example of a second decoder in the claims. Further, the configuration of the positive side pMOS parallel circuit 430 is not limited to the circuit illustrated in the same figure as long as the total current can be adjusted.
- FIG. 9 is a circuit diagram showing one configuration example of the positive side nMOS parallel circuit 440 according to the first embodiment of the present technology.
- the positive side nMOS parallel circuit 440 includes n (n is an integer) switches 441, n nMOS transistors 442, and a decoder 443.
- the configuration of the negative side nMOS parallel circuit 460 is the same as that of the positive side nMOS parallel circuit 440.
- Each of the switches 441 is associated with a different nMOS transistor 442.
- One end of each of the switches 441 is connected to the positive pMOS parallel circuit 430 and the positive offset current source 421, and the other end is connected to the drain of the corresponding nMOS transistor 442.
- the respective gates and drains of the nMOS transistors 442 are shorted and in a so-called diode connection state.
- the nMOS transistor 442 is an example of the resistance element described in the claims.
- the decoder 443 controls each of the switches 441 in accordance with a predetermined set value previously stored in a register or the like.
- the combined resistance of the diode-connected n nMOS transistors 442 can be controlled by opening and closing the switch 441 in accordance with the set value by the decoder 443. Then, the voltage generated by the sum of the adjustment current Ipix_ctl + and the offset current Iofs + flowing through the combined resistance is output as the upper limit threshold Von.
- the decoder 443 is an example of a third decoder in the claims. Further, the configuration of the positive side nMOS parallel circuit 440 is not limited to the circuit illustrated in the figure, as long as the upper limit threshold Von can be generated by current-voltage conversion.
- FIG. 10 is a block diagram showing a configuration example of the AER logic circuit 360 in the first embodiment of the present technology.
- the AER logic circuit 360 includes nMOS transistors 361 to 363, 365 to 368, 370 and 371, pMOS transistors 364 and 369, and a capacitor 372.
- the nMOS transistors 361 and 362 are connected in series.
- the comparison result VCH is input to the gates of the nMOS transistors 362 and 363, and the response AckYp1 is input to the gate of the nMOS transistor 361.
- the sources of the nMOS transistors 362 and 363 are grounded, and the drain of the nMOS transistor 361 outputs a request ReqHXp1 to the column AER circuit 220.
- the request ReqYp1 is output from the drain of the nMOS transistor 363 to the row AER circuit 260.
- the pMOS transistor 364 and the nMOS transistor 365 are connected in series between the power supply and the ground terminal.
- the comparison result VCL is input to the gate of the pMOS transistor 364, and the bias voltage Vbaer is applied to the gate of the nMOS transistor 365.
- nMOS transistors 366 and 367 are connected in series.
- the gates of nMOS transistors 367 and 368 are connected to the connection point of pMOS transistor 364 and nMOS transistor 365.
- the response AckYp1 is input to the gate of the nMOS transistor 366.
- the sources of the nMOS transistors 367 and 368 are grounded, and the drain Re of the nMOS transistor 366 outputs a request ReqLxp1 to the column AER circuit 220.
- Request ReqYp1 is output from the drain of the nMOS transistor 368 to the row AER circuit 260.
- the pMOS transistor 369 and the nMOS transistors 370 and 371 are connected in series between the power supply and the ground terminal. Further, a bias voltage Vbrst is applied to the gate of the pMOS transistor 369.
- the response AckYp1 is input to the gate of the nMOS transistor 370, and the response AckXp1 is input to the gate of the nMOS transistor 371.
- One end of the capacitor 372 is connected to the power supply, and the other end is connected to the connection point of the pMOS transistor 369 and the nMOS transistor 370.
- the voltage at the connection point of the pMOS transistor 369 and the nMOS transistor 370 is output to the differentiating circuit 340 as a reset signal xrst.
- the AER logic circuit 360 transmits a low level request ReqYp1 to the row AER circuit 260. Then, upon receiving the response AckYp1 of high level from the row AER circuit 260, the AER logic circuit 360 transmits the request ReqHXp1 of low level to the column AER circuit 220. Next, upon receiving the response AckXp1 of high level from the column AER circuit 220, the AER logic circuit 360 outputs a low level reset signal xrst to the differentiating circuit 340.
- the AER logic circuit 360 transmits a low level request ReqYp1 to the row AER circuit 260. Then, upon receiving the response AckYp1 of high level from the row AER circuit 260, the AER logic circuit 360 transmits a low level request ReqLXp1 to the column AER circuit 220. Next, upon receiving the response AckXp1 of high level from the column AER circuit 220, the AER logic circuit 360 outputs a low level reset signal xrst to the differentiating circuit 340.
- FIG. 11 is a block diagram showing a configuration example of the row AER circuit 260 according to the first embodiment of the present technology.
- the row AER circuit 260 includes a row AER block 270 for each row.
- the row AER block 270 is for performing handshake between the corresponding row and row arbiter 600 and the state machine 215.
- FIG. 12 is a circuit diagram showing one configuration example of the row AER block 270 in the first embodiment of the present technology.
- the row AER block 270 includes a pMOS transistor 271, nMOS transistors 272 and 273, a NOR gate 276, and inverters 274 and 275.
- the pMOS transistor 271 and the nMOS transistors 272 and 273 are connected in series between the power supply and the ground terminal.
- the control signal LOAD from the state machine 215 is input to the gates of the pMOS transistor 271 and the nMOS transistor 272.
- the control signal LOAD is a signal instructing reading of the detection result of the address event. Further, to the gate of the nMOS transistor 273, xCHIP_ACK obtained by inverting the response CHIP_ACK from the state machine 215 is input.
- the NOR gate 276 outputs the NOR of the two input values to the row arbiter 600 as a request ReqYa1.
- the response CHIP_ACK from the state machine 215 is input to one of the input terminals of the NOR gate 276.
- the other input terminal of the NOR gate 276 is connected to a connection point of the pMOS transistor 271 and the nMOS transistor 272 and a signal line for transmitting the request ReqYp1 from the pixel array unit 300.
- the inverter 275 inverts the response AckYa1 from the row arbiter 600 and outputs it to the inverter 274.
- the inverter 274 inverts the signal from the inverter 275 and outputs it to the pixel array unit 300 as a response AckYp1.
- the row AER block 270 when the low level request ReqYp1 is input, the row AER block 270 outputs the low level request ReqYa1 if the response CHIP_ACK is high level. Further, the row AER block 270 delays the high level response AckYa1 and outputs it as a response AckYp1.
- FIG. 13 is a block diagram showing a configuration example of the column AER circuit 220 according to the first embodiment of the present technology.
- the row AER circuit 220 includes a row AER block 221 for each row.
- the column AER block 221 performs handshake between the corresponding column, the state machine 215 and the column arbiter 213.
- FIG. 14 is a block diagram showing one configuration example of the column AER block 221 in the first embodiment of the present technology.
- the row AER block 221 includes an H-side row AER block 222, an L-side row AER block 223, and an OR gate 224.
- the H side row AER block 222 performs handshake when the low level request ReqHXp1 is input.
- the H-side column AER block 222 outputs a signal obtained by delaying the high level response AckHXa1 to the OR gate 224.
- the L side row AER block 223 performs handshake when the low level request ReqLXp1 is input.
- the L-side column AER block 223 outputs a signal obtained by delaying the high level response AckLXa1 to the OR gate 224.
- the low level request from the pixel array unit 300 is inverted by the H side column AER block 222 and the L side column AER block 223.
- H side column AER block 222 and L side column AER block 223 are the same as row AER block 270 illustrated in FIG.
- the configuration of the AER block of these rows and columns is not limited to the circuit illustrated in FIG. 12 as long as handshake can be performed.
- the OR gate 224 outputs the logical sum of the signals from the H side column AER block 222 and the L side column AER block 223 as a response AckXp1.
- FIG. 15 is a block diagram showing a configuration example of the row arbiter 600 in the first embodiment of the present technology.
- the arbiter block 610 arbitrates between the request from the first line and the request from the second line.
- the arbiter block 610 performs handshake with the arbiter block 652, and outputs a response to the first or second line based on the arbitration result.
- the arbiter block 650 arbitrates between the request from the third line and the request from the fourth line.
- the arbiter block 650 performs handshake with the arbiter block 652, and outputs a response to the third or fourth line based on the arbitration result.
- An arbiter block 651 mediates between the request from the fifth line and the request from the sixth line.
- the arbiter block 651 performs handshake with the arbiter block 653 and outputs a response to the fifth or sixth line based on the arbitration result.
- the arbiter block 652 arbitrates the request from the arbiter block 610 and the request from the arbiter block 650.
- the arbiter block 652 performs handshake with the arbiter block 654, and outputs a response to the arbiter block 610 or 650 based on the arbitration result.
- the arbiter block 653 arbitrates the request from the arbiter block 651 and the request from the seventh line.
- the arbiter block 653 performs handshake with the arbiter block 654, and outputs a response to the arbiter block 651 or the seventh line based on the arbitration result.
- the arbiter block 654 arbitrates the request from the arbiter block 652 and the request from the arbiter block 653.
- the arbiter block 654 delays the response to the earlier request by the inverters 601 and 602 and supplies it to the arbiter block 652 or 653.
- the configuration of the column arbiter 213 is similar to that of the row arbiter 600. Also, the configuration of these arbiters is not limited to the configuration illustrated in the figure, as long as the request can be arbitrated.
- FIG. 16 is a circuit diagram showing one configuration example of the arbiter block 610 in the first embodiment of the present technology.
- the arbiter block 610 includes pMOS transistors 611, 614, 615 to 617, 620, 622, 625 and 626, nMOS transistors 612, 613, 618, 619, 623, 624 and 627, and an inverter 621.
- the pMOS transistors 611 and 614 are connected in parallel to the power supply.
- the nMOS transistors 612 and 613 are connected in series between the drains of the pMOS transistors 611 and 614 and the ground terminal. Further, the request ReqXa1 from the first row is input to the gates of the pMOS transistor 611 and the nMOS transistor 613.
- the pMOS transistors 615 and 616 are connected in series to the power supply. Further, the request ReqXa1 is input to the gate of the pMOS transistor 615, and the request ReqXa2 from the second row is input to the gate of the pMOS transistor 616.
- the pMOS transistors 617 and 620 are connected in parallel to the power supply.
- the nMOS transistors 618 and 619 are connected in series between the drains of the pMOS transistors 617 and 620 and the ground terminal.
- the gates of the pMOS transistor 617 and the nMOS transistor 618 are connected to the drains of the pMOS transistors 611 and 614, respectively.
- the request ReqXa2 is input to the gates of the pMOS transistor 620 and the nMOS transistor 619.
- the drains of the pMOS transistors 617 and 620 are connected to the gates of the pMOS transistor 614 and the nMOS transistor 612.
- connection point of the nMOS transistors 612 and 613, the drain of the pMOS transistor 616, and the connection point of the nMOS transistors 618 and 619 are connected to a signal line for transmitting the request ReqXb1.
- the request ReqXb1 is output to the higher-level arbiter block 652.
- the inverter 621 inverts the response AckXb1 from the higher level arbiter block 652.
- the inverter 621 outputs the inverted signal to the gates of the pMOS transistor 625 and the nMOS transistor 624.
- the pMOS transistors 625 and 626 and the nMOS transistor 627 are connected in series between the power supply and the ground terminal.
- the pMOS transistor 622 and the nMOS transistor 623 are connected in series between the connection point of the pMOS transistors 625 and 626 and the ground terminal.
- the source and drain of the nMOS transistor 624 are connected to the connection point of the pMOS transistor 622 and the nMOS transistor 623 and the connection point of the pMOS transistor 626 and the nMOS transistor 627.
- the gates of the pMOS transistor 622 and the nMOS transistor 623 are connected to the drains of the pMOS transistors 611 and 614.
- the gates of pMOS transistor 626 and nMOS transistor 627 are connected to the drains of pMOS transistors 617 and 620, respectively.
- the connection point of the pMOS transistor 622 and the nMOS transistor 623 is connected to a signal line for transmitting the response AckXa1 to the first row.
- the connection point of the pMOS transistor 626 and the nMOS transistor 627 is connected to the signal line transmitting the response AckXa2 to the second row.
- the arbiter block 610 outputs the request ReqXb1 upon receiving the request ReqXa1 or the request ReqXa2. Then, upon receiving the response AckXb1, the arbiter block 610 outputs a response corresponding to the earlier one of the request ReqXa1 and the request ReqXa2.
- the configuration of the arbiter blocks 650 to 654 is the same as that of the arbiter block 610 illustrated in the figure.
- FIG. 17 is a timing chart showing an example of a handshake according to the first embodiment of the present technology.
- the row AER block 270 returns a high level response AckYp1 if the response CHIP_ACK is high level.
- the pixel 310 When receiving the response AckYp1, the pixel 310 outputs a low level request ReqHXp1 when an on-event occurs. When an off event occurs, a low level request ReqLXp1 is output.
- the column AER block 221 Upon receiving the request ReqHXp1, the column AER block 221 returns a high level response AckXp1 if the response CHIP_ACK is high level. Upon receiving the response AckXp1, the pixel 310 generates a low level reset signal xrst to initialize the requests ReqYp1 and ReqHXp1 to a high level.
- the column AER block 221 outputs a low level request CHIP_REQ.
- the state machine 215 transfers the detection result of the address event to the DSP circuit 120, and returns a low level response CHIP_ACK.
- the row AER block 270 When receiving the response CHIP_ACK, the row AER block 270 initializes the response AckYp1 to low level if the request ReqYp1 is at high level. Also, upon receiving the response CHIP_ACK, the column AER block 221 initializes the response AckXp1 to low level if the request ReqHXp1 is at high level.
- the pixel 310 When the response AckXp1 is initialized, the pixel 310 initializes the reset signal xrst to high level, and the column AER block 221 initializes the request CHIP_REQ to high level.
- the state machine 215 also initializes the response CHIP_ACK to high level.
- FIG. 18 is a flowchart illustrating an example of the AER process according to the first embodiment of the present technology. This AER process is started, for example, when a predetermined application for detecting an address event is executed.
- the pixel 310 is initialized by the reset signal xrst or the like (step S920), and converts the photocurrent into a differential signal (step S921). Further, the current detection unit 410 detects the total current (step S922), and the threshold control unit 420 controls the threshold (upper limit threshold and lower limit threshold) according to the total current (step S923). Then, the pixel 310 compares the amount of change in voltage (differential signal) according to the luminance with the upper limit threshold to determine whether the differential signal exceeds the upper limit threshold (step S 924).
- step S 924: Yes When the differential signal exceeds the upper threshold (step S 924: Yes), the pixel 310 detects an on event (step S 927). On the other hand, when the differential signal is less than or equal to the upper threshold (step S 924: No), the pixel 310 determines whether the differential signal is lower than the lower threshold (step S 925).
- step S 926 When the differential signal is lower than the lower limit threshold (step S 925: Yes), the pixel 310 detects an off event (step S 926). After step S926 or S927, the pixel 310 transfers the detection result by handshake (step S928) and performs initialization (step S929).
- step S 925 No
- step S 929 the pixel 310 or the like repeatedly executes step S 921 and subsequent steps.
- FIG. 19 is a diagram illustrating an example of the detection result of the address event according to the first embodiment of the present technology.
- FIG. 20 is a diagram showing an example of the detection result of the address event in the comparative example.
- FIGS. 19A and 20A are diagrams showing an example of signal level variations from respective pixels in the first embodiment of the present technology and the comparative example, and b in FIGS. 19 and 20 is a first diagram. It is a figure which shows an example of the detection result of each address event of embodiment and a comparative example.
- the vertical axis in FIG. 19 and FIG. 20 a indicates the level of the signal, and the horizontal axis indicates time.
- 19 and 20 b indicate the level of the output signal from the differentiating circuit, and the horizontal axes indicate time.
- a thin solid curve indicates the locus of the level of the differential signal that fluctuates according to the flicker.
- a thick solid line indicates the level of the differential signal which fluctuates in accordance with the luminance change other than the flicker.
- An alternate long and short dash line indicates the upper limit threshold Von, and a dashed line indicates the lower limit threshold Voff.
- the differential signal obtained by converting the photocurrent periodically fluctuates as exemplified by a thin solid line under the influence of the flicker. For example, if the flicker period is 60 hertz (Hz), the period in which the differential signal fluctuates is also 60 hertz (Hz).
- the total current Ipix_tot of all the pixels is detected, and the upper threshold Von and the lower threshold Voff are controlled to higher values as the current is larger.
- the threshold Von and the lower threshold Voff also change. Therefore, even if the level of the signal fluctuates due to the flicker, the on event or the off event is not detected as exemplified in b in the figure.
- FIG. 21 is a diagram illustrating an example of a change in image data according to the first embodiment of the present technology.
- a is an example of the image data 700 before the luminance change other than the flicker occurs
- b in the figure is an example of the image data 710 in the case of the luminance change other than the flicker.
- the hatched part indicates an area where no address event is detected
- the white part indicates an area where an address event is detected.
- FIG. 22 is a diagram showing an example of changes in image data in a comparative example in which the upper limit threshold Von and the lower limit threshold Voff are fixed values.
- a is an example of the image data 730 before the luminance changes due to the flicker
- b in the drawing is an example of the image data 740 when the luminance changes due to the flicker.
- the hatched part indicates an area where no address event is detected
- the white part indicates an area where an address event is detected.
- An address event is not detected in the image data 730 before the luminance changes due to the flicker.
- an address event is erroneously detected in all pixels. As a result, flicker may cause noise in the image data.
- the solid-state imaging device 200 controls the threshold value to a value according to the total current of all the pixels, the variation of the total current when flicker occurs It is possible to suppress false detection of the originating address event. Thereby, noise due to flicker can be reduced in the image data.
- the threshold control unit 420 controls the adjustment current and the combined resistance by the decoder, adds and subtracts fixed offset currents Iofs + and Iofs ⁇ , and converts them into the upper threshold Von and the lower threshold Voff. It was However, in this configuration, since the offset current is fixed, fine adjustment of the upper limit threshold Von and the lower limit threshold Voff may be difficult.
- the solid-state imaging device 200 according to the second embodiment is different from the first embodiment in that the offset current is further controlled.
- FIG. 23 is a block diagram showing a configuration example of the current detection unit 410 and the threshold control unit 420 in the second embodiment of the present technology.
- the threshold control unit 420 of the second embodiment is different from the first embodiment in that the positive side current splitter 470 and the negative side current splitter 480 are provided instead of the positive side offset current source 421 and the negative side offset current source 422. It is different from the form.
- FIG. 24 is a circuit diagram showing one configuration example of the positive side current splitter 470 in the second embodiment of the present technology.
- the positive side current splitter 470 includes a reference current source 471, an nMOS transistor 472, m + 1 switches 473, m + 1 nMOS transistors 474, m ⁇ 1 nMOS transistors 475, a decoder 476, and a buffer 477.
- a reference current source 471 an nMOS transistor 472
- m + 1 switches 473 m + 1 nMOS transistors 474
- m ⁇ 1 nMOS transistors 475 m ⁇ 1 nMOS transistors 475
- decoder 476 m ⁇ 1 nMOS transistors
- the reference current source 471 generates a predetermined reference current I REF and supplies it to the drain of the nMOS transistor 472.
- the drain and gate of the nMOS transistor 472 are shorted and the source is grounded.
- Each of the switches 473 is associated with a different nMOS transistor 474.
- the switch 473 connects the drain of the corresponding transistor to one of the buffer 477 and the output-side positive nMOS parallel circuit 440 according to the control of the decoder 476.
- each of the nMOS transistors 474 is connected to the gate of the nMOS transistor 472.
- the sources of the nMOS transistors 474 are commonly connected to the ground terminal.
- Each gate of the nMOS transistor 475 is connected to the gate of the nMOS transistor 472.
- the drain and the source of the m-th nMOS transistor 475 are connected to the sources of the m-th and the (m + 1) -th nMOS transistor 474, respectively.
- the decoder 476 controls each of the switches 473 in accordance with a predetermined set value previously stored in a register or the like.
- the input terminal of the buffer 477 is connected to the output-side positive nMOS parallel circuit 440, and the output terminal is connected to each of the switches 473.
- Each of the nMOS transistors 474 forms a current mirror circuit with the nMOS transistor 472. These current mirror circuits can distribute the total current to generate a plurality of distributed currents by the distribution ratio according to the respective gate widths and gate lengths of the transistors.
- a circuit including m + 1 switches 473, m + 1 nMOS transistors 474, and m-1 nMOS transistors 475 is an example of the first distribution circuit described in the claims.
- the gate width W and the gate length L of each of the nMOS transistor 472 and the first to m-th nMOS transistors 474 are set to values satisfying the following equation.
- W / L (N-1) ⁇ ⁇ formula 6
- the gate width W and the gate length L of the nMOS transistor 475 are set to values satisfying the following equation.
- W / L N ⁇ ⁇ / (N ⁇ 1) formula 8
- I m + 1 I REF / ⁇ N m-1 (N-1) ⁇ equation 10
- the offset current Iofs + can be controlled on the order of sub-picoamperes based on Equation 9 and Equation 10 by the decoder 476 controlling the connection of the switch 473 according to the set value.
- the first and m + 1-th switch 473 connect to the output side, when the remaining buffer 477 side, it is possible to control the offset current Iofs + the sum of the distributed current I 1 and I m + 1.
- the decoder 476 is an example of the first decoder in the claims.
- the configuration of the positive side current splitter 470 is not limited to the circuit illustrated in the same figure as long as it can control the offset current Iofs +.
- the upper limit threshold is compared with the case where only the adjustment current and the combined resistance are controlled. Fine adjustment of Von and the lower limit threshold Voff is facilitated.
- the technology according to the present disclosure can be applied to various products.
- the technology according to the present disclosure is realized as a device mounted on any type of mobile object such as a car, an electric car, a hybrid electric car, a motorcycle, a bicycle, personal mobility, an airplane, a drone, a ship, a robot May be
- FIG. 25 is a block diagram showing a schematic configuration example of a vehicle control system that is an example of a mobile control system to which the technology according to the present disclosure can be applied.
- Vehicle control system 12000 includes a plurality of electronic control units connected via communication network 12001.
- the vehicle control system 12000 includes a drive system control unit 12010, a body system control unit 12020, an external information detection unit 12030, an in-vehicle information detection unit 12040, and an integrated control unit 12050.
- a microcomputer 12051, an audio image output unit 12052, and an in-vehicle network I / F (interface) 12053 are illustrated as a functional configuration of the integrated control unit 12050.
- the driveline control unit 12010 controls the operation of devices related to the driveline of the vehicle according to various programs.
- the drive system control unit 12010 includes a drive force generation device for generating a drive force of a vehicle such as an internal combustion engine or a drive motor, a drive force transmission mechanism for transmitting the drive force to the wheels, and a steering angle of the vehicle. It functions as a control mechanism such as a steering mechanism that adjusts and a braking device that generates a braking force of the vehicle.
- Body system control unit 12020 controls the operation of various devices equipped on the vehicle body according to various programs.
- the body system control unit 12020 functions as a keyless entry system, a smart key system, a power window device, or a control device of various lamps such as a headlamp, a back lamp, a brake lamp, a blinker or a fog lamp.
- the body system control unit 12020 may receive radio waves or signals of various switches transmitted from a portable device substituting a key.
- Body system control unit 12020 receives the input of these radio waves or signals, and controls a door lock device, a power window device, a lamp and the like of the vehicle.
- Outside vehicle information detection unit 12030 detects information outside the vehicle equipped with vehicle control system 12000.
- an imaging unit 12031 is connected to the external information detection unit 12030.
- the out-of-vehicle information detection unit 12030 causes the imaging unit 12031 to capture an image outside the vehicle, and receives the captured image.
- the external information detection unit 12030 may perform object detection processing or distance detection processing of a person, a vehicle, an obstacle, a sign, characters on a road surface, or the like based on the received image.
- the imaging unit 12031 is an optical sensor that receives light and outputs an electrical signal according to the amount of light received.
- the imaging unit 12031 can output an electric signal as an image or can output it as distance measurement information.
- the light received by the imaging unit 12031 may be visible light or non-visible light such as infrared light.
- In-vehicle information detection unit 12040 detects in-vehicle information.
- a driver state detection unit 12041 that detects a state of a driver is connected to the in-vehicle information detection unit 12040.
- the driver state detection unit 12041 includes, for example, a camera for imaging the driver, and the in-vehicle information detection unit 12040 determines the degree of fatigue or concentration of the driver based on the detection information input from the driver state detection unit 12041. It may be calculated or it may be determined whether the driver does not go to sleep.
- the microcomputer 12051 calculates a control target value of the driving force generation device, the steering mechanism or the braking device based on the information inside and outside the vehicle acquired by the outside information detecting unit 12030 or the in-vehicle information detecting unit 12040, and a drive system control unit A control command can be output to 12010.
- the microcomputer 12051 controls the driving force generating device, the steering mechanism, the braking device, and the like based on the information around the vehicle acquired by the outside information detecting unit 12030 or the in-vehicle information detecting unit 12040 so that the driver can Coordinated control can be performed for the purpose of automatic driving that travels autonomously without depending on the operation.
- the microcomputer 12051 can output a control command to the body system control unit 12020 based on the information outside the vehicle acquired by the external information detection unit 12030.
- the microcomputer 12051 controls the headlamp according to the position of the preceding vehicle or oncoming vehicle detected by the external information detection unit 12030, and performs cooperative control for the purpose of antiglare such as switching the high beam to the low beam. It can be carried out.
- the audio image output unit 12052 transmits an output signal of at least one of audio and image to an output device capable of visually or aurally notifying information to a passenger or the outside of a vehicle.
- an audio speaker 12061, a display unit 12062, and an instrument panel 12063 are illustrated as the output device.
- the display unit 12062 may include, for example, at least one of an on-board display and a head-up display.
- FIG. 26 is a diagram illustrating an example of the installation position of the imaging unit 12031.
- imaging units 12101, 12102, 12103, 12104, and 12105 are included.
- the imaging units 12101, 12102, 12103, 12104, and 12105 are provided, for example, at positions such as the front nose of the vehicle 12100, a side mirror, a rear bumper, a back door, and an upper portion of a windshield of a vehicle interior.
- the imaging unit 12101 provided in the front nose and the imaging unit 12105 provided in the upper part of the windshield in the vehicle cabin mainly acquire an image in front of the vehicle 12100.
- the imaging units 12102 and 12103 included in the side mirror mainly acquire an image of the side of the vehicle 12100.
- the imaging unit 12104 provided in the rear bumper or the back door mainly acquires an image of the rear of the vehicle 12100.
- the imaging unit 12105 provided on the top of the windshield in the passenger compartment is mainly used to detect a leading vehicle or a pedestrian, an obstacle, a traffic light, a traffic sign, a lane, or the like.
- FIG. 26 shows an example of the imaging range of the imaging units 12101 to 12104.
- the imaging range 12111 indicates the imaging range of the imaging unit 12101 provided on the front nose
- the imaging ranges 12112 and 12113 indicate the imaging ranges of the imaging units 12102 and 12103 provided on the side mirrors
- the imaging range 12114 indicates The imaging range of the imaging part 12104 provided in the rear bumper or the back door is shown. For example, by overlaying the image data captured by the imaging units 12101 to 12104, a bird's eye view of the vehicle 12100 viewed from above can be obtained.
- At least one of the imaging units 12101 to 12104 may have a function of acquiring distance information.
- at least one of the imaging units 12101 to 12104 may be a stereo camera including a plurality of imaging devices, or an imaging device having pixels for phase difference detection.
- the microcomputer 12051 measures the distance to each three-dimensional object in the imaging ranges 12111 to 12114, and the temporal change of this distance (relative velocity with respect to the vehicle 12100). In particular, it is possible to extract a three-dimensional object traveling at a predetermined speed (for example, 0 km / h or more) in substantially the same direction as the vehicle 12100 as a leading vehicle, in particular by finding the it can. Further, the microcomputer 12051 can set an inter-vehicle distance to be secured in advance before the preceding vehicle, and can perform automatic brake control (including follow-up stop control), automatic acceleration control (including follow-up start control), and the like. As described above, it is possible to perform coordinated control for the purpose of automatic driving or the like that travels autonomously without depending on the driver's operation.
- automatic brake control including follow-up stop control
- automatic acceleration control including follow-up start control
- the microcomputer 12051 converts three-dimensional object data relating to three-dimensional objects into two-dimensional vehicles such as two-wheeled vehicles, ordinary vehicles, large vehicles, pedestrians, telephone poles, and other three-dimensional objects. It can be classified, extracted and used for automatic avoidance of obstacles. For example, the microcomputer 12051 identifies obstacles around the vehicle 12100 into obstacles visible to the driver of the vehicle 12100 and obstacles difficult to see.
- the microcomputer 12051 determines the collision risk indicating the degree of risk of collision with each obstacle, and when the collision risk is a setting value or more and there is a possibility of a collision, through the audio speaker 12061 or the display unit 12062 By outputting an alarm to the driver or performing forcible deceleration or avoidance steering via the drive system control unit 12010, driving support for collision avoidance can be performed.
- At least one of the imaging units 12101 to 12104 may be an infrared camera that detects infrared light.
- the microcomputer 12051 can recognize a pedestrian by determining whether a pedestrian is present in the images captured by the imaging units 12101 to 12104.
- pedestrian recognition is, for example, a procedure for extracting feature points in images captured by the imaging units 12101 to 12104 as an infrared camera, and pattern matching processing on a series of feature points indicating the outline of an object to determine whether it is a pedestrian or not
- the procedure is to determine
- the audio image output unit 12052 generates a square outline for highlighting the recognized pedestrian.
- the display unit 12062 is controlled so as to display a superimposed image. Further, the audio image output unit 12052 may control the display unit 12062 to display an icon or the like indicating a pedestrian at a desired position.
- the technique according to the present disclosure may be applied to the outside information detection unit 12030 among the configurations described above.
- the imaging device 100 of FIG. 1 can be applied to the external information detection unit 12030.
- noise due to flicker can be reduced and a more easily viewable photographed image can be obtained, so detection accuracy of people, vehicles and obstacles can be improved. .
- the processing procedure described in the above embodiment may be regarded as a method having a series of these procedures, and a program for causing a computer to execute the series of procedures or a recording medium storing the program. You may catch it.
- a recording medium for example, a CD (Compact Disc), an MD (Mini Disc), a DVD (Digital Versatile Disc), a memory card, a Blu-ray disc (Blu-ray (registered trademark) Disc) or the like can be used.
- the present technology can also be configured as follows. (1) a plurality of pixels each of which compares the amount of change in voltage according to the photocurrent with a predetermined threshold value; A current detection unit that detects the sum of the photocurrent of each of the plurality of pixels as a total current; And a threshold control unit configured to control the predetermined threshold to a value corresponding to the total current. (2) The threshold control unit An adjusting unit that adjusts the total current and outputs it as an adjusted current; An offset current source generating a predetermined offset current; The solid-state imaging device according to (1), further comprising: a conversion unit that converts the sum or difference of the adjustment current and the predetermined offset current into the predetermined threshold and supplies the predetermined threshold to each of the plurality of pixels.
- the offset current source is A reference current source generating a predetermined reference current; A first distribution circuit that distributes the predetermined reference current at a plurality of different ratios to generate a plurality of distribution currents; The solid-state imaging device according to (2), further comprising: a first decoder that controls the first distribution circuit to output a predetermined number of sums of the plurality of divided currents as the predetermined offset current.
- the adjustment unit A second distribution circuit that distributes the total current at a plurality of different ratios to generate a plurality of distribution currents; The solid-state imaging device according to (2) or (3), further comprising: a second decoder that controls the second distribution circuit to output a predetermined number of sums of the plurality of distribution currents as the adjustment current.
- a third decoder for connecting a predetermined number of the plurality of resistance elements in parallel and outputting a voltage generated as a result of the adjustment current flowing through the combined resistance of the predetermined number of resistance elements as the predetermined threshold
- the solid-state imaging device according to any one of 2) to 4).
- the current detection unit detects, as the total current, the sum of the photocurrent of each of some of the plurality of pixels. element.
- the threshold control unit controls the predetermined threshold to a higher value as the total current is larger.
- the predetermined threshold includes an upper threshold and a lower threshold that are different from each other, Each of the plurality of pixels is Detecting that the amount of change exceeds the upper threshold as an on-event;
- the solid-state imaging device according to any one of (1) to (7), which detects that the amount of change falls below the lower limit threshold as an off event.
- (9) a plurality of pixels each of which compares the amount of change in voltage according to the photocurrent with a predetermined threshold value;
- a current detection unit that detects the sum of the photocurrent of each of the plurality of pixels as a total current;
- a threshold control unit configured to control the predetermined threshold to a value corresponding to the total current;
- a signal processing unit configured to process a signal composed of comparison results of the plurality of pixels.
- a control method for a solid-state imaging device comprising: a threshold control procedure for controlling the predetermined threshold value to a value corresponding to the total current.
- Reference Signs List 100 imaging apparatus 110 optical unit 120 DSP circuit 130 display unit 140 operation unit 150 bus 160 frame memory 170 storage unit 180 power supply unit 200 solid-state image sensor 201 light receiving chip 202 circuit chip 213 column arbiter 214 column address encoder 215 state machine 216 row address encoder 220 column AER circuit 221 column AER block 222 H side column AER block 223 L side column AER block 224 OR gate 260 line AER circuit 270 lines AER block 271, 324, 331, 332, 342, 344, 351, 353, 364, 369 411, 432, 433, 611, 614-617, 620, 622, 625, 626 pMOS transistors 272, 273, 321, 323, 345, 352, 3 4, 361-363, 365-368, 370, 371, 442, 472, 474, 475, 612, 618, 619, 623, 624, 627 nMOS transistors 274, 275, 601, 602, 621 inverters 276 NOR gates 300 pixel array
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- Nonlinear Science (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
Abstract
Description
各々が光電流に応じた電圧の変化量と所定の閾値とを比較する複数の画素と、上記複数の画素のそれぞれの上記光電流の和を総電流として検出する電流検出部と、上記総電流に応じた値に上記所定の閾値を制御する閾値制御部とを具備する固体撮像素子、および、その制御方法である。これにより、総電流に応じた値に閾値が制御されるという作用をもたらす。
1.第1の実施の形態(総電流に応じて閾値を制御する例)
2.第2の実施の形態(オフセット電流を制御し、総電流に応じて閾値を制御する例)
3.移動体への応用例
[撮像装置の構成例]
図1は、本技術の第1の実施の形態における撮像装置100の一構成例を示すブロック図である。この撮像装置100は、画像データを撮像するための装置であり、光学部110、固体撮像素子200およびDSP(Digital Signal Processing)回路120を備える。さらに撮像装置100は、表示部130、操作部140、バス150、フレームメモリ160、記憶部170および電源部180を備える。撮像装置100としては、産業用ロボットに搭載されるカメラや、車載カメラなどが想定される。
図2は、本技術の第1の実施の形態における固体撮像素子200の積層構造の一例を示す図である。この固体撮像素子200は、受光チップ201と、その受光チップ201に積層された回路チップ202とを備える。
図5は、本技術の第1の実施の形態における画素310の一構成例を示す回路図である。この画素310は、対数応答部320、バッファ330、微分回路340、コンパレータ350およびAERロジック回路360を備える。
図7は、本技術の第1の実施の形態における電流検出部410および閾値制御部420の一構成例を示すブロック図である。電流検出部410は、pMOSトランジスタ411を備える。また、閾値制御部420は、正側pMOS並列回路430、正側nMOS並列回路440、負側pMOS並列回路450、負側nMOS並列回路460、正側オフセット電流源421および負側オフセット電流源422を備える。
図8は、本技術の第1の実施の形態における正側pMOS並列回路430の一構成例を示す回路図である。この正側pMOS並列回路430は、m+1(mは、整数)個のスイッチ431と、m+1個のpMOSトランジスタ432と、m-1個のpMOSトランジスタ433と、デコーダ434とを備える。なお、負側pMOS並列回路450の構成は、正側pMOS並列回路430の構成と同様である。
W/L=(N-1)×α ・・・式1
W/L=α ・・・式2
W/L=N×α/(N-1) ・・・式3
Im=Ipix_tot/Nm-1 ・・・式4
Im+1=Ipix_tot/{Nm-1(N-1)} ・・・式5
図9は、本技術の第1の実施の形態における正側nMOS並列回路440の一構成例を示す回路図である。この正側nMOS並列回路440は、n(nは、整数)個のスイッチ441と、n個のnMOSトランジスタ442と、デコーダ443とを備える。なお、負側nMOS並列回路460の構成は、正側nMOS並列回路440と同様である。
図10は、本技術の第1の実施の形態におけるAERロジック回路360の一構成例を示すブロック図である。このAERロジック回路360は、nMOSトランジスタ361乃至363、365乃至368、370および371と、pMOSトランジスタ364および369と、容量372とを備える。
図11は、本技術の第1の実施の形態における行AER回路260の一構成例を示すブロック図である。この行AER回路260は、行ごとに、行AERブロック270を備える。行AERブロック270は、対応する行と行アービタ600とステートマシン215との間でハンドシェイクを行うものである。
図12は、本技術の第1の実施の形態における行AERブロック270の一構成例を示す回路図である。この行AERブロック270は、pMOSトランジスタ271と、nMOSトランジスタ272および273と、NORゲート276と、インバータ274および275とを備える。
図13は、本技術の第1の実施の形態における列AER回路220の一構成例を示すブロック図である。この列AER回路220は、列ごとに列AERブロック221を備える。列AERブロック221は、対応する列と、ステートマシン215と、列アービタ213との間でハンドシェイクを行うものである。
図14は、本技術の第1の実施の形態における列AERブロック221の一構成例を示すブロック図である。この列AERブロック221は、H側列AERブロック222、L側列AERブロック223およびORゲート224を備える。
図15は、本技術の第1の実施の形態における行アービタ600の一構成例を示すブロック図である。この行アービタ600は、アービタブロック610、650乃至654とインバータ601および602とを7行ごとに備える。なお、同図は、垂直のイベントドリブンの画素数を7画素とした場合の図である。例えば、垂直のイベントドリブンの画素数が1000画素であれば、2^10段(=1024画素分)までカバーする10段のアービタが設けられる。
図16は、本技術の第1の実施の形態におけるアービタブロック610の一構成例を示す回路図である。このアービタブロック610は、pMOSトランジスタ611、614、615乃至617、620、622、625および626と、nMOSトランジスタ612、613、618、619、623、624および627とインバータ621とを備える。
図18は、本技術の第1の実施の形態におけるAER処理の一例を示すフローチャートである。このAER処理は、例えば、アドレスイベントを検出するための所定のアプリケーションが実行されたときに開始される。
上述の第1の実施の形態では、閾値制御部420は、デコーダにより調整電流や合成抵抗を制御し、固定のオフセット電流Iofs+およびIofs-を加減算して、上限閾値Vonおよび下限閾値Voffに変換していた。しかしながら、この構成では、オフセット電流が固定であるため、上限閾値Vonおよび下限閾値Voffの微調整が困難になるおそれがある。この第2の実施の形態の固体撮像素子200は、オフセット電流をさらに制御する点において第1の実施の形態と異なる。
W/L=(N-1)×α ・・・式6
W/L=α ・・・式7
W/L=N×α/(N-1) ・・・式8
Im=IREF/Nm-1 ・・・式9
Im+1=IREF/{Nm-1(N-1)} ・・・式10
本開示に係る技術(本技術)は、様々な製品へ応用することができる。例えば、本開示に係る技術は、自動車、電気自動車、ハイブリッド電気自動車、自動二輪車、自転車、パーソナルモビリティ、飛行機、ドローン、船舶、ロボット等のいずれかの種類の移動体に搭載される装置として実現されてもよい。
(1)各々が光電流に応じた電圧の変化量と所定の閾値とを比較する複数の画素と、
前記複数の画素のそれぞれの前記光電流の和を総電流として検出する電流検出部と、
前記総電流に応じた値に前記所定の閾値を制御する閾値制御部と
を具備する固体撮像素子。
(2)前記閾値制御部は、
前記総電流を調整して調整電流として出力する調整部と、
所定のオフセット電流を生成するオフセット電流源と、
前記調整電流と前記所定のオフセット電流との和または差を前記所定の閾値に変換して前記複数の画素のそれぞれに供給する変換部と
を備える前記(1)記載の固体撮像素子。
(3)前記オフセット電流源は、
所定の参照電流を生成する参照電流源と、
前記所定の参照電流を互いに異なる複数の比率で分配して複数の分配電流を生成する第1の分配回路と、
前記第1の分配回路を制御して前記複数の分配電流のうち所定数の和を前記所定のオフセット電流として出力させる第1のデコーダと
を備える前記(2)記載の固体撮像素子。
(4)前記調整部は、
前記総電流を互いに異なる複数の比率で分配して複数の分配電流を生成する第2の分配回路と、
前記第2の分配回路を制御して前記複数の分配電流のうち所定数の和を前記調整電流として出力させる第2のデコーダと
を備える前記(2)または(3)に記載の固体撮像素子。
(5)前記変換部は、
複数の抵抗素子と、
前記複数の抵抗素子のうち所定数を並列に接続して前記所定数の抵抗素子の合成抵抗に前記調整電流が流れて生じる電圧を前記所定の閾値として出力させる第3のデコーダと
を備える前記(2)から(4)のいずれかに記載の固体撮像素子。
(6)前記電流検出部は、前記複数の画素のうち一部の画素のそれぞれの前記光電流の和を前記総電流として検出する
前記(1)から(5)のいずれかに記載の固体撮像素子。
(7)前記閾値制御部は、前記総電流が大きいほど高い値に前記所定の閾値を制御する
前記(1)から(6)のいずれかに記載の固体撮像素子。
(8)前記所定の閾値は、互いに異なる上限閾値および下限閾値を含み、
前記複数の画素のそれぞれは、
前記変化量が前記上限閾値を超えた旨をオンイベントとして検出し、
前記変化量が前記下限閾値を下回る旨をオフイベントとして検出する
前記(1)から(7)のいずれかに記載の固体撮像素子。
(9)各々が光電流に応じた電圧の変化量と所定の閾値とを比較する複数の画素と、
前記複数の画素のそれぞれの前記光電流の和を総電流として検出する電流検出部と、
前記総電流に応じた値に前記所定の閾値を制御する閾値制御部と、
前記複数の画素のそれぞれの比較結果からなる信号を処理する信号処理部と
を具備する撮像装置。
(10)複数の画素の各々が光電流に応じた電圧の変化量と所定の閾値とを比較する比較手順と、
前記複数の画素のそれぞれの前記光電流の和を総電流として検出する電流検出手順と、
前記総電流に応じた値に前記所定の閾値を制御する閾値制御手順と
を具備する固体撮像素子の制御方法。
110 光学部
120 DSP回路
130 表示部
140 操作部
150 バス
160 フレームメモリ
170 記憶部
180 電源部
200 固体撮像素子
201 受光チップ
202 回路チップ
213 列アービタ
214 列アドレスエンコーダ
215 ステートマシン
216 行アドレスエンコーダ
220 列AER回路
221 列AERブロック
222 H側列AERブロック
223 L側列AERブロック
224 ORゲート
260 行AER回路
270 行AERブロック
271、324、331、332、342、344、351、353、364、369、411、432、433、611、614~617、620、622、625、626 pMOSトランジスタ
272、273、321、323、345、352、354、361~363、365~368、370、371、442、472、474、475、612、613、618、619、623、624、627 nMOSトランジスタ
274、275、601、602、621 インバータ
276 NORゲート
300 画素アレイ部
310 画素
320 対数応答部
322 フォトダイオード
330、477 バッファ
340 微分回路
341、343、372 容量
350 コンパレータ
360 AERロジック回路
410 電流検出部
420 閾値制御部
421 正側オフセット電流源
422 負側オフセット電流源
430 正側pMOS並列回路
431、441、473 スイッチ
434、443、476 デコーダ
440 正側nMOS並列回路
450 負側pMOS並列回路
460 負側nMOS並列回路
470 正側電流スプリッタ
471 参照電流源
480 負側電流スプリッタ
600 行アービタ
610、650~654 アービタブロック
12030 車外情報検出ユニット
Claims (10)
- 各々が光電流に応じた電圧の変化量と所定の閾値とを比較する複数の画素と、
前記複数の画素のそれぞれの前記光電流の和を総電流として検出する電流検出部と、
前記総電流に応じた値に前記所定の閾値を制御する閾値制御部と
を具備する固体撮像素子。 - 前記閾値制御部は、
前記総電流を調整して調整電流として出力する調整部と、
所定のオフセット電流を生成するオフセット電流源と、
前記調整電流と前記所定のオフセット電流との和または差を前記所定の閾値に変換して前記複数の画素のそれぞれに供給する変換部と
を備える請求項1記載の固体撮像素子。 - 前記オフセット電流源は、
所定の参照電流を生成する参照電流源と、
前記所定の参照電流を互いに異なる複数の比率で分配して複数の分配電流を生成する第1の分配回路と、
前記第1の分配回路を制御して前記複数の分配電流のうち所定数の和を前記所定のオフセット電流として出力させる第1のデコーダと
を備える請求項2記載の固体撮像素子。 - 前記調整部は、
前記総電流を互いに異なる複数の比率で分配して複数の分配電流を生成する第2の分配回路と、
前記第2の分配回路を制御して前記複数の分配電流のうち所定数の和を前記調整電流として出力させる第2のデコーダと
を備える請求項2記載の固体撮像素子。 - 前記変換部は、
複数の抵抗素子と、
前記複数の抵抗素子のうち所定数を並列に接続して前記所定数の抵抗素子の合成抵抗に前記調整電流が流れて生じる電圧を前記所定の閾値として出力させる第3のデコーダと
を備える請求項2記載の固体撮像素子。 - 前記電流検出部は、前記複数の画素のうち一部の画素のそれぞれの前記光電流の和を前記総電流として検出する
請求項1記載の固体撮像素子。 - 前記閾値制御部は、前記総電流が大きいほど高い値に前記所定の閾値を制御する
請求項1記載の固体撮像素子。 - 前記所定の閾値は、互いに異なる上限閾値および下限閾値を含み、
前記複数の画素のそれぞれは、
前記変化量が前記上限閾値を超えた旨をオンイベントとして検出し、
前記変化量が前記下限閾値を下回る旨をオフイベントとして検出する
請求項1記載の固体撮像素子。 - 各々が光電流に応じた電圧の変化量と所定の閾値とを比較する複数の画素と、
前記複数の画素のそれぞれの前記光電流の和を総電流として検出する電流検出部と、
前記総電流に応じた値に前記所定の閾値を制御する閾値制御部と、
前記複数の画素のそれぞれの比較結果からなる信号を処理する信号処理部と
を具備する撮像装置。 - 複数の画素の各々が光電流に応じた電圧の変化量と所定の閾値とを比較する比較手順と、
前記複数の画素のそれぞれの前記光電流の和を総電流として検出する電流検出手順と、
前記総電流に応じた値に前記所定の閾値を制御する閾値制御手順と
を具備する固体撮像素子の制御方法。
Priority Applications (5)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201880074844.7A CN111357279B (zh) | 2018-01-05 | 2018-09-18 | 固态成像元件、成像设备、及控制固态成像元件的方法 |
| KR1020207013680A KR102539061B1 (ko) | 2018-01-05 | 2018-09-18 | 고체 촬상 소자, 촬상 장치 및 고체 촬상 소자의 제어 방법 |
| EP18898733.3A EP3737084B1 (en) | 2018-01-05 | 2018-09-18 | Solid-state imaging element, imaging device, and method for controlling solid-state imaging element |
| US16/766,447 US11297268B2 (en) | 2018-01-05 | 2018-09-18 | Solid-state imaging element, imaging apparatus, and method of controlling solid-state imaging element |
| JP2019563925A JP7227926B2 (ja) | 2018-01-05 | 2018-09-18 | 固体撮像素子、撮像装置および固体撮像素子の制御方法 |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2018-000577 | 2018-01-05 | ||
| JP2018000577 | 2018-01-05 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2019135303A1 true WO2019135303A1 (ja) | 2019-07-11 |
Family
ID=67143957
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/JP2018/034437 Ceased WO2019135303A1 (ja) | 2018-01-05 | 2018-09-18 | 固体撮像素子、撮像装置および固体撮像素子の制御方法 |
Country Status (6)
| Country | Link |
|---|---|
| US (1) | US11297268B2 (ja) |
| EP (1) | EP3737084B1 (ja) |
| JP (1) | JP7227926B2 (ja) |
| KR (1) | KR102539061B1 (ja) |
| CN (1) | CN111357279B (ja) |
| WO (1) | WO2019135303A1 (ja) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2021054183A1 (en) * | 2019-09-18 | 2021-03-25 | Sony Semiconductor Solutions Corporation | Solid-state imaging device and imaging device with combined dynamic vision sensor and imaging functions |
| WO2021111873A1 (ja) * | 2019-12-02 | 2021-06-10 | ソニーグループ株式会社 | 信号処理装置、信号処理方法、および検出センサ |
| WO2021200523A1 (ja) * | 2020-04-01 | 2021-10-07 | ソニーセミコンダクタソリューションズ株式会社 | 撮像装置及び撮像方法 |
| WO2021205937A1 (ja) * | 2020-04-10 | 2021-10-14 | ソニーセミコンダクタソリューションズ株式会社 | 撮像装置及び撮像方法 |
| WO2021235323A1 (ja) * | 2020-05-21 | 2021-11-25 | ソニーセミコンダクタソリューションズ株式会社 | 撮像装置及び撮像方法 |
| WO2021246194A1 (ja) * | 2020-06-04 | 2021-12-09 | ソニーグループ株式会社 | 信号処理装置、信号処理方法、および検出センサ |
| JPWO2022009807A1 (ja) * | 2020-07-10 | 2022-01-13 | ||
| CN114245986A (zh) * | 2019-08-30 | 2022-03-25 | 索尼半导体解决方案公司 | 固态成像元件、成像装置和用于控制固态成像元件的方法 |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP7449663B2 (ja) * | 2018-10-30 | 2024-03-14 | ソニーセミコンダクタソリューションズ株式会社 | 固体撮像素子、撮像装置、および、固体撮像素子の制御方法 |
| ES2962472T3 (es) * | 2020-06-26 | 2024-03-19 | Alpsentek Gmbh | Sensor de imagen delta con almacenamiento de píxeles digital |
| CN113132656B (zh) * | 2021-04-20 | 2022-01-28 | 豪威芯仑传感器(上海)有限公司 | 一种图像传感器及图像处理系统 |
| EP4412236A1 (en) | 2023-02-06 | 2024-08-07 | Prophesee | Global and cluster contrast detection in vision neuromorphic sensors |
| KR20240126282A (ko) | 2023-02-13 | 2024-08-20 | 삼성전자주식회사 | 비전 센서, 이의 이벤트 신호 처리 방법 및 이를 포함하는 이미지 처리 장치 |
| EP4723663A4 (en) * | 2023-05-29 | 2026-08-12 | Sony Semiconductor Solutions Corp | IMAGING DEVICE AND METHOD |
| TW202505912A (zh) * | 2023-07-17 | 2025-02-01 | 大陸商廣州印芯半導體技術有限公司 | 動態視覺感測器 |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2008066320A (ja) * | 2006-09-04 | 2008-03-21 | Sumitomo Electric Ind Ltd | レーザダイオード駆動回路 |
| JP2009508085A (ja) | 2005-06-03 | 2009-02-26 | ウニヴェルズィテート チューリッヒ | 時間依存性の画像データを検出するフォトアレイ |
| JP2016501495A (ja) * | 2012-12-11 | 2016-01-18 | コンセホ・スペリオール・デ・インベスティガシオネス・シエンティフィカスConsejo Superior De Investigaciones Cientificas | 光センサーのマトリクス中の光強度の時間的変化を検出するための方法およびデバイス |
| US20170033777A1 (en) * | 2015-07-31 | 2017-02-02 | Samsung Electronics Co., Ltd. | Method and apparatus for controlling threshold voltage |
| JP2017521746A (ja) * | 2014-04-30 | 2017-08-03 | サントル ナスィオナル ド ラ ルシェルシュ スィアンティフィク(セ.エン.エル.エス.) | 非同期光センサーによって観測されたシーン内の形状を追跡する方法 |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP3875461B2 (ja) * | 2000-07-06 | 2007-01-31 | 株式会社東芝 | 固体撮像システム |
| CN103875031B (zh) * | 2011-10-14 | 2016-08-31 | 株式会社日本有机雷特显示器 | 图像显示装置 |
| JP6237045B2 (ja) * | 2013-09-24 | 2017-11-29 | 株式会社ニコン | 撮像素子および撮像装置 |
| JP6541347B2 (ja) * | 2014-03-27 | 2019-07-10 | キヤノン株式会社 | 固体撮像装置および撮像システム |
| CN104658480A (zh) * | 2015-03-06 | 2015-05-27 | 京东方科技集团股份有限公司 | 像素电路及其驱动方法、显示装置 |
| CN104978932A (zh) * | 2015-07-16 | 2015-10-14 | 京东方科技集团股份有限公司 | 像素驱动电路、像素驱动方法和显示装置 |
-
2018
- 2018-09-18 US US16/766,447 patent/US11297268B2/en active Active
- 2018-09-18 JP JP2019563925A patent/JP7227926B2/ja active Active
- 2018-09-18 EP EP18898733.3A patent/EP3737084B1/en active Active
- 2018-09-18 CN CN201880074844.7A patent/CN111357279B/zh active Active
- 2018-09-18 WO PCT/JP2018/034437 patent/WO2019135303A1/ja not_active Ceased
- 2018-09-18 KR KR1020207013680A patent/KR102539061B1/ko active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2009508085A (ja) | 2005-06-03 | 2009-02-26 | ウニヴェルズィテート チューリッヒ | 時間依存性の画像データを検出するフォトアレイ |
| JP2008066320A (ja) * | 2006-09-04 | 2008-03-21 | Sumitomo Electric Ind Ltd | レーザダイオード駆動回路 |
| JP2016501495A (ja) * | 2012-12-11 | 2016-01-18 | コンセホ・スペリオール・デ・インベスティガシオネス・シエンティフィカスConsejo Superior De Investigaciones Cientificas | 光センサーのマトリクス中の光強度の時間的変化を検出するための方法およびデバイス |
| JP2017521746A (ja) * | 2014-04-30 | 2017-08-03 | サントル ナスィオナル ド ラ ルシェルシュ スィアンティフィク(セ.エン.エル.エス.) | 非同期光センサーによって観測されたシーン内の形状を追跡する方法 |
| US20170033777A1 (en) * | 2015-07-31 | 2017-02-02 | Samsung Electronics Co., Ltd. | Method and apparatus for controlling threshold voltage |
Non-Patent Citations (2)
| Title |
|---|
| PATRICK LICHTSTEINER: "2 A 128×128 120dB 15 µ s Latency Asynchronous Temporal Contrast Vision Sensor", IEEE JOURNAL OF SOLID-STATE CIRCUITS, vol. 43, no. 2, 31 January 2008 (2008-01-31), pages 566 - 576, XP011200748, doi:10.1109/JSSC.2007.914337 * |
| See also references of EP3737084A4 |
Cited By (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114245986B (zh) * | 2019-08-30 | 2025-08-19 | 索尼半导体解决方案公司 | 固态成像元件、成像装置和用于控制固态成像元件的方法 |
| CN114245986A (zh) * | 2019-08-30 | 2022-03-25 | 索尼半导体解决方案公司 | 固态成像元件、成像装置和用于控制固态成像元件的方法 |
| US11240449B2 (en) | 2019-09-18 | 2022-02-01 | Sony Semiconductor Solutions Corporation | Solid-state imaging device and imaging device with combined dynamic vision sensor and imaging functions |
| US12155944B2 (en) | 2019-09-18 | 2024-11-26 | Sony Semiconductor Solutions Corporation | Solid-state imaging device and imaging device with combined dynamic vision sensor and imaging functions |
| WO2021054183A1 (en) * | 2019-09-18 | 2021-03-25 | Sony Semiconductor Solutions Corporation | Solid-state imaging device and imaging device with combined dynamic vision sensor and imaging functions |
| US12058457B2 (en) | 2019-09-18 | 2024-08-06 | Sony Semiconductor Solutions Corporation | Solid-state imaging device and imaging device with combined dynamic vision sensor and imaging functions |
| US11758300B2 (en) | 2019-09-18 | 2023-09-12 | Sony Semiconductor Solutions Corporation | Solid-state imaging device and imaging device with combined dynamic vision sensor and imaging functions |
| US12096137B2 (en) | 2019-12-02 | 2024-09-17 | Sony Group Corporation | Signal processing device, signal processing method, and detection sensor |
| JP7533479B2 (ja) | 2019-12-02 | 2024-08-14 | ソニーグループ株式会社 | 信号処理装置、信号処理方法、および検出センサ |
| WO2021111873A1 (ja) * | 2019-12-02 | 2021-06-10 | ソニーグループ株式会社 | 信号処理装置、信号処理方法、および検出センサ |
| JPWO2021111873A1 (ja) * | 2019-12-02 | 2021-06-10 | ||
| US12184995B2 (en) | 2020-04-01 | 2024-12-31 | Sony Semiconductor Solutions Corporation | Imaging device and imaging method for preventing an unnecessary event |
| WO2021200523A1 (ja) * | 2020-04-01 | 2021-10-07 | ソニーセミコンダクタソリューションズ株式会社 | 撮像装置及び撮像方法 |
| WO2021205937A1 (ja) * | 2020-04-10 | 2021-10-14 | ソニーセミコンダクタソリューションズ株式会社 | 撮像装置及び撮像方法 |
| US12219274B2 (en) | 2020-04-10 | 2025-02-04 | Sony Semiconductor Solutions Corporation | Imaging device and imaging method |
| WO2021235323A1 (ja) * | 2020-05-21 | 2021-11-25 | ソニーセミコンダクタソリューションズ株式会社 | 撮像装置及び撮像方法 |
| US12301962B2 (en) | 2020-05-21 | 2025-05-13 | Sony Semiconductor Solutions Corporation | Imaging device and imaging method with adjustment of threshold value corresponding to change in signals from photoelectric conversion elements |
| CN115868172A (zh) * | 2020-06-04 | 2023-03-28 | 索尼集团公司 | 信号处理装置、信号处理方法和检测传感器 |
| WO2021246194A1 (ja) * | 2020-06-04 | 2021-12-09 | ソニーグループ株式会社 | 信号処理装置、信号処理方法、および検出センサ |
| US12192647B2 (en) | 2020-06-04 | 2025-01-07 | Sony Group Corporation | Signal processing device, signal processing method, and detection sensor |
| JP7695622B2 (ja) | 2020-06-04 | 2025-06-19 | ソニーグループ株式会社 | 信号処理装置、信号処理方法、および検出センサ |
| JPWO2021246194A1 (ja) * | 2020-06-04 | 2021-12-09 | ||
| JPWO2022009807A1 (ja) * | 2020-07-10 | 2022-01-13 |
Also Published As
| Publication number | Publication date |
|---|---|
| EP3737084A1 (en) | 2020-11-11 |
| US11297268B2 (en) | 2022-04-05 |
| JPWO2019135303A1 (ja) | 2020-12-17 |
| CN111357279B (zh) | 2022-10-11 |
| CN111357279A (zh) | 2020-06-30 |
| KR102539061B1 (ko) | 2023-06-01 |
| JP7227926B2 (ja) | 2023-02-22 |
| KR20200106152A (ko) | 2020-09-11 |
| US20210152762A1 (en) | 2021-05-20 |
| EP3737084A4 (en) | 2020-12-02 |
| EP3737084B1 (en) | 2022-03-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7227926B2 (ja) | 固体撮像素子、撮像装置および固体撮像素子の制御方法 | |
| US11632505B2 (en) | Solid-state image sensor and imaging device | |
| EP3576404B1 (en) | Solid-state image pickup element | |
| WO2019150786A1 (ja) | 固体撮像素子、撮像装置、および、固体撮像素子の制御方法 | |
| JP2020136958A (ja) | イベント信号検出センサ及び制御方法 | |
| KR102626770B1 (ko) | 고체 촬상 소자, 촬상 장치, 및 고체 촬상 소자의 제어 방법 | |
| KR102544592B1 (ko) | 고체 촬상 소자, 촬상 장치 및 고체 촬상 소자의 제어 방법 | |
| WO2022064867A1 (ja) | 固体撮像素子、および、撮像装置 | |
| WO2021039142A1 (ja) | 固体撮像素子、撮像装置、および、固体撮像素子の制御方法 | |
| JP2020099015A (ja) | センサ及び制御方法 | |
| WO2021131831A1 (ja) | 固体撮像素子、および、撮像装置 | |
| CN112997475B (zh) | 电子电路、固态成像元件以及制造电子电路的方法 | |
| WO2025057566A1 (ja) | 固体撮像素子、電子機器、および、固体撮像素子の制御方法 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 18898733 Country of ref document: EP Kind code of ref document: A1 |
|
| ENP | Entry into the national phase |
Ref document number: 2019563925 Country of ref document: JP Kind code of ref document: A |
|
| ENP | Entry into the national phase |
Ref document number: 20207013680 Country of ref document: KR Kind code of ref document: A |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| ENP | Entry into the national phase |
Ref document number: 2018898733 Country of ref document: EP Effective date: 20200805 |