WO2025067904A1 - Radar stéréo - Google Patents

Radar stéréo Download PDF

Info

Publication number
WO2025067904A1
WO2025067904A1 PCT/EP2024/075712 EP2024075712W WO2025067904A1 WO 2025067904 A1 WO2025067904 A1 WO 2025067904A1 EP 2024075712 W EP2024075712 W EP 2024075712W WO 2025067904 A1 WO2025067904 A1 WO 2025067904A1
Authority
WO
WIPO (PCT)
Prior art keywords
radar
signal data
radar signal
spectrum
objects
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
PCT/EP2024/075712
Other languages
English (en)
Inventor
Ebrahim Sadeghpour
Niko Moritz Scholz
Sandeep Kumar
Maximilian Poepperl
Artem LUKIN
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Valeo Schalter und Sensoren GmbH
Original Assignee
Valeo Schalter und Sensoren GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Valeo Schalter und Sensoren GmbH filed Critical Valeo Schalter und Sensoren GmbH
Priority to CN202480061317.8A priority Critical patent/CN121925572A/zh
Publication of WO2025067904A1 publication Critical patent/WO2025067904A1/fr
Anticipated expiration legal-status Critical
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/02—Systems using reflection of radio waves, e.g. primary radar systems; Analogous systems
    • G01S13/06—Systems determining position data of a target
    • G01S13/42—Simultaneous measurement of distance and other co-ordinates
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/02—Systems using reflection of radio waves, e.g. primary radar systems; Analogous systems
    • G01S13/50—Systems of measurement based on relative movement of target
    • G01S13/58—Velocity or trajectory determination systems; Sense-of-movement determination systems
    • G01S13/583—Velocity or trajectory determination systems; Sense-of-movement determination systems using transmission of continuous unmodulated waves, amplitude-, frequency-, or phase-modulated waves and based upon the Doppler effect resulting from movement of targets
    • G01S13/584—Velocity or trajectory determination systems; Sense-of-movement determination systems using transmission of continuous unmodulated waves, amplitude-, frequency-, or phase-modulated waves and based upon the Doppler effect resulting from movement of targets adapted for simultaneous range and velocity measurements
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/02—Systems using reflection of radio waves, e.g. primary radar systems; Analogous systems
    • G01S13/50—Systems of measurement based on relative movement of target
    • G01S13/58—Velocity or trajectory determination systems; Sense-of-movement determination systems
    • G01S13/589—Velocity or trajectory determination systems; Sense-of-movement determination systems measuring the velocity vector
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/87—Combinations of radar systems, e.g. primary radar and secondary radar
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88—Radar or analogous systems specially adapted for specific applications
    • G01S13/93—Radar or analogous systems specially adapted for specific applications for anti-collision purposes
    • G01S13/931—Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/02—Systems using reflection of radio waves, e.g. primary radar systems; Analogous systems
    • G01S13/06—Systems determining position data of a target
    • G01S13/08—Systems for measuring distance only
    • G01S13/32—Systems for measuring distance only using transmission of continuous waves, whether amplitude-, frequency-, or phase-modulated, or unmodulated
    • G01S13/34—Systems for measuring distance only using transmission of continuous waves, whether amplitude-, frequency-, or phase-modulated, or unmodulated using transmission of continuous, frequency-modulated waves while heterodyning the received signal, or a signal derived therefrom, with a locally-generated signal related to the contemporaneously transmitted signal
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/02—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S13/00
    • G01S7/35—Details of non-pulse systems
    • G01S7/352—Receivers
    • G01S7/356—Receivers involving particularities of FFT processing

Definitions

  • the invention relates to the field of radar detection. More particularly, the invention relates to a computer-implemented method for detecting one or more objects using at least two radar sensors of a stereo radar assembly arranged spaced apart from each other.
  • Radar sensing is an integral solution, e.g., for autonomous driving as it may be used to yield locations and radial velocities of objects in the surroundings of a vehicle, e.g., a car.
  • the ability of a radar in resolving two closely spaced objects depends, e.g., on the number of antennas, which may be limited by cost and dimension constraints.
  • Multi-input-multi-output (MIMO) radars employ a virtual array idea to increase a radar aperture without increasing the number of physical antennas.
  • MIMO radars compatible with automotive constraints still suffer, e.g., from low spatial resolution.
  • a single radar may fail to detect objects with low signal-noise-ratio (SNR) as well as occluded targets. Therefore, there is a need for an approach for an improved object detection.
  • SNR signal-noise-ratio
  • a computer-implemented method for detecting one or more objects using at least two radar sensors of a stereo radar assembly arranged spaced apart from each other.
  • the method comprises receiving first radar signal data determined using a first radar sensor of the at least two radar sensors.
  • the first radar signal data is descriptive of characteristics of first radar signals acquired using the first radar sensor.
  • Second radar signal data determined using a second radar sensor of the at least two radar sensors is received.
  • the second radar signal data is descriptive of characteristics of second radar signals acquired using the second radar sensor.
  • Using the first radar signal data one or more first combinations of distance and radial velocity are determined, for which an intensity peak is comprised by the first radar signal data.
  • one or more second combinations of distance and radial velocity are determined, for which an intensity peak is comprised by the second radar signal data.
  • a first spectrum descriptive of intensities as a function of an azimuth and elevation angle is determined using the first radar signal data.
  • a second spectrum descriptive of intensities as a function of the azimuth and elevation angle is determined using the second radar signal data.
  • one or more positions of one or more objects in terms of the azimuth and elevation angle are determined using the first and second spectrum.
  • the determining comprises a matching and a comparing of the first and second spectrum.
  • This method may enable an efficient implementation of a stereo radar approach in order to improve the performance of a radar system.
  • This approach does not require the software of the radar system or the hardware to be extensively adapted.
  • the at least two radar sensors in question may be two radar sensors arranged spaced apart from each other. In the following, such a combination of at least two radar sensors whose ranges of detection at least partially overlap is referred to as a stereo radar assembly.
  • the at least two radar sensors may, e.g., be independent of one another, i.e., may not or only roughly be synchronized with one another
  • the individual radar sensors of the at least two radar sensors may, e.g., be operated in a monostatic mode and/or in a bistatic mode.
  • the at least two radar sensors may, e.g., be operated in a multistatic mode.
  • a radar sensor In the monostatic mode, a radar sensor is operated as a receiver for receiving reflected radar signals emitted by the same radar sensor, i.e., receiver and transmitter are co-located in form of the respective radar sensor.
  • a radar sensor is operated as a receiver for receiving reflected radar signals emitted by another radar sensors of the at least two radar sensors, i.e., receiver and emitter are arranged spaced apart from each other.
  • a radar sensor is operated as a receiver for receiving reflected radar signals emitted by multiple other radar sensors in case of an assembly of more than two radar sensors.
  • a sensor of the assembly operated in the multistatic mode may, e.g., be used as a receiver for receiving radar signals emitted by up to n - 1 other radar sensor of the assembly.
  • Each radar sensor of the stereo radar assembly may, e.g., transmit radar signals. These radar signals may interact with objects, e.g., be reflected, scattered, and/or diffracted, and due to these interactions being received by the emitting radar sensor and/or one or more other radar sensors of the assembly.
  • a single radar sensor is used as both transmitter and receiver of a radar signal.
  • the radar sensor emits radar signals and receives reflections of the emitted radar signals.
  • the distances, velocities, and/and other characteristics of the reflecting objects may be determined.
  • the first radar signal data may be descriptive of intensities of first radar signals received by the first radar sensor with the received first radar signals being emitted by the first radar sensor.
  • the second radar signal data may be descriptive of intensities of second radar signals received by the second radar sensor with the received second radar signals being emitted by the second radar sensor.
  • the transmitter radar sensor emits radar signals which interact with objects, e.g., be reflected, scattered, and/or diffracted.
  • the receiver radar sensor arranged spaced apart from the transmitter radar sensor receives the radar signals due to the interaction.
  • the first radar signal data may be descriptive of intensities of first radar signals received by the first radar sensor with the received first radar signals being emitted by the second radar sensor.
  • the second radar signal data may be descriptive of intensities of second radar signals received by the second radar sensor with the received second radar signals being emitted by the first radar sensor.
  • the first radar signal data may be descriptive of a combination of intensities of first radar signals received by the first radar sensor with the received first radar signals comprising radar signals emitted by the first radar sensor as well as radar signals emitted by the second radar sensor.
  • the first radar signal data may comprise a combination of radar signal data descriptive of received radar signals emitted by the first radar sensor and radar signal data descriptive of received radar signals emitted by the second radar sensor.
  • the second radar signal data may be descriptive of a combination of intensities of second radar signals received by the second radar sensor with the received second radar signals comprising radar signals emitted by the first radar sensor as well as radar signals emitted by the second radar sensor.
  • the second radar signal data may comprise a combination of radar signal data descriptive of received radar signals emitted by the first radar sensor and radar signal data descriptive of received radar signals emitted by the second radar sensor.
  • the first radar signal data may comprise a combination data descriptive of received radar signals emitted by n or less radar sensors of the n radar sensors.
  • the second radar signal data may comprise a combination data descriptive of received radar signals emitted by n or less radar sensors of the n radar sensors.
  • the method may, e.g., comprise receiving first to n-th radar signal data determined using a first to n-th radar sensor of the n radar sensors.
  • the first to n-th radar signal data being descriptive of characteristics of first to n-th radar signals acquired using the first to n-th radar sensor.
  • Using the first to n-th radar signal data one or more first to n-th combinations of distance and radial velocity are determined, for which an intensity peak is comprised by the first to n-th radar signal data.
  • a first to n-th spectrum descriptive of intensities as a function of an azimuth and elevation angle is determined using the first to n-th radar signal data. Furthermore, one or more positions of one or more objects in terms of the azimuth and elevation angle are determined using the first to n-th spectrum. The determining comprises a matching and a comparing of the first to n-th spectrum.
  • the radar signals emitted by the at least two radar sensors may have different waveforms in order to, e.g., reduce a likelihood of interference and improve coexistence of the different radar signals.
  • different frequency bands may be allocated to different radar sensors. By operating on different frequency bands, i.e., non-overlapping frequency ranges, the potential for interferences between radar signals emitted by different radar sensors may be reduced.
  • the stereo radar assembly may, e.g., be a stereo radar assembly of a vehicle, in particular a car.
  • the radar sensors of the stereo radar assembly may, e.g., be installed in a vehicle, in particular a car, and may be configured to detect the surroundings of the vehicle, i.e., objects in the surroundings of the vehicle.
  • the stereo radar assembly may comprise radar sensors of a front radar, a corner radar, a side radar and/or a back radar of a vehicle, e.g., a car.
  • Such a stereo radar assembly may be used in a vehicle, e.g., for implementing functions of an assisted, automated and/or autonomous driving system.
  • a stereo radar assembly may be used in car for an adaptive cruise control (ACC).
  • An adaptive cruise control is a type of advanced driver-assistance system for road vehicles that is configured for automatically adjusting the vehicle's speed, e.g., to maintain a safe distance from vehicles ahead.
  • the adaptive cruise control may be part of a radar-based emergency braking assistant.
  • such a stereo radar assembly may, e.g., be used for a cross traffic alert (CTA) in order to be able to detect cross traffic, e.g., behind the vehicle.
  • CTA cross traffic alert
  • Such a cross traffic alert may, e.g., work in conjunction with a blind spot monitoring system and be configured for warning the driver of approaching cross traffic when reversing out of a parking spot.
  • a stereo radar assembly similar to a stereo camera system in the field of optical imaging, may allow for improving a performance of a radar system by combining radar signal data of at least two radar sensors arranged spaced apart from each other.
  • Radar frequencies typically used for radars in vehicles may, e.g., be in the range of 76 to 77 GHz corresponding to a wavelength of about 4 mm.
  • Radar sensors are devices which are used to emit a radar signal and detect reflections of the emitted radar signal from objects within the ranges of detection of the radar sensors.
  • the characteristics of these reflections and thus of the detected radar signal may depend on features of reflecting objects within the ranges of detection of the radar sensors. These features of the objects may, e.g., comprise position, size, shape, surface conditions, motion characteristics, and/or motion trajectory.
  • the reflected radar signals acquired by the radar sensors may, e.g., comprise radar signals emitted by one or more radar sensors.
  • the first radar signal acquired using the first radar sensor may result from reflections of a radar signal emitted by the first radar sensor and/or the second radar sensor.
  • the second radar signal acquired using the second radar sensor may, e.g., result from reflections of a radar signal emitted by the second radar sensor and/or the first radar sensor.
  • the reflected radar signals acquired by the radar sensors may, e.g., be descriptive of positions of one or more objects being detected, e.g., defined by a distance, an azimuth angle, and an elevation angle, as well as of radial velocities relative to radar sensors.
  • radar signal data descriptive of such a radar signal may comprise fourdimensional information about objects within a range of detection of a radar sensor. This four- dimensional information may comprise distance, azimuth angle, elevation angle, and radial velocity of the detected object relative to the detecting radar sensor.
  • a presence of an object within the range of detection of a radar sensor may, e.g., be indicated by an intensity peak of the acquired radar signal and thus of the radar signal data descriptive of the respective radar signal.
  • Radar signal data may, e.g., be provided in form of an acquired radar signal or radar signal data may, e.g., be provided in form of a processed radar signal acquired using a radar sensor.
  • a range-Doppler profile may be determined using the radar signal data descriptive of the radar signal, i.e., the detected radar reflections.
  • a range-Doppler profile may be provided in form of a graphical two-dimensional representation of intensities of radar reflections received from objects in the range of detection of a radar sensor as a function of range, i.e., distance, and Doppler frequency shift, i.e., radial velocity of the respective objects relative to the radar sensor.
  • FMCW radar sensors may be used.
  • the transmitted radar signal is frequency modulated.
  • This frequency modulation enables a distance measurement using an indirect time-of-flight measurement by comparing the frequency of the received radar signal with a reference, e.g., the emitted radar signal.
  • radial velocities may be measured Doppler shifts of the received radar signal.
  • the acquired reflected radar signal may comprise frequency variations. These frequency variations may be processed using suitable techniques, like Fast Fourier Transform (FFT), to extract characteristics of objects, like distances and/or radial velocities.
  • FFT Fast Fourier Transform
  • Range-Doppler profiles of an object determined by two radar sensors spaced apart from each may differ from each other.
  • the range-Doppler profiles may be descriptive of intensity spectra or power spectra of the radar signals acquired by the radar sensors.
  • the range-Doppler profiles may be descriptive of intensity spectra or power spectra of radar signals emitted and received by the same radar sensor.
  • the range-Doppler profiles may be descriptive of intensity spectra or power spectra of radar signals emitted and received by different radar sensors arranged spaced apart from each other.
  • the range-Doppler profiles may be descriptive of intensity spectra or power spectra of a combination of radar signals emitted and received by the same radar sensor with radar signals emitted and received by different radar sensors arranged spaced apart from each other.
  • the intensity spectra or power spectra may be descriptive of intensity or power distributions over distance and radial velocity.
  • An intensity or power spectrum determined using the first radar sensor of the at least two-radar system is referred to as a first spectrum and an intensity or power spectrum determined by the second radar sensor of the at least two-radar system is referred to as a second spectrum.
  • the first spectrum may, e.g., be a spectrum of radar signals received and emitted by the first radar sensor and/or radar signals received by the first radar sensor, but emitted by another radar sensor of the assembly arranged spaced apart from the first radar sensor, e.g., the second radar sensor.
  • the second spectrum may, e.g., be a spectrum of radar signals received and emitted by the second radar sensor and/or radar signals received by the second radar sensor, but emitted by another radar sensor of the assembly arranged spaced apart from the second radar sensor, e.g., the first radar sensor.
  • I P/A
  • a parameter space spanned by distance and radial velocity may, e.g., be discretized by dividing it into intervals or bins.
  • the bins may be specified as consecutive, non-overlapping intervals of the variables distance and radial velocity.
  • the bins may be adjacent and of equal size.
  • Each bin may be assigned with an accumulation of the radar signal data assigned to a distance and a velocity comprised by the respective bin. Based on intensity peaks, bins may be identified with radar signal data descriptive of one or more objects being present or detected.
  • intensity or power spectra may be determined as a function of azimuth angle and elevation angle, which corresponds to a two-dimensional image from which a position of the corresponding object or objects within the area spanned by azimuth and elevation angle may be determined.
  • Such an intensity or power spectrum may describe a two-dimensional distribution of intensity or power of a radar signal depending on the azimuth and elevation angle for radar signal data assigned to a distance and a velocity comprised by the respective bin.
  • a spatial arrangement of objects in terms of azimuth and elevation angle at distances within the same interval of distances and with radial velocities within the same interval of radial velocities may be determined.
  • a presence of the one or more objects is determined in response to determining intensity peaks within the first and second spectrum at matching positions in terms of the azimuth and elevation angle.
  • higher SNR and/or precision may be achievable and consequently false positives and/or false negatives may be avoided.
  • a presence of an object may be positively detected, in case it is detectible at matching positions in terms of the azimuth and elevation angle within the radar signal data of both radar sensors. This may even be the case for comparatively low intensity peaks enabling a detection of low SNR objects and/or occluded objects.
  • intensity peaks may be discarded in order to avoid false positives.
  • the azimuth and elevation angle may when matching the first and second spectrum be coordinates of a global coordinate system used to locate the position of the objects relative to the stereo radar assembly and consequently, e.g., relative to a car.
  • azimuth and elevation angle may be defined in a local coordinate system relative to the respective radar sensors. These local coordinate systems may differ from one another as they are arranged spaced apart to each other. By transforming these local coordinates to the global coordinate system positions may be commonly defined relative to the stereo radar assembly comprising both radar sensors.
  • the first and second combinations of distance and radial velocity comprise combinations of intervals of distances and intervals of radial velocities according to a predefined distribution of intervals. These intervals are designated as bins which may be specified as consecutive, non-overlapping ranges of values.
  • the range of parameter values i.e., distance and radial velocity, may be divided into a series of intervals. Different combinations of distance and radial velocity may fall in different intervals. Thus, range of parameter values may be discretized.
  • the parameter space of distance and radial velocity may, e.g., be discretized by dividing it into intervals or bins. Based on intensity peaks, bins may be identified within which one or more objects are present or detected. For these bins, e.g., an intensity or power spectrum may be determined as a function of azimuth angle and elevation angle. Such an intensity or power spectrum for a specific bin corresponds to a two-dimensional image, from which a position of the corresponding object or objects within the area spanned by azimuth and elevation angle may be determined.
  • a first distribution of intervals used for the determining of the first combinations of distance and radial velocity is shifted relative to a second distribution of intervals used for the determining the second combinations of distance and radial velocity.
  • bins defined for the analysis of the first radar signal data may, e.g., be shifted relative to bins defined for the analysis of the second radar signal data.
  • a border between two bins defined for the first radar sensor may, due to the shifting, correspond to a combination of parameter values within a bin defined for the second radar sensor. It may, e.g., correspond to the middle of the bin defined for the second radar sensor, in case the bins are shifted by half a bin's width.
  • This shift may result in a slightly different assignment of radar signal data to bins for the different radar sensors.
  • radar signal data assigned to two different adjacent bins defined for the first radar sensor may be assigned to the same bin in case of the second radar sensor. This may further improve a detection of objects, since effects only resulting from the selection of the borders of the bins may be compensated and thus avoided.
  • a global coordinate system descriptive of the azimuth and elevation angle is used for determining the first and second spectrum.
  • the using of the global coordinate system comprises transforming first local coordinates of a first local coordinate system assigned to the first radar sensor and second local coordinates of a second local coordinate system assigned to the second radar sensor into global coordinates of the global coordinate system.
  • Transforming the local coordinates to a global coordinate system may enable a definition of a common volume sensed by the two radar sensors.
  • This volume may, e.g., be a 3D space spanned using a common distance, azimuth angle and elevation angle as coordinates.
  • Intensity or power of the radar signals detected by the two radar sensors may be assigned to positions within this volume and describe a strength of radar signal reflections of objects arranged at these positions.
  • the acquired radar signals may be analyzed using different interval, i.e., bins, defined based on a discretization of the respective common volume. For example, bins may be defined using distance and radial velocity.
  • Each interval or bin in this volume may, e.g., have two channels namely a power or intensity spectrum determined using first radar signal data of the first radar sensor and a power or intensity spectrum determined using second radar signal data of the second radar sensor.
  • a machine learning module comprising, e.g., an architecture of a neural network, may be trained and used to regularize the power spectra.
  • the neural network may, e.g., comprise convolutional neural network (CNN) layers used for the regularization.
  • CNN convolutional neural network
  • a machine learning module is used for the determining of the one or more positions of the one or more objects.
  • the machine learning module is trained for providing the one or more positions of the one or more objects in response to receiving the first and second spectrum as an input.
  • the matching and comparing of the first and second spectrum may, e.g., be executed by the machine learning module.
  • machine learning module may, e.g., be trained for providing the one or more positions of the one or more objects in response to receiving the first to n-th spectrum as an input.
  • the machine learning module comprises one or more neural networks.
  • the one of more neural networks may, e.g., comprise one or more of the following: a feed-forward neural network, a convolutional neural network.
  • a feed-forward neural network is also known as a multilayer perceptron (MLP) where the flow of information through the network occurs in a single direction, from the input layer through one or more hidden layers to the output layer, without any loops or feedback connections.
  • MLP multilayer perceptron
  • a convolutional neural network is a type of deep learning model designed specifically for image classification, object detection, and image segmentation. Its ability to automatically learn hierarchical representations from raw input data makes it well-suited for analyzing images and other grid-like data structures.
  • a convolutional neural network consists of an input layer, hidden layers, and an output layer.
  • the hidden layers comprise one or more layers that perform convolutions, i.e., convolutional layers.
  • the convolution operation may generate a feature map, which in turn contributes to the input of a next layer.
  • the one or more convolutional layers may be followed by other layers such as pooling layers, fully connected layers, and/or normalization layers.
  • Fast-ABC may be used as a neural network, such as described in Xiaoru Xie et al., "Fast-ABC: A Fast Architecture for Bottleneck-Like Based Convolutional Neural Networks," in 2019 IEEE Computer Society Annual Symposium on VLSI (ISVLSI), pages 1 to 6.
  • Fast-ABC provides an accelerator for BLO(Bottleneck-Like Operations)-based convolutional networks.
  • Neural networks may be able to efficiently learn the matching between the spectra at positions with and without objects. These neural networks are trained to fuse the power spectra at different locations in the global coordinate system. Since the idea of stereo radar matching is not yet explored in previous studies, concepts used in stereo algorithms for optical images may be utilized to design the neural network architecture. The stereo algorithms for optical images may be used to extract depth information from pairs of stereo images by matching corresponding points between the images in pair, thereby inferring the 3D structure of the object with improved accuracy.
  • the machine learning module comprises one or more encoder-decoder blocks with residual layers trained for determining similarities between the first and second spectrum as an output in response to receiving the first and second spectrum as an input.
  • the power spectra of the two radar sensors may not exactly match and display some deviations from each other.
  • the data may be passed to one or more encoder-decoder blocks, i.e., hourglass blocks, with residual layers to regularize the data, find similarities between channels, and mitigate the noise effect.
  • encoder-decoder blocks may further be able to extract information at various levels of detail, from fine-grained details to more global details, which contributes to enhancing the resolution.
  • the output of the neural network may indicate positions, at which objects are present.
  • one or more positions of one or more objects in terms of the azimuth and elevation angle may be determined with improved accuracy.
  • the calculations may be limited to the detection areas of the radar sensors from where intensity peaks are acquired. Thus, the calculations may be limited to areas with potential objects.
  • a machine learning module to be trained may be provided.
  • a set of training datasets may be provided for training the machine learning module to be trained.
  • each training dataset may comprise a first training spectrum and a second training spectrum as well as a training specification of one or more positions of one or more objects.
  • the first training spectrum is descriptive of intensities of a first training radar signal as a function of an azimuth and elevation angle.
  • the second training spectrum is descriptive of intensities of a second training radar signal as a function of an azimuth and elevation angle.
  • the machine learning module to be trained may be trained to provide the one or more positions of one or more objects defined by the training specifications of the training datasets as an output in response to receiving the first and second training spectra of the respective training datasets as an input.
  • the training datasets may, e.g., comprise a first to n-th training spectrum as well as a training specification of one or more positions of one or more objects.
  • the first to n-th training spectrum is descriptive of intensities of a first to n-th training radar signal as a function of an azimuth and elevation angle.
  • the machine learning module to be trained may be trained to provide the one or more positions of one or more objects defined by the training specifications of the training datasets as an output in response to receiving the first to n-th training spectra of the respective training datasets as an input.
  • one or more vectorial velocities of the one or more objects are determined.
  • the determining of the one or more vectorial velocities comprises using the determined one or more positions of the one or more objects and the one or more radial velocities of the one or more objects determined using the first and second radar signal data.
  • a vectorial velocity of an object refers to the changes in both the position and radial velocity over time, providing a comprehensive description of the objects motion. It may particularly be useful for example in autonomous driving system to obtain the total velocity of the detected object including its magnitude and direction.
  • a computer program for detecting one or more objects using at least two radar sensors of a stereo radar assembly arranged spaced apart from each other.
  • the computer program comprises program instructions, which are executable by a processor of a computer device to cause the computer device to receive first radar signal data determined using a first radar sensor of the at least two radar sensors.
  • the first radar signal data is descriptive of characteristics of first radar signals acquired using the first radar sensor.
  • Second radar signal data determined using a second radar sensor of the at least two radar sensors is received.
  • the second radar signal data is descriptive of characteristics of second radar signals acquired using the second radar sensor.
  • Using the first radar signal data one or more first combinations of distance and radial velocity are determined, for which an intensity peak is comprised by the first radar signal data.
  • one or more second combinations of distance and radial velocity are determined, for which an intensity peak is comprised by the second radar signal data.
  • a first spectrum descriptive of intensities as a function of an azimuth and elevation angle is determined using the first radar signal data.
  • a second spectrum descriptive of intensities as a function of the azimuth and elevation angle is determined using the second radar signal data.
  • one or more positions of one or more objects in terms of the azimuth and elevation angle are determined using the first and second spectrum.
  • the determining comprises a matching and a comparing of the first and second spectrum.
  • the program instructions comprised by the computer program may further be executable by the processor of the computer device to cause the computer device to execute any of the aforementioned examples of the computer-implemented method for detecting the one or more one or more objects using the at least two radar sensors of the stereo radar assembly arranged spaced apart from each other.
  • a computer program product for detecting one or more objects using at least two radar sensors of a stereo radar assembly arranged spaced apart from each other comprises a computer readable storage medium having program instructions embodied therewith.
  • the program instructions are executable by a processor of a computer device to cause the computer device to receive first radar signal data determined using a first radar sensor of the at least two radar sensors.
  • the first radar signal data is descriptive of characteristics of first radar signals acquired using the first radar sensor.
  • Second radar signal data determined using a second radar sensor of the at least two radar sensors is received.
  • the second radar signal data is descriptive of characteristics of second radar signals acquired using the second radar sensor.
  • first radar signal data one or more first combinations of distance and radial velocity are determined, for which an intensity peak is comprised by the first radar signal data.
  • second radar signal data one or more second combinations of distance and radial velocity are determined, for which an intensity peak is comprised by the second radar signal data.
  • a first spectrum descriptive of intensities as a function of an azimuth and elevation angle is determined using the first radar signal data.
  • a second spectrum descriptive of intensities as a function of the azimuth and elevation angle is determined using the second radar signal data.
  • one or more positions of one or more objects in terms of the azimuth and elevation angle are determined using the first and second spectrum.
  • the determining comprises a matching and a comparing of the first and second spectrum.
  • the program instructions provided by the computer program product may further be executable by the processor of the computer device to cause the computer device to execute any of the aforementioned examples of the computer-implemented method for detecting the one or more objects using the at least two radar sensors of the stereo radar assembly arranged spaced apart from each other.
  • a computer device for detecting one or more objects using at least two radar sensors of a stereo radar assembly arranged spaced apart from each other.
  • the computer device comprises a processor and a memory storing program instructions executable by the processor. Execution of the program instructions by the processor causes the computer device to receive first radar signal data determined using a first radar sensor of the at least two radar sensors.
  • the first radar signal data is descriptive of characteristics of first radar signals acquired using the first radar sensor.
  • Second radar signal data determined using a second radar sensor of the at least two radar sensors is received.
  • the second radar signal data is descriptive of characteristics of second radar signals acquired using the second radar sensor.
  • first radar signal data one or more first combinations of distance and radial velocity are determined, for which an intensity peak is comprised by the first radar signal data.
  • second radar signal data one or more second combinations of distance and radial velocity are determined, for which an intensity peak is comprised by the second radar signal data.
  • a first spectrum descriptive of intensities as a function of an azimuth and elevation angle is determined using the first radar signal data.
  • a second spectrum descriptive of intensities as a function of the azimuth and elevation angle is determined using the second radar signal data.
  • one or more positions of one or more objects in terms of the azimuth and elevation angle are determined using the first and second spectrum.
  • the determining comprises a matching and a comparing of the first and second spectrum.
  • Execution of the program instructions stored in the memory by the processor may further cause the computer device to execute any of the aforementioned examples of the computer-implemented method for detecting the one or more one or more objects using the at least two radar sensors of the stereo radar assembly arranged spaced apart from each other.
  • Execution of the program instructions stored in the memory by the processor may further cause the computer device to execute any of the aforementioned examples of the computer-implemented method for detecting the one or more one or more objects using the at least two radar sensors of the stereo radar assembly arranged spaced apart from each other.
  • FIG. 1 shows a flowchart illustrating an exemplary method for detecting one or more objects using at least two radar sensors arranged spaced apart from each other;
  • FIG. 2 shows a diagram illustrating an exemplary detecting of an object using radial distance and angle relative to two radar sensors arranged spaced apart from each other;
  • FIG. 3 shows block diagram of an exemplary computer device for detecting one or more objects using at least two radar sensors arranged spaced apart from each other.
  • Fig. 1 shows an exemplary method for detecting one or more objects using at least two radar sensors arranged spaced apart from each other.
  • first radar signal data is received using a first radar sensor.
  • second radar signal data is received using a second radar sensor respectively.
  • the first and second signal data may, e.g., be received in form of separated datasets.
  • the first and second signal data may, e.g., be received together.
  • These received radar signal data are descriptive of characteristics, e.g., intensities, of the radar signals. For example, an intensity peak in received radar signal data signifies an object detection.
  • the radar signal data may be descriptive of a position, in particular distance, and radial velocity of an object, with which it is associated.
  • a signal intensity indicative of an object detection may be used to determine the position, where an object may be present, as well as a radial velocity of the object by analyzing the received radar signal data.
  • the first and second radar sensor may, e.g., be operated in monostatic and/or bistatic mode. In case of n > 2 radar sensors, the first and second radar sensor may, e.g., be operated in multistatic mode.
  • one or more first combinations of distance and radial velocity using the first radar signal data may be determined.
  • one or more second combinations of distance and radial velocity using the second radial signal data respectively may be determined.
  • the first and second combinations of distance and radial velocity each may, e.g., be a combination of an interval of distances and an interval of radial velocities according to a predefined distribution of intervals forming a two-dimensional bin.
  • a first distribution of intervals used for the determining the first combinations of distance and radial velocity may be shifted relative to a second distribution of intervals used for the determining the second combinations of distance and radial velocity.
  • one or more first spectra using the first radar signal data may be determined.
  • one or more second spectra using the second radar signal data may be determined.
  • a global coordinate system descriptive of the azimuth and elevation angle may be used for determining first and second spectra.
  • the using of the global coordinate system may comprise transforming first local coordinates of a first local coordinate system assigned to the first radar sensor and second local coordinates of a second local coordinate system assigned to the second radar sensor into the global coordinates of the global coordinate system.
  • determined first and second spectra are matched and compared to determine one or more positions of one or more objects in terms of the azimuth and elevation angle.
  • the method further comprises using a machine learning module for the determining of the one or more positions of the one or more objects.
  • the machine learning module may be trained for providing the one or more positions of the one or more objects in response to receiving the first and second spectrum as an input.
  • the machine learning module may, e.g., comprise one or more neural networks.
  • the one of more neural networks may, e.g., comprise one or more of the following: a feed-forward neural network and/or a convolutional neural network.
  • Fig. 2 illustrates an exemplary detection of an object using two radar sensors arranged spaced apart from each other, i.e., a first radar sensor 310 and a second radar sensor 312.
  • a first power Pi spectrum 302 is determined using first radar signal data acquired with the first radar sensor 310 as well as second P2 spectrum 304 using second radar signal data acquired with the second radar sensor 312.
  • the power spectra 302, 304 may, e.g., be descriptive of radar signal intensities as a function of an azimuth and elevation angle.
  • the azimuth angles 0i, 02 shown in Fig. 2 may, e.g., be determined in local coordinate systems assigned to the individual radar sensors 310, 312.
  • the power spectra 302, 304 may be described in a global coordinate system descriptive of azimuth and elevation angle defined relative to the radar sensor assembly 314.
  • Using the global coordinate system may comprise transforming first local coordinates of a first local coordinate system assigned to the first radar sensor 310 and a second local coordinates of a second local coordinate system assigned to the second radar sensor 314 into the global coordinates of the global coordinate system.
  • Fig. 3 illustrates an exemplary computer device 102 for detecting one or more objects using at least two radar sensors arranged spaced apart from each other.
  • the computer device 102 may be integrated in a vehicle, e.g., a car.
  • the computer device 102 is intended to represent one or more computer devices, which may be distributed.
  • the computer device 102 is shown as comprising a computational system 104.
  • the computational system 104 is intended to represent one or more computational systems.
  • the computer device 102 is further shown as containing an optional hardware interface 106.
  • the hardware interface may enable the computational system 104 to control other components such as a sensor, like a radar sensor for acquiring signal data of objects, if such other components are present.
  • the computational system 104 is further shown as being in communication with an optional user interface 108.
  • the user interface 108 may for example also include a display device, e.g., a display device in a car.
  • a display could include such things as a two-dimensional computer display, a touchscreen, a virtual reality system, and an augmented reality system.
  • the computational system 104 is further shown as being in communication with a memory 110.
  • the memory 110 is intended to represent various types of memory which the computational system 104 may have access to. In one example the memory 110 is a non- transitory storage medium.
  • the memory 110 is shown as containing machine-executable instructions 120.
  • the machine-executable instructions 120 may enable the computational system 104 to perform various numerical, stereo processing, and computational tasks.
  • the machine-executable instructions 120 may also enable the computational system 104 to control and operate other components via the hardware interface 106, like a radar sensor.
  • Execution of the machineexecutable instructions 120 by the computational system 104 may cause the computational system 104 to control the computer device 102 to execute the method for detecting one or more objects, e.g., as illustrated in Fig. 1.
  • the memory 110 is further shown as containing a first spectrum module 122.
  • the memory 110 is further shown as containing a second spectrum module 124.
  • the first spectrum module 122 and the second spectrum module 124 are configured to determine the characteristics, e.g., intensities, of received radar signal data acquired using the first and second radar sensors. Alternatively, a single spectrum module may be used for determining the characteristics of the received radar signal data.
  • the memory 110 is further shown as containing a machine learning module 130.
  • the machine learning module 130 may, e.g., comprise two architectures of neural network referred as stereo processing module 126 and encoder-decoder module 128.
  • the stereo processing module 126 may be configured for extracting depth information by matching the pairs of stereo images. It may involve stereo algorithms for images that matches corresponding points between the images in pair to estimate disparity, which represents the pixel-level depth or 3D position differences between the images. For example, first and second spectra determined using the spectrum modules 122, 124 may, e.g., be provided as input in form of two-dimensional images to the stereo processing module 126.
  • the encoder-decoder module 128 may be trained to find similarities between spectra and mitigate noise effects that may be comprised in the received radar signal data.
  • the stereo process module 126, the encoder-decoder module 128 of the machine learning module 130 may work together to learn and model complex input-output relationships.
  • the machine learning module 130 may further provide complementary functions to the stereo processing module 126 and the encoder-decoder module 128, where the stereo processing module 126 and the encoder-decoder module 128 provide a structured framework for generating outputs, which may be postprocessed by the machine learning module 130, e.g., for optimizing and/or improving an overall output.
  • the machine learning module 130 may be trained for providing the one or more positions of the one or more objects with an improved accuracy in response to receiving the first and second spectrum as an input.
  • a single processor or other unit may fulfill the functions of several items recited in the claims.
  • a computer program may be stored/distributed on a suitable medium, such as an optical storage medium or a solid-state medium supplied together with or as part of other hardware, but may also be distributed in other forms, such as via the Internet or other wired or wireless telecommunication systems.
  • aspects of the present invention may be embodied as an apparatus, method, or computer program product. Accordingly, aspects of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, micro-code, etc.) or an embodiment combining software and hardware aspects that may all generally be referred to herein as a "circuit,” “module” or “system.” Furthermore, aspects of the present invention may take the form of a computer program product embodied in one or more computer readable medium(s) having computer executable code embodied thereon.
  • the computer readable medium may be a computer readable signal medium or a computer readable storage medium.
  • a "computer-readable storage medium” as used herein encompasses any tangible storage medium which may store instructions which are executable by a processor or computational system of a computing device.
  • the computer-readable storage medium may be referred to as a computer-readable non-transitory storage medium.
  • the computer-readable storage medium may also be referred to as a tangible computer readable medium.
  • a computer-readable storage medium may also be able to store data which is able to be accessed by the computational system of the computing device.
  • Examples of computer- readable storage media include, but are not limited to: a floppy disk, a magnetic hard disk drive, a solid-state hard disk, flash memory, a USB thumb drive, Random Access Memory (RAM), Read Only Memory (ROM), an optical disk, a magneto-optical disk, and the register file of the computational system.
  • Examples of optical disks include Compact Disks (CD) and Digital Versatile Disks (DVD), for example CD-ROM, CD-RW, CD-R, DVD-ROM, DVD-RW, or DVD-R disks.
  • the term computer readable-storage medium also refers to various types of recording media capable of being accessed by the computer device via a network or communication link.
  • data may be retrieved over a modem, over the internet, or over a local area network.
  • Computer executable code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wire line, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
  • a computer readable signal medium may include a propagated data signal with computer executable code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated signal may take any of a variety of forms, including, but not limited to, electromagnetic, optical, or any suitable combination thereof.
  • a computer readable signal medium may be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
  • Computer memory or “memory” is an example of a computer-readable storage medium.
  • Computer memory is any memory which is directly accessible to a computational system.
  • Computer storage or “storage” is a further example of a computer-readable storage medium.
  • Computer storage is any non-volatile computer-readable storage medium. In some embodiments computer storage may also be computer memory or vice versa.
  • a "computational system” as used herein encompasses an electronic component which is able to execute a program or machine executable instruction or computer executable code. References to the computational system comprising the example of "a computational system” should be interpreted as possibly containing more than one computational system or processing core. The computational system may for instance be a multi-core processor. A computational system may also refer to a collection of computational systems within a single computer system or distributed amongst multiple computer systems. The term computational system should also be interpreted to possibly refer to a collection or network of computing devices each comprising a processor or computational system. The machine executable code or instructions may be executed by multiple computational systems or processors that may be within the same computing device or which may even be distributed across multiple computing devices.
  • Machine executable instructions or computer executable code may comprise instructions or a program which causes a processor or other computational system to perform an aspect of the present invention.
  • Computer executable code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object-oriented programming language such as Java, Smalltalk, C++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages and compiled into machine executable instructions.
  • the computer executable code may be in the form of a high-level language or in a precompiled form and be used in conjunction with an interpreter which generates the machine executable instructions on the fly.
  • the machine executable instructions or computer executable code may be in the form of programming for programmable logic gate arrays.
  • the computer executable code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server.
  • the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider).
  • These computer program instructions may be provided to a computational system of a general-purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the computational system of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
  • machine executable instructions or computer program instructions may also be stored in a computer readable medium that can direct a computer, other programmable data processing apparatus, or other devices to function in a particular manner, such that the instructions stored in the computer readable medium produce an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.
  • the machine executable instructions or computer program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
  • a "user interface” as used herein is an interface which allows a user or operator to interact with a computer or computer system.
  • a "user interface” may also be referred to as a "human interface device".
  • a user interface may provide information or data to the operator and/or receive information or data from the operator.
  • a user interface may enable input from an operator to be received by the computer and may provide output to the user from the computer.
  • the user interface may allow an operator to control or manipulate a computer and the interface may allow the computer to indicate the effects of the operator's control or manipulation.
  • the display of data or information on a display or a graphical user interface is an example of providing information to an operator.
  • the receiving of data through a keyboard, mouse, trackball, touchpad, pointing stick, graphics tablet, joystick, gamepad, webcam, headset, pedals, wired glove, remote control, and accelerometer are all examples of user interface components which enable the receiving of information or data from an operator.
  • a "hardware interface” as used herein encompasses an interface which enables the computational system of a computer system to interact with and/or control an external computing device and/or apparatus.
  • a hardware interface may allow a computational system to send control signals or instructions to an external computing device and/or apparatus.
  • a hardware interface may also enable a computational system to exchange data with an external computing device and/or apparatus. Examples of a hardware interface include but are not limited to: a universal serial bus, IEEE 1394 port, parallel port, IEEE 1284 port, serial port, RS-232 port, IEEE-488 port, Bluetooth connection, Wireless local area network connection, TCP/IP connection, Ethernet connection, control voltage interface, MIDI interface, analog input interface, and digital input interface.
  • a "display” or “display device” as used herein encompasses an output device or a user interface adapted for displaying images or data.
  • a display may output visual, audio, and or tactile data. Examples of a display include, but are not limited to: a computer monitor, a television screen, a touch screen, tactile electronic display, Braille screen,
  • CTR Cathode ray tube
  • Storage tube Bi-stable display
  • electronic paper Electronic paper
  • Vector display Portable Display
  • VF Vacuum fluorescent display
  • LED Light-emitting diode
  • ELD Electroluminescent display
  • PDP Plasma display panels
  • LCD Liquid crystal display
  • OLED Organic light-emitting diode display
  • projector and Head-mounted display.
  • machine learning refers to a computer algorithm used to extract useful information from training datasets by building probabilistic models, which are referred to as machine learning modules or models, in an automated way.
  • a machine learning module may also be referred to as a predictive model, machine learning algorithms build a mathematical model based on sample data, known as "training data”, in order to make predictions or decisions without being explicitly programmed to perform the task.
  • the machine learning module may be performed using a learning algorithm such as supervised or unsupervised learning.
  • the machine learning module may be based on various techniques such as clustering, classification, linear regression, reinforcement, self-learning, support vector machines, neural networks, etc.
  • a machine learning module may, e.g., be a data structure or program such as a neural network, in particular a convolutional neural network, a support vector machine, a decision tree, a Bayesian network etc.
  • the machine learning module may be adapted, i.e., trained to predict an unmeasured value.
  • the trained machine learning module may thus be enabled to predict the unmeasured value as output from other known values as input.
  • a machine learning module to be trained may, e.g., be an untrained machine learning module, a pre-trained machine learning module or a partially trained machine learning module.
  • the machine learning module being trained may be an untrained machine learning module, which is trained from scratch.
  • the machine learning module being trained may be a pre-trained or partially trained machine learning module.
  • it may not be necessary to start with an untrained machine learning module e.g., in deep learning.
  • one may start with a pre-trained or partially trained machine learning module.
  • the pre-trained or partially trained machine learning module may have been pre-trained or partially trained for the same or a similar task.
  • Using a pre-trained or partially trained machine learning may, e.g., enable a faster training of the trained machine learning module to be trained, i.e., the training may converge faster.
  • transfer learning may be used fortraining a pre-trained or partially trained machine learning module.
  • Transfer learning refers to a machine learning process, which rather than starting the learning process from scratch starts from patterns that have been previously learned, when solving a different problem. This way previous learnings may, e.g., be leveraged, avoiding to start from scratch.
  • a pre-trained machine learning module is a machine learning module that was trained previously, e.g., on a large benchmark dataset to solve a problem similar to the one to be solved by the additional learning.
  • a pre-trained machine learning module In case of a pre-trained machine learning module a previous learning process has been completed successfully.
  • a partially trained machine learning module is a machine learning module, which has been partially trained, i.e., the training process may not have been completed yet.
  • a pre-trained or partially machine learning module may, e.g., be import and trained to be used for the purposes disclosed herein.

Landscapes

  • Engineering & Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • General Physics & Mathematics (AREA)
  • Electromagnetism (AREA)
  • Radar Systems Or Details Thereof (AREA)

Abstract

Est divulgué un procédé mis en œuvre par ordinateur pour détecter au moins un objet au moyen d'au moins deux capteurs radar (310 ; 312) d'un ensemble radar stéréo (314) disposés à distance l'un de l'autre. Le procédé consiste à recevoir des premières données de signal radar et des deuxièmes données de signal radar déterminées respectivement au moyen d'un premier capteur radar (310) et d'un deuxième capteur radar (312). Les deux ensembles de données de signal radar décrivent des caractéristiques des signaux radar respectifs acquis au moyen de l'un des deux capteurs radar (310 ; 312). Au moins une combinaison de distance et de vitesse radiale comprenant un pic d'intensité sont déterminées au moyen des premières et deuxièmes données de signal radar. Pour au moins une combinaison respective de distance et de vitesse radiale, un premier et un deuxième spectre (302 ; 304) décrivant des intensités en fonction de l'angle d'azimut et d'élévation sont déterminés respectivement au moyen des première et deuxièmes données de signal radar. La mise en correspondance et la comparaison des premier et deuxième spectres (302 ; 304) permettent de déterminer au moins une position d'au moins un objet s'agissant de l'angle d'azimut et d'élévation.
PCT/EP2024/075712 2023-09-28 2024-09-16 Radar stéréo Pending WO2025067904A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202480061317.8A CN121925572A (zh) 2023-09-28 2024-09-16 立体雷达

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102023126464.8 2023-09-28
DE102023126464.8A DE102023126464A1 (de) 2023-09-28 2023-09-28 Stereo-radar

Publications (1)

Publication Number Publication Date
WO2025067904A1 true WO2025067904A1 (fr) 2025-04-03

Family

ID=92816651

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2024/075712 Pending WO2025067904A1 (fr) 2023-09-28 2024-09-16 Radar stéréo

Country Status (3)

Country Link
CN (1) CN121925572A (fr)
DE (1) DE102023126464A1 (fr)
WO (1) WO2025067904A1 (fr)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102024130756A1 (de) 2024-10-22 2026-04-23 Valeo Schalter Und Sensoren Gmbh Radarsystem zum ermitteln einer anzahl von objekten in einer umgebung eines fahrzeugs in abhängigkeit von mithilfe eines bildes dargestellten phaseninformationen von empfangssignalen

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3470874A1 (fr) * 2017-10-11 2019-04-17 Symeo GmbH Procédé et système radar permettant de déterminer la position angulaire, l'emplacement et / ou la vitesse d'une cible, en particulier la vitesse vectorielle
DE102019219649A1 (de) * 2019-12-16 2021-06-17 Robert Bosch Gmbh Kooperatives Radarsensorsystem mit winkelauflösenden Radarsensoren
DE102020123293A1 (de) * 2020-09-07 2022-03-10 Friedrich-Alexander-Universität Erlangen-Nürnberg Verfahren, Radarsystem und Fahrzeug zur Signalverarbeitung von Radarsignalen

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102007058242A1 (de) * 2007-12-04 2009-06-10 Robert Bosch Gmbh Verfahren zur Messung von Querbewegungen in einem Fahrerassistenzsystem
DE102021110060A1 (de) * 2021-04-21 2022-10-27 Infineon Technologies Ag Systeme, vorrichtungen und verfahren zur radardetektion

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3470874A1 (fr) * 2017-10-11 2019-04-17 Symeo GmbH Procédé et système radar permettant de déterminer la position angulaire, l'emplacement et / ou la vitesse d'une cible, en particulier la vitesse vectorielle
DE102019219649A1 (de) * 2019-12-16 2021-06-17 Robert Bosch Gmbh Kooperatives Radarsensorsystem mit winkelauflösenden Radarsensoren
DE102020123293A1 (de) * 2020-09-07 2022-03-10 Friedrich-Alexander-Universität Erlangen-Nürnberg Verfahren, Radarsystem und Fahrzeug zur Signalverarbeitung von Radarsignalen

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
XIAORU XIE ET AL.: "Fast-ABC: A Fast Architecture for Bottleneck-Like Based Convolutional Neural Networks", 2019 IEEE COMPUTER SOCIETY ANNUAL SYMPOSIUM ON VLSI (ISVLSI, pages 1 - 6

Also Published As

Publication number Publication date
CN121925572A (zh) 2026-04-24
DE102023126464A1 (de) 2025-04-03

Similar Documents

Publication Publication Date Title
US11720799B2 (en) Object detection neural networks
US20230022265A1 (en) Providing Actionable Uncertainties in Autonomous Vehicles
CN112230193B (zh) 雷达数据处理设备和局部行程分辨力调整方法
US11093799B2 (en) Rare instance classifiers
US10769809B1 (en) Neural networks for object detection
Chamseddine et al. Ghost target detection in 3d radar data using point cloud based deep neural network
EP3825728A1 (fr) Procédé et dispositif pour améliorer des données de radar à l'aide du contexte de données de référence
CN111352110A (zh) 处理雷达数据的方法和装置
US12497079B2 (en) Trajectory prediction using efficient attention neural networks
WO2019178082A1 (fr) Réseaux neuronaux pour détection et caractérisation d'objets
US12055621B2 (en) Determining the orientation of objects using radar or through the use of electromagnetic interrogation radiation
US20210302538A1 (en) Method and apparatus for detecting object based on radar signal
CN115561746B (zh) Fmcw雷达系统中的干扰抑制
Kopp et al. Tackling Clutter in Radar Data--Label Generation and Detection Using PointNet++
WO2025067904A1 (fr) Radar stéréo
CN116381634A (zh) 用于雷达信号处理的方法和系统
Sharifisoraki et al. Comparative analysis of mmWave radar-based object detection in autonomous vehicles
US20240142575A1 (en) Method and apparatus with neural network training
EP4474852A1 (fr) Système radar utilisant un modèle appris par machine pour identifier un certain nombre d'objets
US12339396B2 (en) Radar reflection detection with convolutional neural network kernels matched to reflection-ghost offset
EP4365624A1 (fr) Détection et classification d'objets mobiles dans des données radar à l'aide d'un apprentissage profond
US11953590B1 (en) Radar multipath detection based on changing virtual arrays
WO2025098748A1 (fr) Augmentation de la résolution d'un spectre radar
WO2025087687A1 (fr) Détection d'objets à l'aide d'au moins deux capteurs radar
US12449512B2 (en) Radar point cloud multipath reflection compensation

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 24772956

Country of ref document: EP

Kind code of ref document: A1