WO2024017086A1 - 一种激光雷达系统、控制方法、装置和车辆 - Google Patents
一种激光雷达系统、控制方法、装置和车辆 Download PDFInfo
- Publication number
- WO2024017086A1 WO2024017086A1 PCT/CN2023/106673 CN2023106673W WO2024017086A1 WO 2024017086 A1 WO2024017086 A1 WO 2024017086A1 CN 2023106673 W CN2023106673 W CN 2023106673W WO 2024017086 A1 WO2024017086 A1 WO 2024017086A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- lidar
- vehicle
- short
- range
- environment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/88—Lidar systems specially adapted for specific applications
- G01S17/93—Lidar systems specially adapted for specific applications for anti-collision purposes
- G01S17/931—Lidar systems specially adapted for specific applications for anti-collision purposes of land vehicles
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R11/00—Arrangements for holding or mounting articles, not otherwise provided for
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
- G01S17/06—Systems determining position data of a target
- G01S17/08—Systems determining position data of a target for measuring distance only
- G01S17/10—Systems determining position data of a target for measuring distance only using transmission of interrupted, pulse-modulated waves
- G01S17/14—Systems determining position data of a target for measuring distance only using transmission of interrupted, pulse-modulated waves wherein a voltage or current pulse is initiated and terminated in accordance with the pulse transmission and echo reception respectively, e.g. using counters
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/87—Combinations of systems using electromagnetic waves other than radio waves
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/481—Constructional features, e.g. arrangements of optical elements
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/481—Constructional features, e.g. arrangements of optical elements
- G01S7/4811—Constructional features, e.g. arrangements of optical elements common to transmitter and receiver
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/481—Constructional features, e.g. arrangements of optical elements
- G01S7/4811—Constructional features, e.g. arrangements of optical elements common to transmitter and receiver
- G01S7/4813—Housing arrangements
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/497—Means for monitoring or calibrating
- G01S7/4972—Alignment of sensor
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R1/12—Mirror assemblies combined with other articles, e.g. clocks
- B60R2001/1223—Mirror assemblies combined with other articles, e.g. clocks with sensors or transducers
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R11/00—Arrangements for holding or mounting articles, not otherwise provided for
- B60R2011/0001—Arrangements for holding or mounting articles, not otherwise provided for characterised by position
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R11/00—Arrangements for holding or mounting articles, not otherwise provided for
- B60R2011/0001—Arrangements for holding or mounting articles, not otherwise provided for characterised by position
- B60R2011/004—Arrangements for holding or mounting articles, not otherwise provided for characterised by position outside the vehicle
Definitions
- Embodiments of the present application relate to the field of intelligent driving, and more specifically, to a lidar system, control method, device and vehicle.
- Vehicles usually use sensors, such as millimeter wave radar, laser radar (LiDAR), ultrasonic radar, and cameras, to perform environment perception and target measurement, such as measuring the target's position, distance, speed, etc.
- sensors such as millimeter wave radar, laser radar (LiDAR), ultrasonic radar, and cameras, to perform environment perception and target measurement, such as measuring the target's position, distance, speed, etc.
- Lidar has high confidence and plays an increasingly important role in autonomous driving.
- the lidar of vehicles is generally arranged on the front side of the vehicle (such as the front bumper).
- the blind spots caused by lidar during driving of the vehicle will affect the vehicle's perception of the surrounding environment, thus affecting the safety of the vehicle. If you want to improve vehicle safety, you need to install multiple lidars on the vehicle, which will make the cost of the vehicle too high.
- Embodiments of the present application provide a lidar system, control method, device and vehicle, which can help reduce the cost of the vehicle while improving the safety of the vehicle.
- the vehicle in this application is a vehicle in a broad sense, which can be a means of transportation (such as commercial vehicles, passenger cars, motorcycles, flying cars, trains, etc.), industrial vehicles (such as forklifts, trailers, tractors, etc.), engineering vehicles Vehicles (such as excavators, bulldozers, cranes, etc.), agricultural equipment (such as lawn mowers, harvesters, etc.), amusement equipment, toy vehicles, etc.
- the embodiments of this application do not specifically limit the types of vehicles.
- a lidar system in a first aspect, includes: a first lidar; a first flip component for connecting the first lidar to a first side of a vehicle; wherein, when the third lidar When a flipping component is flipped to the first position, the first laser radar is used to sense the environment in the first direction; or when the first flipping component is flipped to the second position, the first lidar is used to sense the environment. Perceiving the environment in the second direction.
- the first lidar can be installed on the first side of the vehicle.
- the data collected by the lidar on the first side of the vehicle can make up for the blind area caused by the lidar on the front side of the vehicle, thereby helping to improve the vehicle. safety performance; at the same time, controlling the first lidar to sense the environment in the first direction or the second direction through the first flipping component helps to reduce the number of lidars on the vehicle, thereby helping to reduce the cost of the vehicle.
- the lidar system further includes: a lidar disposed on the front side of the vehicle.
- the blind zone range of the lidar disposed on the front side of the vehicle is larger than the blind zone range of the first lidar.
- the ranging capability of the lidar disposed on the front side of the vehicle is greater than the ranging capability of the first lidar.
- the ranging accuracy of the lidar disposed on the front side of the vehicle is smaller than the ranging accuracy of the first lidar.
- the lidar disposed on the front side of the vehicle is a long-range lidar.
- the first lidar is a short-range lidar.
- a short-range lidar can be installed on the first side of the vehicle, so that the short-range lidar on the first side
- the collected data can identify people, animals or other obstacles that are close to the vehicle, thereby helping to improve the safety performance of the vehicle.
- the lidar system further includes: a second lidar; and a second flip component for connecting the second lidar to the second side of the vehicle. ; Wherein, when the second flipping component flips to the third position, the second lidar is used to sense the environment in the first direction; or, when the second flipping component flips to the fourth position, the second laser radar The second lidar is used to sense the environment in the second direction.
- a second lidar can be installed on the second side of the vehicle, so that the data collected by the lidar on the first side and the second side of the vehicle can further make up for the blind area caused by the lidar on the front side of the vehicle.
- controlling the second lidar to sense the environment in the first direction or the second direction through the second flipping component helps to reduce the number of lidars on the vehicle, thus helping to reduce The cost of the vehicle.
- the second lidar is a short-range lidar.
- the first lidar and the second lidar are symmetrical about a centerline in the width direction of the vehicle.
- the first lidar and the second lidar may be symmetrical about the center line in the width direction of the vehicle, which can ensure the appearance of the vehicle.
- the first lidar and the second lidar are respectively disposed on the rearview mirrors of the first side and the second side; or, the The first lidar and the second lidar are respectively arranged on the wheel eyebrows of the first side and the second side; or the first lidar and the second lidar are respectively arranged on the first side. and on the B-pillar of the second side; or, the first lidar and the second lidar are respectively arranged on the door handles of the first side and the second side.
- the first lidar and the second lidar can be respectively arranged on the rearview mirror, wheel arch, B-pillar or door handle on the first side and the second side.
- Such an arrangement can reduce the load on the vehicle.
- the lidar system further includes: a third lidar, arranged at the rear of the vehicle.
- a third lidar may be arranged at the rear of the vehicle. In this way, when the vehicle is driving backward (for example, parking), the environment is sensed through the data collected by the third lidar, which helps to improve the safety performance of the vehicle.
- the third lidar is a short-range lidar.
- a short-range lidar can be installed at the rear of the vehicle.
- the data collected by the short-range lidar can detect people who are close to the vehicle. , animals or other obstacles (such as ground locks, poles, etc.), which helps to improve the safety performance of the vehicle.
- the lidar system further includes: a fourth lidar, arranged at the rear of the vehicle; wherein the third lidar and the fourth lidar are respectively arranged on both sides of the rear license plate of the vehicle; or, the third lidar and the fourth lidar are arranged on the rear wing of the vehicle; or, the third lidar and the fourth lidar are arranged on the rear license plate of the vehicle the upper or lower side.
- the point cloud data collected by the third lidar and the fourth lidar can cover the entire blind area in the rear direction of the vehicle, which is helpful to Improve vehicle safety performance.
- the fourth lidar is a short-range lidar.
- the lidar system further includes: a control device for obtaining an instruction, the instruction being used to instruct the first lidar to respond to the first direction or the second direction. to sense the environment in the direction; the control device is also used to control the first flipping component to flip according to the instruction.
- the first direction is the direction in which the vehicle travels forward
- the second direction is the direction in which the vehicle travels backward
- a control method which method includes: obtaining an instruction; controlling the first flipping component to flip according to the instruction, and the first flipping component connects the first lidar to the first side of the vehicle; wherein, When the first flipping component flips to the first position, the first lidar is used to sense the environment in the first direction; or, when the first flipping component flips to the second position, the first laser radar The first lidar is used to sense the environment in the second direction.
- the first lidar can be installed on the first side of the vehicle.
- the data collected by the lidar on the first side of the vehicle can make up for the blind area caused by the lidar on the front side of the vehicle, thereby helping to improve the vehicle. safety performance; at the same time, controlling the first lidar to sense the environment in the first direction or the second direction through the first flipping component helps to reduce the number of lidars on the vehicle, thereby helping to reduce the cost of the vehicle.
- the first lidar is a short-range lidar.
- a short-range lidar can be installed on the first side of the vehicle, so that people, animals or other obstacles that are close to the vehicle can be identified through the data collected by the short-range lidar on the first side. , thus helping to improve the safety performance of the vehicle.
- the instruction includes a driving state of the vehicle
- controlling the first flipping component to flip according to the instruction includes: when the driving state indicates that the vehicle is moving forward. , control the first flipping component to flip to the first position, and the first direction is the direction in which the vehicle travels forward; or, when the driving state indicates that the vehicle travels backward, control the first flipping component to flip to the In the second position, the second direction is the direction in which the vehicle travels backward.
- a second lidar can be installed on the second side of the vehicle, so that the data collected by the lidar on the first side and the second side of the vehicle can further make up for the blind area caused by the lidar on the front side of the vehicle.
- controlling the second lidar to sense the environment in the first direction or the second direction through the second flipping component helps to reduce the number of lidars on the vehicle, thus helping to reduce The cost of the vehicle.
- the second lidar is a short-range lidar.
- the method further includes: controlling a second flipping component to flip according to the control instruction, and the second flipping component connects the second lidar to the second lidar of the vehicle. side; wherein, when the second flipping component flips to the third position, the second lidar is used to sense the environment in the first direction; or, when the second flipping component flips to the fourth position , the second lidar is used to sense the environment in the second direction.
- the method further includes: composing the image based on the point cloud data collected by the first lidar.
- the first lidar is a short-range lidar
- the vehicle also includes other sensors (for example, a long-range lidar, a camera, etc.)
- the point cloud data collected by the first lidar is Composing images, including: composing images based on point cloud data collected by short-range lidar and data collected by other sensors.
- a control device in a third aspect, includes: an acquisition unit for acquiring an instruction; and a control unit for controlling the first flipping component to flip the first lidar according to the instruction. Connected to the first side of the vehicle; wherein, when the first flipping component flips to the first position, the first laser radar is used to sense the environment in the first direction; or, when the first flipping component flips When reaching the second position, the first lidar is used to sense the environment in the second direction.
- the first lidar is a short-range lidar.
- the instruction includes the driving state of the vehicle
- the control unit is specifically configured to: control the first flipping component when the driving state indicates that the vehicle is moving forward. Flip to the first position, the first direction is the direction in which the vehicle travels forward; or, when the driving state indicates that the vehicle travels backward, control the first flip component to flip to the second position, the second The direction is the direction in which the vehicle is traveling backwards.
- control unit is also used to control the second flipping component to flip according to the control instruction, and the second flipping component connects the second lidar to the vehicle. the second side; wherein, when the second flipping component flips to the third position, the second lidar is used to sense the environment in the first direction; or, when the second flipping component flips to the fourth position, the second lidar is used to sense the environment in the second direction.
- the second lidar is a short-range lidar.
- the device further includes: a composition unit configured to compose a composition based on the point cloud data collected by the first lidar.
- a device in a fourth aspect, includes a processing unit and a storage unit, where the storage unit is used to store instructions, and the processing unit executes the instructions stored in the storage unit, so that the device performs any of the possibilities in the second aspect. Methods.
- the above-mentioned processing unit may include at least one processor, and the above-mentioned storage unit may be a memory, where the memory may be a storage unit within the chip (for example, a register, cache, etc.), or it may be a storage unit outside the chip in the vehicle. (For example, only read memory, random access memory, etc.).
- a system which includes the lidar system described in the first aspect and the device described in the third or fourth aspect.
- a sixth aspect provides a vehicle, which includes the lidar system described in the first aspect, or the vehicle includes the device described in the third or fourth aspect, or the vehicle includes the fifth aspect. system described in this aspect.
- a computer program product includes: computer program code.
- the computer program code When the computer program code is run on a computer, it causes the computer to perform any of the possible methods in the second aspect.
- the above computer program code can be stored in whole or in part on the first storage medium, where the first storage medium can be packaged together with the processor, or can be packaged separately from the processor. This is not the case in the embodiments of this application. Specific limitations.
- a computer-readable medium stores program code.
- the computer program code When the computer program code is run on a computer, it causes the computer to perform any of the possible methods in the second aspect. .
- inventions of the present application provide a chip system.
- the chip system includes a processor for calling a computer program or computer instructions stored in a memory, so that the processor executes any of the possible methods of the second aspect. method.
- the processor is coupled with the memory through an interface.
- the chip system further includes a memory, and a computer program or computer instructions are stored in the memory.
- Figure 1 is a schematic functional block diagram of a vehicle provided by an embodiment of the present application. .
- Figure 2 is a schematic diagram of the layout and blind zone of a long-range lidar.
- Figure 3 is a schematic diagram of the layout of a long-range lidar and a short-range lidar and the field of view of the short-range lidar provided by an embodiment of the present application.
- Figure 4 is a schematic diagram of another arrangement of long-range lidar and short-range lidar and another field of view of short-range lidar provided by the embodiment of the present application.
- Figure 5 is a schematic diagram of arranging a short-range lidar on a rearview mirror provided by an embodiment of the present application.
- Figure 6 is a process of controlling the short-range lidar to flip forward or backward through worm drive according to the embodiment of the present application.
- Figure 7 is a schematic diagram of arranging a short-range lidar on the B-pillar of a vehicle according to an embodiment of the present application.
- Figure 8 is a schematic diagram of arranging a short-range lidar on the wheel eyebrow of a vehicle according to an embodiment of the present application.
- FIG. 9 is a schematic diagram of arranging a short-range lidar on a door handle of a vehicle according to an embodiment of the present application.
- Figure 10 is a schematic diagram of arranging a short-range lidar on the side of a bus body provided by an embodiment of the present application.
- Figure 11 is a schematic diagram of arranging a short-range lidar on the side of a truck body provided by an embodiment of the present application.
- Figure 12 is a schematic diagram of arranging short-range lidar on both sides of the license plate at the rear of the vehicle provided by the embodiment of the present application.
- Figure 13 is a schematic diagram of arranging a short-range lidar above the license plate at the rear of a vehicle provided by an embodiment of the present application.
- Figure 14 is a schematic diagram of arranging short-range lidar on the tail according to the embodiment of the present application.
- Figure 15 is a schematic flow chart of a control method provided by an embodiment of the present application.
- Figure 16 is a schematic diagram of the external structure of a DTOF lidar for direct measurement of time of flight provided by an embodiment of the present application.
- Figure 17 is a schematic diagram of the internal structure of the DTOF lidar provided by the embodiment of the present application.
- Figure 18 is a schematic block diagram of a lidar system provided by an embodiment of the present application.
- Figure 19 is a schematic diagram of an application scenario provided by an embodiment of the present application.
- Figure 20 is another schematic flow chart of a control method provided by an embodiment of the present application.
- Figure 21 is a schematic block diagram of a control device provided by an embodiment of the present application.
- Prefixes such as “first” and “second” are used in the embodiments of this application only to distinguish different description objects, and have no limiting effect on the position, order, priority, quantity or content of the described objects.
- the use of ordinal words and other prefixes used to distinguish the described objects does not limit the described objects.
- Words constitute redundant restrictions.
- plural means two or more.
- FIG. 1 is a functional block diagram of a vehicle 100 provided by an embodiment of the present application.
- Vehicle 100 may include a perception system 120 and a computing platform 150 , where perception system 120 may include one or more sensors that sense information about the environment surrounding vehicle 100 .
- the sensing system 120 may include a positioning system, which may be a global positioning system (GPS), Beidou system or other positioning systems, or an inertial measurement unit (IMU).
- the perception system 120 may also include one or more of an eye tracker, a laser radar, a millimeter wave radar, an ultrasonic radar, and a camera device.
- lidar can also be divided into long-range lidar and short-range lidar.
- the computing platform 150 may include one or more processors, such as processors 151 to 15n (n is a positive integer).
- the processor is a circuit with signal processing capabilities.
- the processor may be a circuit with instructions. Circuits with read and run capabilities, such as central processing unit (CPU), microprocessor, graphics processing unit (GPU) (can be understood as a microprocessor), or digital signal processor (digital signal processor, DSP), etc.; in another implementation, the processor can achieve certain functions through the logical relationship of the hardware circuit. The logical relationship of the hardware circuit is fixed or can be reconstructed.
- the processor is a dedicated integrated Hardware circuits implemented by application-specific integrated circuit (ASIC) or programmable logic device (PLD), such as field programmable gate array (FPGA).
- ASIC application-specific integrated circuit
- PLD programmable logic device
- FPGA field programmable gate array
- the process of the processor loading the configuration file and realizing the hardware circuit configuration can be understood as the process of the processor loading instructions to realize the functions of some or all of the above units.
- it can also be a hardware circuit designed for artificial intelligence, which can be understood as an ASIC, such as a neural network processing unit (NPU), tensor processing unit (TPU), deep learning processing Unit (deep learning processing unit, DPU), etc.
- the computing platform 150 may also include a memory, which is used to store instructions. Some or all of the processors 151 to 15n may call instructions in the memory and execute the instructions to implement corresponding functions.
- Figure 2 is a schematic diagram of the layout position and blind zone of a long-range lidar.
- the long-range lidar currently on the market has a blind zone of 0-0.6 meters, which makes it impossible to determine the location of objects in front of the vehicle and close to the vehicle through the point cloud data collected by the long-range lidar.
- long-range lidars cannot make up for their own blind spots.
- the blind spot may cause the vehicle to be unable to detect animals (for example, kittens, puppies) or people crouching close to the vehicle, which may cause vehicle safety accidents and affect the safety performance of the vehicle.
- Figure 3 shows the arrangement positions of a long-range lidar and a short-range lidar provided by an embodiment of the present application, as well as a schematic diagram of the field of view of the short-range lidar.
- Figure 3 by arranging two short-range lidars on the sides of the vehicle body for sensing the environment in front of the vehicle, the blind spot when the vehicle is driving forward can be compensated. This helps avoid safety accidents caused by the inability of long-range lidar to detect objects at close range, and helps improve vehicle safety performance. For example, it can improve vehicle safety when parking out of a parking space.
- two short-range lidars can also be arranged on the rearview mirror respectively; or, two short-range lidars can be arranged on both sides of the front bumper.
- the lidar arranged on the side of the vehicle body is a short-range lidar as an example.
- the lidar arranged on the side of the vehicle body can also be a long-range lidar. This long-range lidar can also make up for the blind spot of the lidar on the front side of the vehicle.
- the blind area range of the lidar arranged on the front side of the vehicle is larger than the blind area range of the lidar arranged on the side of the vehicle.
- the ranging capability of the lidar arranged on the front side of the vehicle is greater than the ranging capability of the lidar arranged on the side of the vehicle.
- the ranging accuracy of the lidar arranged on the front side of the vehicle is smaller than the ranging accuracy of the lidar arranged on the side of the vehicle.
- Figure 4 shows the arrangement positions of another long-range lidar and short-range lidar provided by the embodiment of the present application, as well as a schematic diagram of the field of view of the short-range lidar.
- Figure 4 by arranging four short-range lidars on the sides and rear of the vehicle for sensing the environment behind the vehicle, the blind spot when the vehicle is traveling backwards can be compensated. In this way, it helps to improve the safety performance of the vehicle when parking, thereby helping to improve the user's parking experience.
- two of the four short-range lidars can be arranged on the rearview mirror, and the other two can be arranged on both sides of the license plate at the rear of the vehicle.
- the above figure 4 illustrates the arrangement of four short-range lidars for sensing the environment behind the vehicle as an example.
- the embodiment of the present application does not limit the number of short-range lidars.
- three short-range lidars for sensing the environment behind the vehicle can also be arranged on the sides and rear of the vehicle. Two of them can be arranged on the rearview mirror, and the other one can be arranged on the rear of the vehicle (for example, the vehicle The upper or lower side of the tail license plate).
- the above arrangement scheme shown in Figure 3 introduces the arrangement of two short-range lidars on the sides of the vehicle body for sensing the environment in front of the vehicle.
- the arrangement scheme shown in Figure 4 introduces the arrangement of two short-range lidars on the sides and rear of the vehicle body.
- Arrange 4 short-range lidars for sensing the environment behind the vehicle.
- the two short-range lidars arranged on the sides of the vehicle body shown in Figures 3 and 4 can be the same lidars.
- a flipping component can be provided on the side of the vehicle body. The flipping component can control the short-range lidar to flip forward and backward, and then use the same short-range lidar to sense the environment in front of the vehicle and the environment behind the vehicle, which helps reduce the risk of the vehicle. the cost of.
- Figure 5 shows a schematic diagram of arranging a short-range lidar on a rearview mirror provided by an embodiment of the present application.
- the rearview mirror may include a folding mechanism 510 , a flip component 520 and a short-range lidar 530 .
- the X-axis direction is the direction of the vehicle's longitudinal axis
- the Y-axis is the direction of the vehicle's transverse axis
- the Z-axis is the vehicle height direction.
- the positive direction (or positive direction) of the X-axis may be the direction in which the vehicle travels forward
- the negative direction (or negative direction) of the X-axis may be the direction in which the vehicle travels backward.
- the folding mechanism 510 is used to fold the rearview mirror.
- the user can adjust the rearview mirror to an unfolded state or a folded state by rotating the rearview mirror knob.
- the folding mechanism 510 can be used to control the rearview mirror to be in a folded state; when a user's operation of unlocking the vehicle is detected, the folding mechanism 510 can be used to control the rearview mirror to be in an unfolded state. .
- the flipping component 520 is used to control the short-range lidar 530 to flip forward and backward.
- the vehicle can control the short-range lidar 530 to flip backward through the flip component 520, so as to sense the environment behind the vehicle through the data collected by the short-range lidar 530.
- the short-range lidar 530 in (a) of Figure 5 is currently in flip state 1. In the flip state 1, the data collected by the short-range lidar 530 can be used to make up for the blind spot when the vehicle is driving forward in Figure 2.
- the above short-range lidar 530 is in flip state 1, which can also be understood as the horizontal field of view (FOV) of the short-range lidar corresponding to the positive direction of the X-axis.
- FOV horizontal field of view
- FIG. 5 shows another view when the short-range lidar is in flip state 1.
- the vehicle when the vehicle needs to move forward, the vehicle can control the short-range lidar 530 along the Y-axis direction (or along the XOZ plane) through the flip component 520 Flip 180° clockwise or counterclockwise to flip the short-range lidar 530 backwards.
- the flipping component 520 controls the short-range lidar 530 to flip backward, so that the vehicle can sense the environment behind the vehicle through the data collected by the short-range lidar 530 .
- the short-range lidar 530 is currently in flip state 2.
- the FOV of the short-range lidar 530 may have a symmetrical relationship.
- the data collected by the short-range lidar 530 can be used to compensate for the blind spot when the vehicle is traveling backwards in Figure 2.
- the above short-range lidar 530 is currently in the flip state 2, which can also be understood as the horizontal field of view (FOV) of the short-range lidar corresponding to the negative direction of the X-axis.
- FOV horizontal field of view
- FIG. 5 shows another view when the short-range lidar is in flip state 2.
- FIG. 6 shows a schematic diagram of arranging a short-range lidar on a rearview mirror provided by an embodiment of the present application.
- the flipping component 520 may be a flippable mechanism 602 .
- the rearview mirror 601 of the vehicle is provided with a reversible mechanism 602
- the reversible mechanism 602 is provided with a short-range lidar 603 .
- the short-range lidar 603 can be fixedly connected to the reversible mechanism 602. catch.
- the above-mentioned reversible mechanism 602 may include a driving motor 604, a reduction gearbox assembly 605, and a rotating shaft 607.
- the driving motor 604 is connected to the rotating shaft 607 through a reduction gearbox assembly 605.
- the reduction gearbox assembly 605 includes a synchronously driven first gear and a second gear (not shown in the figure) provided on the transmission shaft 606 .
- the output shaft of the driving motor 604 is connected to the first gear, and the second gear meshes with the external gear 608 provided on the outer surface of the rotating shaft 607 to form a worm drive.
- the flippable mechanism 602 can be driven to rotate through the worm drive, thereby controlling the short-range lidar 603 to flip forward or backward.
- the reversible mechanism 602 may also include bearings 609 and bearings 610 for supporting the reversible mechanism 602.
- a worm drive is used to control the short-range lidar to flip forward or backward, which is not specifically limited in the embodiment of the present application.
- the lidar can also be controlled to flip forward or backward through other transmission methods.
- the turning component 520 can also be a motor.
- the short-range lidar can be rotated around the Y-axis by controlling the motor to sense the environment in front or behind the vehicle.
- Figures 5 and 6 take a manual rearview mirror or an electric rearview mirror with a mirror as an example.
- the embodiment of the present application does not specifically limit the type of rearview mirror.
- the rearview mirror may also be an electronic rearview mirror.
- Figure 7 shows a schematic diagram of arranging a short-range lidar on the B-pillar of a vehicle according to an embodiment of the present application.
- short-range lidar can be arranged on the B-pillar on the left side and the B-pillar on the rear side of the vehicle respectively.
- the short-range lidar can also be arranged on the A-pillar of the vehicle, or the short-range lidar can also be arranged on the C-pillar of the vehicle, or the short-range lidar can also be arranged on the D-pillar of the vehicle. .
- Figure 8 shows a schematic diagram of arranging a short-range lidar on the wheel eyebrow of a vehicle provided by an embodiment of the present application.
- a short-range lidar can be arranged on the wheel eyebrow of the vehicle's front wheel, or a short-range lidar can be arranged on the wheel eyebrow of the rear wheel of the vehicle.
- a short-range lidar can be arranged on the wheel eyebrow of the left front wheel of the vehicle and a short-range lidar can be arranged on the wheel eyebrow of the right front wheel of the vehicle.
- a short-range lidar can be arranged on the wheel eyebrow of the left rear wheel of the vehicle and a short-range lidar can be arranged on the wheel eyebrow of the right rear wheel of the vehicle.
- Figure 9 shows a schematic diagram of arranging a short-range lidar on a door handle of a vehicle provided by an embodiment of the present application.
- the short-range lidar can be arranged on the rear door handle, or it can also be arranged on the front door handle.
- a short-range lidar may be arranged on the door handle of the left rear door of the vehicle and a short-range lidar may be arranged on the door handle of the right rear door of the vehicle.
- a short-range lidar may be arranged on the door handle of the left front door of the vehicle and a short-range lidar may be arranged on the door handle of the right front door of the vehicle.
- the short-range lidar can also be arranged on the fender on the side of the vehicle.
- the flipping component can be connected to the short-range lidar, and the flipping component can drive the short-range lidar to flip forward or backward, thereby realizing the perception of the environment in front or behind the vehicle.
- FIGS. 7 to 9 take a car as an example for explanation, and the embodiments of the present application are not limited thereto.
- the short-range lidar arrangement in the embodiment of the present application can also be applied to buses, trucks, or other types of vehicles.
- Figure 10 shows a schematic diagram of arranging short-range lidar on the side of the bus body provided by the embodiment of the present application.
- the point cloud data collected by the short-range lidar on the rear wheel eyebrows can make up for the blind spots when the bus is driving forward. This will help avoid safety accidents caused by the inability of long-range lidar to detect objects at close range, and help improve the safety performance of buses. For example, it can improve the safety of buses when parking in and out of parking spaces.
- the point cloud data collected by the short-range lidar on the front wheel eyebrows and rear wheel eyebrows can make up for the blind spots when the bus is driving backwards. For example, it can improve the safety performance of buses when parking.
- Figure 11 shows a schematic diagram of arranging a short-range lidar on the side of a truck body provided by an embodiment of the present application.
- short-range lidar can be arranged on the rearview mirror of the truck and at different positions in the side cargo box.
- the short-range lidar provided by the embodiment of the present application can also be arranged at other positions at the rear of the vehicle.
- Figure 12 shows a schematic diagram of arranging short-range lidar on both sides of the license plate at the rear of the vehicle provided by the embodiment of the present application.
- the short-range lidar on both sides of the license plate at the rear of the vehicle is symmetrical with respect to the centerline of the vehicle in the width direction.
- Figure 13 shows a schematic diagram of arranging the short-range lidar above the license plate at the rear of the vehicle provided by the embodiment of the present application.
- Figure 14 shows a schematic diagram of arranging short-range lidar on the tail fin according to the embodiment of the present application.
- Figures 12 to 14 above take the example of arranging two short-range lidars at the rear of the vehicle as an example.
- the embodiment of the present application does not specifically limit the number of short-range lidars at the rear of the vehicle.
- a short-range lidar can also be arranged at the rear of the car, such as arranging a short-range lidar on the left or right side of the rear license plate, or arranging a short-range lidar on the upper side of the rear license plate. Either on the lower side, or a short-range lidar is placed on the tail fin.
- FIG. 15 shows a schematic flowchart of a control method 1500 provided by an embodiment of the present application.
- the method 1500 includes:
- the current state of the vehicle includes driving forward or driving backward.
- the current status of the vehicle can be determined by the gear position of the vehicle.
- the vehicle detects the user's operation of shifting the D gear it can be determined that the current state of the vehicle is driving forward; when it detects the user's operation of shifting the R gear, it can be determined that the current state of the vehicle is driving backward.
- steps S1502-S1504 may be executed; when it is determined that the vehicle is traveling backward, steps S1505-S1507 may be executed.
- S1502 controls the short-range lidar to sense the environment in front of the vehicle.
- the short-range lidar when it is determined that the vehicle is moving forward, the short-range lidar can be controlled to flip forward through the above-mentioned flip component.
- the computing platform determines that the current state of the vehicle is driving forward through the data collected by the gear sensor, it can control the operation of the above-mentioned drive motor (or motor) to control the short-range lidar on the rearview mirror to flip forward and enter the vehicle.
- the fusion module can collect point cloud data collected by short-range lidar, point cloud data collected by long-range lidar, images collected by a camera device (for example, a surround-view camera), and data collected by millimeter-wave radar or centimeter-wave radar. Point cloud data are fused to obtain the fusion result.
- the fusion result can be sent to the regulation and control module, so that the regulation and control module performs corresponding operations.
- control module includes, but is not limited to, an automatic emergency brake (automatic emergency brake, AEB) module and an adaptive cruise (automatic cruise control, ACC) module.
- AEB automatic emergency brake
- ACC adaptive cruise control
- control instructions are executed, including: when it is determined through the fusion result that there is an object (for example, an animal or a squatting person) near the vehicle body, controlling the vehicle to brake or avoid.
- an object for example, an animal or a squatting person
- the fusion result is determined by the point cloud data collected by short-range lidar and the point cloud data collected by long-range lidar. This can make up for the blind spots caused by point cloud data collected only by long-range lidar. It helps to improve vehicle safety by avoiding safety accidents caused by long-range lidar and camera devices being unable to detect objects or people close to the vehicle.
- S1505 controls the short-range lidar to sense the environment behind the vehicle.
- the short-range lidar when it is determined that the vehicle is traveling backward, the short-range lidar can be controlled to flip backward through the above-mentioned flip component.
- the computing platform determines that the current state of the vehicle is driving backward through the data collected by the gear sensor, it can control the operation of the above-mentioned drive motor (or motor), thereby controlling the short-range lidar on the rearview mirror to flip backward and enter the vehicle.
- the above flipped state 2 2.
- the fusion module can collect point cloud data collected by short-range lidar, point cloud data collected by long-range lidar, images collected by a camera device (for example, a surround-view camera), and data collected by millimeter-wave radar or centimeter-wave radar. Point cloud data are fused to obtain the fusion result.
- the image can be composed based on data collected by short-range lidar and other sensors.
- the vehicle can perform simultaneous localization and map construction (simultaneous localization and mapping, SLAM) through point cloud data collected by short-range lidar and long-range lidar and image data collected by camera devices.
- simultaneous localization and map construction Simultaneous localization and mapping, SLAM
- the control instruction is executed, including: during the parking process of the vehicle, it is determined through the fusion result that there are objects (for example, animals or squatting people), ground locks or other obstacles (for example, near the vehicle body). , pole), control the vehicle to brake or avoid.
- objects for example, animals or squatting people
- ground locks or other obstacles for example, near the vehicle body. , pole
- the short-range lidar can be controlled to sense the environment in front of or behind the vehicle, which helps to make up for the blind spots caused by the long-range lidar and improve the accuracy of the perception of the environment around the vehicle. safety, thereby helping to improve vehicle safety; at the same time, through flipping components and short-range lidar, the environment in front of or behind the vehicle can be sensed, which helps reduce the number of short-range lidars installed on the vehicle, thus Helps reduce vehicle costs.
- the short-range lidar may be a direct measurement time of flight (DTOF) lidar.
- DTOF direct measurement time of flight
- FIG. 16 shows a schematic diagram of the external structure of the DTOF lidar provided by the embodiment of the present application.
- the distance measurement of DTOF lidar can be between 5m and 10m; the distance measurement accuracy can reach 3cm ⁇ 5cm; the horizontal and vertical resolution can be determined according to the actual scene requirements; the blind zone of DTOF lidar is within 5cm-15cm, which is smaller than that of long-range lidar. 60cm blind zone; horizontal FOV and vertical FOV can be determined according to actual scene requirements, which can meet the above requirements for vehicle layout and visual field blindness compensation.
- Table 1 shows the correspondence between parameters and corresponding parameter values in DTOF lidar.
- FIG 17 shows a schematic diagram of the internal structure of the DTOF lidar provided by the embodiment of the present application.
- DTOF lidar consists of a vertical cavity surface emitting laser (VCSEL), a transmitting light machine, a single photon avalanche diode (SPAD), a receiving light machine, a holder bracket, and a It is composed of assembled printed circuit board assembly (PCBA) and so on.
- the detection principle of DTOF lidar is based on the time of flight (TOF) principle for ranging. Its advantages are accurate ranging, fast response time and simultaneous detection of multiple objects.
- short-range lidar as DTOF lidar as an example.
- type of short-range lidar is not specifically limited.
- short-range lidar can also be mechanical lidar, optical phased array (OPA) lidar, etc.
- OPA optical phased array
- FIG 18 shows a schematic block diagram of a lidar system 1800 provided by an embodiment of the present application.
- the lidar system 1800 includes: a first lidar 1810; a first flip component 1820 for connecting the first lidar 1810 to the first side of the vehicle; wherein, when the first flip When the component 1820 is flipped to the first position, the first lidar 1810 is used to sense the environment in the first direction; or, when the first flipping component 1820 is flipped to the second position, the first lidar 1810 is used to sense the environment in the first direction. To perceive the environment in the second direction.
- the first lidar is a long-range lidar or a short-range lidar.
- the first lidar is a long-range lidar.
- the data collected by the long-range lidar on the first side can make up for the blind spot caused by the lidar on the front side of the vehicle, thereby helping to improve the safety performance of the vehicle.
- the first lidar is a short-range lidar.
- the data collected by the short-range lidar on the first side can make up for the blind spot caused by the lidar on the front side of the vehicle.
- the data collected by the short-range lidar on the first side can identify people, animals or other obstacles closer to the vehicle, thus helping to improve the safety performance of the vehicle.
- the first side is the left side of the vehicle, and the second side is the right side of the vehicle; or, the first side is the right side of the vehicle, and the second side is the left side of the vehicle.
- the above connection method between the first flipping component 1820 and the first laser radar 1810 can be fixed connection, or can also be connected together through other devices (or components).
- the first direction may be the direction in which the vehicle travels forward (for example, the positive direction of the X-axis).
- the first flipping component When 1820 is flipped to the first position the first lidar 1810 can sense the environment in the forward direction of the vehicle.
- the above-mentioned first lidar can sense the environment in the forward direction of the vehicle. It can also be understood that the horizontal FOV of the first lidar corresponds to the positive direction of the X-axis.
- the second direction may be the direction in which the vehicle travels backward (for example, the negative direction of the X-axis).
- the first flipping component 1820 when the first flipping component 1820 is flipped to the second position, the first laser radar 1810 can sense the environment in the backward driving direction of the vehicle.
- the above first lidar can sense the environment in the backward driving direction of the vehicle. It can also be understood that the horizontal FOV of the first lidar corresponds to the negative direction of the X-axis.
- the first direction is the direction in which the vehicle travels forward and the second direction is the direction in which the vehicle travels backward.
- the embodiments of the present application are not limited thereto.
- the first direction may also be the direction in which the vehicle moves along the positive direction of the Y-axis
- the second direction may also be the direction in which the vehicle moves in the negative direction of the Y-axis.
- Figure 19 shows a schematic diagram of the application scenario provided by the embodiment of the present application.
- the vehicle is located on a movable plane.
- the movable plane moves to the right, the vehicle moves along the positive direction of the Y-axis.
- the first flipping component 1820 can be flipped to the first position, thereby enabling the first lidar 1810 to sense the environment on the right side of the vehicle; or, when the movable plane moves to the left, the vehicle moves along the negative direction of the Y-axis move.
- the first flipping component 1820 can be flipped to the second position, thereby enabling the first lidar 1810 to sense the environment on the left side of the vehicle.
- the lidar system further includes: a second lidar; a second flipping component for connecting the second lidar to the second side of the vehicle; wherein, when the second flipping component flips to the first When the second flipping component is flipped to the fourth position, the second lidar is used to sense the environment in the second direction. to perceive the environment.
- the second lidar is a long-range lidar or a short-range lidar.
- the first lidar and the second lidar may be short-range lidars.
- the point cloud data collected by the short-range lidar can make up for the blind spots caused by the long-range lidar, helping to avoid safety hazards caused by the inability of the long-range lidar to detect objects at close range. accidents, helping to improve vehicle safety performance.
- the point cloud data collected through short-range lidar can improve the safety performance during parking, thereby helping to improve the user's parking experience.
- the first lidar and the second lidar are symmetrical about a centerline in the width direction of the vehicle.
- the above width direction of the vehicle can also be understood as the direction of the vehicle's transverse axis.
- the first lidar and the second lidar are symmetrical about the center line in the width direction of the vehicle, which can ensure the appearance of the vehicle.
- the first lidar and the second lidar are respectively provided on the rearview mirrors of the first side and the second side.
- the first lidar and the second lidar may be arranged on the rearview mirrors on the left and right sides of the vehicle respectively.
- first lidar and the second lidar are respectively disposed on the wheel eyebrows of the first side and the second side.
- the first lidar and the second lidar may be arranged on the rear wheel eyebrows on the left and right sides of the vehicle respectively.
- first lidar and the second lidar are respectively disposed on the B-pillars of the first side and the second side.
- the first lidar and the second lidar may be arranged on the B-pillars on the left and right sides of the vehicle respectively.
- the first lidar and the second lidar are respectively provided on the door handles of the first side and the second side.
- a first lidar and a second lidar may be arranged on the door handles on the left and right sides of the vehicle respectively.
- the lidar system further includes: a third lidar, the third lidar is arranged at the rear of the vehicle.
- the third lidar is a long-range lidar or a short-range lidar.
- the lidar system also includes: a fourth lidar, the fourth lidar is arranged at the rear of the vehicle; wherein the third lidar and the fourth lidar are respectively arranged on the license plate of the rear of the vehicle. on both sides; or the third lidar and the fourth lidar are arranged on the rear wing of the vehicle; or the third lidar and the fourth lidar are arranged on the upper or lower side of the rear license plate of the vehicle.
- the fourth lidar is a long-range lidar or a short-range lidar.
- the third lidar and the fourth lidar are respectively disposed on both sides of the rear license plate of the vehicle.
- the third lidar and the fourth lidar are arranged on the upper side of the rear license plate of the vehicle.
- the third lidar and the fourth lidar are arranged on the tail wing of the vehicle.
- the lidar system further includes: a control device for obtaining instructions for controlling the first lidar to sense the environment in the first direction or the second direction; the control device further Used to control the first flipping component to flip according to the instruction.
- the first direction is the direction in which the vehicle travels forward
- the second direction is the direction in which the vehicle travels backward
- control device may be the above-mentioned computing platform 150, or the control device may be a system-on-a-chip (SOC) in the computing platform 150, or the control device may be a system-on-a-chip (SOC) in the computing platform 150.
- processor, or the control device can be a whole vehicle controller, or the control device can be a zonal controller of the vehicle, or the control device can be a microcontroller unit in the zonal controller ( micro controller unit (MCU).
- MCU micro controller unit
- the zone controller may include a vehicle integration unit (VIU).
- VIP vehicle integration unit
- Figure 20 shows a schematic flow chart of a control method 2000 provided by an embodiment of the present application.
- the control method 2000 may be executed by the above-mentioned vehicle, or the control method may be executed by the above-mentioned computing platform 150 , or the control method 2000 may be executed by the SOC in the computing platform, or the control method 2000 may be executed by the SOC in the computing platform.
- the control method 2000 may be executed by the processor, or the control method 2000 may be executed by the entire vehicle controller, or the control method 2000 may be executed by the zone controller of the vehicle, or the control method 2000 may be executed by the MCU in the zone controller.
- the method 2000 includes:
- the instruction includes the driving status of the vehicle.
- the driving status of the vehicle can be obtained through the data collected by the gear sensor.
- the instruction includes the flip angle of the first flip component.
- the instruction is used to instruct the first flip component to rotate 180° clockwise or 180° counterclockwise along the XOZ plane as shown in (c) of Figure 5 .
- S2002 control the first flipping component to flip, which connects the first laser radar to the first side of the vehicle; wherein, when the first flipping component flips to the first position, the first flipping component The lidar is used to sense the environment in the first direction; or, when the first flipping component is flipped to the second position, the first lidar is used to sense the environment in the second direction.
- the first lidar is a long-range lidar or a short-range lidar.
- the first flipping component when the vehicle detects the user's operation of shifting into R gear, the first flipping component can be controlled to flip to the second position, thereby sensing the environment in the vehicle's backward driving direction (or parking direction). When the vehicle is powered off, the first flipping component can be kept in the second position. When the vehicle is powered on and the user's operation of shifting the D gear is detected, the first flipping component can be controlled to flip to the first position, thereby sensing the environment in the forward direction of the vehicle.
- the instruction includes a driving state of the vehicle
- controlling the first flipping component to flip according to the instruction includes: controlling the first flipping component to flip to the first when the driving state indicates that the vehicle is traveling forward. position, the first direction is the direction in which the vehicle is traveling forward; or, when the driving state indicates that the vehicle is traveling backward, the first flipping component is controlled to flip to the second position, and the second direction is the direction in which the vehicle is traveling backwards. direction of travel.
- the computing platform can obtain the signal collected by the gear sensor to determine the current gear information of the vehicle.
- the computing platform can control the first flipping mechanism to flip to the first position, thereby allowing the first lidar to sense the environment in the forward direction of the vehicle; or, when When the computing platform determines that the current gear of the vehicle is the R gear, the computing platform can control the first flipping mechanism to flip to the second position, so that the first lidar can sense the environment in the backward driving direction of the vehicle.
- the method 2000 also includes: controlling the second flipping component to flip according to the control instruction, and the second flipping component connects the second lidar to the second side of the vehicle; wherein, when the second flipping component When flipped to the third position, the second lidar is used to sense the environment in the first direction; or, when the second flipping component is flipped to the fourth position, the second lidar is used to sense the environment in the first direction. Perceiving the environment in two directions
- the second lidar is a long-range lidar or a short-range lidar.
- the method 2000 further includes: composing the image according to the point cloud data collected by the first lidar.
- composing the image based on the point cloud data collected by the first lidar includes: composing the image based on the point cloud data collected by the first lidar and data collected by other sensors.
- the data collected by other sensors include but are not limited to: point cloud data collected by long-range lidar, point cloud data collected by millimeter wave radar, or image data collected by cameras.
- Embodiments of the present application provide a control device for implementing any of the above methods.
- a control device is provided that includes a unit (or means) for implementing each step performed by a vehicle in any of the above methods.
- Figure 21 shows a schematic block diagram of a control device 2100 provided by an embodiment of the present application.
- the control device 2100 includes: an acquisition unit 2110, used to acquire instructions; a control unit 2120, used to control the first flip component to flip according to the instruction, and the first flip component connects the first laser radar to The first side of the vehicle; wherein, when the first flipping component flips to the first position, the first lidar is used to sense the environment in the first direction; or, when the first flipping component flips to the first In the second position, the first lidar is used to sense the environment in the second direction.
- the first lidar is a long-range lidar or a short-range lidar.
- the instruction includes the driving state of the vehicle
- the control unit 2120 is specifically configured to: when the driving state indicates that the vehicle is moving forward, control the first flipping component to flip to the first position, and the first laser The radar is used to sense the environment in the forward driving direction of the vehicle; or, when the driving state indicates that the vehicle is driving backward, the first flipping component is controlled to flip to the second position, and the first lidar is used to Perceive the environment in the rearward direction of the vehicle.
- the second lidar is a long-range lidar or a short-range lidar.
- control unit 2120 is also used to control the second flipping component to flip according to the control instruction, and the second flipping component connects the second lidar to the second side of the vehicle; wherein, when the second flipping component When the flipping component is flipped to the third position, the second lidar is used to sense the environment in the first direction; or when the second flipping component is flipped to the fourth position, the second lidar is used to sense the environment in the first direction. The environment in this second direction is sensed.
- the device further includes: a composition unit, configured to compose a composition based on the point cloud data collected by the first lidar.
- a composition unit configured to compose a composition based on the point cloud data collected by the first lidar.
- the acquisition unit 2110 may be implemented by the processor 151 in the computing platform.
- the processor 151 can obtain the gear information collected by the gear sensor.
- control unit 2120 may be implemented by the processor 152 in the computing platform.
- the processor 152 may control the first flip component to flip to the first position, so that the horizontal FOV of the first lidar corresponds to the forward direction of the vehicle.
- the processor 152 can also control the second flipping component to flip to the third position, so that the horizontal FOV of the second lidar corresponds to the forward direction of the vehicle.
- the functions implemented by the acquisition unit 2110 and the control unit 2120 can be implemented by different processors in the computing platform, or can also be implemented by the same processor in the computing platform.
- the comparison of the embodiments of this application is not limited.
- each unit in the above device is only a division of logical functions. In actual implementation, it can be fully or partially integrated into a physical entity, or it can also be physically separated.
- the unit in the device can be implemented in the form of a processor calling software; for example, the device includes a processor, the processor is connected to a memory, instructions are stored in the memory, and the processor calls the instructions stored in the memory to implement any of the above methods.
- the processor is, for example, a general-purpose processor, such as a CPU or a microprocessor
- the memory is a memory within the device or a memory outside the device.
- the units in the device can be implemented in the form of hardware circuits, and some or all of the functions of the units can be implemented through the design of the hardware circuits, which can be understood as one or more processors; for example, in one implementation,
- the hardware circuit is an ASIC, which realizes the functions of some or all of the above units through the design of the logical relationship of the components in the circuit; for another example, in another implementation, the hardware circuit can be implemented through PLD, taking FPGA as an example. It can include a large number of logic gate circuits, and the connection relationships between the logic gate circuits can be configured through configuration files to realize the functions of some or all of the above units. All units of the above device may be fully realized by the processor calling software, or may be fully realized by hardware circuits, or part of the units may be realized by the processor calling software, and the remaining part may be realized by hardware circuits.
- the processor is a circuit with signal processing capabilities.
- the processor may be a circuit with instruction reading and execution capabilities, such as a CPU, a microprocessor, a GPU, or DSP, etc.; in another implementation, the processor can realize certain functions through the logical relationship of the hardware circuit. The logical relationship of the hardware circuit is fixed or can be reconstructed.
- the processor is a hardware circuit implemented by ASIC or PLD. For example, FPGA.
- the process of the processor loading the configuration file and realizing the hardware circuit configuration can be understood as the process of the processor loading instructions to realize the functions of some or all of the above units.
- it can also be a hardware circuit designed for artificial intelligence, which can be understood as an ASIC, such as NPU, TPU, DPU, etc.
- each unit in the above device can be one or more processors (or processing circuits) configured to implement the above method, such as: CPU, GPU, NPU, TPU, DPU, microprocessor, DSP, ASIC, FPGA , or a combination of at least two of these processor forms.
- processors or processing circuits
- each unit in the above device may be integrated together in whole or in part, or may be implemented independently. In one implementation, these units are integrated together and implemented as a system-on-a-chip (SOC).
- SOC may include at least one processor for implementing any of the above methods or implementing the functions of each unit of the device.
- the at least one processor may be of different types, such as a CPU and an FPGA, or a CPU and an artificial intelligence processor. CPU and GPU etc.
- Embodiments of the present application also provide a device, which includes a processing unit and a storage unit, where the storage unit is used to store instructions, and the processing unit executes the instructions stored in the storage unit, so that the device performs the method performed in the above embodiments or step.
- the above-mentioned processing unit may be the processor 151-15n shown in Figure 1.
- An embodiment of the present application also provides a vehicle, which may include the above-mentioned lidar system 1800 and/or control device 2100 .
- Embodiments of the present application also provide a computer program product.
- the computer program product includes: computer program code.
- the computer program code When the computer program code is run on a computer, it causes the computer to execute the above method.
- Embodiments of the present application also provide a computer-readable medium.
- the computer-readable medium stores program code.
- the computer program code When the computer program code is run on a computer, it causes the computer to perform the above method.
- each step of the above method can be completed by instructions in the form of hardware integrated logic circuits or software in the processor.
- the method disclosed in conjunction with the embodiments of the present application can be directly implemented by a hardware processor for execution, or can be executed by a combination of hardware and software modules in the processor.
- the software module can be located in random access memory, flash memory, read-only memory, programmable read-only memory or power-on erasable programmable memory, registers and other mature storage media in this field.
- the storage medium is located in the memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware. To avoid repetition, it will not be described in detail here.
- the memory may include a read-only memory and a random access memory, and provide instructions and data to the processor.
- the size of the sequence numbers of the above-mentioned processes does not mean the order of execution.
- the execution order of each process should be determined by its functions and internal logic, and should not be implemented in this application.
- the implementation of the examples does not constitute any limitations.
- the disclosed systems, devices and methods can be implemented in other ways.
- the device embodiments described above are only illustrative.
- the division of the units is only a logical function division. In actual implementation, there may be other division methods.
- multiple units or components may be combined or can be integrated into another system, or some features can be ignored, or not implemented.
- the coupling or direct coupling or communication connection between each other shown or discussed may be through some interfaces, and the indirect coupling or communication connection of the devices or units may be in electrical, mechanical or other forms.
- the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or they may be distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
- each functional unit in each embodiment of the present application can be integrated into one processing unit, each unit can exist physically alone, or two or more units can be integrated into one unit.
- the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium.
- the technical solution of the present application can be embodied in the form of a software product.
- the computer software product is stored in a storage medium and includes a number of instructions to enable a computer device (which can be a personal computer, a server, or a network equipment, etc.) to perform all or part of the steps of the methods described in various embodiments of this application.
- the aforementioned storage media include: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), magnetic disk or optical disk and other media that can store program code. .
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- General Physics & Mathematics (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Electromagnetism (AREA)
- Mechanical Engineering (AREA)
- Traffic Control Systems (AREA)
- Optical Radar Systems And Details Thereof (AREA)
Abstract
Description
Claims (10)
- 一种激光雷达系统,其特征在于,包括:第一激光雷达;第一翻转部件,用于将所述第一激光雷达连接到车辆的第一侧边;其中,当所述第一翻转部件翻转到第一位置时,所述第一激光雷达用于对第一方向上的环境进行感知;或者,当所述第一翻转部件翻转到第二位置时,所述第一激光雷达用于对第二方向上的环境进行感知。
- 根据权利要求1所述的激光雷达系统,其特征在于,所述激光雷达系统还包括:第二激光雷达;第二翻转部件,用于将所述第二激光雷达连接到所述车辆的第二侧边;其中,当所述第二翻转部件翻转到第三位置时,所述第二激光雷达用于对所述第一方向上的环境进行感知;或者,当所述第二翻转部件翻转到第四位置时,所述第二激光雷达用于对所述第二方向上的环境进行感知。
- 根据权利要求2所述的激光雷达系统,其特征在于,所述第一激光雷达和所述第二激光雷达关于所述车辆的宽度方向上的中心线对称。
- 根据权利要求2或3所述的激光雷达系统,其特征在于,所述第一激光雷达和所述第二激光雷达分别设置在所述第一侧边和所述第二侧边的后视镜上;或者,所述第一激光雷达和所述第二激光雷达分别设置在所述第一侧边和所述第二侧边的轮眉上;或者,所述第一激光雷达和所述第二激光雷达分别设置在所述第一侧边和所述第二侧边的B柱上;或者,所述第一激光雷达和所述第二激光雷达分别设置在所述第一侧边和所述第二侧边的门把手上。
- 根据权利要求1至4中任一项所述的激光雷达系统,其特征在于,所述激光雷达系统还包括:第三激光雷达,设置在所述车辆的尾部。
- 根据权利要求5所述的激光雷达系统,其特征在于,所述激光雷达系统还包括:第四激光雷达,设置在所述车辆的尾部;其中,所述第三激光雷达和所述第四激光雷达分别设置在所述车辆的尾部车牌的两侧;或者,所述第三激光雷达和所述第四激光雷达设置在所述车辆的尾翼;或者,所述第三激光雷达和所述第四激光雷达设置在所述车辆的尾部车牌的上侧或者下侧。
- 根据权利要求1至6中任一项所述的激光雷达系统,其特征在于,所述激光雷达系统还包括:控制装置,用于获取指令,所述指令用于指示所述第一激光雷达对所述第一方向或者所述第二方向上的环境进行感知;所述控制装置,还用于根据所述指令,控制所述第一翻转部件翻转。
- 根据权利要求1至7中任一项所述的激光雷达系统,其特征在于,所述第一方向为所述车辆向前行驶的方向,所述第二方向为所述车辆向后行驶的方向。
- 根据权利要求1至8中任一项所述的激光雷达系统,其特征在于,所述第一激光雷达为短距激光雷达。
- 一种车辆,其特征在于,包括如权利要求1-9中任一所述的激光雷达系统。
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP23842151.5A EP4560357A4 (en) | 2022-07-21 | 2023-07-11 | LIDAR SYSTEM, CONTROL METHOD AND DEVICE, AND VEHICLE |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210873651.6A CN115390090A (zh) | 2022-07-21 | 2022-07-21 | 一种激光雷达系统、控制方法、装置和车辆 |
| CN202210873651.6 | 2022-07-21 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2024017086A1 true WO2024017086A1 (zh) | 2024-01-25 |
Family
ID=84116026
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2023/106673 Ceased WO2024017086A1 (zh) | 2022-07-21 | 2023-07-11 | 一种激光雷达系统、控制方法、装置和车辆 |
Country Status (3)
| Country | Link |
|---|---|
| EP (1) | EP4560357A4 (zh) |
| CN (1) | CN115390090A (zh) |
| WO (1) | WO2024017086A1 (zh) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115390090A (zh) * | 2022-07-21 | 2022-11-25 | 华为技术有限公司 | 一种激光雷达系统、控制方法、装置和车辆 |
| CN115973036A (zh) * | 2023-02-23 | 2023-04-18 | 浙江极氪智能科技有限公司 | 车辆后视镜的控制方法、控制器及车辆 |
| CN118033598B (zh) * | 2024-04-15 | 2024-08-16 | 深圳市速腾聚创科技有限公司 | 激光雷达控制方法、装置和计算机可读存储介质 |
| CN118483654B (zh) * | 2024-05-07 | 2025-01-24 | 复睿智行智能科技(上海)有限公司 | 具有人体感知和后向预警功能的两轮车毫米波雷达系统 |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160282468A1 (en) * | 2015-03-25 | 2016-09-29 | Google Inc. | Vehicle with Multiple Light Detection and Ranging Devices (LIDARs) |
| CN109375635A (zh) * | 2018-12-20 | 2019-02-22 | 安徽江淮汽车集团股份有限公司 | 一种自动驾驶汽车道路环境感知系统及方法 |
| CN111736153A (zh) * | 2019-03-21 | 2020-10-02 | 北京京东尚科信息技术有限公司 | 用于无人驾驶车辆的环境检测系统、方法、设备和介质 |
| CN113366341A (zh) * | 2020-01-06 | 2021-09-07 | 深圳市速腾聚创科技有限公司 | 点云数据的处理方法、装置、存储介质及激光雷达系统 |
| CN115390090A (zh) * | 2022-07-21 | 2022-11-25 | 华为技术有限公司 | 一种激光雷达系统、控制方法、装置和车辆 |
Family Cites Families (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE10349755B3 (de) * | 2003-10-24 | 2005-01-27 | Adam Opel Ag | Sensor an einem Kraftfahrzeug |
| DE102011078641A1 (de) * | 2011-07-05 | 2013-01-10 | Robert Bosch Gmbh | Radarsystem für Kraftfahrzeuge sowie Kraftfahrzeug mit einem Radarsystem |
| CN105388477B (zh) * | 2015-10-29 | 2018-07-20 | 浙江吉利汽车研究院有限公司 | 一种车辆雷达调节控制方法 |
| CN107009968B (zh) * | 2017-03-28 | 2020-08-28 | 驭势科技(北京)有限公司 | 车载激光雷达控制方法、装置及车载设备 |
| CN110537109B (zh) * | 2017-04-28 | 2024-02-20 | 深圳市大疆创新科技有限公司 | 用于自主驾驶的感测组件 |
| CN207433391U (zh) * | 2017-11-16 | 2018-06-01 | 北京汽车集团有限公司 | 后视镜、后视镜总成和车辆 |
| WO2020082363A1 (zh) * | 2018-10-26 | 2020-04-30 | 深圳市大疆创新科技有限公司 | 一种环境感知系统及移动平台 |
| CN209955874U (zh) * | 2019-03-08 | 2020-01-17 | 深圳市大疆创新科技有限公司 | 一种车辆以及用于安装于车辆的侧后视镜 |
| CN114047496B (zh) * | 2021-10-14 | 2024-10-01 | 中国第一汽车股份有限公司 | 一种多激光雷达可调的耦合系统及方法 |
| CN114137503A (zh) * | 2021-10-29 | 2022-03-04 | 际络科技(上海)有限公司 | 激光雷达扫描角度自动调整方法及装置 |
| CN114325758A (zh) * | 2021-12-27 | 2022-04-12 | 上海集度汽车有限公司 | 激光雷达控制方法、装置、车辆及相关设备 |
-
2022
- 2022-07-21 CN CN202210873651.6A patent/CN115390090A/zh active Pending
-
2023
- 2023-07-11 WO PCT/CN2023/106673 patent/WO2024017086A1/zh not_active Ceased
- 2023-07-11 EP EP23842151.5A patent/EP4560357A4/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160282468A1 (en) * | 2015-03-25 | 2016-09-29 | Google Inc. | Vehicle with Multiple Light Detection and Ranging Devices (LIDARs) |
| EP3274738A1 (en) * | 2015-03-25 | 2018-01-31 | Waymo Llc | Vehicle with multiple light detection and ranging devices (lidars) |
| CN109375635A (zh) * | 2018-12-20 | 2019-02-22 | 安徽江淮汽车集团股份有限公司 | 一种自动驾驶汽车道路环境感知系统及方法 |
| CN111736153A (zh) * | 2019-03-21 | 2020-10-02 | 北京京东尚科信息技术有限公司 | 用于无人驾驶车辆的环境检测系统、方法、设备和介质 |
| CN113366341A (zh) * | 2020-01-06 | 2021-09-07 | 深圳市速腾聚创科技有限公司 | 点云数据的处理方法、装置、存储介质及激光雷达系统 |
| CN115390090A (zh) * | 2022-07-21 | 2022-11-25 | 华为技术有限公司 | 一种激光雷达系统、控制方法、装置和车辆 |
Non-Patent Citations (1)
| Title |
|---|
| See also references of EP4560357A4 |
Also Published As
| Publication number | Publication date |
|---|---|
| EP4560357A1 (en) | 2025-05-28 |
| EP4560357A4 (en) | 2025-11-12 |
| CN115390090A (zh) | 2022-11-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2024017086A1 (zh) | 一种激光雷达系统、控制方法、装置和车辆 | |
| EP3867118B1 (en) | Lidar-based trailer tracking | |
| US11822011B2 (en) | Mirrors to extend sensor field of view in self-driving vehicles | |
| CN108528460B (zh) | 车辆及车辆控制方法 | |
| CN107472350A (zh) | 车辆控制装置、车辆控制方法和车辆控制程序 | |
| EP4613592A1 (en) | Auto parking method and apparatus, and intelligent driving device | |
| EP4650243A1 (en) | Control method and apparatus, and intelligent driving device | |
| CN114348018A (zh) | 商用车辆的自动驾驶系统及方法 | |
| CN117584946A (zh) | 用于车辆的障碍物躲避 | |
| CN113251993B (zh) | 偏转角的检测方法、装置、计算机设备和可读存储介质 | |
| US12566275B2 (en) | Methods of using background images from a light detection and ranging (LIDAR) device | |
| WO2025139571A1 (zh) | 智能驾驶方法、用于智能驾驶的装置和智能驾驶设备 | |
| US12501003B2 (en) | Multi-sensor assembly with improved backward view of a vehicle | |
| EP4640508A1 (en) | Parking method and apparatus, and intelligent driving device | |
| EP4563434A1 (en) | Display method, and control apparatus and vehicle | |
| US20240036212A1 (en) | Lane boundary detection using sub-short range active light sensor | |
| WO2025139570A1 (zh) | 后视镜检测方法、装置和智能驾驶设备 | |
| US11719810B2 (en) | Automotive synthetic aperture radar with radon transform | |
| US12511914B1 (en) | Camera arrangements for vehicular object detection and avoidance | |
| KR20250172819A (ko) | 차량 도어 시스템, 제어 방법 및 장치, 그리고 차량 | |
| WO2025223200A1 (zh) | 泊车方法、装置和车辆 | |
| WO2025175763A1 (zh) | 控制方法、装置和智能驾驶设备 | |
| CN121133678A (zh) | 控制方法、装置和智能驾驶设备 | |
| WO2026036804A1 (zh) | 控制方法、装置和智能驾驶设备 | |
| WO2026051683A1 (zh) | 一种投影控制方法及相关装置 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 23842151 Country of ref document: EP Kind code of ref document: A1 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2023842151 Country of ref document: EP |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| ENP | Entry into the national phase |
Ref document number: 2023842151 Country of ref document: EP Effective date: 20250221 |
|
| WWP | Wipo information: published in national office |
Ref document number: 2023842151 Country of ref document: EP |