WO2023060592A1 - 定位方法及装置 - Google Patents
定位方法及装置 Download PDFInfo
- Publication number
- WO2023060592A1 WO2023060592A1 PCT/CN2021/124206 CN2021124206W WO2023060592A1 WO 2023060592 A1 WO2023060592 A1 WO 2023060592A1 CN 2021124206 W CN2021124206 W CN 2021124206W WO 2023060592 A1 WO2023060592 A1 WO 2023060592A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- grid
- information
- attribute information
- environment
- local
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/005—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 with correlation of navigation data from several sources, e.g. map or contour matching
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/10—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration
- G01C21/12—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning
- G01C21/16—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation
- G01C21/165—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation combined with non-inertial navigation instruments
- G01C21/1652—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation combined with non-inertial navigation instruments with ranging devices, e.g. LIDAR or RADAR
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/88—Lidar systems specially adapted for specific applications
- G01S17/89—Lidar systems specially adapted for specific applications for mapping or imaging
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/20—Control system inputs
- G05D1/24—Arrangements for determining position or orientation
- G05D1/242—Means based on the reflection of waves generated by the vehicle
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/20—Control system inputs
- G05D1/24—Arrangements for determining position or orientation
- G05D1/246—Arrangements for determining position or orientation using environment maps, e.g. simultaneous localisation and mapping [SLAM]
- G05D1/2464—Arrangements for determining position or orientation using environment maps, e.g. simultaneous localisation and mapping [SLAM] using an occupancy grid
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
- G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
- G06T7/74—Determining position or orientation of objects or cameras using feature-based methods involving reference images or patches
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/88—Lidar systems specially adapted for specific applications
- G01S17/93—Lidar systems specially adapted for specific applications for anti-collision purposes
- G01S17/931—Lidar systems specially adapted for specific applications for anti-collision purposes of land vehicles
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D2107/00—Specific environments of the controlled vehicles
- G05D2107/10—Outdoor regulated spaces
- G05D2107/13—Spaces reserved for vehicle traffic, e.g. roads, regulated airspace or regulated waters
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D2109/00—Types of controlled vehicles
- G05D2109/10—Land vehicles
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D2111/00—Details of signals used for control of position, course, altitude or attitude of land, water, air or space vehicles
- G05D2111/10—Optical signals
- G05D2111/17—Coherent light, e.g. laser signals
Definitions
- the present application relates to the technical field of positioning, and in particular to a positioning method and device.
- Intelligent driving includes assisted driving and automatic driving.
- Their key technologies include positioning, perception, planning and decision-making, control and so on.
- high-precision positioning can provide a reliable basis for planning decision-making or control. Therefore, high-precision positioning plays an indispensable role in intelligent driving.
- GPS global positioning system
- Embodiments of the present application provide a positioning method and device, which can improve positioning accuracy and stability.
- a positioning method includes: acquiring a grid map corresponding to the first environment, acquiring a local grid corresponding to the second environment, and acquiring when the local grid is located at a different position in the grid map , the first matching probability between the local grid and the grid in the grid map, and determine the position of the device to be located according to the first matching probability.
- the above-mentioned grid map includes a plurality of first grids, and any first grid includes a plurality of points, location information of the plurality of points, and attribute information of the first grid.
- the attribute information of the first grid includes semantic information of the first grid and height information of the first grid, and the semantic information of the first grid is used to indicate that the first grid represents each of various objects.
- the height information of the first grid is used to indicate the height of the points included in the first grid;
- the second environment is included in the first environment, the local grid includes at least one second grid , any second grid includes a plurality of points and the attribute information of the second grid, the attribute information of the second grid includes the semantic information of the second grid and the height information of the second grid, the first
- the semantic information of the second grid is used to indicate the probability that the second grid represents each object in the plurality of objects, and the height information of the second grid is used to indicate the height of the points included in the second grid.
- the device to be located is located in the second environment.
- the positioning device can obtain the grid map corresponding to the first environment, obtain the local grid corresponding to the second environment information, and combine various attribute information of the first grid with the second grid A variety of attribute information of the positioning device is used to locate the positioning device, which improves the accuracy and stability of positioning.
- the attribute information of the first grid further includes reflection intensity information of the first grid, and the reflection intensity information of the first grid is used to indicate the Reflection intensity
- the attribute information of the second grid further includes reflection intensity information of the second grid, and the reflection intensity information of the second grid is used to indicate the reflection intensity of the points included in the second grid.
- the positioning device can also combine the reflection intensity information of the first grid and the reflection intensity information of the second grid to perform positioning, further improving the accuracy and stability of positioning.
- the method further includes: predicting the position corresponding to the position of the device to be positioned at the second moment according to the pose information of the device to be positioned at the first moment and the motion parameters of the device to be positioned. an area. Based on the above method, the positioning device can predict the position of the device to be positioned at the second moment, so as to position the device to be positioned according to the predicted position.
- the acquiring the first matching probability includes: when acquiring the grid where the local grid is located in the first area, the first matching probability between the local grid and the grid in the grid map match probability. Based on the above method, the positioning device does not need to match the grids in the local grid with all the grids in the grid map, but matches the grids in the local grid with the grids in the first region, Reduced computational overhead.
- the first matching probability between the local grid and the grid in the grid map includes: according to the local grid The attribute information of the grids in the grid and the attribute information of the grids in the first area are used to obtain the first matching probability corresponding to each type of attribute information of the first grids in the first area.
- the positioning device can determine the first matching probability corresponding to each type of attribute information of the first grid in the first area based on the attribute information of the first grid and the attribute information of the second grid, and then can according to the first The matching probability is used to locate the positioning device, so that the positioning device does not rely only on a certain attribute for positioning during positioning, which improves the accuracy and stability of positioning.
- the positioning device can match each second grid in the local grid with each first grid in the first area to determine the first attribute information of the first grid in the first area The corresponding first matching probability makes the positioning accuracy of the device to be positioned higher.
- determining the position of the device to be positioned according to the first matching probability includes: determining each attribute according to the first matching probability corresponding to each attribute information of the first grid in the first area The location information corresponding to the information; according to the location information corresponding to each attribute information, the location of the device to be positioned is determined. Based on the above method, the positioning device can obtain the location information corresponding to each type of attribute information according to the first matching probability corresponding to each type of attribute information of the first grid in the first area, and obtain the location of the device to be positioned according to the location information , so as to locate the device to be positioned.
- determining the position of the device to be positioned according to the first matching probability further includes: determining the location information corresponding to at least one type of attribute information conforming to preset rules in the location information corresponding to each type of attribute information.
- Position information according to the position information corresponding to each type of attribute information, determining the position of the device to be positioned includes: if the quantity of the at least one type of attribute information is greater than 1, weighting the position information corresponding to the at least one type of attribute information and, obtaining the location of the device to be located; or, if the quantity of the at least one type of attribute information is equal to 1, determining the location information corresponding to the at least one type of attribute information as the location of the device to be located.
- the positioning device determines the location information corresponding to each attribute information, it can first screen the location information, eliminate inaccurate location information, and then determine the location of the device to be positioned according to the filtered location information, so as to This enables the positioning device to more accurately locate the positioning device to be positioned.
- the method further includes: acquiring a second matching probability, where the second matching probability is when the local grid is located at the position of the device to be positioned and the local grid is rotated by different angles , the matching probability of the local grid and the grid in the grid map; determine the orientation angle of the device to be positioned according to the second matching probability.
- the positioning device can determine the orientation angle of the device to be positioned, that is, the moving direction of the device to be positioned.
- the method further includes: predicting the orientation angle of the device to be positioned at the second moment according to the orientation angle of the device to be positioned at the third moment and the motion parameters of the device to be positioned. Based on the above method, the positioning device can predict the orientation angle of the device to be positioned at the second moment, so as to determine the orientation angle of the device to be positioned according to the predicted orientation angle.
- obtaining the second matching probability includes: obtaining the second matching probabilities of multiple rotation angles corresponding to the local grid when the local grid is located at the position of the device to be positioned, Among the plurality of rotation angles, the included angle between each rotation angle and the predicted orientation angle of the device to be positioned at the second moment is less than or equal to the first angle.
- the positioning device does not need to rotate the local grid once to obtain multiple rotation angles, but rotates the local grid around the orientation angle at the second moment to obtain multiple rotation angles. It can not only reduce the calculation cost of the positioning device, but also improve the accuracy of the determined orientation angle of the device to be positioned.
- obtaining the second matching probability of the first rotation angle when the local grid is located at the position of the device to be positioned includes: The attribute information of the grid and the attribute information of the grid in the grid map, and obtain the second matching probability corresponding to each attribute information of the first rotation angle, and the first rotation angle is any of the plurality of rotation angles a rotation angle.
- the positioning device can determine the second matching probability corresponding to each attribute information of the first rotation angle based on the attribute information of the first grid and the attribute information of the second grid, and then determine the undetermined probability according to the second matching probability.
- the orientation angle of the positioning device makes the positioning device not only rely on a certain attribute when determining the orientation angle of the device to be positioned, and improves the accuracy of the orientation angle determined by the positioning device.
- the first attribute of the first rotation angle is acquired according to the attribute information of the grid in the local grid corresponding to the first rotation angle and the attribute information of the grid in the grid map
- the second matching probability corresponding to the information includes: obtaining the position of each second grid in the partial grid when the local grid is located at the position of the device to be positioned and the partial grid is rotated by a first rotation angle
- the first attribute information, the second deviation between the first attribute information of the first grid corresponding to the second grid, the first attribute information of the second grid is the attribute information of the second grid
- the first attribute information of the first grid is the same as the first attribute information of the second grid; according to the second deviation, the first attribute information corresponding to the first rotation angle is obtained.
- the positioning device can match each second grid in the local grid with the first grid corresponding to the second grid at the first rotation angle, so as to determine the first attribute information of the first rotation angle
- the corresponding second matching probability makes the orientation angle determined by the positioning device more accurate.
- determining the orientation angle of the device to be positioned according to the second matching probability includes: determining the orientation corresponding to each attribute information according to the second matching probability corresponding to each attribute information of each rotation angle
- Angle information the orientation angle information corresponding to each attribute information is weighted and summed to obtain the orientation angle of the device to be positioned.
- the positioning device can obtain the orientation angle information corresponding to each attribute information according to the second matching probability corresponding to each attribute information of each rotation angle, and obtain the orientation angle of the device to be positioned according to the orientation angle information, Thus, the positioning device can determine the moving direction of the device to be positioned.
- acquiring the grid map corresponding to the first environment includes: acquiring point cloud information corresponding to the first environment, where the point cloud information corresponding to the first environment is used to indicate the first environment The location information of the points in the corresponding point cloud; according to the point cloud information corresponding to the first environment, the grid map corresponding to the first environment is obtained. Based on the above method, the positioning device can acquire the grid map corresponding to the first environment.
- the information of the point cloud corresponding to the first environment is further used to indicate the reflection intensity of points in the point cloud corresponding to the first environment.
- the positioning device may acquire reflection intensity information of the first grid according to point cloud information corresponding to the first environment.
- obtaining the local grid corresponding to the second environment includes: obtaining point cloud information corresponding to the second environment, where the point cloud information corresponding to the second environment is used to indicate the second environment The location information of the points in the corresponding point cloud; according to the point cloud information corresponding to the second environment, the local grid corresponding to the second environment is obtained. Based on the above method, the positioning device can acquire the local grid corresponding to the second environment.
- the information of the point cloud corresponding to the second environment is also used to indicate the reflection intensity of points in the point cloud corresponding to the second environment.
- the positioning device may acquire reflection intensity information of the second grid according to point cloud information corresponding to the second environment.
- a positioning device for implementing the above method.
- the positioning device may be the positioning device in the above first aspect, or a device including the above positioning device.
- the positioning device includes corresponding modules, units, or means (means) for realizing the above method, and the modules, units, or means can be implemented by hardware, software, or by executing corresponding software on hardware.
- the hardware or software includes one or more modules or units corresponding to the above functions.
- a positioning device including: a processor; the processor is configured to be coupled with a memory, and after reading an instruction in the memory, execute the method according to the above first aspect according to the instruction.
- the positioning device may be the positioning device in the above first aspect, or a device including the above positioning device.
- the positioning device further includes a memory, and the memory is configured to store necessary program instructions and data.
- the positioning device is a chip or a chip system.
- the positioning device when it is a system-on-a-chip, it may consist of chips, or may include chips and other discrete devices.
- a positioning device including: a processor and an interface circuit; the interface circuit is used to receive a computer program or instruction and transmit it to the processor; the processor is used to execute the computer program or instruction, so that the positioning The device executes the method described in the first aspect above.
- the positioning device is a chip or a chip system.
- the positioning device when it is a system-on-a-chip, it may consist of chips, or may include chips and other discrete devices.
- a computer-readable storage medium is provided, and instructions are stored in the computer-readable storage medium, and when the computer-readable storage medium is run on a computer, the computer can execute the method described in the above-mentioned first aspect.
- a computer program product containing instructions is provided, and when it is run on a computer, the computer can execute the method described in the first aspect above.
- the technical effects brought about by any one of the possible implementations from the second aspect to the sixth aspect can refer to the technical effects brought about by the different possible implementations in the above-mentioned first aspect or any one of the aspects, and no longer repeat.
- FIG. 1A is a first schematic diagram of a positioning system architecture provided by an embodiment of the present application.
- FIG. 1B is a second schematic diagram of the positioning system architecture provided by the embodiment of the present application.
- FIG. 2 is a schematic diagram of the hardware structure of the positioning device provided by the embodiment of the present application.
- FIG. 3 is a first schematic flow diagram of a positioning method provided in an embodiment of the present application.
- FIG. 4 is a first schematic diagram of a grid map and a local grid provided by the embodiment of the present application.
- FIG. 5 is a schematic flow diagram II of the positioning method provided by the embodiment of the present application.
- FIG. 6 is a schematic diagram of the angular velocity of the device to be positioned, the linear velocity of the device to be positioned and the rotation angle of the wheel of the device to be positioned according to the embodiment of the present application;
- FIG. 7 is a second schematic diagram of a grid map and a partial grid provided by the embodiment of the present application.
- FIG. 8 is a schematic flow diagram III of the positioning method provided by the embodiment of the present application.
- FIG. 9 is a third schematic diagram of a grid map and a local grid provided by the embodiment of the present application.
- FIG. 10 is a fourth schematic flow diagram of the positioning method provided by the embodiment of the present application.
- FIG. 11 is a schematic flow diagram five of the positioning method provided by the embodiment of the present application.
- Fig. 12 is a schematic diagram of the position of the device to be positioned provided by the embodiment of the present application.
- FIG. 13 is a schematic structural diagram of a positioning device provided by an embodiment of the present application.
- SLAM can specify positioning and map construction, or concurrent mapping and positioning.
- a map acquisition device such as a robot
- the map acquisition device can gradually draw the map while moving according to the surrounding environment information and the position information of the map acquisition device at each time. Environment map.
- the ICP algorithm can determine the point set Qi closest to the point set Pi in the target point cloud set in the source point cloud set according to certain constraints, and calculate the rotation matrix R and translation matrix T, so that the error function is minimized; Use R and T to perform rotation and translation transformation to obtain a new point P' i ; calculate the average distance d between P' i and Qi, if d is less than a certain threshold, or the number of iterations to calculate the rotation matrix and translation matrix is greater than the maximum number of iterations, Then stop the calculation, otherwise re-determine the point set Q' i closest to the point set Pi in the target point cloud set in the source point cloud set, and continue to iteratively calculate the rotation matrix and translation matrix until the obtained average distance is less than a certain Threshold, or the number of iterations to calculate the rotation matrix and translation matrix is greater than the maximum number of iterations.
- LiDAR odometry and mapping is an algorithm for implementing SLAM using LiDAR.
- the position of the robot relative to the initial moment is calculated by matching the lidar point cloud, which is called the lidar odometer. According to each position, the point cloud is combined to form a map, which is called mapping.
- PCL is a large-scale cross-platform open source C++ programming library established on the basis of absorbing previous point cloud related research. It implements a large number of point cloud-related general algorithms and efficient data structures, involving point cloud acquisition, filtering, segmentation, registration, retrieval, feature extraction, recognition, tracking, surface reconstruction, visualization, etc. It supports multiple operating system platforms and can run on Windows, Linux, Android, Mac OS X, and some embedded real-time systems.
- PointNet is a new type of deep learning model for processing point cloud data. It can be used for various cognitive tasks on point cloud data, such as classification, semantic segmentation and object recognition.
- the following method can be used for positioning to improve the accuracy and stability of positioning.
- the ICP algorithm can be used to combine the point cloud (which can be equivalent to the above-mentioned Pi) obtained by the lidar in real time with the point cloud in the pre-established point cloud map (which can be equivalent to the point set Pi in the above-mentioned and target point cloud collection) The closest point set) to match to determine the real-time position.
- Method 2 Positioning method based on feature information and grid map
- the local grid can be obtained according to the point cloud information (such as the position information of the point cloud, the feature information of the point cloud, etc.) obtained by the lidar in real time, and the feature information of each grid in the local grid
- the feature information of the point cloud in the raster map is matched to complete the positioning.
- the feature information of the point cloud may include height information.
- the pre-stored grid map is obtained from the point cloud information obtained by the lidar in the environment corresponding to the grid map.
- Method 3 Positioning method based on category information and grid map
- the local grid can be obtained according to the position information of the point cloud obtained by the lidar in real time, and the image information corresponding to the above point cloud obtained by the visual sensor, and the object in the image information can be identified to obtain the type information corresponding to the object. Save the type information in the local grid; then match the type information of each grid in the local grid with the type information of each grid in the pre-stored grid map, so as to complete the positioning.
- the pre-stored grid map is obtained according to the point cloud information acquired by the laser radar in the environment corresponding to the grid map, and the image information acquired by the visual sensor in the environment corresponding to the grid map.
- Method 4 Positioning method based on attribute information and grid map
- a grid map corresponding to the first environment may be obtained, and a local grid corresponding to the second environment information may be obtained.
- the grid map includes a plurality of first grids, the first grid includes a plurality of points, the position information of each point in the plurality of points, and the attribute information of the first grid, and the attribute information of the first grid includes the first The semantic information of the first grid and the height information of the first grid.
- the second environment includes that in the first environment, the local grid includes at least one second grid, and the second grid includes a plurality of points and attribute information of the second grid.
- the attribute information of the second grid includes semantic information of the second grid and height information of the second grid.
- the first matching probability between the local grid and the grid in the grid map may be obtained, and the position of the device to be positioned is determined according to the first matching probability.
- Method 4 will be described in the following embodiment shown in FIG. 3 , and will not be repeated here.
- the above method 1 is relatively simple to implement, method 1 only considers the minimum distance between points, and the algorithm tends to converge to a wrong position, that is, the positioning is inaccurate.
- the above method 2 combines the feature information of the point cloud for positioning, which improves the positioning accuracy compared with method 1. However, if the characteristic information changes, the positioning of method 2 will be inaccurate and the stability will be poor.
- the above method 3 combines the type information of the object for positioning, and compared with method 1, the positioning accuracy is improved. However, method 3 generally relies on the accuracy of recognizing objects in image information or point cloud information, and if the accuracy of recognizing objects is low, the positioning will be inaccurate.
- the above method 4 can be combined with the attribute information of the grid, such as the height information of the grid and the semantic information of the grid for positioning. Compared with methods 1-3, the positioning accuracy and stability of method 4 are higher.
- the embodiments of the present application provide a positioning method and device, which can perform positioning within a certain area.
- the positioning method and device can be used for positioning in environments such as residential quarters, industrial parks, and parks.
- the positioning accuracy and stability can be improved.
- the applicable system architecture of this embodiment of the present application includes a positioning device.
- the system architecture also includes a sensing device.
- the sensing device can communicate with the positioning device in a wired or wireless manner.
- the system architecture may be as shown in FIG. 1A.
- the system architecture 10 shown in FIG. 1A includes a positioning device 101 .
- the system architecture 10 further includes a sensing device 102 .
- the above-mentioned positioning device can be used to obtain the grid map corresponding to the first environment, obtain the local grid corresponding to the second environment, and obtain the local grid and grid map when the local grid is located at different positions in the grid map.
- the first matching probability of the grid and determine the position of the device to be located according to the first matching probability.
- the grid map includes a plurality of first grids. Any first grid includes a plurality of points, position information of each point in the plurality of points, and attribute information of the first grid.
- the attribute information of the first grid includes semantic information of the first grid and height information of the first grid.
- the second environment is included in the first environment, and the local grids include at least one second grid. Any second grid includes multiple points and attribute information of the second grid.
- the attribute information of the second grid includes semantic information of the second grid and height information of the second grid.
- the above positioning apparatus may be a vehicle-mounted device or a computing device.
- the above-mentioned positioning device is a computer, a computing unit in a computer, an embedded device, an industrial computer of an x86 system, or a wireless terminal in unmanned driving.
- the above-mentioned positioning device may be a vehicle-mounted module, vehicle-mounted module, vehicle-mounted component, vehicle-mounted chip or vehicle-mounted unit built into the vehicle as one or more components or units.
- the vehicle uses the built-in vehicle module, vehicle-mounted module, vehicle-mounted component,
- the on-board chip or on-board unit can implement the method of the present application.
- the above sensing device may be used to obtain point cloud information corresponding to the first environment, and send the point cloud information to the above positioning device.
- the point cloud information corresponding to the first environment may be used to indicate position information of points in the point cloud corresponding to the first environment.
- the information of the point cloud corresponding to the first environment may also be used to indicate the reflection intensity of the points in the point cloud corresponding to the first environment.
- the sensing device may also be used to acquire point cloud information corresponding to the second environment, and send the point cloud information to the positioning device.
- the point cloud information corresponding to the second environment is used to indicate the position information of the point cloud corresponding to the second environment.
- the point cloud information corresponding to the second environment may also be used to indicate the reflection intensity of points in the point cloud corresponding to the second environment.
- the above sensing device may be a lidar, or other devices capable of acquiring point cloud information corresponding to a certain environment.
- the applicable system architecture of this embodiment of the present application includes a positioning device.
- a positioning module can be deployed in the positioning device.
- a perception module is also deployed in the positioning device.
- the system architecture may be as shown in FIG. 1B.
- the system architecture 11 shown in FIG. 1B includes a positioning device 111 .
- a positioning module 1111 is deployed in the positioning device 111 .
- a perception module 1112 is further deployed in the positioning device 111 .
- the above-mentioned positioning module can be used to obtain the grid map corresponding to the first environment, obtain the local grid corresponding to the second environment, and obtain the local grid and grid map when the local grid is located at different positions in the grid map.
- the first matching probability of the grid and determine the position of the device to be located according to the first matching probability.
- the above perception module may be used to acquire point cloud information corresponding to the first environment, and send the point cloud information to the above positioning module.
- the above perception module can also be used to acquire point cloud information corresponding to the second environment, and send the point cloud information to the above positioning module.
- the above positioning device may be a device having a perception function and a calculation function.
- the above-mentioned positioning device is a smart car, such as an unmanned car, an automatic takeaway car, an automatic express car, and the like.
- the positioning module is a module having a calculation function in the positioning device
- the sensing module is a module having a sensing function in the positioning device.
- the positioning module can be an on-board computer in a smart car, a computing unit in a car computer, an embedded device in a smart car, an industrial computer in a smart car, or a wireless terminal in a smart car, etc.;
- the perception module can be the laser radar in the smart car, or other devices in the smart car that can obtain point cloud information corresponding to a certain environment.
- FIG. 1A and FIG. 1B are only schematic diagrams, and do not constitute a limitation on the application scenarios of the technical solutions provided in this application. Those skilled in the art should understand that in the specific implementation process, the above system architecture may also include other devices, and the number of positioning devices, sensing devices, positioning modules or sensing modules may also be determined according to specific needs, without limitation.
- the device for example, the positioning device shown in FIG. 1A or FIG. 1B in this embodiment of the present application may be a general-purpose device or a special-purpose device, which is not specifically limited in this embodiment of the present application.
- the relevant functions of the device (such as the positioning device) in FIG. 1A or FIG. 1B in the embodiment of the present application can be realized by one device, or by multiple devices, or by one or more It is implemented by a functional module, which is not specifically limited in the embodiment of the present application.
- a functional module which is not specifically limited in the embodiment of the present application.
- the above-mentioned functions can be network elements in hardware devices, software functions running on dedicated hardware, or a combination of hardware and software, or instantiated virtualization on a platform (for example, a cloud platform) Function.
- FIG. 2 is a schematic diagram of a hardware structure of a positioning device applicable to an embodiment of the present application.
- the positioning device 20 includes at least one processor 201, configured to implement the method provided in the embodiment of the present application.
- the positioning device 20 may also include a communication line 202 , a memory 203 and at least one communication interface 204 .
- the processor 201 can be a general-purpose central processing unit (central processing unit, CPU), a microprocessor, a specific application integrated circuit (application-specific integrated circuit, ASIC), or one or more for controlling the execution of the program program of this application integrated circuit.
- CPU central processing unit
- ASIC application-specific integrated circuit
- Communication line 202 may include a path, such as a bus, for transferring information between the aforementioned components.
- the communication interface 204 is used for communicating with other devices or communication networks.
- the communication interface 204 can be any device such as a transceiver, such as an Ethernet interface, a wireless access network (radio access network, RAN) interface, a wireless local area network (wireless local area networks, WLAN) interface, a transceiver, a pin , bus, or transceiver circuits, etc.
- a transceiver such as an Ethernet interface, a wireless access network (radio access network, RAN) interface, a wireless local area network (wireless local area networks, WLAN) interface, a transceiver, a pin , bus, or transceiver circuits, etc.
- Memory 203 may be read-only memory (read-only memory, ROM) or other types of static storage devices that can store static information and instructions, random access memory (random access memory, RAM) or other types that can store information and instructions It can also be an electrically erasable programmable read-only memory (EEPROM), compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compact discs, laser discs, optical discs, digital versatile discs, Blu-ray discs, etc.), magnetic disk storage media or other magnetic storage devices, or can be used to carry or store desired program code in the form of instructions or data structures and can be programmed by a computer Any other medium accessed, but not limited to.
- the memory may exist independently and be coupled with the processor 201 through the communication line 202 .
- the memory 203 can also be integrated with the processor 201 .
- the memory provided by the embodiment of the present application may generally be non-volatile.
- the memory 203 is used to store computer-executed instructions involved in executing the solutions provided by the embodiments of the present application, and the execution is controlled by the processor 201 .
- the processor 201 is configured to execute computer-executed instructions stored in the memory 203, so as to implement the method provided in the embodiment of the present application.
- the processor 201 may also perform processing-related functions in the methods provided in the following embodiments of the application, and the communication interface 204 is responsible for communicating with other devices or communication networks. The example does not specifically limit this.
- the computer-executed instructions in the embodiments of the present application may also be referred to as application program codes, which is not specifically limited in the embodiments of the present application.
- the coupling in the embodiments of the present application is an indirect coupling or a communication connection between devices, units or modules, which may be in electrical, mechanical or other forms, and is used for information exchange between devices, units or modules.
- the processor 201 may include one or more CPUs, such as CPU0 and CPU1 in FIG. 2 .
- the positioning apparatus 20 may include multiple processors, for example, the processor 201 and the processor 207 in FIG. 2 .
- Each of these processors may be a single-core (single-CPU) processor or a multi-core (multi-CPU) processor.
- a processor herein may refer to one or more devices, circuits, and/or processing cores for processing data (eg, computer program instructions).
- composition structure shown in FIG. 2 does not constitute a limitation to the positioning device.
- some components, or a different arrangement of components are shown in FIG. 2 in addition to the components shown in FIG. 2 in addition to the components shown in FIG. some components, or a different arrangement of components.
- the positioning method provided by the embodiment of the present application will be described below with reference to the accompanying drawings.
- the positioning device in the following embodiments may have the components shown in FIG. 2 , which will not be described in detail.
- the positioning method provided by the embodiment of the present application can be applied in multiple fields, for example: the field of unmanned driving, the field of automatic driving, the field of assisted driving, the field of intelligent driving, the field of networked driving, the field of intelligent networked driving, car sharing, etc.
- A/B can indicate A or B
- A/B can indicate A or B
- and/or can be used to describe There are three kinds of relationships between associated objects, for example, A and/or B, which can mean: A exists alone, A and B exist simultaneously, and B exists independently, where A and B can be singular or plural.
- expressions like "at least one of A, B, and C" or "at least one of A, B, or C” are generally used to mean any of the following: A alone; B alone; C exists; A and B exist together; A and C exist simultaneously; B and C exist simultaneously; A, B, and C exist simultaneously.
- the above is an example of the three elements of A, B and C to illustrate the optional items of the item.
- the meaning of the expression can be obtained according to the aforementioned rules.
- words such as “first” and “second” may be used to distinguish technical features with the same or similar functions.
- the words “first” and “second” do not limit the number and execution order, and the words “first” and “second” do not necessarily mean that they must be different.
- words such as “exemplary” or “for example” are used to represent examples, illustrations or illustrations, and any embodiment or design described as “exemplary” or “for example” should not be interpreted It is more preferred or more advantageous than other embodiments or design solutions.
- the use of words such as “exemplary” or “for example” is intended to present related concepts in a specific manner for easy understanding.
- the positioning device may perform some or all of the steps in the embodiment of the present application, and these steps are only examples, and the embodiment of the present application may also perform other steps or variations of various steps.
- each step may be performed in a different order presented in the embodiment of the present application, and it may not be necessary to perform all the steps in the embodiment of the present application.
- the positioning method includes S301-S304.
- the positioning device acquires a grid map corresponding to the first environment.
- the positioning device may be the positioning device 101 in FIG. 1A , or the positioning device 111 in FIG. 1B .
- the above-mentioned first environment may be the environment where the device to be positioned is located.
- the first environment is a residential area, an industrial park, or a park.
- the device to be positioned is a device that needs to be positioned, and the device to be positioned and the positioning device may be the same or different. If the device to be positioned is the same as the positioning device, it means that the positioning device needs to position itself. If the device to be positioned is different from the positioning device, it means that the positioning device needs to locate a device other than itself.
- the above grid map is a two-dimensional map.
- the grid map includes a plurality of first grids.
- the first grid may be square or rectangular, or some of the plurality of first grids may be square and the other part may be rectangular, which is not limited.
- the size of the first grid can be fixed, that is, it is pre-stored in the positioning device, or it can be set by the user according to needs.
- the grid may also have other names, for example, the grid may also be called a grid, an area, etc., which are not limited.
- the grid map may be as shown in FIG. 4 .
- the grid map 401 in FIG. 4 includes 63 first grids.
- the first grid in the grid map 401 is a square.
- any one of the multiple first grids includes multiple points, position information of each point in the multiple points, and attribute information of the first grid.
- the location information of the point may be used to indicate the location of the point in the grid map.
- the position information of a point includes the value x of the abscissa and the value y of the ordinate of the point in the grid map, ie (x, y).
- the position information of each point included in the first grid may be presented in the first grid by distributing each point in the first grid at different positions of the first grid.
- the position information of point 1 is (x1, y1)
- the position information of point 2 is (x2, y2)
- point 1 and point 2 are at different positions in the first grid.
- the attribute information of the first grid may include semantic information of the first grid and height information of the first grid.
- the attribute information of the first grid may also include reflection intensity information of the first grid.
- Each type of attribute information included in the attribute information of the first grid is introduced below.
- the semantic information of the first grid may be used to indicate the probability that the first grid represents each of the plurality of objects.
- the first grid represents the probability of each object in the various objects, which can be understood as the object to which the point in the first grid belongs (or the object corresponding to the point in the first grid) is one of the various objects Probability of each object.
- the plurality of objects may include at least two of trees, parked vehicles, walls, ground, buildings, lawns, or other objects.
- the semantic information of the first grid can be used to indicate that the first grid represents the probability of trees, the probability of representing parked vehicles, the probability of representing walls, the probability of representing ground, the probability of representing lawns and the probability of representing other objects.
- Probability or in other words, the semantic information of the first grid can be used to indicate the probability that the object belonging to the point in the first grid is a tree, a parked vehicle, a wall, a ground, or a lawn The probability of and the probability of other objects.
- the semantic information of the first grid includes the probability that the first grid represents each of the various objects. Taking a variety of objects including trees, parked vehicles, buildings and other objects as an example, if the probability of the first grid representing trees is 0.95, the probability of representing parked vehicles is 0.02, and the probability of representing buildings is 0.01, representing other The probability of the object is 0.02, and the semantic information of the first grid includes ⁇ 0.95, 0.02, 0.01, 0.02 ⁇ .
- the semantic information of the first grid includes label information of each of the multiple objects, and a probability that the first grid represents each of the multiple objects. Taking a variety of objects including trees, parked vehicles, buildings and other objects as an example, if the probability of the first grid representing trees is 0.95, the probability of representing parked vehicles is 0.02, and the probability of representing buildings is 0.01, representing other The probability of an object is 0.02, then the semantic information of the first grid includes ⁇ trees: 0.95; parked vehicles: 0.02; buildings: 0.01; other objects: 0.02 ⁇ , or the semantic information of the first grid includes ⁇ trees, 0.95 ⁇ ; ⁇ Parked vehicles: 0.02 ⁇ ; ⁇ Buildings: 0.01 ⁇ ; ⁇ Other objects: 0.02 ⁇ .
- the semantic information of the first grid may be presented in the first grid through the color attribute parameters of the points in the first grid.
- the color attribute parameters include at least one of grayscale, saturation, lightness or hue.
- each object in various objects can correspond to a grayscale value
- the grayscale value of the point in the first grid is the grayscale value corresponding to the first object
- the first object is The first grid represents the object with the highest probability among the probabilities of each of the plurality of objects.
- a variety of objects include trees, parked vehicles, buildings and other objects.
- Trees correspond to a gray value of 1
- parked vehicles correspond to a gray value of 2
- buildings correspond to a gray value of 3
- other objects correspond to a gray value of Take gray value 4 as an example, if the probability of the first grid representing trees is 0.95, the probability of representing parked vehicles is 0.02, the probability of representing buildings is 0.01, and the probability of representing other objects is 0.02, then the first grid represents The object with the highest probability among the various objects is a tree, so the gray value of the midpoint of the first grid is 1 corresponding to the tree.
- the height information of the first grid may be used to indicate the height of points included in the first grid.
- the height information of the first grid includes an average value of the heights of all points included in the first grid.
- the average of the heights of all points included in the first grid z a is the height of the ath point among all points included in the first grid
- N is the number of all points included in the first grid.
- the height information of the first grid may be presented in the first grid through the color attribute parameters of the points in the first grid.
- the color attribute parameter including lightness as an example, the height can be divided into multiple height intervals. Any two height intervals include different height values. Each height interval corresponds to a lightness. Then, the lightness corresponding to the point in the first grid It is the lightness corresponding to the height interval to which the height of the point belongs.
- the reflection intensity information of the first grid may be used to indicate the reflection intensity of the points included in the first grid, for example, the reflectance of the object surface to which the points belong.
- the reflection intensity information of the first grid includes an average value of reflection intensities of all points included in the first grid.
- the average value of the reflection intensity of all points included in the first grid A a is the reflection intensity of the ath point among all the points included in the first grid.
- the reflection intensity information of the first grid may be presented in the first grid through color attribute parameters of points in the first grid.
- the color attribute parameter including hue as an example, the reflection intensity can be divided into multiple reflection intensity intervals. The reflection intensity values included in any two reflection intensity intervals are different, and each reflection intensity interval corresponds to a hue. Then, in the first grid The hue corresponding to the point is the hue corresponding to the reflection intensity interval to which the reflection intensity of the point belongs.
- the positioning device may acquire the grid map corresponding to the first environment in at least the following two exemplary ways.
- the positioning device obtains point cloud information corresponding to the first environment, and obtains a grid map corresponding to the first environment according to the point cloud information corresponding to the first environment.
- the point cloud information corresponding to the first environment may be used to indicate position information of points in the point cloud corresponding to the first environment.
- the information of the point cloud corresponding to the first environment may also be used to indicate the reflection intensity of the points in the point cloud corresponding to the first environment. The specific process of mode 1 will be described later in the method shown in FIG. 10 , and will not be repeated here.
- the positioning device acquires the grid map corresponding to the first environment locally.
- the grid map corresponding to the first environment is stored locally.
- the positioning device obtains the grid map from other devices, it stores it locally.
- the positioning device obtains the grid map according to the above-mentioned method 1, it stores it locally. Subsequently, when the grid map needs to be used, the positioning device acquires the grid map corresponding to the first environment locally.
- the positioning device acquires a local grid corresponding to the second environment.
- the second environment is included in the first environment, that is to say, the second environment is a part of the first environment.
- the second environment is the surrounding environment where the device to be positioned is currently located, that is, the device to be positioned is in the second environment.
- the second environment may be the north side of Building No. 2 in the residential area; taking the first environment as an industrial park as an example, the second environment may be an office building in the industrial park In front of the door; the first environment is the park, and the second environment can be under the rockery in the park.
- the aforementioned partial grid may include at least one second grid.
- the second grids may be square or rectangular, or at least one second grid has a part of the grids that are square and another part of the grids that are rectangular, which is not limited.
- the size of the second grid can be fixed, that is, it is pre-stored in the positioning device, or it can be set by the user according to needs.
- the local grid may be as shown in FIG. 4 .
- the partial grid 402 in FIG. 4 includes 9 second grids.
- the second grid in partial grid 402 is a square.
- any one of the at least one second grid includes multiple points and attribute information of the second grid.
- the attribute information of the second grid may include semantic information of the second grid and height information of the second grid.
- the attribute information of the second grid may further include reflection intensity information of the second grid.
- the semantic information of the second grid may be used to indicate the probability that the second grid represents each object in the plurality of objects.
- the second grid represents the probability of each of the various objects, which can be understood as the object to which the point in the second grid belongs (or the object corresponding to the point in the second grid) is each of the various objects probability of an object.
- the height information of the second grid may be used to indicate the height of points included in the second grid.
- the reflection intensity information of the second grid may be used to indicate the reflection intensity of the points included in the second grid. It can be understood that the content included in the attribute information of the second grid is similar to the content included in the attribute information of the first grid. Therefore, the introduction of the attribute information of the second grid can refer to the attribute information of the first grid in S301 above. The description of the information will not be repeated here.
- the positioning device acquires point cloud information corresponding to the second environment, and acquires a local grid corresponding to the second environment according to the point cloud information corresponding to the second environment.
- the point cloud information corresponding to the second environment may be used to indicate position information of points in the point cloud corresponding to the second environment.
- the point cloud information corresponding to the second environment may also be used to indicate the reflection intensity of points in the point cloud corresponding to the second environment.
- the positioning device acquires a first matching probability.
- the first matching probability is the matching probability of the local grid and the grid in the grid map when the local grid is located at different positions in the grid map.
- the positioning device may determine the first matching probability corresponding to each type of attribute information based on each type of attribute information.
- the positioning device acquires the first matching probability corresponding to each type of attribute information at different locations according to the attribute information of the grid in the local grid and the attribute information of the grid in the grid map. Specifically, when the positioning device acquires that the local grid is located in the first grid in the grid map, the first attribute information of the second grid in the local grid corresponds to the first attribute information of the first grid corresponding to the second grid. A first deviation between the attribute information. According to the first deviation, a first matching probability corresponding to the first attribute information of the first grid in the grid map is obtained.
- the first attribute information of the second grid is any attribute information in the attribute information of the second grid.
- the first attribute information of the second grid is semantic information of the second grid, or height information of the second grid, or reflection intensity information of the second grid.
- the first attribute information of the first grid is the same as the first attribute information of the second grid. For example, if the first attribute information of the second grid is the semantic information of the second grid, then the first attribute information of the first grid is the semantic information of the first grid; if the first attribute information of the second grid is the height information of the second grid, then the first attribute information of the first grid is the height information of the first grid; if the first attribute information of the second grid is the reflection intensity information of the second grid, then The first attribute information of a grid is the reflection intensity information of the first grid.
- the positioning device may also obtain the first predicted probability corresponding to each attribute information of the first grid in the grid map, so that the positioning device may obtain the corresponding The first matching probability and the first predicted probability determine the first posterior probability corresponding to each attribute information of the first grid, and then determine the undetermined probability according to the first posterior probability corresponding to each attribute information of the first grid position of the bit device.
- the first predicted probability corresponding to the first attribute information of any first grid in the grid map is the probability that the local grid is currently located in the first grid predicted according to the first attribute information.
- the first posterior probability corresponding to the first attribute information of any first grid in the grid map is the first predicted probability corresponding to the first attribute information of the first grid and the first attribute information of the first grid The product of the first matching probabilities corresponding to the information.
- the following describes respectively when the first attribute information is semantic information, height information and reflection intensity information.
- the positioning device acquires the first matching probability and the first prediction probability corresponding to the first attribute information of each first grid when the local grid is located in each first grid in the grid map. Specifically, reference may be made to the descriptions in Example 1-Example 3 below.
- Example 1 When the first attribute information is semantic information, the positioning device obtains the first matching probability and The first process of predicting probabilities.
- the positioning device can make the centers of the local grid 402 be located at the centers of the 63 first grids in the grid map 401 one by one, so as to obtain the local grid The first deviation between the semantic information of the nine second grids in 402 and the semantic information of the nine first grids corresponding to the nine second grids.
- the partial grid 402 is equivalent to overlapping with the grid of the shaded part in the grid map 401 .
- the first grid corresponding to the second grid (1,1) in the local grid 402 is the first grid (2,7) in the grid map 401
- the second grid (1,2 ) is the first grid (2,8) in the grid map 401
- the first grid corresponding to the second grid (1,3) in the partial grid 402 is the grid map 401
- the first grid (2,9) of the local grid 402 corresponding to the second grid (2,1) is the first grid (3,7) in the grid map 401
- the first grid corresponding to the second grid (2,2) in grid 402 is the first grid (3,8) in grid map 401 , and so on.
- the second grid (a, b) represents the grid of row a and column b in the partial grid 402
- the first grid (a, b) represents row a in the
- the first deviation of the semantic information of the second grid (1,1) and the semantic information of the first grid (2,7) satisfy the formula Among them, s 1 is the first deviation between the semantic information of the second grid (1,1) and the semantic information of the first grid (2,7), n is the number of various objects in S301, and p b is the first deviation of the semantic information of the first grid (2,7).
- the second grid represents the probability of the second object among the plurality of objects, represents the probability of the second object among the plurality of objects for the first grid.
- the second object is any one of various objects.
- the probability that the second grid represents trees is 0.2
- the probability that it represents buildings is 0.85
- the probability that it represents other objects is 0.05
- the probability that the first grid represents trees is 0.95, indicating that the probability of a building is 0.01, and that of other objects is 0.04
- s 1 (0.2-0.95)+(0.85-0.01)+(0.05-0.04).
- the positioning device can obtain the semantic information of the second grid (1,2) and the first deviation s 2 of the semantic information of the first grid (2,8), and obtain the second grid ( 1,3) and the first deviation s 3 of the semantic information of the first grid (2,9), obtain the semantic information of the second grid (2,1) and the first grid (3,7)
- the first deviation s 4 of the semantic information of the second grid (3,3) and the first deviation s 9 of the semantic information of the first grid (4,9) are acquired.
- the positioning device may obtain the first total deviation between the semantic information of the second grid and the semantic information of the first grid when the center of the local grid 402 is located at the center of the first black grid in the grid map 401, that is, the first total deviation between the semantic information of the second grid and the semantic information of the first grid. a total deviation
- the positioning device may obtain the first matching probability corresponding to the semantic information of the first black grid when the center of the local grid 402 is located at the center of the first black grid in the grid map 401 according to the first total deviation.
- xi , y i ,m) may satisfy the formula: p(z
- xi ,y i ,m) ⁇ e ⁇ S .
- x i is the abscissa of the center position of the first black grid in the grid map 401
- y i is the ordinate of the center position of the first black grid in the grid map 401 .
- ⁇ is a constant.
- the positioning device can use the same method as the above method to obtain when the center of the local grid 402 is located at the center of each of the other 62 first grids in the grid map 401, the second grid The first total deviation between the semantic information of the grid and the semantic information of the first grid, and according to each first total deviation, obtain each of the other 62 first grids whose center of the local grid 402 is located in the grid map 401 When the centers of the first grids, the semantic information of each first grid corresponds to the first matching probability.
- the first prediction probability corresponding to the semantic information of any first grid in the grid map is a preset initial value, such as The ratio of 1 to the number of the first grid in the grid map, that is, the first prediction probability corresponding to the semantic information of any first grid satisfies the formula in, is the first prediction probability corresponding to the semantic information of any first grid, x i is the abscissa of the center of the first grid, y i is the ordinate of the center of the first grid, and num is the grid map The number of first rasters in .
- the positioning device is not determining the position of the device to be positioned for the first time, the first prediction probability corresponding to the semantic information of any first grid in the grid map satisfies the formula:
- n is a constant.
- z,m) is the first posterior probability corresponding to the semantic information obtained last time when the position of the device to be positioned on the grid map is (x 0 ,y 0 ), (x 0 ,y 0 ) is the position of the device to be positioned in the grid map at the current moment predicted by the positioning device based on the position information of the device to be positioned at the previous moment and the motion parameters of the device to be positioned. According to the position information of the device to be positioned at the previous moment and the motion parameters of the device to be positioned, the positioning device can predict the position of the device to be positioned in the grid map at the current moment. Refer to the subsequent method shown in Figure 5 mentioned, and will not be repeated here.
- ⁇ is the variance.
- the center of the local grid can also be replaced by other positions, such as the upper left corner of the local grid (such as the upper left corner of the second grid (1,1) in the local grid 402), the local grid upper right corner (such as the upper right corner of the second grid (1,3) in the local grid 402), the lower left corner of the local grid (such as the lower left corner of the second grid (3,1) in the local grid 402), The lower right corner of the local grid (such as the upper right corner of the second grid (3,3) in the local grid 402 ), etc.
- the center of the first grid can also be replaced with other positions.
- the center of the first grid can be replaced by the upper left corner of the first grid (such as the first grid (2,7 )); if the center of the local grid is replaced by the upper right corner of the local grid, then the center of the first grid can be replaced by the upper right corner of the first grid (such as the first grid in the grid map 401 (2,7) at the upper right corner); if the center of the local grid is replaced with the lower left corner of the local grid, then the center of the first grid can be replaced with the lower left corner of the first grid (as in the grid map 401 The lower left corner of the first grid (2,7)); if the center of the local grid is replaced by the lower right corner of the local grid, the center of the first grid can be replaced by the lower right corner of the first grid (such as grid Lower right corner of first grid (2,7) in map 401).
- Example 2 When the first attribute information is height information, the positioning device acquires the first matching probability and The first process of predicting probabilities.
- the semantic information of the nine second grids in the local grid 402 obtained by the positioning device corresponds to the nine second grids respectively.
- the first deviation between the semantic information of a grid is similar, and the positioning device can obtain the center of the local grid 402 when the center of the local grid 402 is located at the center of the 63 first grids in the grid map 401 one by one.
- the positioning device makes the center of the partial grid 402 located at the center of the first black grid in the grid map 401 , then the partial grid 402 is equivalent to overlapping with the grid of the shaded part in the grid map 401 .
- the first deviation between the height information of the second grid (1,1) and the height information of the first grid (2,7) Satisfies the formula: in, is the first deviation between the height information of the second grid (1,1) and the height information of the first grid (2,7), h 1 is the height of all points included in the second grid (1,1) average value, is the average height of all points included in the first grid (2,7).
- the positioning device can obtain the first deviation between the height information of the second grid (1, 2) and the height information of the first grid (2, 8) Obtain the first deviation between the height information of the second grid (1,3) and the height information of the first grid (2,9) Obtain the first deviation between the height information of the second grid (2,1) and the height information of the first grid (3,7) Obtain the first deviation between the height information of the second grid (3,3) and the height information of the first grid (4,9) Subsequently, the positioning device can obtain the first total deviation between the height information of the second grid and the height information of the first grid when the center of the local grid 402 is located at the center of the first black grid in the grid map 401, that is, the first total deviation a total deviation Subsequently, the positioning device may obtain the first matching probability corresponding to the height information of the first black grid when the center of the local grid 402 is located at the center of the first black grid in the grid map 401 according to the first total deviation.
- the positioning device can use the same method as the above method to obtain when the center of the local grid 402 is located at the center of each of the other 62 first grids in the grid map 401, the second grid
- the height information of each first grid corresponds to the first matching probability.
- the first prediction probability corresponding to the height information of any first grid in the grid map is a preset initial value, such as The ratio of 1 to the number of first grids in the grid map, that is, the first predicted probability corresponding to the height information of any first grid satisfies the formula in, is the first prediction probability corresponding to the height information of any first grid, x i is the abscissa of the center of the first grid, and y i is the ordinate of the center of the first grid.
- the positioning device is not determining the position of the device to be positioned for the first time, the first prediction probability corresponding to the height information of any first grid in the grid map satisfies the formula:
- n is a constant.
- z,m) is the first posterior probability corresponding to the height information obtained last time when the position of the device to be positioned on the grid map is (x 0 ,y 0 ), (x 0 ,y 0 ) is the position of the device to be positioned in the grid map at the current moment predicted by the positioning device based on the position information of the device to be positioned at the previous moment and the motion parameters of the device to be positioned.
- ⁇ is the variance.
- Example 3 When the first attribute information is reflection intensity information, the positioning device acquires the first matching probability corresponding to the first attribute information of each first grid when the local grid is located in each first grid in the grid map and the first process of predicting probabilities.
- the process of the positioning device obtaining the first matching probability corresponding to the first attribute information of each first grid is different from that in the case where the first attribute information is height information , the process of the positioning device acquiring the first matching probability corresponding to the first attribute information of each first grid is similar.
- the positioning device can obtain the local The first deviation between the reflection intensity information of the nine second grids in the grid 402 and the reflection intensity information of the nine first grids corresponding to the nine second grids respectively.
- the partial grid 402 is equivalent to overlapping with the grid of the shaded part in the grid map 401 .
- the reflection intensity information of the second grid (1,1) and the reflection intensity information of the first grid (2,7) A deviation can satisfy the formula: in, is the first deviation between the reflection intensity information of the second grid (1,1) and the reflection intensity information of the first grid (2,7), and a 1 is the value of all points included in the second grid (1,1)
- the mean value of the reflected intensity is the average value of reflection intensities of all points included in the first grid (2,7).
- the positioning device can obtain the first deviation between the reflection intensity information of the second grid (1, 2) and the reflection intensity information of the first grid (2, 8) Obtain the first deviation between the reflection intensity information of the second grid (1,3) and the reflection intensity information of the first grid (2,9) Obtain the first deviation between the reflection intensity information of the second grid (2,1) and the reflection intensity information of the first grid (3,7) Obtain the first deviation between the reflection intensity information of the second grid (3,3) and the reflection intensity information of the first grid (4,9) Subsequently, the positioning device may obtain the first total deviation between the reflection intensity information of the second grid and the reflection intensity information of the first grid when the center of the local grid 402 is located at the center of the first black grid in the grid map 401, the first total deviation Subsequently, the positioning device may obtain the first matching probability corresponding to the reflection intensity information of the first black grid when the center of the local grid 402 is located at the center of the first black grid in the grid map 401 according to the first total deviation.
- the first matching probability corresponding to the reflection intensity
- the positioning device can use the same method as the above method to obtain when the center of the local grid 402 is located at the center of each of the other 62 first grids in the grid map 401, the second grid The first total deviation between the reflection intensity information of the grid and the reflection intensity information of the first grid, according to each first total deviation, the center of the local grid 402 is located in the other 62 first grids in the grid map 401 When the center of each first grid of , the first matching probability corresponding to the reflection intensity information of each first grid.
- the first prediction probability corresponding to the reflection intensity information of any first grid in the grid map is a preset initial value, For example, the ratio of 1 to the number of the first grid in the grid map, that is, the first predicted probability corresponding to the reflection intensity information of any first grid satisfies the formula in, is the first predicted probability corresponding to the reflection intensity information of any first grid, x i is the abscissa of the center of the first grid, and y i is the ordinate of the center of the first grid.
- the positioning device is not determining the position of the device to be positioned for the first time, the first prediction probability corresponding to the reflection intensity information of any first grid in the grid map satisfies the formula:
- n is a constant.
- z,m) is the first posterior probability corresponding to the reflection intensity information obtained last time when the position of the device to be positioned on the grid map is (x 0 ,y 0 ), (x 0 , y 0 ) is the predicted position of the device to be positioned in the grid map at the current moment by the positioning device based on the position information of the device to be positioned at the previous moment and the motion parameters of the device to be positioned.
- ⁇ is the variance.
- the positioning device determines the position of the device to be positioned according to the first matching probability.
- the position of the device to be located is the position of the device to be located in the grid map.
- the position of the device to be positioned is the position of the centroid of the smart car in the grid map.
- the positioning device determines the location information corresponding to each type of attribute information according to the first matching probability corresponding to each type of attribute information at different locations, and determines the location of the device to be positioned according to the location information corresponding to each type of attribute information.
- the positioning device determines the first matching probability corresponding to each type of attribute information at different locations and the first predicted probability corresponding to each type of attribute information at different locations, and determines the first matching probability corresponding to each type of attribute information at different locations.
- a posterior probability according to the first posterior probability corresponding to each attribute information at different locations, determine the location information corresponding to each attribute information.
- the first posterior probability corresponding to the semantic information of any first grid in the grid map is that the first predicted probability corresponding to the semantic information of the first grid corresponds to the semantic information of the first grid The product of the first matching probabilities of .
- the first posterior probability corresponding to the semantic information of the first black grid in the grid map 401 Satisfies the formula:
- the location information corresponding to the semantic information satisfies the formula: in, is the abscissa of the device to be located in the grid map determined based on the semantic information, that is, the abscissa of the device to be located in the grid map corresponding to the semantic information
- x i is the ith first grid in the grid map
- z, m) is the first posterior probability corresponding to the semantic information of the i-th first grid in the grid map
- N is included in the grid map the number of first grids, is the ordinate of the device to be located in the grid map determined based on the semantic information, that is, the ordinate of the device to be located
- the first posterior probability corresponding to the height information of any first grid in the grid map is that the first predicted probability corresponding to the height information of the first grid corresponds to the height information of the first grid The product of the first matching probabilities of .
- the first posterior probability corresponding to the height information of the first black grid in the grid map 401 Satisfies the formula:
- the location information corresponding to the height information satisfies the formula: in, is the abscissa of the device to be located in the grid map determined based on the height information, that is, the abscissa of the device to be located in the grid map corresponding to the height information, q( xi ,y i
- the first posterior probability corresponding to the height information of the i-th first grid in the map is the vertical coordinate of the device to be positioned in the grid map determined based on the height information, that is, the vertical coordinate of the device to be positioned corresponding to the height information in the grid map.
- the first posterior probability corresponding to the reflection intensity information of any first grid in the grid map is the first predicted probability corresponding to the reflection intensity information of the first grid and the first prediction probability of the first grid The product of the first matching probabilities corresponding to the reflection intensity information.
- the reflection intensity information of the first black grid in the grid map 401 corresponds to the first posterior
- the probability satisfies the formula:
- the position information corresponding to the reflection intensity information satisfies the formula: in, is the abscissa of the device to be located in the grid map determined based on the reflection intensity information, that is, the abscissa of the device to be located in the grid map corresponding to the reflection intensity information, r(xi , y i
- the following describes the process by which the positioning device determines the position of the device to be positioned according to the position information corresponding to each type of attribute information.
- the positioning device weights and sums the position information corresponding to each type of attribute information to obtain the position of the device to be positioned.
- the weight corresponding to each attribute information may be determined first. It can be understood that the weights corresponding to each type of attribute information may be the same or different, for example, the weights corresponding to each type of attribute information are 1.
- the weight corresponding to each attribute information may be preset and stored in the positioning device, or may be determined according to a certain algorithm.
- the weight corresponding to each attribute information is determined according to the distribution of the first matching probability corresponding to the attribute information. For example, the more concentrated the distribution of the first matching probability corresponding to the attribute information in the grid map is, the higher the weight corresponding to the attribute information is, and the less concentrated the distribution of the first matching probability corresponding to the attribute information in the grid map is, the more concentrated the distribution of the attribute information is. The lower the weight corresponding to the information.
- the weight corresponding to each attribute information is determined according to the variance of the first matching probability corresponding to the attribute information.
- the weight corresponding to semantic information can satisfy the formula: Among them, w p is the weight corresponding to the semantic information, ⁇ is a constant, and up is the variance of the first matching probability corresponding to the semantic information.
- the weight corresponding to the height information can satisfy the formula: Wherein, w h is the weight corresponding to the height information, and u h is the variance of the first matching probability corresponding to the height information.
- the weight corresponding to the reflection intensity information can satisfy the formula: Wherein, w a is the weight corresponding to the reflection intensity information, and u a is the variance of the first matching probability corresponding to the reflection intensity information. It can be understood that the smaller the variance, the more concentrated the distribution of the first matching probability corresponding to the variance is, and the larger the variance is, the less concentrated the distribution of the first matching probability is corresponding to the variance.
- the position of the device to be positioned satisfies the following formula: Wherein, X is the abscissa of the device to be positioned in the grid map determined by the positioning device, and Y is the vertical coordinate of the device to be positioned in the grid map determined by the positioning device.
- the positioning device determines the location information corresponding to each attribute information, it can first screen the location information to eliminate inaccurate location information, Then the position of the device to be positioned is determined according to the filtered position information.
- the positioning device determines the location information corresponding to at least one attribute information that meets the preset rules in the location information corresponding to each attribute information, and determines the location information of the device to be positioned according to the location information corresponding to at least one attribute information s position.
- the preset rules may include at least one of the following rules: Among the location information corresponding to each attribute information, the location information whose distance from the first location is less than or equal to the first value is determined as the location corresponding to at least one attribute information information; or, among the location information corresponding to each attribute information, the location information whose matching degree is greater than or equal to the second value is determined as the location information corresponding to at least one attribute information.
- the first position is the position of the device to be positioned in the grid map at the current moment predicted by the positioning device according to the position information of the device to be positioned at a previous moment and the motion parameters of the device to be positioned.
- the matching degree of the position information corresponding to any kind of attribute information can be based on the ICP algorithm, and the point corresponding to the position information in the point cloud map corresponding to the first environment is matched with the point in the point cloud corresponding to the first environment owned.
- the location information corresponding to at least one attribute information is determined as the location of the device to be positioned.
- the method of determining the weight corresponding to the attribute information is as described above, and will not be repeated here.
- the positioning device may also not determine the first posterior probability corresponding to each type of attribute information at different locations, but directly determines the corresponding The location information of each attribute information, and then determine the location of the device to be located according to the location information corresponding to each attribute information.
- the first posterior probability corresponding to the attribute information takes into account the first predicted probability corresponding to the attribute information, therefore, the position of the device to be positioned determined according to the first posterior probability corresponding to each attribute information in different positions is more than It is more accurate to determine the position of the device to be located directly according to the first matching probability corresponding to each attribute information of different positions.
- the positioning device can obtain the grid map corresponding to the first environment, and obtain the local grid corresponding to the second environment information, and according to the various attribute information of the first grid in the grid map and the local grid Multiple attribute information of the second grid can locate the positioning device, so that the positioning device does not only rely on a certain attribute for positioning, thereby improving the accuracy and stability of positioning.
- the positioning device acquires the first matching probabilities of the local grids and the grids in the grid map one by one at each positioning, and the calculation cost is relatively large.
- the positioning device may obtain the matching probabilities of the local grids and the grids in the grid map one by one.
- the positioning device may match the local grid with the grid in the grid map based on a histogram filter method.
- the positioning device may first predict the position of the device to be positioned on the grid map, and then obtain the matching probability between the local grid and the grid corresponding to the position in the grid map. In this way, the matching probabilities between the local grids and the grids in the grid map do not need to be obtained one by one, which reduces the calculation cost.
- the method shown in FIG. 3 may further include S305.
- the positioning device predicts the first area corresponding to the position of the device to be positioned at the second moment according to the pose information of the device to be positioned at the first moment and the motion parameters of the device to be positioned.
- the first moment is the last time when the positioning device performs positioning for the device to be positioned.
- the pose information at the first moment is used to indicate the latest position and orientation angle of the device to be positioned in the grid map determined by the positioning device.
- the orientation angle of the device to be located on the grid map may indicate the direction of movement of the device to be located on the grid map.
- the second moment is the current moment.
- the position at the second moment is the position of the device to be located in the grid map at the current moment. That is to say, the positioning device can predict the position of the device to be positioned at the current moment according to the latest determined pose information of the device to be positioned and the motion parameters of the device to be positioned.
- the motion parameter may be a parameter acquired by the perception module in real time.
- the sensing module may be the sensing device 102 in FIG. 1A , or the sensing module 1112 in FIG. 1B .
- the motion parameters are inertial measurement unit (IMU) data.
- the sensing module can also be a wheel speed sensor installed on the device to be positioned, in this case, the motion parameter is a wheel speed meter parameter.
- the positioning device acquires the motion parameters, parameters such as the angular velocity of the device to be positioned and the linear velocity of the device to be positioned can be obtained according to the motion parameters.
- the positioning device can also obtain the rotation angle of the wheel of the device to be positioned according to the motion parameters.
- the angular velocity of the device to be positioned, the linear velocity of the device to be positioned and the rotation angle of the wheel of the device to be positioned may be as shown in FIG. 6 .
- Lines 601 and 602 in FIG. 6 are used to represent the two rear wheels of the smart car, and lines 603 and 604 are used to represent the two front wheels of the smart car.
- the angular velocity ⁇ of the device to be positioned may be the arc traversed by the device to be positioned per unit time.
- the linear velocity v of the device to be positioned can be the distance traveled by the center point of the line connecting the two rear wheels of the smart car in unit time.
- the rotation angle ⁇ of the wheel of the device to be positioned may be the angle between the wheel of the smart car and the line connecting the center of the front wheel and the center of the rear wheel of the smart car.
- the pose (x t1 , y t1 , ⁇ t1 ) of the device to be positioned at the first moment and the predicted position (x t2 , y t2 ) of the device to be positioned at the second moment satisfy the formula:
- x t1 is the abscissa of the device to be positioned in the grid map at the first moment.
- y t1 is the vertical coordinate of the device to be positioned in the grid map at the first moment.
- x t2 is the predicted abscissa of the device to be positioned in the grid map at the second moment.
- y t2 is the predicted vertical coordinate of the device to be positioned in the grid map at the second moment.
- v is the linear velocity of the device to be positioned.
- ⁇ is the angular velocity of the device to be positioned.
- ⁇ t is the difference between the second moment and the first moment.
- the positioning device predicts the position of the device to be positioned at the second moment. Therefore, after the positioning device predicts the position of the device to be positioned at the second moment, according to the predicted position of the device to be positioned at the second moment The position at the second moment determines the first area. Subsequently, the positioning device may acquire a first matching probability between the local grid and the grid in the first area, and determine the position of the device to be positioned according to the first matching probability. In this way, the positioning accuracy and stability of the positioning device can be improved, and the calculation cost can also be reduced.
- the positioning device may determine an area within a certain range centered on the predicted position of the device to be positioned at the second moment as the first area. For example, if the pose of the device to be positioned at the first moment and the predicted position of the device to be positioned at the second moment are shown in FIG. 7 , the first area may be the shaded part in FIG. 7 .
- the positioning device may not need to obtain the first matching probability according to the method shown in FIG. 3 above, and determine the position of the device to be positioned according to the first matching probability.
- the positioning device may obtain the first matching probability of the local grid and the grid in the previous map when the local grid is located in the first area, that is, the first matching probability of the grid in the first area, according to the first matching probability of the grid in the first area.
- a first matching probability of grids in an area determines the location of the device to be located. The details are described below.
- the positioning device acquires the first matching probability corresponding to each type of attribute information at different positions according to the attribute information of the grids in the local grids and the attribute information of the grids in the first region. Specifically, when the positioning device acquires the first grid in which the local grid is located in the first area, the first attribute information of the second grid in the local grid corresponds to the first attribute information of the first grid corresponding to the second grid. A first deviation between the attribute information. According to the first deviation, a first matching probability corresponding to the first attribute information of the first grid in the first region is acquired.
- the first attribute information of the second grid is any attribute information in the attribute information of the second grid, and the first attribute information of the first grid has the same attribute as the first attribute information of the second grid.
- the positioning device may also acquire the first predicted probability corresponding to each attribute information of the first grid in the first area, so that the positioning device may The first matching probability and the first prediction probability corresponding to the information determine the first posterior probability corresponding to each attribute information of the first grid in the first area, and then according to each type of attribute information of the first grid in the first area The first posterior probability corresponding to the attribute information determines the position of the device to be located.
- the process of the positioning device obtaining the first predicted probability corresponding to each attribute information of the first grid in the first area is the same as the positioning device obtaining the first prediction probability corresponding to each attribute information of the first grid in the grid map in S303 above.
- the process of predicting the probability is similar, so reference can be made to the corresponding description in S303 above, and details are not repeated here.
- the positioning device determines the location information corresponding to each type of attribute information according to the first matching probability corresponding to each type of attribute information of the first grid in the first area, and according to the location information corresponding to each type of attribute information, Determine the location of the device to be located. Specifically, according to the first matching probability and the first prediction probability corresponding to each attribute information of the first grid in the first area, the positioning device determines the first matching probability corresponding to each attribute information of the first grid in the first area. A posterior probability, according to the first posterior probability corresponding to each attribute information of the first grid in the first area, determine the location information corresponding to each attribute information, and determine the undetermined location information according to the location information corresponding to each attribute information position of the bit device.
- the above process is similar to the process of determining the position of the device to be positioned by the positioning device in S304 above, so reference may be made to the corresponding description in S304 above, and details are not repeated here.
- the positioning device determines the location information corresponding to each attribute information, it can first screen the location information to eliminate inaccurate location information, Then the position of the device to be positioned is determined according to the filtered position information. Specifically, reference may be made to the corresponding description in S304 above, and details are not repeated here.
- the positioning device can locate the device to be positioned and acquire the position of the device to be positioned.
- the positioning device may also obtain the orientation angle of the device to be positioned.
- the method shown in FIG. 3 further includes S306-S307.
- S306 The positioning device acquires a second matching probability.
- the second matching probability is the matching probability between the partial grid and the grid in the grid map when the partial grid is located at the position of the device to be positioned and the partial grid is rotated by different angles. Different rotation angles of the local grid correspond to different orientation angles of the device to be positioned.
- the center of the local grid can be located at the position of the device to be positioned, such as the local grid 901 in Figure 9, and the local grid can be rotated around the position of the device to be positioned to obtain different rotations.
- the local grids of the corners such as the local grids 902-904 in FIG. 9 .
- the orientation angle of the device to be positioned corresponding to the rotation angle of the partial grid 901 is the orientation angle corresponding to the arrow 905
- the orientation angle of the device to be positioned corresponding to the rotation angle of the partial grid 902 is the orientation angle corresponding to the arrow 906
- the partial grid 903 The orientation angle of the device to be positioned corresponding to the rotation angle of is the orientation angle corresponding to the arrow 907
- the orientation angle of the device to be positioned corresponding to the rotation angle of the partial grid 904 is the orientation angle corresponding to the arrow 908 .
- the positioning device can acquire the second matching probability between the local grid and the grid in the grid map at different rotation angles, for example, the second matching probability between the local grid 901 and the grid in the grid map, the local grid 902 the second matching probability with the grid in the grid map, the partial grid 903 the second matching probability with the grid in the grid map, the partial grid 904 the second matching probability with the grid in the grid map .
- the rotation angle of the local grid is the angle between the rotated local grid pattern and the local grid initially located at the position of the device to be positioned.
- the rotation angle of the local grid 902 is the angle between the local grid 902 and the local grid 901
- the rotation angle of the local grid 903 is the angle between the local grid 903 and the local grid 901. angle.
- the difference between the rotation angles of two adjacent rotations of the local grid may be the same or different, which is not limited.
- the positioning device acquires the second matching probabilities of multiple rotation angles corresponding to the local grid when the local grid is located at the position of the device to be positioned.
- the center of the partial grid is located at the position of the device to be positioned, and the partial grid is rotated around the position of the device to be positioned to obtain multiple rotation angles.
- the plurality of rotation angles may be 0°, 45°, 90°, 135°, 180°, 225°, 270° and 315°.
- the positioning device can first predict the orientation angle of the device to be positioned according to the orientation angle of the device to be positioned at the third moment and the motion parameters of the device to be positioned.
- the orientation angle of the positioning device at the second moment, and a plurality of rotation angles are determined according to the orientation angle at the second moment. In this case, it is not necessary to rotate the local grid around the position of the device to be positioned to obtain multiple rotation angles. Instead, the local grid is centered on the position of the device to be positioned, and at the second moment Rotate around the orientation angle to get multiple rotation angles.
- the included angle between each rotation angle and the orientation angle at the second moment is smaller than or equal to the first angle. In this way, the calculation overhead of the positioning device can be reduced, and the accuracy of the determined orientation angle of the device to be positioned can be improved.
- the third moment is the last time when the positioning device determines the orientation angle for the device to be positioned.
- the orientation angle at the third moment is the orientation angle of the device to be located in the grid map determined by the positioning device last time.
- the third moment and the first moment may be the same or different.
- the orientation angle of the device to be located on the grid map may indicate the direction of movement of the device to be located on the grid map.
- the second moment is the current moment.
- the orientation angle at the second moment is the orientation angle of the device to be located in the grid map at the current moment. That is to say, the positioning device can predict the orientation angle of the device to be located on the grid map at the current moment according to the latest determined orientation angle of the device to be located and the motion parameters of the device to be located.
- the motion parameters For the introduction of the motion parameters, reference may be made to the corresponding description in S305 above, which will not be repeated here.
- parameters such as the angular velocity of the device to be positioned may be obtained according to the motion parameters.
- the positioning device can also obtain the linear velocity of the device to be positioned, the rotation angle of the wheel of the device to be positioned, etc. according to the motion parameters.
- ⁇ is the angular velocity of the device to be positioned.
- ⁇ t is the difference between the second moment and the third moment.
- the positioning device may determine the second matching probability corresponding to each type of attribute information based on each type of attribute information. Exemplarily, according to the attribute information of the grid in the local grid and the attribute information of the grid in the grid map, the positioning device acquires the second matching probability corresponding to each attribute information of the local grid corresponding to the multiple rotation angles .
- the positioning device obtains the information corresponding to each type of attribute information of the first rotation angle according to the attribute information of the grid in the local grid corresponding to the first rotation angle and the attribute information of the grid in the grid map.
- Second match probability wherein, the first rotation angle is any rotation angle among multiple rotation angles, and the second matching probability corresponding to each attribute information of the first rotation angle is each type of the grid in the local grid corresponding to the first rotation angle. Attribute information, the matching probability of each attribute information of the raster in the raster map.
- the positioning device obtains the local grid at the position of the device to be positioned, and when the local grid is rotated by the first rotation angle, the first attribute information of each second grid in the local grid, and the second grid According to the second deviation between the first attribute information of the first grid corresponding to the grid, the second matching probability corresponding to the first attribute information of the first rotation angle is obtained according to the second deviation.
- the first attribute information of the second grid is any attribute information in the attribute information of the second grid, and the first attribute information of the first grid has the same attribute as the first attribute information of the second grid.
- the process that the positioning device obtains the second deviation, and obtains the second matching probability corresponding to the first attribute information of the first rotation angle according to the second deviation is the same as the above S303 in which the positioning device obtains the first deviation, and obtains the second matching probability according to the first deviation.
- the process of the first matching probability corresponding to the first attribute information of the first grid in the grid map is similar, and reference may be made to the corresponding description in S303 above, and details are not repeated here.
- the positioning device can also obtain the second predicted probability corresponding to each attribute information of the first rotation angle, so that the positioning device can use the second matching probability and the second prediction probability corresponding to each attribute information of the first rotation angle.
- the prediction probability is to determine the second posterior probability corresponding to each attribute information of the first rotation angle, and then determine the orientation angle of the device to be positioned according to the second posterior probability corresponding to each attribute information of the first rotation angle.
- the second prediction probability corresponding to each attribute information of the first rotation angle is a preset initial value, such as 1/360.
- the positioning device is not determining the position of the device to be positioned for the first time, the second prediction probability corresponding to the first attribute information of the first rotation angle satisfies the formula:
- ⁇ is the second prediction probability corresponding to the attribute information of the first rotation angle.
- ⁇ is a constant.
- z,m) is the second posterior probability corresponding to the first attribute information of the device to be positioned when the orientation angle of the grid map is ⁇ 0 acquired last time, and ⁇ 0 is the The orientation angle of the device at the last moment and the motion parameters of the device to be positioned, and the predicted orientation angle of the device to be positioned in the grid map at the current moment.
- ⁇ i is the orientation angle of the device to be positioned corresponding to the first rotation angle.
- ⁇ is the variance.
- the positioning device determines the orientation angle of the device to be positioned according to the second matching probability.
- the positioning device determines the orientation angle information corresponding to each attribute information according to the second matching probability corresponding to each attribute information of each rotation angle, and determines the undetermined orientation angle information according to the orientation angle information corresponding to each attribute information.
- the orientation angle of the device determines the second posterior probability corresponding to each attribute information of each rotation angle according to the second matching probability and the second prediction probability corresponding to each attribute information of each rotation angle, and according to each rotation angle According to the second posterior probability corresponding to each attribute information, the orientation angle information corresponding to each attribute information is determined, and the orientation angle of the device to be positioned is determined according to the orientation angle information corresponding to each attribute information.
- the second posterior probability corresponding to the first attribute information of the first rotation angle satisfies the formula: Among them, k( ⁇ i
- the orientation angle information corresponding to the first attribute information satisfies the formula: in, is the orientation angle indicated by the orientation angle information corresponding to the first attribute information, that is, the orientation angle of the device to be positioned determined based on the first attribute information, ⁇ i is the orientation angle of the device to be positioned corresponding to the i-th rotation angle among the multiple rotation angles Orientation angle, j is the number of multiple rotation angles.
- the positioning device weights and sums the orientation angle information corresponding to each type of attribute information to obtain the orientation angle of the device to be positioned.
- the weights corresponding to each type of attribute information reference may be made to the corresponding description in S304 above, which will not be repeated here.
- the orientation angle of the device to be positioned satisfies the following formula: Wherein, ⁇ is the orientation angle of the device to be positioned determined by the positioning device, w p is the weight corresponding to the semantic information, w h is the weight corresponding to the height information, and w a is the weight corresponding to the reflection intensity information. is the orientation angle of the device to be positioned based on the semantic information, is the orientation angle of the device to be positioned based on the height information, is the orientation angle of the device to be positioned based on the reflection intensity information.
- the positioning device may also not determine the second posterior probability corresponding to each attribute information of multiple rotation angles, but directly determines each The orientation angle information corresponding to each type of attribute information, and then according to the orientation angle information corresponding to each type of attribute information, the orientation angle of the device to be positioned is determined.
- the second posterior probability corresponding to the attribute information takes into account the second predicted probability corresponding to the attribute information, therefore, the orientation of the device to be positioned is determined according to the second posterior probability corresponding to each attribute information of multiple rotation angles The angle is more accurate than the orientation angle of the device to be positioned which is determined directly according to the second matching probability corresponding to each attribute information of the plurality of rotation angles.
- S301 may include S3011 and S3012.
- the positioning device acquires point cloud information corresponding to the first environment.
- the point cloud information corresponding to the first environment may be used to indicate the location information of the points in the point cloud corresponding to the first environment, such as the coordinates of the points in the point cloud corresponding to the first environment in the three-dimensional map.
- the three-dimensional map may be a point cloud map.
- the point cloud information corresponding to the first environment is also used to indicate the reflection intensity of the points in the point cloud corresponding to the first environment.
- the positioning device acquires point cloud information corresponding to the first environment through the sensing device.
- the sensing device may or may not be deployed on the positioning device.
- the laser radar can move in the first environment and emit laser light to collect point cloud information in the first environment.
- the positioning device is based on SLAM algorithm, such as lightweight and ground optimized lidar odometry and mapping (Lego-Loam) algorithm, Obtain the point cloud map corresponding to the first environment.
- the point cloud in the first environment is a point cloud obtained by reflecting the lidar from objects in the first environment.
- the reflection intensity of a point in the point cloud corresponding to the first environment is the reflection intensity of the point to the laser.
- point cloud information when collecting point cloud information through lidar, point cloud information can be collected once at a certain distance.
- each acquired point cloud can be down-sampled by a voxel raster filter in the point cloud library.
- the voxel grid filter can achieve the function of downsampling without destroying the geometric structure of the point cloud itself. After downsampling, the number of points in the point cloud collected each time can be reduced while maintaining the shape characteristics of the point cloud.
- the positioning device acquires a grid map corresponding to the first environment according to the point cloud information corresponding to the first environment.
- the positioning device projects (for example, projecting onto the ground) the point cloud map corresponding to the first environment to obtain a two-dimensional map corresponding to the first environment, and divides the two-dimensional map into a plurality of first grids, To obtain the grid map corresponding to the first environment.
- the height of each point in the grid map is the value of the vertical coordinate (z coordinate) of the point in the point cloud map.
- the reflection intensity of each point in the grid map is the reflection intensity of the point to the laser.
- the semantic information of the first grid may be determined according to the semantic information of points in the first grid.
- the semantic information of a point in the first grid is the probability that the object to which the point belongs (or the object corresponding to the point) is each of the various objects.
- p m [i] is the probability that the first grid represents any one of multiple objects
- ⁇ is a constant
- count(label i ) 1 is the points in the first grid that belong to any one of the objects
- M is the number of points in the first grid.
- the point in the first grid is input into the semantic model, and the probability that the object to which the point belongs (or the object corresponding to the point) is each of various objects can be obtained.
- the semantic model may be stored in the positioning device.
- the semantic model may also be obtained by training the positioning device before S3012.
- the positioning device can use PointNet for training based on various objects marked in advance to obtain a semantic model.
- the actions of the positioning device in S3011-S3012 above can be executed by the processor 201 in the positioning device 20 shown in FIG. 2 calling the application program code stored in the memory 203, which is not limited in this embodiment of the present application.
- S302 may include S3021 and S3022.
- the positioning device acquires point cloud information corresponding to the second environment.
- the point cloud information corresponding to the second environment may be used to indicate position information of points in the point cloud corresponding to the second environment, such as coordinates of points in the point cloud corresponding to the second environment in the three-dimensional map.
- the three-dimensional map may be a point cloud map.
- the point cloud information corresponding to the second environment is also used to indicate the reflection intensity of the points in the point cloud corresponding to the second environment.
- a sensing device is deployed on the device to be positioned, and the point cloud information corresponding to the second environment is obtained through the sensing device.
- the sensing device as a lidar
- the device to be positioned can move in the first environment, and when it moves to the second environment, emit laser light through the lidar to collect point cloud information in the second environment. If the device to be positioned is the same as the positioning device, the device to be positioned obtains a point cloud map corresponding to the second environment based on a SLAM algorithm, such as a Lego-Loam algorithm.
- the device to be positioned sends point cloud information in the second environment to the positioning device, and the positioning device obtains a point cloud map corresponding to the second environment based on a SLAM algorithm, such as a Lego-Loam algorithm.
- the point cloud in the second environment is a point cloud obtained by reflecting the lidar from objects in the second environment.
- the reflection intensity of a point in the point cloud corresponding to the second environment is the reflection intensity of the point to the laser.
- point cloud information when collecting point cloud information through lidar, point cloud information can be collected once at a certain distance.
- each acquired point cloud can be down-sampled by a voxel raster filter in the point cloud library.
- the positioning device acquires a local grid corresponding to the second environment according to the point cloud information corresponding to the second environment.
- the positioning device projects the point cloud map corresponding to the second environment (such as projecting onto the ground) to obtain a two-dimensional map corresponding to the second environment, divides the two-dimensional map into a plurality of second grids, To get the local grid corresponding to the second environment.
- the height of each point in the local grid is the value of the vertical coordinate (z coordinate) of the point in the point cloud map.
- the reflection intensity of each point in the local grid is the reflection intensity of the point to the laser.
- the semantic information of the second grid may be determined according to the semantic information of points in the second grid.
- the semantic information of a point in the second grid is the probability that the object to which the point belongs (or the object corresponding to the point) is each of the various objects.
- p[i] is the probability that the second grid represents any one of the various objects
- ⁇ is a constant
- count(label i ) 2 is the number of points belonging to the arbitrary object in the second grid
- W is the number of points in the second grid.
- the point in the second grid is input into the semantic model, and the probability that the object to which the point belongs (or the object corresponding to the point) is each of various objects can be obtained.
- the semantic model For the introduction of the semantic model, reference may be made to the corresponding description in S3012 above, and details are not repeated here.
- the actions of the positioning device in S3021-S3022 above can be executed by the processor 201 in the positioning device 20 shown in FIG. 2 calling the application program code stored in the memory 203, which is not limited in this embodiment of the present application.
- the methods and/or steps implemented by the positioning device may also be implemented by components (such as chips or circuits) that can be used in the positioning device, without limitation.
- the positioning devices to be positioned in 4 positions were respectively positioned using method 1, method 2 and method 4, and 50 positioning results at different times were counted. After the statistics The positioning results are shown in Table 1.
- Table 1 for position 1, that is, the actual position of the device to be positioned as shown in Figure 12, in the 50 positionings, the proportion of the positioning error of the method 1 when the device to be positioned is less than 10 cm is 58.9%, and the method 2 to be positioned is 58.9%.
- the proportion of positioning error less than 10cm when the device is positioned is 68.1%, and the proportion of positioning error less than 10cm when the positioning device is positioned by method 4 is 92.0%.
- the proportion of positioning error less than 10cm when the positioning device is positioned by method 1 is 56.3%, the proportion of positioning error is less than 10cm when positioning the positioning device by method 2 is 66.8%, method 4
- the proportion of positioning error less than 10cm when the positioning device is positioned is 91.3%.
- the proportion of positioning error less than 10cm when the positioning device is positioned by method 1 is 67.1%, the proportion of positioning error is less than 10cm when positioning the positioning device by method 2 is 85%, method 4
- the proportion of positioning error less than 10cm when the positioning device is positioned is 94.2%. It can be seen that the positioning accuracy of method 4 is significantly better than that of method 1 and method 2.
- the attribute information in the embodiment of the present application can also be used for environment perception of automatic driving.
- features that are not easy to change in the environment can be extracted and used as attribute information to model the environment, or objects in the environment can be identified according to the process of acquiring semantic information in the embodiment of the present application to realize the movement of dynamic objects in the environment Estimation, thus providing conditions for path planning and obstacle avoidance of automatic driving.
- An embodiment of the present application also provides a positioning device, which may be the positioning device in the above method embodiment, or a device including the above positioning device, or a component that can be used for the above positioning device.
- the above-mentioned positioning device includes corresponding hardware structures and/or software modules for performing various functions.
- the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed by hardware or computer software drives hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions for each specific application, but such implementation should not be regarded as exceeding the scope of the present application.
- the functional modules of the positioning device may be divided according to the above method examples.
- each functional module may be divided corresponding to each function, or two or more functions may be integrated into one processing module.
- the above-mentioned integrated modules can be implemented in the form of hardware or in the form of software function modules. It should be noted that the division of modules in the embodiment of the present application is schematic, and is only a logical function division, and there may be other division methods in actual implementation.
- FIG. 13 shows a schematic structural diagram of a positioning device 130 .
- the positioning device 130 includes an acquisition module 1301 and a processing module 1302 .
- the positioning device 130 is used to realize the functions of the above positioning device.
- the positioning device 130 is, for example, the terminal shown in the embodiment shown in FIG. 3 , the embodiment shown in FIG. 5 , the embodiment shown in FIG. 8 , the embodiment shown in FIG. 10 or the embodiment shown in FIG. 11 .
- the acquiring module 1301 is configured to acquire a grid map corresponding to the first environment, the grid map includes a plurality of first grids, the first grid includes a plurality of points, position information of the plurality of points, and Attribute information, the attribute information of the first grid includes the semantic information of the first grid and the height information of the first grid, the semantic information of the first grid is used to indicate that the first grid represents each object in various objects The probability of , the height information of the first grid is used to indicate the height of the points included in the first grid.
- the acquiring module 1301 is further configured to acquire a local grid corresponding to the second environment, the second environment is included in the first environment, the local grid includes at least one second grid, the second grid includes a plurality of points and the second grid
- the attribute information of the second grid, the attribute information of the second grid includes the semantic information of the second grid and the height information of the second grid, and the semantic information of the second grid is used to indicate that the second grid represents each of the various objects
- the probability of an object, and the height information of the second grid is used to indicate the height of the points included in the second grid.
- the acquiring module 1301 is further configured to acquire a first matching probability, where the first matching probability is a matching probability between the local grid and the grid in the grid map when the local grid is located at different positions in the grid map.
- the processing module 1302 is configured to determine the location of the device to be located according to the first matching probability, and the device to be located is located in the second environment.
- the attribute information of the first grid further includes reflection intensity information of the first grid, and the reflection intensity information of the first grid is used to indicate the reflection intensity of points included in the first grid;
- the attribute information of the second grid further includes reflection intensity information of the second grid, and the reflection intensity information of the second grid is used to indicate the reflection intensity of the points included in the second grid.
- the processing module 1302 is further configured to predict the first position corresponding to the position of the device to be positioned at the second moment according to the pose information of the device to be positioned at the first moment and the motion parameters of the device to be positioned. area.
- the acquiring module 1301 is specifically configured to acquire a first matching probability between the local grid and the grid in the grid map when the local grid is located in the grid in the first region.
- the acquiring module 1301 is specifically configured to acquire each attribute information of the first grid in the first area according to the attribute information of the grid in the local grid and the attribute information of the grid in the first area. The first matching probability corresponding to the attribute information.
- the acquisition module 1301 is specifically configured to acquire the first attribute information of the second grid in the local grid and the first attribute information of the second grid in the case where the local grid is located in the first region
- the first deviation between the first attribute information of the first grid corresponding to the two grids, the first attribute information of the second grid is any one of the attribute information of the second grid, and the first attribute information of the first grid
- the attributes of the first attribute information and the first attribute information of the second grid are the same;
- the acquiring module 1301 is also specifically configured to acquire the first attribute corresponding to the first attribute information of the first grid in the first region according to the first deviation. match probability.
- the processing module 1302 is specifically configured to determine the position information corresponding to each attribute information according to the first matching probability corresponding to each attribute information of the first grid in the first area; the processing module 1302 , which is also specifically used to determine the location of the device to be positioned according to the location information corresponding to each attribute information.
- the processing module 1302 is further specifically configured to determine, among the location information corresponding to each type of attribute information, the location information corresponding to at least one attribute information conforming to preset rules; the processing module 1302 is also specifically configured to use If the quantity of at least one kind of attribute information is greater than 1, the position information corresponding to at least one kind of attribute information is weighted and summed to obtain the position of the device to be positioned; or, if the quantity of at least one kind of attribute information is equal to 1, then at least The location information corresponding to one kind of attribute information is determined as the location of the device to be positioned.
- the acquisition module 1301 is also used to acquire the second matching probability.
- the second matching probability is the local The matching probability of the grid and the grid in the grid map; the processing module 1302 is further configured to determine the orientation angle of the device to be located according to the second matching probability.
- the processing module 1302 is further configured to predict the orientation angle of the device to be positioned at the second moment according to the orientation angle of the device to be positioned at the third moment and the motion parameters of the device to be positioned.
- the acquiring module 1301 is specifically configured to acquire the second matching probabilities of multiple rotation angles corresponding to the local grid when the local grid is located at the position of the device to be positioned, among the multiple rotation angles , the included angle between each rotation angle and the predicted orientation angle of the device to be positioned at the second moment is less than or equal to the first angle.
- the obtaining module 1301 is specifically configured to obtain the first rotation angle according to the attribute information of the grid in the local grid corresponding to the first rotation angle and the attribute information of the grid in the grid map
- the second matching probability corresponding to each attribute information of , and the first rotation angle is any one of the multiple rotation angles.
- the obtaining module 1301 is specifically configured to obtain the position of each second grid in the local grid when the local grid is located at the position of the device to be positioned and the local grid is rotated by the first rotation angle.
- the first attribute information of the grid, the second deviation between the first attribute information of the first grid corresponding to the second grid, the first attribute information of the second grid is any of the attribute information of the second grid
- a piece of attribute information, the first attribute information of the first grid is the same as the attribute of the first attribute information of the second grid
- the acquisition module 1301 is also specifically configured to acquire the first attribute information of the first rotation angle according to the second deviation The corresponding second matching probability.
- the processing module 1302 is specifically configured to determine the orientation angle information corresponding to each type of attribute information according to the second matching probability corresponding to each type of attribute information of each rotation angle; the processing module 1302 is also specifically configured to It is used to weight and sum the orientation angle information corresponding to each attribute information to obtain the orientation angle of the device to be positioned.
- the acquiring module 1301 is specifically configured to acquire point cloud information corresponding to the first environment, and the point cloud information corresponding to the first environment is used to indicate the position of the midpoint of the point cloud corresponding to the first environment The information; acquisition module 1301 is specifically configured to acquire the grid map corresponding to the first environment according to the point cloud information corresponding to the first environment.
- the information of the point cloud corresponding to the first environment is further used to indicate the reflection intensity of the points in the point cloud corresponding to the first environment.
- the obtaining module 1301 is specifically configured to obtain point cloud information corresponding to the second environment, and the point cloud information corresponding to the second environment is used to indicate the position of the point cloud corresponding to the second environment
- the information; obtaining module 1301 is also specifically configured to obtain the local grid corresponding to the second environment according to the point cloud information corresponding to the second environment.
- the point cloud information corresponding to the second environment is further used to indicate the reflection intensity of the points in the point cloud corresponding to the second environment.
- FIG. 3 When used to realize the functions of the above positioning device, other functions that can be realized by the positioning device 130 can be referred to the embodiment shown in FIG. 3 , the embodiment shown in FIG. 5 , the embodiment shown in FIG. 8 , and the embodiment shown in FIG. 10
- FIG. 11 The illustrated embodiment or the related introduction of the embodiment shown in FIG. 11 will not be described in detail.
- the positioning device 130 can take the form shown in FIG. 2 .
- the processor 201 in FIG. 2 may invoke the computer-executed instructions stored in the memory 203, so that the positioning device 130 executes the methods described in the foregoing method embodiments.
- the functions/implementation process of the acquisition module 1301 and the processing module 1302 in FIG. 13 may be implemented by the processor 201 in FIG. 2 invoking computer-executed instructions stored in the memory 203 .
- one or more of the above modules or units may be implemented by software, hardware or a combination of both.
- the software exists in the form of computer program instructions and is stored in the memory, and the processor can be used to execute the program instructions and realize the above method flow.
- the processor can be built into a SoC (system on a chip) or ASIC, or it can be an independent semiconductor chip.
- the core of the processor is used to execute software instructions for calculation or processing, and can further include necessary hardware accelerators, such as field programmable gate array (field programmable gate array, FPGA), PLD (programmable logic device) , or a logic circuit that implements a dedicated logic operation.
- the hardware can be CPU, microprocessor, digital signal processing (digital signal processing, DSP) chip, microcontroller unit (microcontroller unit, MCU), artificial intelligence processor, ASIC, Any one or any combination of SoC, FPGA, PLD, dedicated digital circuit, hardware accelerator or non-integrated discrete device, which can run necessary software or not depend on software to execute the above method flow.
- DSP digital signal processing
- MCU microcontroller unit
- ASIC artificial intelligence processor
- an embodiment of the present application further provides a chip system, including: at least one processor and an interface, the at least one processor is coupled to the memory through the interface, and when the at least one processor executes the computer program or instruction in the memory When, the method in any one of the above method embodiments is executed.
- the chip system further includes a memory.
- the system-on-a-chip may consist of a chip, or may include a chip and other discrete devices, which is not specifically limited in this embodiment of the present application.
- the embodiment of the present application further provides a computer-readable storage medium. All or part of the processes in the above method embodiments can be completed by computer programs to instruct related hardware, and the program can be stored in the above computer-readable storage medium. When the program is executed, it can include the processes of the above method embodiments .
- the computer-readable storage medium may be an internal storage unit of the positioning device in any of the foregoing embodiments, such as a hard disk or memory of the positioning device.
- the above-mentioned computer-readable storage medium may also be an external storage device of the above-mentioned positioning device, such as a plug-in hard disk equipped on the above-mentioned positioning device, a smart memory card (smart media card, SMC), a secure digital (secure digital, SD) card, Flash card (flash card), etc. Further, the above-mentioned computer-readable storage medium may also include both an internal storage unit of the above-mentioned positioning device and an external storage device.
- the above-mentioned computer-readable storage medium is used to store the above-mentioned computer program and other programs and data required by the above-mentioned positioning device.
- the computer-readable storage medium described above can also be used to temporarily store data that has been output or will be output.
- the embodiment of the present application further provides a computer program product. All or part of the processes in the above method embodiments can be completed by computer programs instructing related hardware, and the programs can be stored in the above computer program products. When the programs are executed, they can include the processes of the above method embodiments.
- An optional embodiment of the present application further provides a computer instruction. All or part of the procedures in the above method embodiments may be completed by computer instructions to instruct related hardware (such as computers, processors, access network devices, mobility management network elements or session management network elements, etc.).
- the program may be stored in the above-mentioned computer-readable storage medium or in the above-mentioned computer program product.
- the disclosed devices and methods may be implemented in other ways.
- the device embodiments described above are only illustrative.
- the division of the modules or units is only a logical function division. In actual implementation, there may be other division methods.
- multiple units or components can be Incorporation or may be integrated into another device, or some features may be omitted, or not implemented.
- the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.
- the unit described as a separate component may or may not be physically separated, and the component displayed as a unit may be one physical unit or multiple physical units, that is, it may be located in one place, or may be distributed to multiple different places . Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
- each functional unit in each embodiment of the present application may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit.
- the above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.
Landscapes
- Engineering & Computer Science (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Aviation & Aerospace Engineering (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Computer Networks & Wireless Communication (AREA)
- Electromagnetism (AREA)
- Navigation (AREA)
Abstract
Description
| 位置1 | 位置2 | 位置3 | 位置4 | |
| 方法1 | 58.9% | 76.2% | 56.3% | 67.1% |
| 方法2 | 68.1% | 86.3% | 66.8% | 85% |
| 方法4 | 92.0% | 93.9% | 91.3% | 94.2% |
Claims (38)
- 一种定位方法,其特征在于,所述方法包括:获取第一环境对应的栅格地图,所述栅格地图包括多个第一栅格,所述第一栅格包括多个点、所述多个点的位置信息和所述第一栅格的属性信息,所述第一栅格的属性信息包括所述第一栅格的语义信息和所述第一栅格的高度信息,所述第一栅格的语义信息用于指示所述第一栅格表示多种物体中的每种物体的概率,所述第一栅格的高度信息用于指示所述第一栅格包括的点的高度;获取第二环境对应的局部栅格,所述第二环境包括在所述第一环境中,所述局部栅格包括至少一个第二栅格,所述第二栅格包括多个点和所述第二栅格的属性信息,所述第二栅格的属性信息包括所述第二栅格的语义信息和所述第二栅格的高度信息,所述第二栅格的语义信息用于指示所述第二栅格表示多种物体中的每种物体的概率,所述第二栅格的高度信息用于指示所述第二栅格包括的点的高度;获取第一匹配概率,所述第一匹配概率为所述局部栅格位于所述栅格地图中的不同位置时,所述局部栅格与所述栅格地图中的栅格的匹配概率;根据所述第一匹配概率确定待定位装置的位置,所述待定位装置位于所述第二环境中。
- 根据权利要求1所述的方法,其特征在于,所述第一栅格的属性信息还包括所述第一栅格的反射强度信息,所述第一栅格的反射强度信息用于指示所述第一栅格包括的点的反射强度;所述第二栅格的属性信息还包括所述第二栅格的反射强度信息,所述第二栅格的反射强度信息用于指示所述第二栅格包括的点的反射强度。
- 根据权利要求1或2所述的方法,其特征在于,所述方法还包括:根据所述待定位装置在第一时刻的位姿信息和所述待定位装置的运动参数,预测所述待定位装置在第二时刻的位置对应的第一区域。
- 根据权利要求3所述的方法,其特征在于,所述获取第一匹配概率,包括:获取所述局部栅格位于所述第一区域中的栅格时,所述局部栅格与所述栅格地图中的栅格的第一匹配概率。
- 根据权利要求4所述的方法,其特征在于,所述获取所述局部栅格位于所述第一区域中的栅格时,所述局部栅格与所述栅格地图中的栅格的第一匹配概率,包括:根据所述局部栅格中的栅格的属性信息和所述第一区域中的栅格的属性信息,获取第一区域中第一栅格的每种属性信息对应的第一匹配概率。
- 根据权利要求5所述的方法,其特征在于,根据所述局部栅格中的栅格的属性信息和所述第一区域中的栅格的属性信息,获取第一区域中第一栅格的第一属性信息对应的第一匹配概率,包括:获取所述局部栅格位于所述第一区域中的第一栅格的情况下,所述局部栅格中的第二栅格的第一属性信息与所述第二栅格对应的第一栅格的第一属性信息之间的第一偏差,所述第二栅格的第一属性信息为所述第二栅格的属性信息中的任意一个属性信息,所述第一栅格的第一属性信息与所述第二栅格的第一属性信息的属性相同;根据所述第一偏差,获取所述第一区域中的第一栅格的第一属性信息对应的第一 匹配概率。
- 根据权利要求5或6所述的方法,其特征在于,所述根据所述第一匹配概率确定待定位装置的位置,包括:根据所述第一区域中第一栅格的每种属性信息对应的第一匹配概率,确定每种属性信息对应的位置信息;根据所述每种属性信息对应的位置信息,确定所述待定位装置的位置。
- 根据权利要求7所述的方法,其特征在于,所述根据所述第一匹配概率确定所述待定位装置的位置,还包括:在所述每种属性信息对应的位置信息中确定符合预设规则的至少一种属性信息对应的位置信息;所述根据所述每种属性信息对应的位置信息,确定所述待定位装置的位置,包括:若所述至少一种属性信息的数量大于1,则对所述至少一种属性信息对应的位置信息加权求和,得到所述待定位装置的位置;或者,若所述至少一种属性信息的数量等于1,则将所述至少一种属性信息对应的位置信息确定为所述待定位装置的位置。
- 根据权利要求1-8中任一项所述的方法,其特征在于,所述方法还包括:获取第二匹配概率,所述第二匹配概率为在所述局部栅格位于所述待定位装置的位置,并且所述局部栅格旋转不同角度的情况下,所述局部栅格与所述栅格地图中的栅格的匹配概率;根据所述第二匹配概率确定所述待定位装置的朝向角。
- 根据权利要求9所述的方法,其特征在于,所述方法还包括:根据所述待定位装置在第三时刻的朝向角和所述待定位装置的运动参数,预测所述待定位装置在第二时刻的朝向角。
- 根据权利要求10所述的方法,其特征在于,所述获取所述第二匹配概率,包括:获取所述局部栅格位于所述待定位装置的位置的情况下,所述局部栅格对应的多个旋转角的第二匹配概率,所述多个旋转角中,每个旋转角与所述预测所述待定位装置在第二时刻的朝向角之间的夹角小于或等于第一角度。
- 根据权利要求11所述的方法,其特征在于,获取所述局部栅格位于所述待定位装置的位置的情况下,第一旋转角的第二匹配概率,包括:根据所述第一旋转角对应的局部栅格中的栅格的属性信息和所述栅格地图中的栅格的属性信息,获取所述第一旋转角的每种属性信息对应的第二匹配概率,所述第一旋转角为所述多个旋转角中的任意一个旋转角。
- 根据权利要求12所述的方法,其特征在于,根据所述第一旋转角对应的局部栅格中的栅格的属性信息和所述栅格地图中的栅格的属性信息,获取所述第一旋转角的第一属性信息对应的第二匹配概率,包括:获取所述局部栅格位于所述待定位装置的位置,并且所述局部栅格旋转第一旋转角的情况下,所述局部栅格中的每个第二栅格的第一属性信息,与所述第二栅格对应的第一栅格的第一属性信息之间的第二偏差,所述第二栅格的第一属性信息为所述第 二栅格的属性信息中的任意一个属性信息,所述第一栅格的第一属性信息与所述第二栅格的第一属性信息的属性相同;根据所述第二偏差,获取所述第一旋转角的第一属性信息对应的第二匹配概率。
- 根据权利要求12或13所述的方法,其特征在于,所述根据所述第二匹配概率确定待定位装置的朝向角,包括:根据每个旋转角的每种属性信息对应的第二匹配概率,确定每种属性信息对应的朝向角信息;对所述每种属性信息对应的朝向角信息加权求和,得到所述待定位装置的朝向角。
- 根据权利要求1-14中任一项所述的方法,其特征在于,所述获取第一环境对应的栅格地图,包括:获取所述第一环境对应的点云的信息,所述第一环境对应的点云的信息用于指示所述第一环境对应的点云中点的位置信息;根据所述第一环境对应的点云的信息,获取所述第一环境对应的栅格地图。
- 根据权利要求15所述的方法,其特征在于,所述第一环境对应的点云的信息还用于指示所述第一环境对应的点云中点的反射强度。
- 根据权利要求1-16中任一项所述的方法,其特征在于,所述获取第二环境对应的局部栅格,包括:获取所述第二环境对应的点云的信息,所述第二环境对应的点云的信息用于指示所述第二环境对应的点云中点的位置信息;根据所述第二环境对应的点云的信息,获取所述第二环境对应的局部栅格。
- 根据权利要求17所述的方法,其特征在于,所述第二环境对应的点云的信息还用于指示所述第二环境对应的点云中点的反射强度。
- 一种定位装置,其特征在于,所述装置包括:获取模块和处理模块;所述获取模块,用于获取第一环境对应的栅格地图,所述栅格地图包括多个第一栅格,所述第一栅格包括多个点、所述多个点的位置信息和所述第一栅格的属性信息,所述第一栅格的属性信息包括所述第一栅格的语义信息和所述第一栅格的高度信息,所述第一栅格的语义信息用于指示所述第一栅格表示多种物体中的每种物体的概率,所述第一栅格的高度信息用于指示所述第一栅格包括的点的高度;所述获取模块,还用于获取第二环境对应的局部栅格,所述第二环境包括在所述第一环境中,所述局部栅格包括至少一个第二栅格,所述第二栅格包括多个点和所述第二栅格的属性信息,所述第二栅格的属性信息包括所述第二栅格的语义信息和所述第二栅格的高度信息,所述第二栅格的语义信息用于指示所述第二栅格表示多种物体中的每种物体的概率,所述第二栅格的高度信息用于指示所述第二栅格包括的点的高度;所述获取模块,还用于获取第一匹配概率,所述第一匹配概率为所述局部栅格位于所述栅格地图中的不同位置时,所述局部栅格与所述栅格地图中的栅格的匹配概率;所述处理模块,用于根据所述第一匹配概率确定待定位装置的位置,所述待定位装置位于所述第二环境中。
- 根据权利要求19所述的定位装置,其特征在于,所述第一栅格的属性信息还包括所述第一栅格的反射强度信息,所述第一栅格的反射强度信息用于指示所述第一栅格包括的点的反射强度;所述第二栅格的属性信息还包括所述第二栅格的反射强度信息,所述第二栅格的反射强度信息用于指示所述第二栅格包括的点的反射强度。
- 根据权利要求19或20所述的定位装置,其特征在于,所述处理模块,还用于根据所述待定位装置在第一时刻的位姿信息和所述待定位装置的运动参数,预测所述待定位装置在第二时刻的位置对应的第一区域。
- 根据权利要求21所述的定位装置,其特征在于,所述获取模块,具体用于获取所述局部栅格位于所述第一区域中的栅格时,所述局部栅格与所述栅格地图中的栅格的第一匹配概率。
- 根据权利要求22所述的定位装置,其特征在于,所述获取模块,具体用于根据所述局部栅格中的栅格的属性信息和所述第一区域中的栅格的属性信息,获取第一区域中第一栅格的每种属性信息对应的第一匹配概率。
- 根据权利要求23所述的定位装置,其特征在于,所述获取模块,具体用于获取所述局部栅格位于所述第一区域中的第一栅格的情况下,所述局部栅格中的第二栅格的第一属性信息与所述第二栅格对应的第一栅格的第一属性信息之间的第一偏差,所述第二栅格的第一属性信息为所述第二栅格的属性信息中的任意一个属性信息,所述第一栅格的第一属性信息与所述第二栅格的第一属性信息的属性相同;所述获取模块,还具体用于根据所述第一偏差,获取所述第一区域中的第一栅格的第一属性信息对应的第一匹配概率。
- 根据权利要求23或24所述的定位装置,其特征在于,所述处理模块,具体用于根据所述第一区域中第一栅格的每种属性信息对应的第一匹配概率,确定每种属性信息对应的位置信息;所述处理模块,还具体用于根据所述每种属性信息对应的位置信息,确定所述待定位装置的位置。
- 根据权利要求25所述的定位装置,其特征在于,所述处理模块,还具体用于在所述每种属性信息对应的位置信息中确定符合预设规则的至少一种属性信息对应的位置信息;所述处理模块,还具体用于若所述至少一种属性信息的数量大于1,则对所述至少一种属性信息对应的位置信息加权求和,得到所述待定位装置的位置;或者,若所述至少一种属性信息的数量等于1,则将所述至少一种属性信息对应的位置信息确定为所述待定位装置的位置。
- 根据权利要求19-26中任一项所述的定位装置,其特征在于,所述获取模块,还用于获取第二匹配概率,所述第二匹配概率为在所述局部栅格位于所述待定位装置的位置,并且所述局部栅格旋转不同角度的情况下,所述局部栅格与所述栅格地图中的栅格的匹配概率;所述处理模块,还用于根据所述第二匹配概率确定所述待定位装置的朝向角。
- 根据权利要求27所述的定位装置,其特征在于,所述处理模块,还用于根据所述待定位装置在第三时刻的朝向角和所述待定位装置的运动参数,预测所述待定位装置在第二时刻的朝向角。
- 根据权利要求28所述的定位装置,其特征在于,所述获取模块,具体用于获取所述局部栅格位于所述待定位装置的位置的情况下,所述局部栅格对应的多个旋转角的第二匹配概率,所述多个旋转角中,每个旋转角与所述预测所述待定位装置在第二时刻的朝向角之间的夹角小于或等于第一角度。
- 根据权利要求29所述的定位装置,其特征在于,所述获取模块,具体用于根据所述第一旋转角对应的局部栅格中的栅格的属性信息和所述栅格地图中的栅格的属性信息,获取所述第一旋转角的每种属性信息对应的第二匹配概率,所述第一旋转角为所述多个旋转角中的任意一个旋转角。
- 根据权利要求30所述的定位装置,其特征在于,所述获取模块,具体用于获取所述局部栅格位于所述待定位装置的位置,并且所述局部栅格旋转第一旋转角的情况下,所述局部栅格中的每个第二栅格的第一属性信息,与所述第二栅格对应的第一栅格的第一属性信息之间的第二偏差,所述第二栅格的第一属性信息为所述第二栅格的属性信息中的任意一个属性信息,所述第一栅格的第一属性信息与所述第二栅格的第一属性信息的属性相同;所述获取模块,还具体用于根据所述第二偏差,获取所述第一旋转角的第一属性信息对应的第二匹配概率。
- 根据权利要求30或31所述的定位装置,其特征在于,所述处理模块,具体用于根据每个旋转角的每种属性信息对应的第二匹配概率,确定每种属性信息对应的朝向角信息;所述处理模块,还具体用于对所述每种属性信息对应的朝向角信息加权求和,得到所述待定位装置的朝向角。
- 根据权利要求19-32中任一项所述的定位装置,其特征在于,所述获取模块,具体用于获取所述第一环境对应的点云的信息,所述第一环境对应的点云的信息用于指示所述第一环境对应的点云中点的位置信息;所述获取模块,具体用于根据所述第一环境对应的点云的信息,获取所述第一环境对应的栅格地图。
- 根据权利要求33所述的定位装置,其特征在于,所述第一环境对应的点云的信息还用于指示所述第一环境对应的点云中点的反射强度。
- 根据权利要求19-34中任一项所述的定位装置,其特征在于,所述获取模块,具体用于获取所述第二环境对应的点云的信息,所述第二环境对应的点云的信息用于指示所述第二环境对应的点云中点的位置信息;所述获取模块,还具体用于根据所述第二环境对应的点云的信息,获取所述第二环境对应的局部栅格。
- 根据权利要求35所述的定位装置,其特征在于,所述第二环境对应的点云的信息还用于指示所述第二环境对应的点云中点的反射强度。
- 一种定位装置,其特征在于,包括:处理器,所述处理器与存储器耦合,所述存储器用于存储程序或指令,当所述程序或指令被所述处理器执行时,使得所述装 置执行如权利要求1至18中任一项所述的方法。
- 一种计算机可读存储介质,其上存储有计算机程序或指令,其特征在于,所述计算机程序或指令被执行时使得计算机执行如权利要求1至18中任一项所述的方法。
Priority Applications (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP21960322.2A EP4404018A4 (en) | 2021-10-15 | 2021-10-15 | POSITIONING METHOD AND DEVICE |
| CN202180103257.8A CN118119907A (zh) | 2021-10-15 | 2021-10-15 | 定位方法及装置 |
| PCT/CN2021/124206 WO2023060592A1 (zh) | 2021-10-15 | 2021-10-15 | 定位方法及装置 |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2021/124206 WO2023060592A1 (zh) | 2021-10-15 | 2021-10-15 | 定位方法及装置 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2023060592A1 true WO2023060592A1 (zh) | 2023-04-20 |
Family
ID=85987245
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2021/124206 Ceased WO2023060592A1 (zh) | 2021-10-15 | 2021-10-15 | 定位方法及装置 |
Country Status (3)
| Country | Link |
|---|---|
| EP (1) | EP4404018A4 (zh) |
| CN (1) | CN118119907A (zh) |
| WO (1) | WO2023060592A1 (zh) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2026048529A (ja) * | 2024-09-05 | 2026-03-17 | 京セラ株式会社 | 電子機器、電子機器の制御方法、及びプログラム |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109781119A (zh) * | 2017-11-15 | 2019-05-21 | 百度在线网络技术(北京)有限公司 | 一种激光点云定位方法和系统 |
| US20190232487A1 (en) * | 2018-02-01 | 2019-08-01 | Robert Bosch Gmbh | Method for tracking multiple target objects, device, and computer program for implementing the tracking of multiple target objects for the case of moving objects |
| CN110221616A (zh) * | 2019-06-25 | 2019-09-10 | 清华大学苏州汽车研究院(吴江) | 一种地图生成的方法、装置、设备及介质 |
| CN110967011A (zh) * | 2019-12-25 | 2020-04-07 | 苏州智加科技有限公司 | 一种定位方法、装置、设备及存储介质 |
| CN112836698A (zh) * | 2020-12-31 | 2021-05-25 | 北京纵目安驰智能科技有限公司 | 一种定位方法、装置、存储介质及电子设备 |
| CN112867977A (zh) * | 2021-01-13 | 2021-05-28 | 华为技术有限公司 | 一种定位方法、装置和车辆 |
| CN113011517A (zh) * | 2021-03-30 | 2021-06-22 | 上海商汤临港智能科技有限公司 | 定位结果检测方法、装置、电子设备及存储介质 |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111174777A (zh) * | 2018-11-09 | 2020-05-19 | 阿里巴巴集团控股有限公司 | 定位方法、装置以及电子设备 |
-
2021
- 2021-10-15 WO PCT/CN2021/124206 patent/WO2023060592A1/zh not_active Ceased
- 2021-10-15 EP EP21960322.2A patent/EP4404018A4/en active Pending
- 2021-10-15 CN CN202180103257.8A patent/CN118119907A/zh active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109781119A (zh) * | 2017-11-15 | 2019-05-21 | 百度在线网络技术(北京)有限公司 | 一种激光点云定位方法和系统 |
| US20190232487A1 (en) * | 2018-02-01 | 2019-08-01 | Robert Bosch Gmbh | Method for tracking multiple target objects, device, and computer program for implementing the tracking of multiple target objects for the case of moving objects |
| CN110221616A (zh) * | 2019-06-25 | 2019-09-10 | 清华大学苏州汽车研究院(吴江) | 一种地图生成的方法、装置、设备及介质 |
| CN110967011A (zh) * | 2019-12-25 | 2020-04-07 | 苏州智加科技有限公司 | 一种定位方法、装置、设备及存储介质 |
| CN112836698A (zh) * | 2020-12-31 | 2021-05-25 | 北京纵目安驰智能科技有限公司 | 一种定位方法、装置、存储介质及电子设备 |
| CN112867977A (zh) * | 2021-01-13 | 2021-05-28 | 华为技术有限公司 | 一种定位方法、装置和车辆 |
| CN113011517A (zh) * | 2021-03-30 | 2021-06-22 | 上海商汤临港智能科技有限公司 | 定位结果检测方法、装置、电子设备及存储介质 |
Also Published As
| Publication number | Publication date |
|---|---|
| EP4404018A1 (en) | 2024-07-24 |
| EP4404018A4 (en) | 2024-11-27 |
| CN118119907A (zh) | 2024-05-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11530924B2 (en) | Apparatus and method for updating high definition map for autonomous driving | |
| AU2024219514A1 (en) | Computer vision systems and methods for detecting and modeling features of structures in images | |
| CN113587933A (zh) | 一种基于分支定界算法的室内移动机器人定位方法 | |
| CN114485698B (zh) | 一种交叉路口引导线生成方法及系统 | |
| Liu et al. | Real-time 6d lidar slam in large scale natural terrains for ugv | |
| CN113310488A (zh) | 一种基于slam的果园机器人导航方法 | |
| US11004332B2 (en) | Cooperative mapping for autonomous vehicles, robots or multi-agent systems | |
| CN113838203B (zh) | 基于三维点云地图和二维栅格地图的导航系统及应用方法 | |
| US20240427019A1 (en) | Visual mapping method, and computer program recorded on recording medium for executing method therefor | |
| US20240426987A1 (en) | Method for calibration of multiple lidars, and computer program recorded on record-medium for executing method therefor | |
| US20250224252A1 (en) | System and method for generating multi-resolution voxel spaces | |
| CN110031825B (zh) | 激光定位初始化方法 | |
| CN120993920B (zh) | 一种复杂场景中的轮式机器人可通过性预测方法及系统 | |
| Rachman | 3d-lidar multi object tracking for autonomous driving | |
| Wang et al. | Map-enhanced ego-lane detection in the missing feature scenarios | |
| WO2024230403A1 (zh) | Agv位姿确定方法和装置、及存储介质 | |
| CN115060268B (zh) | 一种机房融合定位方法、系统、设备及存储介质 | |
| CN114966736A (zh) | 一种基于点云数据进行目标速度预测的处理方法 | |
| Wu et al. | A non-rigid hierarchical discrete grid structure and its application to UAVs conflict detection and path planning | |
| CN116858269A (zh) | 基于激光slam的烟草行业成品库平库盘点机器人路径优化方法 | |
| CN119478465A (zh) | 位姿估计方法、计算机设备及存储介质 | |
| CN114049362A (zh) | 一种基于transformer的点云实例分割方法 | |
| WO2024036984A1 (zh) | 目标定位方法及相关系统、存储介质 | |
| EP4404018A1 (en) | Positioning method and device | |
| CN116311114A (zh) | 一种可行驶区域生成方法、装置、电子设备及存储介质 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21960322 Country of ref document: EP Kind code of ref document: A1 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 202180103257.8 Country of ref document: CN |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2021960322 Country of ref document: EP |
|
| ENP | Entry into the national phase |
Ref document number: 2021960322 Country of ref document: EP Effective date: 20240419 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |







