CN111952883A - A transmission line fault identification system and method based on three-dimensional lidar - Google Patents

A transmission line fault identification system and method based on three-dimensional lidar Download PDF

Info

Publication number
CN111952883A
CN111952883A CN202010863796.9A CN202010863796A CN111952883A CN 111952883 A CN111952883 A CN 111952883A CN 202010863796 A CN202010863796 A CN 202010863796A CN 111952883 A CN111952883 A CN 111952883A
Authority
CN
China
Prior art keywords
transmission line
power transmission
aircraft
microcomputer
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010863796.9A
Other languages
Chinese (zh)
Other versions
CN111952883B (en
Inventor
彭炽刚
张英
范亚洲
刘高
李雄刚
汪勇
廖如超
廖建东
郭启迪
李国强
陈赟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Power Grid Co Ltd
Machine Inspection Center of Guangdong Power Grid Co Ltd
Original Assignee
Guangdong Power Grid Co Ltd
Machine Inspection Center of Guangdong Power Grid Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Power Grid Co Ltd, Machine Inspection Center of Guangdong Power Grid Co Ltd filed Critical Guangdong Power Grid Co Ltd
Priority to CN202010863796.9A priority Critical patent/CN111952883B/en
Publication of CN111952883A publication Critical patent/CN111952883A/en
Application granted granted Critical
Publication of CN111952883B publication Critical patent/CN111952883B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H02GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
    • H02GINSTALLATION OF ELECTRIC CABLES OR LINES, OR OF COMBINED OPTICAL AND ELECTRIC CABLES OR LINES
    • H02G1/00Methods or apparatus specially adapted for installing, maintaining, repairing or dismantling electric cables or lines
    • H02G1/02Methods or apparatus specially adapted for installing, maintaining, repairing or dismantling electric cables or lines for overhead lines or cables
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88Lidar systems specially adapted for specific applications
    • G01S17/89Lidar systems specially adapted for specific applications for mapping or imaging
    • G01S17/894Three-dimensional [3D] imaging with simultaneous measurement of time-of-flight at a two-dimensional [2D] array of receiver pixels, e.g. time-of-flight cameras or flash lidar
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/10Terrestrial scenes
    • G06V20/13Satellite images

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Remote Sensing (AREA)
  • Astronomy & Astrophysics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Electromagnetism (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)

Abstract

本发明公开了一种基于三维激光雷达的输电线路故障识别系统及方法,系统包括:飞行器,所述飞行器上设有双光相机、交换机与微型计算机;所述双光相机包括可见光摄像头与红外光摄像头;所述微型计算机,基于卷积神经网络算法,将所述输电线路的场景画面与红外热像图融合生成巡检图像,并基于深度学习训练算法,匹配所述巡检图像中的特征从而识别所述输电线路的导线,生成线路缺陷数据,同时,所述微型计算机用于生成与存储巡检报告,所述巡检报告包含所述线路缺陷数据。通过本发明使得能够自动对巡检图像中的特征进行识别并自动诊断缺陷,极大地提高工作效率。

Figure 202010863796

The invention discloses a three-dimensional laser radar-based transmission line fault identification system and method. The system includes: an aircraft, on which a dual-light camera, a switch and a microcomputer are arranged; the dual-light camera includes a visible light camera and an infrared light camera; the microcomputer, based on the convolutional neural network algorithm, fuses the scene picture of the transmission line with the infrared thermal image to generate an inspection image, and based on a deep learning training algorithm, matches the features in the inspection image to thereby Identify the wires of the transmission line, and generate line defect data, and at the same time, the microcomputer is used to generate and store an inspection report, and the inspection report includes the line defect data. The present invention enables automatic identification of features in inspection images and automatic diagnosis of defects, thereby greatly improving work efficiency.

Figure 202010863796

Description

一种基于三维激光雷达的输电线路故障识别系统及方法A transmission line fault identification system and method based on three-dimensional lidar

技术领域technical field

本发明涉及电力线路维护技术领域,尤其涉及一种输电线路故障识别系统及方法。The invention relates to the technical field of power line maintenance, and in particular, to a system and method for identifying faults in power transmission lines.

背景技术Background technique

当电力输电线路受到自然灾害和外力破坏的影响时,会造成不同程度的故障,若线路故障发生时没有得到及时处理,将造成短路、火灾、电力中断、通信中断等事故。线路巡检可以有效降低线路故障率,可以及时发现、及时解决输电线路的缺陷。采用飞行器对输电线路进行自主巡检作业已逐渐成为研究热点,飞行器搭载相机可以采集线路图片或视频用作后期故障识别处理,但随之而来的是每次自主巡检后会有大量的正常或带有缺陷的图片,需要人工筛选带有缺陷的图片,给工作人员增加了较重的工作量,同时,工作效率低下且容易出现因为人为疏忽所带来的失误。When the power transmission line is affected by natural disasters and external forces, it will cause different degrees of failure. If the line failure is not dealt with in time, it will cause short circuit, fire, power interruption, communication interruption and other accidents. Line inspection can effectively reduce the line failure rate, and can detect and solve the defects of the transmission line in time. The use of aircraft to conduct autonomous inspection of transmission lines has gradually become a research hotspot. The aircraft equipped with cameras can capture line pictures or videos for later fault identification and processing. However, after each autonomous inspection, there will be a large number of normal inspections. Or pictures with defects need to be manually screened for pictures with defects, which increases the workload of the staff. At the same time, the work efficiency is low and errors caused by human negligence are prone to occur.

同时,由于在现有技术中,通过相机拍摄输电线路,并产生照片,由于在自然环境下,其照片内的目标物体较多,难以分辨输电线路的导线,并对其导线进行识别缺陷,这就造成了误差较大,且工作效率较低的后果。At the same time, since in the prior art, the transmission line is photographed by a camera and a photo is generated, because there are many target objects in the photo in the natural environment, it is difficult to distinguish the wires of the transmission line and identify the defects of the wires. This results in larger errors and lower work efficiency.

另外,现有技术中,传输图像为线路传输方式,其导致图像传输速度比较低,且分别到达地面与飞行器处理模块的时间不同步,使得实时观测巡检图像与缺陷识别无法同步,导致了工作效率低下,给输电线路巡检与检修带来损失。In addition, in the prior art, the transmission of images is a line transmission method, which results in a relatively low transmission speed of the images, and the time of reaching the ground and the aircraft processing module is not synchronized, so that the real-time observation and inspection images and defect identification cannot be synchronized, resulting in work The efficiency is low, which brings losses to the inspection and maintenance of the transmission line.

发明内容SUMMARY OF THE INVENTION

本发明提供了一种基于三维激光雷达的输电线路故障识别系统及方法,通过算法技术融合拍摄的输电线路画面与对应热像图,并识别线路中的导线,判断其导线缺陷,用于解决工作人员工作量较重、工作效率低下以及失误率高的技术问题。The invention provides a transmission line fault identification system and method based on three-dimensional laser radar, which integrates the photographed transmission line picture and the corresponding thermal image through algorithm technology, identifies the wires in the line, judges the wire defects, and is used to solve the problem of work Technical problems with heavy workload, low work efficiency and high error rate.

由此本发明提供的一种基于三维激光雷达的输电线路故障识别系统,包括:飞行器,所述飞行器上设有双光相机、交换机与微型计算机;Therefore, a three-dimensional laser radar-based transmission line fault identification system provided by the present invention includes: an aircraft, and the aircraft is provided with a dual-light camera, a switch and a microcomputer;

所述双光相机包括可见光摄像头与红外光摄像头,所述可见光摄像头用于拍摄所述输电线路的场景画面,所述红外光摄像头用于通过感应所述输电线路的红外辐射能量从而获取所述输电线路的红外热像图;The dual-light camera includes a visible light camera and an infrared light camera, the visible light camera is used to capture the scene picture of the power transmission line, and the infrared light camera is used to obtain the power transmission line by sensing the infrared radiation energy of the power transmission line. Infrared thermal image of the line;

所述微型计算机,基于卷积神经网络算法,将所述输电线路的场景画面与红外热像图融合生成巡检图像,并基于深度学习训练算法,匹配所述巡检图像中的特征从而识别所述输电线路的导线,判断所述导线对应的温度是否超出预设温度阈值,当所述导线对应的温度超出预设温度阈值时,生成线路缺陷数据,同时,所述微型计算机用于生成与存储巡检报告,所述巡检报告包含所述线路缺陷数据;The microcomputer, based on the convolutional neural network algorithm, fuses the scene picture of the transmission line with the infrared thermal image to generate an inspection image, and based on a deep learning training algorithm, matches the features in the inspection image to identify the inspection image. The wire of the transmission line, judge whether the temperature corresponding to the wire exceeds the preset temperature threshold, and when the temperature corresponding to the wire exceeds the preset temperature threshold, generate line defect data, and at the same time, the microcomputer is used to generate and store. an inspection report, the inspection report includes the line defect data;

所述交换机,用于将所述双光相机分别与所述微型计算机和所述飞行器建立连接以实现同步数据交互。The switch is used to connect the dual-light camera with the microcomputer and the aircraft respectively to realize synchronous data exchange.

优选地,所述飞行器上设有用于获取所述飞行器的坐标点的RTK导航定位系统与用于存储机巡数据的数据管理模块;Preferably, the aircraft is provided with an RTK navigation and positioning system for acquiring coordinate points of the aircraft and a data management module for storing aircraft patrol data;

所述机巡数据包括所述输电线路中的杆塔的坐标点;The machine patrol data includes coordinate points of the tower in the transmission line;

所述微型计算机用于当所述导线对应的温度超出预设温度阈值后,基于所述RTK导航定位系统与所述机巡数据,分别获取对应所述飞行器当前坐标点与所述导线对应最近的两端杆塔的坐标点,从而计算所述导线的坐标点。The microcomputer is used to obtain, based on the RTK navigation and positioning system and the aircraft patrol data, the nearest coordinates corresponding to the current coordinate point of the aircraft and the wire when the temperature corresponding to the wire exceeds the preset temperature threshold. The coordinate points of the towers at both ends are calculated to calculate the coordinate points of the wire.

优选地,所述飞行器上还设有三维激光雷达、雷达驱动板与RS232通讯模块以及电源模块;Preferably, the aircraft is also provided with a three-dimensional laser radar, a radar driver board, an RS232 communication module, and a power supply module;

所述雷达驱动板,与所述三维激光雷达连接,用于驱动所述三维激光雷达工作;The radar driving board is connected to the three-dimensional laser radar, and is used to drive the three-dimensional laser radar to work;

所述三维激光雷达,用于探测与获取所述输电线路的点云数据;The three-dimensional lidar is used for detecting and acquiring point cloud data of the transmission line;

所述微型计算机通过所述RS232通讯模块与所述雷达驱动板通讯连接;The microcomputer is communicated and connected with the radar driver board through the RS232 communication module;

所述微型计算机,基于获取的所述输电线路的点云数据,计算所述输电线路的坐标点,同时,基于PID控制算法,通过对比所述输电线路的坐标点与所述飞行器的坐标点计算所述飞行器与所述输电线路之间的相对距离,并控制所述飞行器与所述输电线路之间的相对距离保持在预设距离范围内;The microcomputer calculates the coordinate points of the transmission line based on the acquired point cloud data of the transmission line, and at the same time, based on the PID control algorithm, calculates the coordinate points of the transmission line by comparing the coordinate points of the transmission line with the coordinate points of the aircraft. the relative distance between the aircraft and the power transmission line, and controlling the relative distance between the aircraft and the power transmission line to keep within a preset distance range;

所述电源模块,用于对所述三维激光雷达和所述微型计算机供电。The power module is used to supply power to the three-dimensional laser radar and the microcomputer.

优选地,还包括地面监控装置,所述地面监控装置与所述飞行器无线通讯连接,用于控制所述飞行器与获取所述飞行器数据。Preferably, a ground monitoring device is also included, the ground monitoring device is connected with the aircraft in wireless communication, and is used for controlling the aircraft and acquiring the data of the aircraft.

优选地,所述飞行器上设有传输天线;Preferably, a transmission antenna is provided on the aircraft;

所述传输天线与所述地面监控装置无线通讯连接,所述无线通讯连接的链路包括用于图像传输的2.4G无线通信链路与用于命令传输的5.8G无线通信链路。The transmission antenna is wirelessly connected to the ground monitoring device, and the wireless communication link includes a 2.4G wireless communication link for image transmission and a 5.8G wireless communication link for command transmission.

优选地,所述飞行器设有用于控制所述双光相机三维转动的三轴防抖云台。Preferably, the aircraft is provided with a three-axis anti-shake gimbal for controlling the three-dimensional rotation of the dual-light camera.

优选地,所述地面监控装置包括遥控器和显示设备;Preferably, the ground monitoring device includes a remote control and a display device;

所述双光相机设有图像流推流处理器,所述图像流推流处理器用于将所述输电线路的场景画面与红外热像图叠加渲染生成渲染图像以实现图像单线传输;The dual-light camera is provided with an image stream push processor, which is used for superimposing and rendering the scene picture of the transmission line and the infrared thermal image to generate a rendered image to realize single-line image transmission;

所述遥控器用于控制所述飞行器以及所述双光相机的工作状态;The remote controller is used to control the working state of the aircraft and the dual-light camera;

所述显示设备,用于接收并显示所述渲染图像。The display device is configured to receive and display the rendered image.

优选地,所述微型计算机包括缺陷管理模块、报告集模块与数据存储模块;Preferably, the microcomputer includes a defect management module, a report set module and a data storage module;

其中,所述缺陷管理模块,用于当所述微型计算机生成所述线路缺陷数据后,对所述线路缺陷数据筛选与分类,并将所述线路缺陷数据加入报告集;Wherein, the defect management module is configured to screen and classify the line defect data after the microcomputer generates the line defect data, and add the line defect data to a report set;

所述报告集模块,用于接收所述报告集,并生成巡检报告;The report set module is used to receive the report set and generate an inspection report;

所述数据存储模块用于存储所述线路缺陷数据、所述巡检报告与所述机巡数据。The data storage module is used for storing the line defect data, the inspection report and the machine inspection data.

另一方面,本发明还提供了一种基于三维激光雷达的输电线路故障识别方法,应用于上述的基于三维激光雷达的输电线路故障识别系统,包括:On the other hand, the present invention also provides a transmission line fault identification method based on three-dimensional laser radar, which is applied to the above-mentioned three-dimensional laser radar-based transmission line fault identification system, including:

步骤S101:通过地面监控装置控制飞行器飞至待巡检的输电线路作业现场;Step S101: control the aircraft to fly to the transmission line operation site to be inspected through the ground monitoring device;

步骤S102:通过双光相机进行拍摄所述输电线路,获取包含所述输电线路的场景画面与红外热像图;Step S102: photographing the power transmission line with a dual-light camera to obtain a scene image and an infrared thermal image including the power transmission line;

步骤S103:通过局域网向微型计算机与所述飞行器传输所述输电线路的场景画面与红外热像图;Step S103: transmitting the scene picture and the infrared thermal image of the power transmission line to the microcomputer and the aircraft through the local area network;

步骤S104:通过所述微型计算机基于卷积神经网络算法,将所述输电线路的场景画面与红外热像图融合生成巡检图像;Step S104: generating an inspection image by fusing the scene picture of the transmission line with the infrared thermal image based on the convolutional neural network algorithm by the microcomputer;

步骤S105:通过所述微型计算机基于深度学习训练算法,匹配所述巡检图像中的特征从而识别所述输电线路的导线,判断所述导线对应的温度是否超出预设温度阈值,当所述导线对应的温度超出预设温度阈值时,生成线路缺陷数据;Step S105: Through the microcomputer based on a deep learning training algorithm, the features in the inspection image are matched to identify the wires of the transmission line, and it is judged whether the temperature corresponding to the wires exceeds a preset temperature threshold. When the corresponding temperature exceeds the preset temperature threshold, line defect data is generated;

步骤S106:通过所述微型计算机生成与存储巡检报告,所述巡检报告包含所述线路缺陷数据。Step S106: Generate and store an inspection report by the microcomputer, where the inspection report includes the line defect data.

优选地,在所述步骤S101之后,所述步骤S102之前还包括步骤S201:Preferably, after the step S101, and before the step S102, the step S201 is further included:

通过三维激光雷达探测所述输电线路的点云数据,将所述输电线路的点云数据传输至所述微型计算机,通过所述微型计算机计算所述输电线路的坐标点,基于PID控制算法,控制所述飞行器与所述输电线路之间的相对距离保持在预设距离范围内。The point cloud data of the transmission line is detected by 3D lidar, the point cloud data of the transmission line is transmitted to the microcomputer, the coordinate points of the transmission line are calculated by the microcomputer, and based on the PID control algorithm, control The relative distance between the aircraft and the power transmission line is kept within a preset distance range.

从以上技术方案可以看出,本发明具有以下优点:As can be seen from the above technical solutions, the present invention has the following advantages:

本发明实施例提供了一种基于三维激光雷达的输电线路故障识别系统,包括:飞行器,所述飞行器上设有双光相机、交换机与微型计算机;所述双光相机包括可见光摄像头与红外光摄像头,所述可见光摄像头用于拍摄所述输电线路的场景画面,所述红外光摄像头用于通过感应所述输电线路的红外辐射能量从而获取所述输电线路的红外热像图;所述微型计算机,基于卷积神经网络算法,将所述输电线路的场景画面与红外热像图融合生成巡检图像,并基于深度学习训练算法,匹配所述巡检图像中的特征从而识别所述输电线路的导线,判断所述导线对应的温度是否超出预设温度阈值,当所述导线对应的温度超出预设温度阈值时,生成线路缺陷数据,同时,所述微型计算机用于生成与存储巡检报告,所述巡检报告包含所述线路缺陷数据;所述交换机,用于将所述双光相机分别与所述微型计算机和所述飞行器建立连接以实现同步数据交互。An embodiment of the present invention provides a three-dimensional laser radar-based transmission line fault identification system, including: an aircraft, on which a dual-light camera, a switch and a microcomputer are provided; the dual-light camera includes a visible light camera and an infrared light camera , the visible light camera is used for shooting the scene picture of the power transmission line, and the infrared light camera is used for acquiring the infrared thermal image of the power transmission line by sensing the infrared radiation energy of the power transmission line; the microcomputer, Based on the convolutional neural network algorithm, the scene picture of the transmission line and the infrared thermal image are fused to generate the inspection image, and based on the deep learning training algorithm, the features in the inspection image are matched to identify the wires of the transmission line , judging whether the temperature corresponding to the wire exceeds the preset temperature threshold, and when the temperature corresponding to the wire exceeds the preset temperature threshold, generate line defect data, and at the same time, the microcomputer is used to generate and store the inspection report. The inspection report includes the line defect data; the switch is used to connect the dual-light camera with the microcomputer and the aircraft respectively to realize synchronous data exchange.

本发明实施例基于卷积神经网络算法将双光相机获取输电线路的场景画面与热像图融合生成巡检图像,其可匹配巡检图像中的特征识别输电线路导线,使得无需分别对输电线路的场景画面与热像图进行特征识别与匹配,提高了工作效率,而通过判断导线对应的热像图获取的温度是否超出预设温度阈值(即预设的正常温度阈值),使得可以在飞行巡检过程中,实时识别导线缺陷,无需后续筛选识别,提高了工作效率,降低了工作人员工作量与失误率,同时,可以通过微型计算机实时存储巡检报告,压缩了地面后台存储空间,以及提高了工作效率,达到节省人力和时间成本的目的。In the embodiment of the present invention, based on the convolutional neural network algorithm, the scene image of the transmission line acquired by the dual-light camera and the thermal image are fused to generate an inspection image, which can match the features in the inspection image to identify the conductors of the transmission line, so that there is no need to separately analyze the transmission line. The scene picture and the thermal image are identified and matched to improve the work efficiency, and by judging whether the temperature obtained by the thermal image corresponding to the wire exceeds the preset temperature threshold (ie the preset normal temperature threshold), it can be used in flight. During the inspection process, the wire defects are identified in real time without subsequent screening and identification, which improves the work efficiency and reduces the workload and error rate of the staff. Improve work efficiency and achieve the purpose of saving manpower and time costs.

同时,本发明实施例在双光相机通过局域网分别连接飞行器与微型计算机,而飞行器与地面监控装置无线连接,使得双光相机拍摄到的巡检图像以广播的方式向飞行器与微型计算机传输,提高了传输速度,能够同步且方便地实时监控巡检过程与识别线路缺陷。At the same time, in the embodiment of the present invention, the dual-optical camera is respectively connected to the aircraft and the microcomputer through the local area network, and the aircraft is wirelessly connected to the ground monitoring device, so that the inspection images captured by the dual-optical camera are transmitted to the aircraft and the microcomputer in a broadcast manner, improving the The transmission speed is improved, and the inspection process can be monitored in real time and line defects can be identified synchronously and conveniently.

本发明提供的一种基于三维激光雷达的输电线路故障识别方法与上述系统有益效果一致,在此不再赘述。The three-dimensional laser radar-based transmission line fault identification method provided by the present invention is consistent with the beneficial effects of the above-mentioned system, and will not be repeated here.

附图说明Description of drawings

为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其它的附图。In order to explain the embodiments of the present invention or the technical solutions in the prior art more clearly, the following briefly introduces the accompanying drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can also be obtained based on these drawings without any creative effort.

图1为本发明一种基于三维激光雷达的输电线路故障识别系统及方法的实施例一的结构示意图;1 is a schematic structural diagram of Embodiment 1 of a three-dimensional laser radar-based transmission line fault identification system and method according to the present invention;

图2为本发明一种基于三维激光雷达的输电线路故障识别系统及方法的的实施例三的流程图。FIG. 2 is a flowchart of Embodiment 3 of a three-dimensional laser radar-based transmission line fault identification system and method of the present invention.

具体实施方式Detailed ways

为使得本发明的发明目的、特征、优点能够更加的明显和易懂,下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,下面所描述的实施例仅仅是本发明一部分实施例,而非全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其它实施例,都属于本发明保护的范围。In order to make the purpose, features and advantages of the present invention more obvious and understandable, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the following The described embodiments are only some, but not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

实施例一Example 1

本发明实施例一提供的一种基于三维激光雷达的输电线路故障识别系统,参考图1,该系统包括飞行器1与地面监控装置;Embodiment 1 of the present invention provides a three-dimensional laser radar-based transmission line fault identification system. Referring to FIG. 1 , the system includes an aircraft 1 and a ground monitoring device;

进一步地,飞行器1上设有双光相机2和电控箱,其中,电控箱包括微型计算机7,飞行器1采用四旋翼飞行器1,飞行器1底部设有第一安装架4,飞行器1顶部设有第二安装架5;Further, the aircraft 1 is provided with a dual-light camera 2 and an electric control box, wherein the electric control box includes a microcomputer 7, the aircraft 1 adopts a quadrotor aircraft 1, the bottom of the aircraft 1 is provided with a first mounting frame 4, and the top of the aircraft 1 is provided with There is a second mounting frame 5;

其中,双光相机2固定在第一安装架4上,双光相机2包括可见光摄像头与红外光摄像头,双光相机2在工作状态下,其可见光摄像头与红外光摄像头是同时工作的,以便后续直接显示可见光与红外光叠加渲染后的输电线路画面;The dual-light camera 2 is fixed on the first mounting frame 4, and the dual-light camera 2 includes a visible light camera and an infrared light camera. When the dual-light camera 2 is working, the visible light camera and the infrared light camera work at the same time, so that subsequent Directly display the transmission line screen after visible light and infrared light are superimposed and rendered;

其中,红外光摄像头用于通过感应输电线路的红外辐射能量从而获取输电线路的红外热像图,可见光摄像头用于拍摄输电线路的场景画面;Among them, the infrared light camera is used to obtain the infrared thermal image of the transmission line by inducing the infrared radiation energy of the transmission line, and the visible light camera is used to shoot the scene picture of the transmission line;

需要说明的是,红外光摄像头测温过程为:首先把输电线路中的导线辐射功率信号用红外摄像头转化为电信号,在输出电信号时,将红外温度图像输出至成像设备,本实施例中的双光相机2投射到成像设备上的图像是模拟输电线路导线的表面温度和空间位置,即可得到输电线路表面的红外热像图。It should be noted that the temperature measurement process of the infrared light camera is as follows: first, the radiated power signal of the wire in the transmission line is converted into an electrical signal by the infrared camera, and when the electrical signal is output, the infrared temperature image is output to the imaging device. In this embodiment The image projected by the dual-light camera 2 on the imaging device is to simulate the surface temperature and spatial position of the conductor of the transmission line, and an infrared thermal image of the surface of the transmission line can be obtained.

进一步地,飞行器1还设有交换机,用于提供局域网,双光相机2通过交换机分别与微型计算机7和飞行器1建立局域网连接以实现同步数据交互,使得双光相机2可以广播的方式传输图像数据,飞行器1与微型计算机7可以同时接收图像数据,以提高数据传输速度,能够同步实时监控巡检过程以及处理图像。Further, the aircraft 1 is also provided with a switch for providing a local area network, and the dual-light camera 2 establishes a local area network connection with the microcomputer 7 and the aircraft 1 respectively through the switch to realize synchronous data interaction, so that the dual-light camera 2 can transmit image data in a broadcast manner. , the aircraft 1 and the microcomputer 7 can receive image data at the same time, so as to improve the data transmission speed, and can synchronously monitor the inspection process in real time and process images.

进一步地,微型计算机7基于卷积神经网络算法,将获取的输电线路的场景画面与红外热像图融合生成巡检图像;Further, based on the convolutional neural network algorithm, the microcomputer 7 fuses the acquired scene picture of the transmission line with the infrared thermal image to generate an inspection image;

需要说明的是,卷积神经网络算法为现有技术,在此不再赘述;It should be noted that the convolutional neural network algorithm is the prior art, and will not be repeated here;

可以理解的是,将输电线路的场景画面与红外热像图融合生成巡检图像,有利于匹配导线与相应的温度,同时,只针对一幅巡检图像进行识别缺陷,大大提高了工作效率。It can be understood that the fusion of the scene picture of the transmission line and the infrared thermal image to generate the inspection image is conducive to matching the wire and the corresponding temperature. At the same time, only one inspection image is used to identify defects, which greatly improves the work efficiency.

进一步地,微型计算机7,基于深度学习训练算法,匹配巡检图像中的特征从而识别输电线路的导线,判断导线对应的温度是否超出预设温度阈值,当所述导线对应的温度超出预设温度阈值时,生成线路缺陷数据;Further, the microcomputer 7, based on the deep learning training algorithm, matches the features in the inspection image to identify the wires of the transmission line, and judges whether the temperature corresponding to the wires exceeds the preset temperature threshold, when the temperature corresponding to the wires exceeds the preset temperature. When the threshold is reached, line defect data is generated;

可以理解的是,由于巡检图像中的目标物过多,因此,通过建立深度学习训练模型,更好地识别输电线路的导线,并通过红外热像图中获取的温度,能够判断出导线对应的温度是否超出预设的正常温度阈值,如果超出,则说明导线存在缺陷;It is understandable that because there are too many targets in the inspection images, the wires of the transmission line can be better identified by establishing a deep learning training model, and the corresponding wires of the wires can be judged through the temperature obtained in the infrared thermal image. Whether the temperature exceeds the preset normal temperature threshold, if it exceeds, it means that the wire is defective;

进一步地,微型计算机7内置NVIDIA处理芯片,NVIDIA处理芯片用于封装深度学习训练算法。Further, the microcomputer 7 has a built-in NVIDIA processing chip, and the NVIDIA processing chip is used to package the deep learning training algorithm.

可以理解的是,在现有技术中,是采用算法系统进行深度学习训练算法,而这种算法系统需要在地面完成,而本实施例通过在微型计算机7中内置NVIDIA处理芯片,可以在飞行器1上直接通过深度学习训练算法实时识别巡检图像线路缺陷,提高了图像处理效率。It can be understood that, in the prior art, an algorithm system is used to perform deep learning training algorithms, and this algorithm system needs to be completed on the ground. In this embodiment, the NVIDIA processing chip is built in the microcomputer 7, which can be used in the aircraft 1. The inspection image line defects are identified in real time directly through the deep learning training algorithm, which improves the image processing efficiency.

进一步地,飞行器1上设有用于获取飞行器1的坐标点的RTK导航定位系统与用于存储机巡数据的数据管理模块;Further, the aircraft 1 is provided with an RTK navigation and positioning system for obtaining the coordinate points of the aircraft 1 and a data management module for storing aircraft patrol data;

其中,机巡数据包括输电线路中的杆塔的坐标点,其杆塔用于连接导线;Among them, the machine patrol data includes the coordinate points of the towers in the transmission line, and the towers are used to connect the wires;

进一步地,微型计算机7用于当导线对应的温度超出预设温度阈值后,基于RTK导航定位系统与机巡数据,分别获取对应飞行器1当前坐标点与导线对应最近的两端杆塔的坐标点,通过飞行器1当前坐标点与导线对应最近的两端杆塔的坐标点,从而实时计算温度超出预设温度阈值的对应导线的坐标点,进行快速精准定位,便于后续维修。Further, the microcomputer 7 is used to obtain, respectively, the current coordinate point of the corresponding aircraft 1 and the coordinate points of the nearest two ends of the tower corresponding to the wire based on the RTK navigation and positioning system and the aircraft patrol data after the temperature corresponding to the wire exceeds the preset temperature threshold, Through the current coordinate point of aircraft 1 and the coordinate points of the nearest towers at both ends of the wire, the coordinate points of the corresponding wire whose temperature exceeds the preset temperature threshold can be calculated in real time, and the fast and accurate positioning can be carried out, which is convenient for subsequent maintenance.

进一步地,地面监控装置与飞行器1无线通讯连接,用于控制飞行器1与获取飞行器数据;Further, the ground monitoring device is wirelessly connected to the aircraft 1 for controlling the aircraft 1 and acquiring aircraft data;

进一步地,飞行器1还设有传输天线,其与地面监控装置无线通讯连接,用于实现地面监控装置与飞行器1数据交互;同时,无线通讯连接的链路包括图像传输的2.4G无线通信链路与用于命令传输的5.8G无线通信链路。Further, the aircraft 1 is also provided with a transmission antenna, which is connected with the ground monitoring device for wireless communication, and is used to realize data interaction between the ground monitoring device and the aircraft 1; at the same time, the link of the wireless communication connection includes a 2.4G wireless communication link for image transmission. with 5.8G wireless communication link for command transmission.

进一步地,地面监控装置包括遥控器10和显示设备;Further, the ground monitoring device includes a remote controller 10 and a display device;

双光相机2设有图像流推流处理器,图像流推流处理器用于将所述输电线路的场景画面与红外热像图叠加渲染生成渲染图像以实现图像单线传输,以便于快速传输,提高工作效率;The dual-light camera 2 is provided with an image stream push processor. The image stream push processor is used to superimpose and render the scene picture of the transmission line and the infrared thermal image to generate a rendered image to realize single-line image transmission, so as to facilitate fast transmission and improve work efficiency;

遥控器10用于控制飞行器1以及双光相机2的工作状态,以保证飞行器1安全飞行且能够拍摄到清晰的输电线路画面,同时,遥控器10还控制双光相机2执行拍摄工作;The remote controller 10 is used to control the working state of the aircraft 1 and the dual-light camera 2, so as to ensure that the aircraft 1 flies safely and can capture a clear picture of the transmission line. At the same time, the remote controller 10 also controls the dual-light camera 2 to perform the shooting work;

显示设备,用于接收并显示渲染图像。A display device that receives and displays rendered images.

进一步地,飞行器1设有用于控制双光相机2三维转动的三轴防抖云台,同时,还可以防止双光相机2在转动过程中发生抖动情况,三轴防抖云台包括X轴、Y轴与Z轴;Further, the aircraft 1 is provided with a three-axis anti-shake gimbal for controlling the three-dimensional rotation of the dual-light camera 2. At the same time, it can also prevent the dual-light camera 2 from shaking during the rotation process. The three-axis anti-shake gimbal includes the X-axis, Y axis and Z axis;

其中,X轴用于控制双光相机2横向角度转动,Y轴用于控制双光相机2纵向角度转动,Z轴用于控制双光相机2偏向角度转动;Among them, the X axis is used to control the horizontal angle rotation of the dual-light camera 2, the Y axis is used to control the longitudinal angle rotation of the dual-light camera 2, and the Z axis is used to control the deflection angle rotation of the dual-light camera 2;

其中,三轴防抖云台包括分别设置在X轴、Y轴与Z轴上的云台电机,用于为相应角度转动提供动力;Among them, the three-axis anti-shake gimbal includes gimbal motors respectively arranged on the X axis, the Y axis and the Z axis, which are used to provide power for the corresponding angle rotation;

可以理解的是,在飞行器1飞行时,可以调整三轴防抖云台使得双光相机2拍摄输电线路画面。It can be understood that, when the aircraft 1 is flying, the three-axis anti-shake gimbal can be adjusted so that the dual-light camera 2 can take pictures of the transmission line.

进一步地,电控箱设置在第二安装架5上,电控箱包括雷达驱动板6、三维激光雷达3、RS232通讯模块8以及电源模块9;Further, the electric control box is arranged on the second mounting frame 5 , and the electric control box includes a radar drive board 6 , a three-dimensional laser radar 3 , an RS232 communication module 8 and a power supply module 9 ;

其中,雷达驱动板6与三维激光雷达3连接,用于驱动三维激光雷达3工作;Among them, the radar driving board 6 is connected with the three-dimensional laser radar 3, and is used to drive the three-dimensional laser radar 3 to work;

三维激光雷达3,用于探测与获取输电线路的点云数据,并将输电线路的点云数据传输至微型计算机7中;The three-dimensional lidar 3 is used to detect and obtain the point cloud data of the transmission line, and transmit the point cloud data of the transmission line to the microcomputer 7;

微型计算机7,基于获取的输电线路的点云数据,计算输电线路的坐标点,同时,基于PID控制算法,通过对比输电线路的坐标点与飞行器1的坐标点计算述飞行器1与输电线路之间的相对距离,并控制飞行器1与输电线路之间的相对距离保持在预设距离范围内,以实现飞行器1在巡航过程中保持安全距离以及能够让双光相机2拍摄到质量较好的巡检图像。The microcomputer 7 calculates the coordinate points of the transmission line based on the acquired point cloud data of the transmission line, and at the same time, based on the PID control algorithm, calculates the distance between the aircraft 1 and the transmission line by comparing the coordinate points of the transmission line and the coordinate point of the aircraft 1 and control the relative distance between the aircraft 1 and the power transmission line to keep within the preset distance range, so as to keep the aircraft 1 at a safe distance during the cruise and to allow the dual-light camera 2 to capture better quality inspections image.

需要说明的是,在本实施例中,预设距离范围为4-5米。It should be noted that, in this embodiment, the preset distance range is 4-5 meters.

进一步地,三维激光雷达3设有若干个激光发射端口,在本实施例中,激光发射端口为16个,可以同时发射16束激光,以用于测量飞行器1与输电线路之间的距离更加准确。Further, the three-dimensional lidar 3 is provided with several laser emission ports. In this embodiment, there are 16 laser emission ports, and 16 laser beams can be emitted at the same time, so as to measure the distance between the aircraft 1 and the transmission line more accurately. .

其中,三维激光雷达3设有用于激光360度扫描的中心轴,激光发射端口与中心轴相对转动。Among them, the three-dimensional laser radar 3 is provided with a central axis for 360-degree laser scanning, and the laser emission port rotates relative to the central axis.

其中,电源模块9分别与雷达驱动板6和微型计算机7电连接,用于对三维激光雷达3和微型计算机7供电。The power supply module 9 is electrically connected to the radar driving board 6 and the microcomputer 7 respectively, and is used for supplying power to the three-dimensional laser radar 3 and the microcomputer 7 .

实施例二Embodiment 2

本实施例二在实施例一的基础上,进一步地,微型计算机7包括缺陷管理模块、报告集模块与数据存储模块;In the second embodiment, on the basis of the first embodiment, the microcomputer 7 further includes a defect management module, a report set module and a data storage module;

其中,缺陷管理模块,用于当微型计算机生成线路缺陷数据后,对线路缺陷数据筛选与分类,并将线路缺陷数据加入报告集;Wherein, the defect management module is used to screen and classify the line defect data after the microcomputer generates the line defect data, and add the line defect data to the report set;

具体地,缺陷管理模块对巡检图像中所识别出的线路缺陷数据进行存储和记录位置信息,同时,可按照断股、散股、烧蚀等缺陷情况进行分类和筛选;Specifically, the defect management module stores and records the location information of the line defect data identified in the inspection image, and at the same time, can classify and filter according to defects such as broken strands, scattered strands, and ablation;

进一步地,报告集模块,用于接收报告集,查看报告集中的缺陷,生成巡检报告。Further, the report set module is used to receive the report set, view the defects in the report set, and generate an inspection report.

进一步地,数据管理模块,用于计算巡检图像中输电线路的弧垂值、输电线路相对其下方障碍物之间的相对距离已经对三维激光雷达3扫描范围内的作业环境建模;Further, the data management module is used to calculate the sag value of the transmission line in the inspection image, the relative distance between the transmission line and the obstacles below it, and the working environment within the scanning range of the 3D lidar 3 has been modeled;

具体地,RTK定位系统用于确定输电线路的导线坐标与海拔数据,再通过双光相机2结合采集输电线路中杆塔之间的输电导线下垂的曲度图像,可以将导线的坐标、海拔数据以及曲度图像传递给数据管理模块进行拟合计算弧垂值,以判断是否存在缺陷;Specifically, the RTK positioning system is used to determine the wire coordinates and altitude data of the transmission line, and then combined with the dual-optical camera 2 to collect the sagging curvature image of the transmission wire between the towers in the transmission line, the coordinates of the wire, the altitude data and the The curvature image is passed to the data management module for fitting and calculation of the sag value to determine whether there is a defect;

在本实施例中,三维激光雷达3还可以对周围障碍物进行扫描,从而获得输电线路与障碍物之间的净空距离,而在输电线路下方的障碍物(如树木)对于输电线路的威胁比较大,而通过三维激光雷达3可以实现净空距离测量,并传输至数据管理模块进行判断净空距离是否在合理范围内;In this embodiment, the three-dimensional lidar 3 can also scan the surrounding obstacles, so as to obtain the clearance distance between the transmission line and the obstacle, while the obstacles (such as trees) under the transmission line are more likely to threaten the transmission line The headroom distance measurement can be realized through the 3D lidar 3, and transmitted to the data management module to judge whether the headroom distance is within a reasonable range;

另外,三维激光雷达3通过扫描周围障碍物得到的点云数据、IMU惯导数据和RTK数据传输至数据管理模块中,可以进行解算建模,从而判断周围环境是否有对输电线路产生威胁。In addition, the 3D LiDAR 3 transmits the point cloud data, IMU inertial navigation data and RTK data obtained by scanning the surrounding obstacles to the data management module, which can be solved and modeled to determine whether the surrounding environment poses a threat to the transmission line.

进一步地,数据存储模块,用于存储机巡数据、线路缺陷数据、正常样本信息、缺陷样本信息和巡检报告。Further, the data storage module is used for storing machine inspection data, line defect data, normal sample information, defect sample information and inspection report.

本实施例可实现输电线路缺陷的快速分类、智能识别和自动生成报告,相比于传统的人力处理数据,大大地提高线路运行人员工作效率,大幅降低电网运营成本,并且克服了大量冗杂的数据处理和管理工作量大的困难。This embodiment can realize rapid classification, intelligent identification and automatic report generation of transmission line defects. Compared with traditional manual data processing, the work efficiency of line operators is greatly improved, the grid operation cost is greatly reduced, and a large amount of redundant data is overcome. Difficulty handling and managing a high workload.

实施例三Embodiment 3

本实施例三是在实施例一或实施例二的基础上,提供了一种基于三维激光雷达3的输电线路故障识别方法,参考图2,包括:The third embodiment provides a transmission line fault identification method based on the three-dimensional laser radar 3 on the basis of the first embodiment or the second embodiment. Referring to FIG. 2 , the method includes:

步骤S101:通过地面监控装置控制飞行器飞至待巡检的输电线路作业现场;Step S101: control the aircraft to fly to the transmission line operation site to be inspected through the ground monitoring device;

步骤S102:通过双光相机进行拍摄输电线路,获取包含输电线路的场景画面与红外热像图;Step S102: photographing the transmission line with a dual-light camera to obtain a scene image and an infrared thermal image including the transmission line;

步骤S103:通过局域网向微型计算机与飞行器传输输电线路的场景画面与红外热像图;Step S103: transmitting the scene picture and infrared thermal image of the transmission line to the microcomputer and the aircraft through the local area network;

步骤S104:通过微型计算机基于卷积神经网络算法,将输电线路的场景画面与红外热像图融合生成巡检图像;Step S104: generating an inspection image by fusing the scene picture of the transmission line with the infrared thermal image based on the convolutional neural network algorithm by the microcomputer;

步骤S105:通过微型计算机基于深度学习训练算法,匹配巡检图像中的特征从而识别输电线路的导线,判断导线对应的温度是否超出预设温度阈值,当导线对应的温度超出预设温度阈值时,生成线路缺陷数据;Step S105: Use a microcomputer based on a deep learning training algorithm to match the features in the inspection image to identify the wires of the transmission line, and determine whether the temperature corresponding to the wires exceeds the preset temperature threshold. When the temperature corresponding to the wires exceeds the preset temperature threshold, Generate line defect data;

步骤S106:通过微型计算机生成与存储巡检报告,巡检报告包含线路缺陷数据。Step S106: Generate and store an inspection report by the microcomputer, and the inspection report includes line defect data.

进一步地,在步骤S101之后,步骤S102之前还包括步骤S201:Further, after step S101 and before step S102, it also includes step S201:

通过三维激光雷达探测输电线路的点云数据,将输电线路的点云数据传输至微型计算机,通过微型计算机计算输电线路的坐标点,基于PID控制算法,控制飞行器与输电线路之间的相对距离保持在预设距离范围内。The point cloud data of the transmission line is detected by 3D lidar, and the point cloud data of the transmission line is transmitted to the microcomputer, and the coordinate points of the transmission line are calculated by the microcomputer, and the relative distance between the aircraft and the transmission line is controlled based on the PID control algorithm. within a preset distance.

可以理解的是,所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,上述描述的系统和模块的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。It can be understood that those skilled in the art can clearly understand that, for the convenience and brevity of the description, for the specific working process of the above-described systems and modules, reference may be made to the corresponding processes in the foregoing method embodiments, which will not be repeated here. .

在本申请所提供的几个实施例中,应该理解到,所揭露的系统,装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述模块的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个模块或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或模块的间接耦合或通信连接,可以是电性,机械或其它的形式。In the several embodiments provided in this application, it should be understood that the disclosed system, apparatus and method may be implemented in other manners. For example, the apparatus embodiments described above are only illustrative. For example, the division of the modules is only a logical function division. In actual implementation, there may be other division methods. For example, multiple modules or components may be combined or Can be integrated into another system, or some features can be ignored, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or modules, and may be in electrical, mechanical or other forms.

以上所述,以上实施例仅用以说明本发明的技术方案,而非对其限制;尽管参照前述实施例对本发明进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本发明各实施例技术方案的精神和范围。As mentioned above, the above embodiments are only used to illustrate the technical solutions of the present invention, but not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand: The technical solutions described in the embodiments are modified, or some technical features thereof are equivalently replaced; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions in the embodiments of the present invention.

Claims (10)

1. The utility model provides a transmission line fault identification system based on three-dimensional laser radar which characterized in that includes: the aircraft is provided with a double-optical camera, a switch and a microcomputer;
the double-optical camera comprises a visible light camera and an infrared camera, the visible light camera is used for shooting a scene picture of the power transmission line, and the infrared camera is used for acquiring an infrared thermal image of the power transmission line by sensing infrared radiation energy of the power transmission line;
the microcomputer is used for fusing a scene picture of the power transmission line with an infrared thermography to generate a routing inspection image based on a convolutional neural network algorithm, matching features in the routing inspection image based on a deep learning training algorithm to identify a lead of the power transmission line, judging whether the temperature corresponding to the lead exceeds a preset temperature threshold value, generating line defect data when the temperature corresponding to the lead exceeds the preset temperature threshold value, and meanwhile, the microcomputer is used for generating and storing a routing inspection report which comprises the line defect data;
the switch is used for establishing connection between the dual-optical camera and the microcomputer and the aircraft respectively so as to realize synchronous data interaction.
2. The three-dimensional lidar-based power transmission line fault identification system according to claim 1, wherein an RTK navigation positioning system for acquiring a coordinate point of the aircraft and a data management module for storing machine patrol data are provided on the aircraft;
the machine patrol data comprises coordinate points of towers in the power transmission line;
and the microcomputer is used for respectively acquiring coordinate points corresponding to the current coordinate point of the aircraft and the nearest two-end tower corresponding to the lead based on the RTK navigation positioning system and the machine patrol data after the temperature corresponding to the lead exceeds a preset temperature threshold value, so as to calculate the coordinate point of the lead.
3. The power transmission line fault identification system based on the three-dimensional laser radar as claimed in claim 2, wherein the aircraft is further provided with the three-dimensional laser radar, a radar driving plate, an RS232 communication module and a power supply module;
the radar driving board is connected with the three-dimensional laser radar and used for driving the three-dimensional laser radar to work;
the three-dimensional laser radar is used for detecting and acquiring point cloud data of the power transmission line;
the microcomputer is in communication connection with the radar driving board through the RS232 communication module;
the microcomputer calculates a coordinate point of the power transmission line based on the acquired point cloud data of the power transmission line, and simultaneously calculates a relative distance between the aircraft and the power transmission line by comparing the coordinate point of the power transmission line and the coordinate point of the aircraft based on a PID control algorithm, and controls the relative distance between the aircraft and the power transmission line to be kept within a preset distance range;
and the power supply module is used for supplying power to the three-dimensional laser radar and the microcomputer.
4. The three-dimensional lidar based power transmission line fault identification system of claim 1, further comprising a ground monitoring device in wireless communication with the aircraft for controlling the aircraft and obtaining the aircraft data.
5. The three-dimensional lidar based power transmission line fault identification system of claim 4, wherein a transmission antenna is provided on the aircraft;
the transmission antenna is in wireless communication connection with the ground monitoring device, and links in wireless communication connection comprise a 2.4G wireless communication link for image transmission and a 5.8G wireless communication link for command transmission.
6. The three-dimensional lidar based power transmission line fault identification system of claim 1, wherein the aerial vehicle is provided with a three-axis anti-shake pan-tilt for controlling the three-dimensional rotation of the dual-optical camera.
7. The three-dimensional lidar based power transmission line fault identification system of claim 5, wherein the ground monitoring apparatus comprises a remote controller and a display device;
the double-optical camera is provided with an image stream push flow processor, and the image stream push flow processor is used for superposing and rendering the scene picture of the power transmission line and the infrared thermography to generate a rendered image so as to realize single-line transmission of the image;
the remote controller is used for controlling the working states of the aircraft and the dual-light camera;
the display device is used for receiving and displaying the rendering image.
8. The system for identifying the fault of the power transmission line based on the three-dimensional laser radar as claimed in claim 2, wherein the microcomputer comprises a defect management module, a report set module and a data storage module;
the defect management module is used for screening and classifying the line defect data after the microcomputer generates the line defect data, and adding the line defect data into a report set;
the report set module is used for receiving the report set and generating a patrol report;
the data storage module is used for storing the line defect data, the routing inspection report and the machine routing inspection data.
9. A power transmission line fault identification method based on a three-dimensional laser radar is applied to the power transmission line fault identification system based on the three-dimensional laser radar in any one of claims 1 to 8, and is characterized by comprising the following steps:
step S101: controlling the aircraft to fly to a power transmission line operation site to be inspected through a ground monitoring device;
step S102: shooting the power transmission line through a double-optical camera to obtain a scene picture and an infrared thermal image containing the power transmission line;
step S103: transmitting the scene picture and the infrared thermal image of the power transmission line to a microcomputer and the aircraft through a local area network;
step S104: fusing the scene picture of the power transmission line and the infrared thermography to generate a patrol image based on a convolutional neural network algorithm through the microcomputer;
step S105: matching features in the inspection image based on a deep learning training algorithm through the microcomputer so as to identify a lead of the power transmission line, judging whether the temperature corresponding to the lead exceeds a preset temperature threshold value, and generating line defect data when the temperature corresponding to the lead exceeds the preset temperature threshold value;
step S106: generating and storing a patrol report by the microcomputer, the patrol report including the line defect data.
10. The method for identifying the transmission line fault based on the three-dimensional laser radar as claimed in claim 9, wherein after the step S101, before the step S102, the method further comprises the step S201:
the method comprises the steps of detecting point cloud data of the power transmission line through a three-dimensional laser radar, transmitting the point cloud data of the power transmission line to a microcomputer, calculating a coordinate point of the power transmission line through the microcomputer, and controlling the relative distance between the aircraft and the power transmission line to be kept within a preset distance range based on a PID control algorithm.
CN202010863796.9A 2020-08-25 2020-08-25 Power transmission line fault recognition system and method based on three-dimensional laser radar Active CN111952883B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010863796.9A CN111952883B (en) 2020-08-25 2020-08-25 Power transmission line fault recognition system and method based on three-dimensional laser radar

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010863796.9A CN111952883B (en) 2020-08-25 2020-08-25 Power transmission line fault recognition system and method based on three-dimensional laser radar

Publications (2)

Publication Number Publication Date
CN111952883A true CN111952883A (en) 2020-11-17
CN111952883B CN111952883B (en) 2022-03-29

Family

ID=73367509

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010863796.9A Active CN111952883B (en) 2020-08-25 2020-08-25 Power transmission line fault recognition system and method based on three-dimensional laser radar

Country Status (1)

Country Link
CN (1) CN111952883B (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113160150A (en) * 2021-04-01 2021-07-23 西安科技大学 AI (Artificial intelligence) detection method and device for invasion of foreign matters in wire network based on multi-type sample fusion and multi-complex network
CN113286129A (en) * 2021-07-23 2021-08-20 北京图知天下科技有限责任公司 Inspection method and system for photovoltaic power station
CN113591574A (en) * 2021-06-29 2021-11-02 山东信通电子股份有限公司 Power transmission line inspection method and device based on laser radar
CN113808081A (en) * 2021-08-16 2021-12-17 广西电网有限责任公司河池供电局 Transmission line small-size gold utensil defect detecting system
CN113872024A (en) * 2021-12-01 2021-12-31 中国工程物理研究院电子工程研究所 Intelligent Fault Diagnosis Method for Multi-source Physical Monitoring Quantity of Fiber Laser System
CN115616000A (en) * 2022-08-26 2023-01-17 华能澜沧江水电股份有限公司 A method and equipment for automatic inspection and intelligent detection of corrosion defects in flood discharge tunnels
CN115712124A (en) * 2022-09-27 2023-02-24 武汉海达数云技术有限公司 Laser radar-based power facility unmanned aerial vehicle and inspection method
CN116046677A (en) * 2023-01-09 2023-05-02 吕宁杰 Auxiliary equipment for aircraft maintenance and aircraft maintenance method

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101833099A (en) * 2010-05-25 2010-09-15 广州科易光电技术有限公司 Locked tracking method of helicopter in the inspection process of electric power circuits
US8275570B2 (en) * 2011-03-02 2012-09-25 Utility Risk Management Corporation, Llc Thermal powerline rating and clearance analysis using local thermal sensor
CN102941920A (en) * 2012-12-05 2013-02-27 南京理工大学 High-tension transmission line inspection robot based on multi-rotor aircraft and method using robot
CN107491781A (en) * 2017-07-21 2017-12-19 国家电网公司 A kind of crusing robot visible ray and infrared sensor data fusion method
CN108039680A (en) * 2017-11-13 2018-05-15 国网山东省电力公司荣成市供电公司 A kind of automatic cruising power circuit detection unmanned plane and its detection method
CN108037770A (en) * 2017-11-22 2018-05-15 国网山东省电力公司济宁供电公司 Unmanned plane power transmission line polling system and method based on artificial intelligence
CN109885083A (en) * 2019-03-06 2019-06-14 国网陕西省电力公司检修公司 Transmission line of electricity fining inspection flying platform and method for inspecting based on laser radar
CN110765948A (en) * 2019-10-24 2020-02-07 长沙品先信息技术有限公司 Target detection and identification method and system based on unmanned aerial vehicle

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101833099A (en) * 2010-05-25 2010-09-15 广州科易光电技术有限公司 Locked tracking method of helicopter in the inspection process of electric power circuits
US8275570B2 (en) * 2011-03-02 2012-09-25 Utility Risk Management Corporation, Llc Thermal powerline rating and clearance analysis using local thermal sensor
CN102941920A (en) * 2012-12-05 2013-02-27 南京理工大学 High-tension transmission line inspection robot based on multi-rotor aircraft and method using robot
CN107491781A (en) * 2017-07-21 2017-12-19 国家电网公司 A kind of crusing robot visible ray and infrared sensor data fusion method
CN108039680A (en) * 2017-11-13 2018-05-15 国网山东省电力公司荣成市供电公司 A kind of automatic cruising power circuit detection unmanned plane and its detection method
CN108037770A (en) * 2017-11-22 2018-05-15 国网山东省电力公司济宁供电公司 Unmanned plane power transmission line polling system and method based on artificial intelligence
CN109885083A (en) * 2019-03-06 2019-06-14 国网陕西省电力公司检修公司 Transmission line of electricity fining inspection flying platform and method for inspecting based on laser radar
CN110765948A (en) * 2019-10-24 2020-02-07 长沙品先信息技术有限公司 Target detection and identification method and system based on unmanned aerial vehicle

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113160150A (en) * 2021-04-01 2021-07-23 西安科技大学 AI (Artificial intelligence) detection method and device for invasion of foreign matters in wire network based on multi-type sample fusion and multi-complex network
CN113591574A (en) * 2021-06-29 2021-11-02 山东信通电子股份有限公司 Power transmission line inspection method and device based on laser radar
CN113591574B (en) * 2021-06-29 2024-02-27 山东信通电子股份有限公司 A method and device for inspection of transmission lines based on lidar
CN113286129A (en) * 2021-07-23 2021-08-20 北京图知天下科技有限责任公司 Inspection method and system for photovoltaic power station
CN113808081A (en) * 2021-08-16 2021-12-17 广西电网有限责任公司河池供电局 Transmission line small-size gold utensil defect detecting system
CN113872024A (en) * 2021-12-01 2021-12-31 中国工程物理研究院电子工程研究所 Intelligent Fault Diagnosis Method for Multi-source Physical Monitoring Quantity of Fiber Laser System
CN115616000A (en) * 2022-08-26 2023-01-17 华能澜沧江水电股份有限公司 A method and equipment for automatic inspection and intelligent detection of corrosion defects in flood discharge tunnels
CN115712124A (en) * 2022-09-27 2023-02-24 武汉海达数云技术有限公司 Laser radar-based power facility unmanned aerial vehicle and inspection method
CN116046677A (en) * 2023-01-09 2023-05-02 吕宁杰 Auxiliary equipment for aircraft maintenance and aircraft maintenance method

Also Published As

Publication number Publication date
CN111952883B (en) 2022-03-29

Similar Documents

Publication Publication Date Title
CN111952883A (en) A transmission line fault identification system and method based on three-dimensional lidar
US11017228B2 (en) Method and arrangement for condition monitoring of an installation with operating means
CN102914294B (en) System and method for measuring unmanned aerial vehicle electrical line patrol on basis of images
CN109961157B (en) Inspection method and system of solar photovoltaic power generation system
CN113850137B (en) A method, system and device for online monitoring of transmission line images
CN204304922U (en) A kind of photovoltaic module hot spot inspection device based on unmanned plane
CN111198004A (en) A UAV-based power inspection information collection system
CN104638562B (en) Helicopter in electric inspection process system and method
CN105700544A (en) UAV tour inspection system and implementation method for electrical equipment of photovoltaic power station
CN111311967A (en) UAV-based power line inspection system and method
CN112270267B (en) Camera shooting identification system capable of automatically capturing line faults
CN110888457A (en) System and method for carrying out three-dimensional inspection on power transformation equipment by using unmanned aerial vehicle and robot
CN112751414A (en) Transmission line inspection system and method based on 5G link
CN108255189A (en) A kind of power patrol unmanned machine system
CN115272888A (en) Digital twin-based 5G + unmanned aerial vehicle power transmission line inspection method and system
CN106323243A (en) Dam deformation observation early-warning system, method and device based on unmanned aerial vehicle
CN115793649A (en) Automatic cable trench inspection device and inspection method
KR101634937B1 (en) System for automatic vision inspection, method using the same
CN105866626A (en) Unmanned plane-mounted UV detection system for power transmission and transformation equipment
CN112067137A (en) An automatic temperature measurement method for power lines based on UAV line patrolling
CN114200958A (en) Automatic inspection system and method for photovoltaic power generation equipment
CN111244822B (en) Fixed-wing unmanned aerial vehicle line patrol method, system and device in complex geographic environment
CN115755946A (en) Power inspection method, device and system based on digital twinning
CN113031462A (en) Port machine inspection route planning system and method for unmanned aerial vehicle
CN204258162U (en) Helicopter in electric inspection process system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant