Please wait a minute...
浙江大学学报(工学版)  2026, Vol. 60 Issue (10): 2176-2185    DOI: 10.3785/j.issn.1008-973X.2026.10.010
计算机技术与控制工程     
基于上下文增强与多目标语义感知的电力缺陷检测算法
胡欣1(),阎希玥1,常娅姝1,程鸿亮2,肖剑2,*(),罗诗伟3,马亮3
1. 长安大学 能源与电气工程学院,陕西 西安 710018
2. 长安大学 电子与控制工程学院,陕西 西安 710064
3. 陕西核昌机电装备有限公司,陕西 咸阳 712000
Context-enhanced multi-target semantic perception algorithm for power defect detection
Xin HU1(),Xiyue YAN1,Yashu CHANG1,Hongliang CHENG2,Jian XIAO2,*(),Shiwei LUO3,Liang MA3
1. School of Energy and Electrical Engineering, Chang’an University, Xi’an 710018, China
2. School of Electronic and Control Engineering, Chang’an University, Xi’an 710064, China
3. Shaanxi Hechang Electromechanical Equipment Co. Ltd, Xianyang 712000, China
 全文: PDF(3207 KB)   HTML
摘要:

为了提升复杂变电站巡检场景下多类别电力缺陷的检测精度,构建电力缺陷巡检数据集Electric_Data,并基于RT-DETR框架提出基于上下文信息增强与多目标语义感知的PDD-SPCIE算法. 设计LDDM-ResNet网络,通过多核并行卷积提取高低频细节特征;设计DA-Encoder模块,通过可变形注意力和动态采样增强多尺度、形态不规则目标的特征表达;设计LGCA模块,通过空洞卷积和空间深度转换卷积实现全局-局部特征融合. 上述模块分别从特征表达、上下文建模与特征融合3方面对原框架进行改进,增强了模型对多类别缺陷的统一检测能力. 实验结果表明,该模型在自建数据集上的精确度、召回率和mAP50分别为0.819、0.681和0.704,在VOC数据集上的精确度、召回率和mAP50分别为0.719、0.642和0.712.

关键词: 变电站电力缺陷巡检深度学习DETR目标检测算法上下文信息增强多目标语义感知    
Abstract:

The Electric_Data inspection dataset was constructed, and a PDD-SPCIE algorithm based on context information enhancement and multi-target semantic perception was proposed within the RT-DETR framework, in order to improve the detection accuracy of multi-category power defects in complex substation inspection scenarios. The LDDM-ResNet module was designed to extract high- and low-frequency detailed features through multi-kernel parallel convolution. The DA-Encoder module was constructed to enhance the representation of multi-scale and irregularly shaped targets by incorporating deformable attention and dynamic sampling. The LGCA module was introduced to fuse global and local features using atrous convolution and spatial depth transformation convolution. The original framework was improved from the aspects of feature representation, context modeling, and feature fusion, thus enhancing the unified detection ability for multiple defect categories. Experimental results showed that the proposed model achieved a precision of 0.819, a recall of 0.681, and an mAP50 of 0.704 on the self-built dataset, and a precision of 0.719, a recall of 0.642, and an mAP50 of 0.712 on the VOC dataset.

Key words: substation power defect inspection    deep learning    DETR object detection algorithm    context information enhancement    multi-target semantic perception
收稿日期: 2025-08-26 出版日期: 2026-07-28
CLC:  TM 721  
基金资助: 陕西省秦创原“科学家+工程师”队伍建设项目(2024QCY-KXJ-161);咸阳市重大科技创新专项(人工智能)(L2025-ZDKJ-ZDGG-RGZN-005).
通讯作者: 肖剑     E-mail: huxin@chd.edu.cn;xiaojian@chd.edu.cn
作者简介: 胡欣(1975—),女,教授,博士,从事智慧巡检、人工智能和多模态数据融合研究. orcid.org/0009-0006-2066-5490. E-mail:huxin@chd.edu.cn
服务  
把本文推荐给朋友
加入引用管理器
E-mail Alert
作者相关文章  
胡欣
阎希玥
常娅姝
程鸿亮
肖剑
罗诗伟
马亮

引用本文:

胡欣,阎希玥,常娅姝,程鸿亮,肖剑,罗诗伟,马亮. 基于上下文增强与多目标语义感知的电力缺陷检测算法[J]. 浙江大学学报(工学版), 2026, 60(10): 2176-2185.

Xin HU,Xiyue YAN,Yashu CHANG,Hongliang CHENG,Jian XIAO,Shiwei LUO,Liang MA. Context-enhanced multi-target semantic perception algorithm for power defect detection. Journal of ZheJiang University (Engineering Science), 2026, 60(10): 2176-2185.

链接本文:

https://www.zjujournals.com/eng/CN/10.3785/j.issn.1008-973X.2026.10.010        https://www.zjujournals.com/eng/CN/Y2026/V60/I10/2176

属性类别样本类别具体缺陷类型NrawNfinal
电力设备缺陷正样本表计破损236471
正样本表盘模糊遮挡330495
正样本表盘外壳生锈244488
正样本绝缘子龟裂或断裂50482
正样本绝缘子破损161482
正样本绝缘子污闪40495
正样本绝缘子自爆221581
正样本硅胶变色500500
正样本硅胶体破损85505
正样本箱门闭合异常178524
正样本盖板破损或缺失268536
正样本鸟巢503503
正样本挂空悬浮物432512
正样本油污541541
非电力设备缺陷正样本未穿工装96480
正样本未戴安全帽73493
正样本吸烟120514
正常状态负样本表计正常3721116
负样本绝缘子正常5512204
负样本呼吸器正常462924
负样本箱门和盖板正常357714
负样本变电站环境正常4551365
负样本人员行为正常307921
表 1  Electric_Data数据集缺陷类型及样本分布
图 1  LDDM-ResNet模型框架
图 2  高低频卷积模块结构图
图 3  DA-Encoder模块流程示意图
图 4  LGCA模块结构示意图
图 5  PDD-SPCIE算法整体框架
名称实验配置
操作系统Ubuntu 22.04.5 LTS
编程语言Python 3.8
深度学习框架PyTorch 1.13.4
CPUIntel? Core? i7-10700 CPU
GPUNVIDIA GeForce RTX 3090×2
CUDA11.6
平台Pycharm 2022
表 2  实验环境配置
数据集$ \alpha $PRmAP50mAP50-95
VOC00.6710.5680.5960.451
0.1250.7030.5700.6110.466
0.2500.7010.5780.6160.466
0.5000.6970.5730.6150.464
0.7500.6850.5690.6010.456
Electric_Data00.8160.6600.6910.393
0.1250.8140.6930.7010.389
0.2500.8560.6950.7040.395
0.5000.8110.6660.7060.395
0.7500.8270.6660.6910.386
表 3  高低频卷积模块通道占比取值实验
数据集卷积核组合PRmAP50mAP50-95
VOC(3, 3, 3, 3)0.6950.5690.6150.465
(3, 5, 7, 9)0.7010.5780.6160.466
(3, 5, 7, 11)0.6880.5780.6150.467
(3, 5, 5, 7)0.6890.5670.6050.457
(5, 7, 9, 11)0.6770.5570.5930.447
Electric_Data(3, 3, 3, 3)0.8190.6830.7020.391
(3, 5, 7, 9)0.8560.6760.7030.399
(3, 5, 7, 11)0.8280.6750.6940.390
(3, 5, 5, 7)0.8210.6830.7010.395
(5, 7, 9, 11)0.8050.6750.6970.398
表 4  LDDM-ResNet多核卷积组合参数实验
数据集膨胀率PRmAP50mAP50-95
VOC1、2、30.7020.5750.6280.482
2、3、40.6910.5730.6140.471
1、3、50.6930.5810.6270.478
2、4、60.6920.5860.6220.475
Electric_Data1、2、30.8060.6890.7050.393
2、3、40.7810.6670.680.383
1、3、50.7960.6660.6790.384
2、4、60.8010.6750.6910.386
表 5  LGCA模块空洞卷积膨胀率参数实验
算法
类型
PRmAP50mAP50-95FLOPs/
109
Parameters/
106
FPS/
(帧·s?1)
RT-DETR0.6960.5710.6870.379103.532.010108.695
LDDM-
ResNet
0.8310.6610.7030.39164.524.850144.927
DA-
Encoder
0.7880.6530.7000.386114.944.200131.578
LGCA0.8030.670.6700.37257.219.897149.253
PDD-
SPCIE
0.8190.6810.7040.395122.749.170112.359
表 6  Electric_Data数据集上的消融实验结果
算法PRmAP50mAP50-95FLOPs/
109
Parameters/
106
FPS/
(帧·s?1)
YOLOv6(l)0.6570.5790.6280.484391.2110.80070.422
YOLOv8(l)0.7050.6550.7060.526164.943.62253.763
RT-DETR0.6960.5710.6070.449114.944.220116.279
YOLOv9(c)0.7150.6260.6920.53778.725.850163.930
YOLOv10(l)0.6670.6000.6480.501282.3103.70079.365
PDD-SPCIE0.7190.6420.7120.538122.749.10078.740
表 7  网络模型对比实验
模型PRmAP50mAP50-95
先进骨干
网络
StartNet0.6820.5480.5870.438
Efficient Formerv20.6380.5280.5580.412
HGnetV20.6960.5690.6070.449
Ghost HGNetV20.6760.5650.6000.446
PKINet0.6320.5260.5580.414
c2f-PKI0.6870.5410.5910.448
LDDM-ResNet0.7010.5780.6160.466
先进注意力
机制
Efficient Additive0.6890.5490.6050.457
Cascaded Group0.6790.5640.6150.468
HilO0.6890.5490.6010.460
LPE0.6900.5580.6060.466
DA-Encoder0.6870.5750.6160.474
先进下采样
模块
CG-Down0.6650.5920.6130.470
HSFPN0.6760.5760.6080.459
HSPAN0.6590.5380.5760.438
Waveletpool0.5840.4630.4850.364
slimneck0.6860.5680.6010.451
LGCA0.7020.5750.6280.482
表 8  核心模块与其他主流方法对比
图 6  可视化效果对比
1 李鹏, 刘念, 胡秦然, 等 “新型电力系统数字化关键技术综述”专辑评述[J]. 电力系统自动化, 2024, 48 (6): 1- 12
LI Peng, LIU Nian, HU Qinran, et al Commentary on special issue of reviews on key technologies for digitalization of new power system[J]. Automation of Electric Power Systems, 2024, 48 (6): 1- 12
doi: 10.7500/AEPS20240201001
2 李运堂, 李恒杰, 张坤, 等 基于新型编码解码网络的复杂输电线识别[J]. 浙江大学学报: 工学版, 2024, 58 (6): 1133- 1141
LI Yuntang, LI Hengjie, ZHANG Kun, et al Recognition of complex power lines based on novel encoder-decoder network[J]. Journal of Zhejiang University: Engineering Science, 2024, 58 (6): 1133- 1141
3 周远翔, 陈健宁, 赵亮, 等 电力设备数智化发展历程与大语言模型智能体应用展望[J]. 高电压技术, 2025, 51 (8): 4089- 4109
ZHOU Yuanxiang, CHEN Jianning, ZHAO Liang, et al Evolution of digitization and intelligence of power equipment and prospects for application of large language model based agent[J]. High Voltage Engineering, 2025, 51 (8): 4089- 4109
4 刘传洋, 吴一全 基于深度学习的输电线路视觉检测方法研究进展[J]. 中国电机工程学报, 2023, 43 (19): 7423- 7445
LIU Chuanyang, WU Yiquan Research progress of vision detection methods based on deep learning for transmission lines[J]. Proceedings of the CSEE, 2023, 43 (19): 7423- 7445
doi: 10.13334/j.0258-8013.pcsee.221139
5 GIRSHICK R. Fast R-CNN [C]// Proceedings of the IEEE International Conference on Computer Vision. Santiago: IEEE, 2016: 1440–1448.
6 LIU W, ANGUELOV D, ERHAN D, et al. SSD: single shot MultiBox detector [C]// Computer Vision – ECCV 2016. Cham: Springer, 2016: 21–37.
7 REDMON J, DIVVALA S, GIRSHICK R, et al. You only look once: unified, real-time object detection [C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas: IEEE, 2016: 779–788.
8 VASWANI A, SHAZEER N, PARMAR N, et al. Attention is all you need [C]// Advances in Neural Information Processing Systems 30. Long Beach: Curran Associates, 2017: 5998−6008.
9 CARION N, MASSA F, SYNNAEVE G, et al. End-to-end object detection with transformers [C]// Computer Vision – ECCV 2020. Cham: Springer, 2020: 213–229.
10 ZHU X, SU W, LU L, et al. Deformable DETR: deformable transformers for end-to-end object detection [EB/OL]. [ 2025−07−01]. https://arxiv.org/abs/2010.04159.
11 ZHAO Y, LV W, XU S, et al. DETRs beat YOLOs on real-time object detection [C]// Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Seattle: IEEE, 2024: 16965–16974.
12 ZHANG Q, ZHANG J, LI Y, et al ID-YOLO: a multimodule optimized algorithm for insulator defect detection in power transmission lines[J]. IEEE Transactions on Instrumentation and Measurement, 2025, 74: 3505611
doi: 10.1109/tim.2025.3527530
13 HOEFLER M A, MUELLER K, SAMEK W. XAI-guided insulator anomaly detection for imbalanced datasets [C]// Computer Vision – ECCV 2024 Workshops. Cham: Springer, 2025: 65–81.
14 LIU Z, LIN Y, CAO Y, et al. Swin transformer: hierarchical vision transformer using shifted windows [C]// Proceedings of the IEEE/CVF International Conference on Computer Vision. Montreal: IEEE, 2022: 9992–10002.
15 LIU Z, MAO H, WU C Y, et al. A ConvNet for the 2020s [C]// Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. New Orleans: IEEE, 2022: 11966–11976.
16 WU K, ZUO Y, GE J, et al. Insulator defect detection in power grids based on improved YOLOv8 [C]// Proceedings of the IEEE 26th China Conference on System Simulation Technology and its Applications. Shenzhen: IEEE, 2025: 540–545.
17 WOO S, PARK J, LEE J Y, et al. CBAM: convolutional block attention module [C]// Computer Vision – ECCV 2018. Cham: Springer, 2018: 3–19.
18 TANG S, ZHU R, JI C, et al. Intelligent detection of insulator defects on transmission lines in complex backgrounds based on improved DETR visual perception model [C]// Proceedings of the International Conference on Artificial Intelligence and Power Systems. Chengdu: IEEE, 2024: 83–89.
19 SINGH A, HU R, GOSWAMI V, et al. FLAVA: a foundational language and vision alignment model [C]// Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. New Orleans: IEEE, 2022: 15617–15629.
20 ZHANG K, YANG J, WANG J, et al VLF-DETR: integrating vision-language and high-frequency features for transmission line defect detection[J]. IEEE Transactions on Instrumentation and Measurement, 2025, 74: 5506115
doi: 10.1109/tim.2025.3586346
21 CHENG Y, LIU D AdIn-DETR: adapting detection transformer for end-to-end real-time power line insulator defect detection[J]. IEEE Transactions on Instrumentation and Measurement, 2024, 73: 3528511
22 BUSLAEV A, IGLOVIKOV V I, KHVEDCHENYA E, et al Albumentations: fast and flexible image augmentations[J]. Information, 2020, 11 (2): 125
doi: 10.3390/info11020125
23 CAI X, LAI Q, WANG Y, et al. Poly kernel inception network for remote sensing detection [C]// Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Seattle: IEEE, 2024: 27706–27716.
24 XIA Z, PAN X, SONG S, et al. Vision transformer with deformable attention [C]// Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. New Orleans: IEEE, 2022: 4784–4793.
25 WU T, TANG S, ZHANG R, et al CGNet: a light-weight context guided network for semantic segmentation[J]. IEEE Transactions on Image Processing, 2021, 30: 1169- 1179
doi: 10.1109/TIP.2020.3042065
[1] 杨恒,王韶涵,董青,赵科渊,杨明亮. 基于注意力增强的跨模态多层融合网络的物体位姿估计[J]. 浙江大学学报(工学版), 2026, 60(9): 1872-1880.
[2] 林洪彬,吕思进,王晨阳,蔡天放,骆鹏伟. 基于残差/梯度高斯自适应采样的径向基网络[J]. 浙江大学学报(工学版), 2026, 60(5): 1119-1127.
[3] 李子祥,陆克成,蔡海兵,解伟帅,张广东. 基于触觉仿生技术的黑暗环境混凝土裂缝检测[J]. 浙江大学学报(工学版), 2026, 60(5): 915-925.
[4] 吴杰,韩贝林,张舣航,邹超,辛莉峰,黄仕平. 微调稳定扩散模型的裂缝图像数据集扩充方法[J]. 浙江大学学报(工学版), 2026, 60(5): 926-934.
[5] 武晓春,郭宁. 基于HMARU-net的隧道渗漏水轻量化检测方法[J]. 浙江大学学报(工学版), 2026, 60(3): 468-477.
[6] 林乐平,李量,欧阳宁. 基于双偏振雷达的高时空分辨率临近降水预报[J]. 浙江大学学报(工学版), 2026, 60(3): 574-584.
[7] 杨明辉,宋牧原,付大喜,郭炎伟,卢贤锥,张文聪,郑伟龙. 基于多头自注意力-Bi-LSTM模型的盾构掘进引发的土体沉降预测[J]. 浙江大学学报(工学版), 2026, 60(2): 415-424.
[8] 朱志航,闫云凤,齐冬莲. 基于扩散模型多模态提示的电力人员行为图像生成[J]. 浙江大学学报(工学版), 2026, 60(1): 43-51.
[9] 孙月,张兴兰. 基于双重引导的目标对抗攻击方法[J]. 浙江大学学报(工学版), 2026, 60(1): 81-89.
[10] 段继忠,李海源. 基于变分模型和Transformer的多尺度并行磁共振成像重建[J]. 浙江大学学报(工学版), 2025, 59(9): 1826-1837.
[11] 王福建,张泽天,陈喜群,王殿海. 基于多通道图聚合注意力机制的共享单车借还量预测[J]. 浙江大学学报(工学版), 2025, 59(9): 1986-1995.
[12] 张弘,张学成,王国强,顾潘龙,江楠. 基于三维视觉的软体机器人实时定位与控制[J]. 浙江大学学报(工学版), 2025, 59(8): 1574-1582.
[13] 王圣举,张赞. 基于加速扩散模型的缺失值插补算法[J]. 浙江大学学报(工学版), 2025, 59(7): 1471-1480.
[14] 章东平,王大为,何数技,汤斯亮,刘志勇,刘中秋. 基于跨维度特征融合的航空发动机寿命预测[J]. 浙江大学学报(工学版), 2025, 59(7): 1504-1513.
[15] 蔡永青,韩成,权巍,陈兀迪. 基于注意力机制的视觉诱导晕动症评估模型[J]. 浙江大学学报(工学版), 2025, 59(6): 1110-1118.