Please wait a minute...
Journal of ZheJiang University (Engineering Science)  2026, Vol. 60 Issue (7): 1416-1426    DOI: 10.3785/j.issn.1008-973X.2026.07.005
    
Real-time debris flow detection method combining fluid automatic annotation and lightweight YOLOv8n
Ping WANG1,2(),Anzhi XU1,Hongli ZHAO1,Xiaoyuan WEI1,Fulong YANG1
1. School of Microelectronics Industry-education Integration, Lanzhou University of Technology, Lanzhou 730050, China
2. Institute of Automation, Gansu Academy of Sciences, Lanzhou 730000, China
Download: HTML     PDF(5551KB) HTML
Export: BibTeX | EndNote (RIS)      

Abstract  

A novel detection framework integrating automatic fluid target annotation and a lightweight YOLOv8n model was proposed, aiming at addressing the challenges of low annotation efficiency and insufficient model adaptability in real-time debris flow monitoring. An open-source debris flow dataset of 8 064 images was built. This dataset was achieved using multi-scale dynamic capture frames, which leverage fluid motion continuity, along with adaptive frame extraction and an improved binary classification model. To enhance the extraction of dynamic debris flow features and improve the irregular boundary localization, the LGSA module and C2f_GhostNetV2 structure were developed. The Shape-IoU loss function was also introduced into the model architecture. Experimental results demonstrated that the proposed YOLOv8-Mudslide model achieved an mAP@0.5 of 86.7%, which was 4.7% higher than that of the baseline model, and the detection speed reached 230.89 frame/s. This case provides reliable technical support for the real-time monitoring of debris flow disasters, and its framework can be further extended to other intelligent detection fields of fluid targets.



Key wordsautomatic annotation      fluid target      object detection      debris flow      disaster early warning     
Received: 24 June 2025      Published: 23 May 2026
CLC:  TP 391.4  
Fund:  国家自然科学基金资助项目(62361039, 62001198, 62173170);中国博士后科学基金资助项目(2024MD763938);甘肃省青年科技基金资助项目(24JRRA1146);甘肃省联合科研基金资助项目(25JRRA1153, 24JRRA829).
Cite this article:

Ping WANG,Anzhi XU,Hongli ZHAO,Xiaoyuan WEI,Fulong YANG. Real-time debris flow detection method combining fluid automatic annotation and lightweight YOLOv8n. Journal of ZheJiang University (Engineering Science), 2026, 60(7): 1416-1426.

URL:

https://www.zjujournals.com/eng/10.3785/j.issn.1008-973X.2026.07.005     OR     https://www.zjujournals.com/eng/Y2026/V60/I7/1416


融合流体自动标注与轻量化YOLOv8n的泥石流实时检测方法

针对泥石流灾害实时检测中数据标注效率低和模型适应性不足问题,提出融合流体目标自动标注与轻量化YOLOv8n的泥石流检测框架. 基于流体运动连续的特性,设计多尺度动态采集框,通过自适应视频帧截取与改进的二分类筛选模型,构建包含8 064张图像的开源泥石流数据集. 在模型架构上,设计LGSA模块与C2f_GhostNetV2结构,并引入Shape-IoU损失函数,增强模型对泥石流动态特征的提取能力和不规则边界的定位精度. 实验结果表明,提出的YOLOv8-Mudslide模型的mAP@0.5指标达到86.7%,较基线模型提升了4.7%,检测速度达到230.89 帧/s,为泥石流灾害的实时监测提供了可靠的技术支持.


关键词: 自动标注,  流体目标,  目标检测,  泥石流,  灾害预警 
Fig.1 Comparison of different target tracking algorithms
Fig.2 Automatic annotation process of fluid targets
Fig.3 Data collection process
Fig.4 Classification of positive and negative samples
Fig.5 Structure of binary classification screening model
Fig.6 Positive sample extraction workflow
STFH
1100100[0,0.5)
2200300[0,0.6)
3300400[0,0.7)
4400500[0,0.8)
5500600[0,0.9)
Tab.1 Parameter settings for binary classification screening model
Fig.7 Network structure diagram of improved model
Fig.8 LGSA structure diagram
Fig.9 Structure diagrams of C2f network before and after improvement
Fig.10 Network structure diagram of GhostNetV2
Fig.11 Anchor box regression process at different positions
Fig.12 Relationship between anchor and GT
参数含义数值
FG_THRESH正样本IoU阈值[0.9,1.0]
BG_THRESH_LO负样本IoU阈值表1设定
NMS_THRESH非极大值抑制阈值0.9
BATCHSIZE图片目标批次大小256
NUM_SAMPLES总样本数量153 667
Tab.2 Default parameters settings
Fig.13 Results under different filtering conditions on same dataset
Fig.14 Results of partial annotation based on self- annotation method
注意力机制FLOPs/GParams/MmAP@0.5/%
YOLOv8n8.23.082.0
+CBAM8.33.082.7
+SE8.23.081.8
+SimAM8.23.081.3
+EMA8.33.082.5
+LGSA8.33.083.3
Tab.3 Results of comparison experiments with different attention mechanisms
LGSAC2f_GhostNetV2Shape-IoUmAP@0.5/%FLOPs/GParams/MFPS/(帧·s?1)
82.08.23.0223.63
83.38.33.0217.92
82.57.32.6231.41
85.88.33.0216.97
84.37.22.6235.68
86.77.32.6230.89
Tab.4 Results of ablation comparison experiment
Fig.15 Heatmaps of debris flow detection before and after model improvement
模型P/%R/%mAP@0.5/%Params/MFLOPs/GFPS/(帧·s?1)
Faster R-CNN73.582.884.05108.2163.828.28
SSD83.281.286.591.6135.245.65
YOLOv5n74.183.380.22.57.1233.51
YOLOv8n71.280.782.03.18.2223.63
YOLOv8m71.380.684.225.879.192.64
YOLOv10n73.382.382.52.36.7214.32
RefineDet[17]70.276.878.22610.256.27
RT-DETR-R18[18]78.381.483.819.856.9113.64
YOLOv8-Mudslide72.382.886.72.67.3230.89
Tab.5 Comparative experimental results of different models on same dataset
[12]   ZHANG Ye, XU Ting, FENG Dingzhong, et al Research on faster RCNN object detection based on hard example mining[J]. Journal of Electronics and Information Technology, 2019, 41 (6): 1496- 1502
[13]   TANG Y, HAN K, GUO J, et al GhostNetv2: Enhance cheap operation with long-range attention[J]. Advances in Neural Information Processing Systems, 2022, 35: 9969- 9982
[14]   HAN K, WANG Y, GUO J, et al. ParameterNet: Parameters are all you need for large-scale visual pretraining of mobile networks [C]// 2024 IEEE Conference on Computer Vision and Pattern Recognition. Seattle: IEEE, 2024: 15751–15761.
[15]   ZHANG H, ZHANG S. Shape-iou: more accurate metric considering bounding box shape and scale [EB/OL]. [2025-06-01]. https://arxiv.org/pdf/2312.17663.pdf.
[16]   CHEN B, LIU Y, ZHANG Z, et al Transattunet: multi-level attention-guided u-net with transformer for medical image segmentation[J]. IEEE Transactions on Emerging Topics in Computational Intelligence, 2023, 8 (1): 55- 68
[17]   ZHANG S, WEN L, BIAN X, et al. Single-shot refinement neural network for object detection [C]// 2018 IEEE Conference on Computer Vision and Pattern Recognition. Salt Lake City: IEEE, 2018: 4203–4212.
[1]   CABRAL V, REIS F, VELOSO V, et al The consequences of debris flows in Brazil: a historical analysis based on recorded events in the last 100 years[J]. Landslides, 2023, 20 (3): 511- 529
doi: 10.1007/s10346-022-01984-7
[2]   DU Y, LIU H, LI H, et al Exploring the initiating mechanism, monitoring equipment and warning indicators of gully-type debris flow for disaster reduction: a review[J]. Natural Hazards, 2024, 120 (15): 13667- 13692
doi: 10.1007/s11069-024-06742-7
[3]   PHAM M V, KIM Y T Debris flow detection and velocity estimation using deep convolutional neural network and image processing[J]. Landslides, 2022, 19 (10): 2473- 2488
doi: 10.1007/s10346-022-01931-6
[4]   何明杰, 刘德方, 张猛, 等 融合YOLOX和ASFF的高原山地灾害检测模型[J]. 防灾减灾工程学报, 2023, 43 (6): 1215- 1223
HE Mingjie, LIU Defang, ZHANG Meng, et al A plateau mountain disaster detection model by integrating YOLOX and ASFF[J]. Journal of Disaster Prevention and Mitigation Engineering, 2023, 43 (6): 1215- 1223
doi: 10.13409/j.cnki.jdpme.20230105002
[5]   张领先, 景嘉平, 李淑菲, 等 基于图像自动标注与改进YOLO v5的番茄病害识别系统[J]. 农业机械学报, 2023, 54 (11): 198- 207
[18]   ZHAO Y, LV W, XU S, et al. Detrs beat yolos on real-time object detection [C]// 2024 IEEE Conference on Computer Vision and Pattern Recognition. Seattle: IEEE, 2024: 16965–16974.
[5]   ZHANG Lingxian, JING Jiaping, LI Shufei, et al Tomato disease recognition system based on image automatic labeling and improved YOLOv5[J]. Transactions of the Chinese Society for Agricultural Machinery, 2023, 54 (11): 198- 207
[6]   陈庆林, 谷雨, 宋忠浩, 等 融合检测与跟踪的半自动视频目标标注[J]. 计算机工程与应用, 2021, 57 (14): 223- 230
CHEN Qinglin, GU Yu, SONG Zhonghao, et al Semi-automatic video target annotation by combining detection and tracking[J]. Computer Engineering and Applications, 2021, 57 (14): 223- 230
[7]   CUI B, CRÉPUT J C A systematic algorithm for moving object detection with application in real-time surveillance[J]. SN Computer Science, 2020, 1 (2): 106
doi: 10.1007/s42979-020-0118-5
[8]   KALAL Z, MIKOLAJCZYK K, MATAS J Tracking-learning-detection[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2011, 34 (7): 1409- 1422
[9]   YADAV S, PAYANDEH S Critical overview of visual tracking with kernel correlation filter[J]. Technologies, 2021, 9 (4): 93
doi: 10.3390/technologies9040093
[10]   OKOYE O C, BOLAJI B O. Physics of fluid motion [M]// Applications of Heat, Mass and Fluid Boundary Layers. Cambridge: Woodhead Publishing, 2020: 1–22.
[11]   HE K, ZHANG X, REN S, et al. Deep residual learning for image recognition [C]// 2016 IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas: IEEE, 2016: 770–778.
[1] Jian XIAO,Xinze HE,Hongliang CHENG,Xiaoyuan YANG,Xin HU. Aerial small target detection algorithm based on multi-scale feature enhancement[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(1): 19-31.
[2] Xiao’an BAO,Shuyou PENG,Na ZHANG,Xiaomei TU,Qingqi ZHANG,Biao WU. Object detection algorithm based on multi-azimuth perception deep fusion detection head[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(1): 32-42.
[3] Chaoqun DONG,Zhan WANG,Ping LIAO,Shuai XIE,Yujie RONG,Jingsong ZHOU. Lightweight YOLOv5s-OCG rail sleeper crack detection algorithm[J]. Journal of ZheJiang University (Engineering Science), 2025, 59(9): 1838-1845.
[4] Jiarui FU,Zhaofei LI,Hao ZHOU,Wei HUANG. Camouflaged object detection based on Convnextv2 and texture-edge guidance[J]. Journal of ZheJiang University (Engineering Science), 2025, 59(8): 1718-1726.
[5] Huizhi XU,Xiuqing WANG. Perception of distance and speed of front vehicle based on vehicle image features[J]. Journal of ZheJiang University (Engineering Science), 2025, 59(6): 1219-1232.
[6] Shenchong LI,Xinhua ZENG,Chuanqu LIN. Multi-task environment perception algorithm for autonomous driving based on axial attention[J]. Journal of ZheJiang University (Engineering Science), 2025, 59(4): 769-777.
[7] Hongzhao DONG,Shaoxuan LIN,Yini SHE. Research progress of YOLO detection technology for traffic object[J]. Journal of ZheJiang University (Engineering Science), 2025, 59(2): 249-260.
[8] Yongfu HE,Shiwei XIE,Jialu YU,Siyu CHEN. Detection method for spillage risk vehicle considering cross-level feature fusion[J]. Journal of ZheJiang University (Engineering Science), 2025, 59(2): 300-309.
[9] Jianghao CHEN,Jun YANG. Object detection for multi-source remote sensing fused images based on depthwise separable convolution[J]. Journal of ZheJiang University (Engineering Science), 2025, 59(12): 2545-2555.
[10] Jiayi YU,Qin WU. Monocular 3D object detection based on context information enhancement and depth guidance[J]. Journal of ZheJiang University (Engineering Science), 2025, 59(1): 89-99.
[11] Juan SONG,Longxi HE,Huiping LONG. Deep learning-based algorithm for multi defect detection in tunnel lining[J]. Journal of ZheJiang University (Engineering Science), 2024, 58(6): 1161-1173.
[12] Tianmin DENG,Xinxin CHENG,Jinfeng LIU,Xiyue ZHANG. Small target detection algorithm for aerial images based on feature reuse mechanism[J]. Journal of ZheJiang University (Engineering Science), 2024, 58(3): 437-448.
[13] Yaolian SONG,Can WANG,Dayan LI,Xinyi LIU. UAV small target detection algorithm based on improved YOLOv5s[J]. Journal of ZheJiang University (Engineering Science), 2024, 58(12): 2417-2426.
[14] Dingjian DU,Zunhai GAO,Zhuo CHEN. Wolfberry pest detection based on improved YOLOv5[J]. Journal of ZheJiang University (Engineering Science), 2024, 58(10): 1992-2000.
[15] Siyi QIN,Shaoyan GAI,Feipeng DA. Video object detection algorithm based on multi-level feature aggregation under mixed sampler[J]. Journal of ZheJiang University (Engineering Science), 2024, 58(1): 10-19.