|
|
|
| Real-time debris flow detection method combining fluid automatic annotation and lightweight YOLOv8n |
Ping WANG1,2( ),Anzhi XU1,Hongli ZHAO1,Xiaoyuan WEI1,Fulong YANG1 |
1. School of Microelectronics Industry-education Integration, Lanzhou University of Technology, Lanzhou 730050, China 2. Institute of Automation, Gansu Academy of Sciences, Lanzhou 730000, China |
|
|
|
Abstract A novel detection framework integrating automatic fluid target annotation and a lightweight YOLOv8n model was proposed, aiming at addressing the challenges of low annotation efficiency and insufficient model adaptability in real-time debris flow monitoring. An open-source debris flow dataset of 8 064 images was built. This dataset was achieved using multi-scale dynamic capture frames, which leverage fluid motion continuity, along with adaptive frame extraction and an improved binary classification model. To enhance the extraction of dynamic debris flow features and improve the irregular boundary localization, the LGSA module and C2f_GhostNetV2 structure were developed. The Shape-IoU loss function was also introduced into the model architecture. Experimental results demonstrated that the proposed YOLOv8-Mudslide model achieved an mAP@0.5 of 86.7%, which was 4.7% higher than that of the baseline model, and the detection speed reached 230.89 frame/s. This case provides reliable technical support for the real-time monitoring of debris flow disasters, and its framework can be further extended to other intelligent detection fields of fluid targets.
|
|
Received: 24 June 2025
Published: 23 May 2026
|
|
|
| Fund: 国家自然科学基金资助项目(62361039, 62001198, 62173170);中国博士后科学基金资助项目(2024MD763938);甘肃省青年科技基金资助项目(24JRRA1146);甘肃省联合科研基金资助项目(25JRRA1153, 24JRRA829). |
融合流体自动标注与轻量化YOLOv8n的泥石流实时检测方法
针对泥石流灾害实时检测中数据标注效率低和模型适应性不足问题,提出融合流体目标自动标注与轻量化YOLOv8n的泥石流检测框架. 基于流体运动连续的特性,设计多尺度动态采集框,通过自适应视频帧截取与改进的二分类筛选模型,构建包含8 064张图像的开源泥石流数据集. 在模型架构上,设计LGSA模块与C2f_GhostNetV2结构,并引入Shape-IoU损失函数,增强模型对泥石流动态特征的提取能力和不规则边界的定位精度. 实验结果表明,提出的YOLOv8-Mudslide模型的mAP@0.5指标达到86.7%,较基线模型提升了4.7%,检测速度达到230.89 帧/s,为泥石流灾害的实时监测提供了可靠的技术支持.
关键词:
自动标注,
流体目标,
目标检测,
泥石流,
灾害预警
|
|
| [12] |
ZHANG Ye, XU Ting, FENG Dingzhong, et al Research on faster RCNN object detection based on hard example mining[J]. Journal of Electronics and Information Technology, 2019, 41 (6): 1496- 1502
|
|
|
| [13] |
TANG Y, HAN K, GUO J, et al GhostNetv2: Enhance cheap operation with long-range attention[J]. Advances in Neural Information Processing Systems, 2022, 35: 9969- 9982
|
|
|
| [14] |
HAN K, WANG Y, GUO J, et al. ParameterNet: Parameters are all you need for large-scale visual pretraining of mobile networks [C]// 2024 IEEE Conference on Computer Vision and Pattern Recognition. Seattle: IEEE, 2024: 15751–15761.
|
|
|
| [15] |
ZHANG H, ZHANG S. Shape-iou: more accurate metric considering bounding box shape and scale [EB/OL]. [2025-06-01]. https://arxiv.org/pdf/2312.17663.pdf.
|
|
|
| [16] |
CHEN B, LIU Y, ZHANG Z, et al Transattunet: multi-level attention-guided u-net with transformer for medical image segmentation[J]. IEEE Transactions on Emerging Topics in Computational Intelligence, 2023, 8 (1): 55- 68
|
|
|
| [17] |
ZHANG S, WEN L, BIAN X, et al. Single-shot refinement neural network for object detection [C]// 2018 IEEE Conference on Computer Vision and Pattern Recognition. Salt Lake City: IEEE, 2018: 4203–4212.
|
|
|
| [1] |
CABRAL V, REIS F, VELOSO V, et al The consequences of debris flows in Brazil: a historical analysis based on recorded events in the last 100 years[J]. Landslides, 2023, 20 (3): 511- 529
doi: 10.1007/s10346-022-01984-7
|
|
|
| [2] |
DU Y, LIU H, LI H, et al Exploring the initiating mechanism, monitoring equipment and warning indicators of gully-type debris flow for disaster reduction: a review[J]. Natural Hazards, 2024, 120 (15): 13667- 13692
doi: 10.1007/s11069-024-06742-7
|
|
|
| [3] |
PHAM M V, KIM Y T Debris flow detection and velocity estimation using deep convolutional neural network and image processing[J]. Landslides, 2022, 19 (10): 2473- 2488
doi: 10.1007/s10346-022-01931-6
|
|
|
| [4] |
何明杰, 刘德方, 张猛, 等 融合YOLOX和ASFF的高原山地灾害检测模型[J]. 防灾减灾工程学报, 2023, 43 (6): 1215- 1223 HE Mingjie, LIU Defang, ZHANG Meng, et al A plateau mountain disaster detection model by integrating YOLOX and ASFF[J]. Journal of Disaster Prevention and Mitigation Engineering, 2023, 43 (6): 1215- 1223
doi: 10.13409/j.cnki.jdpme.20230105002
|
|
|
| [5] |
张领先, 景嘉平, 李淑菲, 等 基于图像自动标注与改进YOLO v5的番茄病害识别系统[J]. 农业机械学报, 2023, 54 (11): 198- 207
|
|
|
| [18] |
ZHAO Y, LV W, XU S, et al. Detrs beat yolos on real-time object detection [C]// 2024 IEEE Conference on Computer Vision and Pattern Recognition. Seattle: IEEE, 2024: 16965–16974.
|
|
|
| [5] |
ZHANG Lingxian, JING Jiaping, LI Shufei, et al Tomato disease recognition system based on image automatic labeling and improved YOLOv5[J]. Transactions of the Chinese Society for Agricultural Machinery, 2023, 54 (11): 198- 207
|
|
|
| [6] |
陈庆林, 谷雨, 宋忠浩, 等 融合检测与跟踪的半自动视频目标标注[J]. 计算机工程与应用, 2021, 57 (14): 223- 230 CHEN Qinglin, GU Yu, SONG Zhonghao, et al Semi-automatic video target annotation by combining detection and tracking[J]. Computer Engineering and Applications, 2021, 57 (14): 223- 230
|
|
|
| [7] |
CUI B, CRÉPUT J C A systematic algorithm for moving object detection with application in real-time surveillance[J]. SN Computer Science, 2020, 1 (2): 106
doi: 10.1007/s42979-020-0118-5
|
|
|
| [8] |
KALAL Z, MIKOLAJCZYK K, MATAS J Tracking-learning-detection[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2011, 34 (7): 1409- 1422
|
|
|
| [9] |
YADAV S, PAYANDEH S Critical overview of visual tracking with kernel correlation filter[J]. Technologies, 2021, 9 (4): 93
doi: 10.3390/technologies9040093
|
|
|
| [10] |
OKOYE O C, BOLAJI B O. Physics of fluid motion [M]// Applications of Heat, Mass and Fluid Boundary Layers. Cambridge: Woodhead Publishing, 2020: 1–22.
|
|
|
| [11] |
HE K, ZHANG X, REN S, et al. Deep residual learning for image recognition [C]// 2016 IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas: IEEE, 2016: 770–778.
|
|
|
|
Viewed |
|
|
|
Full text
|
|
|
|
|
Abstract
|
|
|
|
|
Cited |
|
|
|
|
| |
Shared |
|
|
|
|
| |
Discussed |
|
|
|
|