Please wait a minute...
浙江大学学报(工学版)  2026, Vol. 60 Issue (8): 1678-1685    DOI: 10.3785/j.issn.1008-973X.2026.08.007
计算机技术     
面向自动驾驶的轻量化交警手势识别方法
柳长源1(),赵海健1,吴海滨1,刘佳伟2
1. 哈尔滨理工大学 测控技术与通信工程学院,黑龙江 哈尔滨 150080
2. 黑龙江省公路建设中心,黑龙江 哈尔滨 150001
Lightweight traffic police gesture recognition method for autonomous driving
Changyuan LIU1(),Haijian ZHAO1,Haibin WU1,Jiawei LIU2
1. College of Measurement and Control Technology and Communication Engineering, Harbin University of Science and Technology, Harbin 150080, China
2. Heilongjiang Province Highway Construction Center, Harbin 150001, China
 全文: PDF(3419 KB)   HTML
摘要:

现阶段的交警手势识别方法难以在保持高识别准确率的同时实现轻量化部署,且交警手势具有变化细微、使用场景复杂的特点,为此提出面向自动驾驶的轻量化交警手势识别方法. 基于YOLOv8n算法,设计高效自适应权重下采样模块,取代主干网络部分标准卷积,捕捉位置差异,减少参数量与计算量. 设计C2f-G模块,充分利用局部和上下文特征,提高复杂背景下的识别准确率. 在颈部网络引入三重注意力机制,全面捕捉细粒度特征信息. 在中国交警手势数据集上进行验证,与基线模型相比,所提方法的参数量减少44.0%,平均精度均值提升3个百分点,检测速度达294帧/s. 所提方法有效解决了复杂环境下交警手势动态识别的问题,在快速、高精度识别的同时,实现模型轻量化,显著减小了部署难度.

关键词: 自动驾驶交警手势识别YOLOv8n自适应权重目标检测    
Abstract:

A lightweight traffic police gesture recognition method for autonomous driving was proposed to address the challenge of maintaining high recognition accuracy while achieving lightweight deployment, particularly given the subtle variations in gestures and complex application scenarios. An efficient adaptive weight downsampling module was designed on the basis of the YOLOv8n algorithm. This module replaced the standard convolutions in the backbone network to capture spatial differences, reducing both parameter count and computational complexity. Additionally, a C2f-G module was introduced to better leverage local and contextual features, improving the recognition accuracy in complex backgrounds. A triplet attention mechanism was incorporated into the neck network to comprehensively capture fine-grained feature details. Experimental validation on the Chinese traffic police gesture dataset showed that compared to the baseline model, the proposed method reduced the parameter count by 44.0%, increased the mean average precision by 3 percentage points, and achieved a detection speed of 294 frames/s. The proposed method effectively addresses the challenge of dynamic traffic police gesture recognition in complex environments, achieves fast and high-precision recognition, realizes a lightweight architecture, and significantly reduces the deployment complexity.

Key words: autonomous driving    traffic police gesture recognition    YOLOv8n    adaptive weight    object detection
收稿日期: 2025-07-11 出版日期: 2026-07-16
CLC:  TP 391.4  
基金资助: 黑龙江省交通运输厅科技资助项目(HJK2024B002).
作者简介: 柳长源(1970—),男,副教授,从事模式识别、图像处理研究. orcid.org/0000-0003-2204-0612. E-mail:liuchangyuan@hrbust.edu.cn
服务  
把本文推荐给朋友
加入引用管理器
E-mail Alert
作者相关文章  
柳长源
赵海健
吴海滨
刘佳伟

引用本文:

柳长源,赵海健,吴海滨,刘佳伟. 面向自动驾驶的轻量化交警手势识别方法[J]. 浙江大学学报(工学版), 2026, 60(8): 1678-1685.

Changyuan LIU,Haijian ZHAO,Haibin WU,Jiawei LIU. Lightweight traffic police gesture recognition method for autonomous driving. Journal of ZheJiang University (Engineering Science), 2026, 60(8): 1678-1685.

链接本文:

https://www.zjujournals.com/eng/CN/10.3785/j.issn.1008-973X.2026.08.007        https://www.zjujournals.com/eng/CN/Y2026/V60/I8/1678

图 1  改进YOLOv8n的轻量化交警手势识别网络
图 2  高效自适应权重下采样模块网络结构
图 3  上下文引导下采样模块网络结构图
图 4  Bottleneck、C2f与C2f-G网络结构
图 5  三重注意力机制结构
图 6  部分数据集图片
实验
编号
EAWDC2f-GTAGFLOPs/
109
Params/
106
mAP/
%
实验
编号
EAWDC2f-GTAGFLOPs/
109
Params/
106
mAP/
%
18.73.294.955.71.897.4
28.02.796.168.12.897.5
35.92.195.876.02.197.2
48.33.095.585.71.897.9
表 1  消融实验结果
网络模型GFLOPs/109Params/106FR/(帧?s?1P/%R/%mAP/%
RT-DETR-R18[13]10.118.718092.891.490.2
Gold-YOLO-N[14]12.15.626596.095.195.2
YOLOv5s[15]16.57.223393.092.794.2
YOLOv8s[16]28.611.220697.596.096.0
YOLOv9s[17]26.77.224396.393.595.1
YOLOv10s[18]21.67.226496.897.396.6
YOLOv11s[19]21.59.425897.898.497.6
本研究网络5.71.829499.298.697.9
表 2  各主流目标检测算法性能对比实验结果
网络模型GFLOPs/109Params/106FR/(帧?s?1P/%R/%mAP/%
YOLOv4-tiny[20]6.96.124484.282.584.0
YOLOv5n[15]4.51.926891.492.092.5
YOLOv7-tiny[21]5.86.225092.491.293.0
YOLOv10n[18]6.72.333595.294.494.8
YOLOv11n[19]6.52.634096.697.196.0
本研究网络5.71.829499.298.697.9
表 3  轻量化目标检测网络性能对比实验结果
图 7  热力图可视化结果
图 8  连续帧的识别结果
图 9  本研究网络与其他轻量化目标检测网络在测试图像上检测结果可视化的对比
1 全国汽车标准化技术委员会. 汽车驾驶自动化分级: GB/T 40429-2021[S]. 北京: 中国标准出版社, 2021: 7–9.
2 YUAN T, WANG B Accelerometer-based Chinese traffic police gesture recognition system[J]. Chinese Journal of Electronics, 2010, 19 (2): 270- 274
3 YOU Z, LIU J, HOU W, et al. A wearable system designed for Chinese traffic police based on gesture recognition [M]// Transdisciplinary Engineering: A Paradigm Shift. IOS Press, 2017: 385–393.
4 GUO F, CAI Z, TANG J. Chinese traffic police gesture recognition in complex scene [C]// 2011 IEEE 10th International Conference on Trust, Security and Privacy in Computing and Communications. Changsha: IEEE, 2011: 1505–1511.
5 SATHYA R, GEETHA M K Vision based traffic police hand signal recognition in surveillance video-a survey[J]. International Journal of Computer Applications, 2013, 81 (9): 1- 10
doi: 10.5120/14037-2192
6 MIAO Y, SHI E, LEI M, et al. Vehicle control system based on dynamic traffic gesture recognition [C]// 2022 5th International Conference on Circuits, Systems and Simulation (ICCSS). Piscataway: IEEE, 2022: 196–201.
7 马天祥 基于目标检测和模板匹配的交警手势识别研究[J]. 现代信息科技, 2022, 6 (20): 60- 64
MA Tianxiang Research on traffic police gesture recognition based on object detection and template matching[J]. Modern Information Technology, 2022, 6 (20): 60- 64
8 徐志平. 基于深度学习的交通指挥手势识别[D]. 济南: 济南大学, 2023.
XU Zhiping. Recognition of traffic command gestures based on deep learning [D]. Jinan: University of Jinan, 2023.
9 方吴逸, 陈章进, 唐英杰 基于改进YOLOX-tiny算法的交警手势识别[J]. 电子测量技术, 2024, 47 (8): 100- 109
FANG Wuyi, CHEN Zhangjin, TANG Yingjie Traffic police gesture recognition based on improved YOLOX-tiny algorithm[J]. Electronic Measurement Technology, 2024, 47 (8): 100- 109
10 WU T, TANG S, ZHANG R, et al CGNet: a light-weight context guided network for semantic segmentation[J]. IEEE Transactions on Image Processing, 2020, 30: 1169- 1179
11 MISRA D, NALAMADA T, ARASANIPALAI A U, et al. Rotate to attend: convolutional triplet attention module [C]// Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision. [S.l.]: IEEE, 2021: 3139–3148.
12 HE J, ZHANG C, HE X, et al Visual recognition of traffic police gestures with convolutional pose machine and handcrafted features[J]. Neurocomputing, 2020, 390: 248- 259
doi: 10.1016/j.neucom.2019.07.103
13 ZHAO Y, LV W, XU S, et al. Detrs beat YOLOs on real-time object detection [C]// Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Seattle: IEEE, 2024: 16965–16974.
14 WANG C, HE W, NIE Y, et al Gold-YOLO: efficient object detector via gather-and-distribute mechanism[J]. Advances in Neural Information Processing Systems, 2023, 36: 51094- 51112
15 JOCHER G, CHAURASIA A, QIU J. YOLOv5 [EB/OL]. (2021–07–08)[2024–04–09]. https://github.com/ultralytics/yolov5.
16 YASEEN M. What is YOLOv8: an in-depth exploration of the internal features of the next-generation object detector [EB/OL]. (2024–08–28)[2026–07–02]. https://arxiv.org/abs/2408.15857.
17 WANG C Y, YEH I H, MARK LIAO H Y. YOLOv9: learning what you want to learn using programmable gradient information [C]// European Conference on Computer Vision. Cham: Springer, 2024: 1–21.
18 WANG A, CHEN H, LIU L, et al YOLOv10: real-time end-to-end object detection[J]. Advances in Neural Information Processing Systems, 2024, 37: 107984- 108011
19 KHANAM R, HUSSAIN M. YOLOv11: an overview of the key architectural enhancements [EB/OL]. (2024–10–23)[2026–07–02]. https://doi.org/10.48550/arXiv.2410.17725.
20 BOCHKOVSKIY A, WANG C Y, LIAO H Y M. YOLOv4: optimal speed and accuracy of object detection [EB/OL]. (2020–04–23)[2024–11–20]. https://arxiv.org/abs/2004.10934.
[1] 常天根,田国富,唐媛媛,曹明学. 考虑主客观因素的自动驾驶模型预测控制参数优化[J]. 浙江大学学报(工学版), 2026, 60(8): 1638-1649.
[2] 董绍江,肖涛,吕振鸣,夏浩然,罗家元,孙世政,张霞,刘超. 基于改进RT-DETR的水下色偏环境中小型生物检测[J]. 浙江大学学报(工学版), 2026, 60(7): 1404-1415.
[3] 王平,徐安之,赵洪黎,魏小源,杨富龙. 融合流体自动标注与轻量化YOLOv8n的泥石流实时检测方法[J]. 浙江大学学报(工学版), 2026, 60(7): 1416-1426.
[4] 肖剑,杨小苑,何昕泽,陈林,胡欣. 基于全局信息感知的轻量级螺纹钢表面缺陷检测算法[J]. 浙江大学学报(工学版), 2026, 60(7): 1438-1451.
[5] 吴佰靖,闫光辉,马龙,程文鑫,黄亚宁. 边缘感知和跨尺度特征增强的小目标水漂垃圾检测[J]. 浙江大学学报(工学版), 2026, 60(7): 1452-1463.
[6] 于鑫淼,夏楠,江佳鸿,郝子莹,把云胜. 基于多尺度特征相似性匹配的低照度目标检测[J]. 浙江大学学报(工学版), 2026, 60(7): 1464-1474.
[7] 于天河,王文龙,刘镛,杨壮壮,侯善冲. 改进的有雾图像中被遮挡车辆及行人识别算法[J]. 浙江大学学报(工学版), 2026, 60(4): 738-750.
[8] 宋耀莲,彭驰,唐菁敏,赵宣植,虞贵财. 基于融合注意力机制的光学遥感图像小目标检测算法[J]. 浙江大学学报(工学版), 2026, 60(4): 763-771.
[9] 陈文强,冯琳越,王东丹,顾玉磊,赵轩. 融合动态风险图与多变量注意力机制的车辆轨迹预测模型[J]. 浙江大学学报(工学版), 2026, 60(3): 455-467.
[10] 吕君陶,祁珏瑜,于淏辰,马雷,马惠敏,胡天宇. 自动驾驶综合仿真平台的现状与展望[J]. 浙江大学学报(工学版), 2026, 60(3): 513-526.
[11] 雒伟群,陆敬蔚,吴佳缔,梁钰迎,申传鹏,朱睿. 藏区高原典型环境地形目标的轻量化检测模型[J]. 浙江大学学报(工学版), 2026, 60(3): 594-603.
[12] 孟昱煜,孔垂乐,火久元,武泽宇. 重构YOLOv11的无人机小目标检测算法[J]. 浙江大学学报(工学版), 2026, 60(2): 303-312.
[13] 肖剑,何昕泽,程鸿亮,杨小苑,胡欣. 基于多尺度特征增强的航拍小目标检测算法[J]. 浙江大学学报(工学版), 2026, 60(1): 19-31.
[14] 包晓安,彭书友,张娜,涂小妹,张庆琪,吴彪. 基于多方位感知深度融合检测头的目标检测算法[J]. 浙江大学学报(工学版), 2026, 60(1): 32-42.
[15] 董超群,汪战,廖平,谢帅,荣玉杰,周靖淞. 轻量化YOLOv5s-OCG的轨枕裂纹检测算法[J]. 浙江大学学报(工学版), 2025, 59(9): 1838-1845.