Please wait a minute...
Journal of ZheJiang University (Engineering Science)  2026, Vol. 60 Issue (8): 1678-1685    DOI: 10.3785/j.issn.1008-973X.2026.08.007
    
Lightweight traffic police gesture recognition method for autonomous driving
Changyuan LIU1(),Haijian ZHAO1,Haibin WU1,Jiawei LIU2
1. College of Measurement and Control Technology and Communication Engineering, Harbin University of Science and Technology, Harbin 150080, China
2. Heilongjiang Province Highway Construction Center, Harbin 150001, China
Download: HTML     PDF(3419KB) HTML
Export: BibTeX | EndNote (RIS)      

Abstract  

A lightweight traffic police gesture recognition method for autonomous driving was proposed to address the challenge of maintaining high recognition accuracy while achieving lightweight deployment, particularly given the subtle variations in gestures and complex application scenarios. An efficient adaptive weight downsampling module was designed on the basis of the YOLOv8n algorithm. This module replaced the standard convolutions in the backbone network to capture spatial differences, reducing both parameter count and computational complexity. Additionally, a C2f-G module was introduced to better leverage local and contextual features, improving the recognition accuracy in complex backgrounds. A triplet attention mechanism was incorporated into the neck network to comprehensively capture fine-grained feature details. Experimental validation on the Chinese traffic police gesture dataset showed that compared to the baseline model, the proposed method reduced the parameter count by 44.0%, increased the mean average precision by 3 percentage points, and achieved a detection speed of 294 frames/s. The proposed method effectively addresses the challenge of dynamic traffic police gesture recognition in complex environments, achieves fast and high-precision recognition, realizes a lightweight architecture, and significantly reduces the deployment complexity.



Key wordsautonomous driving      traffic police gesture recognition      YOLOv8n      adaptive weight      object detection     
Received: 11 July 2025      Published: 16 July 2026
CLC:  TP 391.4  
Fund:  黑龙江省交通运输厅科技资助项目(HJK2024B002).
Cite this article:

Changyuan LIU,Haijian ZHAO,Haibin WU,Jiawei LIU. Lightweight traffic police gesture recognition method for autonomous driving. Journal of ZheJiang University (Engineering Science), 2026, 60(8): 1678-1685.

URL:

https://www.zjujournals.com/eng/10.3785/j.issn.1008-973X.2026.08.007     OR     https://www.zjujournals.com/eng/Y2026/V60/I8/1678


面向自动驾驶的轻量化交警手势识别方法

现阶段的交警手势识别方法难以在保持高识别准确率的同时实现轻量化部署,且交警手势具有变化细微、使用场景复杂的特点,为此提出面向自动驾驶的轻量化交警手势识别方法. 基于YOLOv8n算法,设计高效自适应权重下采样模块,取代主干网络部分标准卷积,捕捉位置差异,减少参数量与计算量. 设计C2f-G模块,充分利用局部和上下文特征,提高复杂背景下的识别准确率. 在颈部网络引入三重注意力机制,全面捕捉细粒度特征信息. 在中国交警手势数据集上进行验证,与基线模型相比,所提方法的参数量减少44.0%,平均精度均值提升3个百分点,检测速度达294帧/s. 所提方法有效解决了复杂环境下交警手势动态识别的问题,在快速、高精度识别的同时,实现模型轻量化,显著减小了部署难度.


关键词: 自动驾驶,  交警手势识别,  YOLOv8n,  自适应权重,  目标检测 
Fig.1 Lightweight traffic police gesture recognition network based on improved YOLOv8n
Fig.2 Efficient adaptive-weight downsampling module network structure
Fig.3 Network structure diagram of context-guided downsampling module
Fig.4 Bottleneck、C2f and C2f-G network structure
Fig.5 Triplet attention mechanism structure
Fig.6 Images of selected datasets
实验
编号
EAWDC2f-GTAGFLOPs/
109
Params/
106
mAP/
%
实验
编号
EAWDC2f-GTAGFLOPs/
109
Params/
106
mAP/
%
18.73.294.955.71.897.4
28.02.796.168.12.897.5
35.92.195.876.02.197.2
48.33.095.585.71.897.9
Tab.1 Results of ablation experiments
网络模型GFLOPs/109Params/106FR/(帧?s?1P/%R/%mAP/%
RT-DETR-R18[13]10.118.718092.891.490.2
Gold-YOLO-N[14]12.15.626596.095.195.2
YOLOv5s[15]16.57.223393.092.794.2
YOLOv8s[16]28.611.220697.596.096.0
YOLOv9s[17]26.77.224396.393.595.1
YOLOv10s[18]21.67.226496.897.396.6
YOLOv11s[19]21.59.425897.898.497.6
本研究网络5.71.829499.298.697.9
Tab.2 Performance comparison experiments of various mainstream target detection algorithms
网络模型GFLOPs/109Params/106FR/(帧?s?1P/%R/%mAP/%
YOLOv4-tiny[20]6.96.124484.282.584.0
YOLOv5n[15]4.51.926891.492.092.5
YOLOv7-tiny[21]5.86.225092.491.293.0
YOLOv10n[18]6.72.333595.294.494.8
YOLOv11n[19]6.52.634096.697.196.0
本研究网络5.71.829499.298.697.9
Tab.3 Comparative experiments on performance of lightweight target detection networks
Fig.7 Heatmap visualization results
Fig.8 Recognition results of consecutive frames
Fig.9 Comparison of proposed network with other lightweight target detection networks for visualization of detection results on test images
[1]   全国汽车标准化技术委员会. 汽车驾驶自动化分级: GB/T 40429-2021[S]. 北京: 中国标准出版社, 2021: 7–9.
[2]   YUAN T, WANG B Accelerometer-based Chinese traffic police gesture recognition system[J]. Chinese Journal of Electronics, 2010, 19 (2): 270- 274
[3]   YOU Z, LIU J, HOU W, et al. A wearable system designed for Chinese traffic police based on gesture recognition [M]// Transdisciplinary Engineering: A Paradigm Shift. IOS Press, 2017: 385–393.
[4]   GUO F, CAI Z, TANG J. Chinese traffic police gesture recognition in complex scene [C]// 2011 IEEE 10th International Conference on Trust, Security and Privacy in Computing and Communications. Changsha: IEEE, 2011: 1505–1511.
[5]   SATHYA R, GEETHA M K Vision based traffic police hand signal recognition in surveillance video-a survey[J]. International Journal of Computer Applications, 2013, 81 (9): 1- 10
doi: 10.5120/14037-2192
[6]   MIAO Y, SHI E, LEI M, et al. Vehicle control system based on dynamic traffic gesture recognition [C]// 2022 5th International Conference on Circuits, Systems and Simulation (ICCSS). Piscataway: IEEE, 2022: 196–201.
[7]   马天祥 基于目标检测和模板匹配的交警手势识别研究[J]. 现代信息科技, 2022, 6 (20): 60- 64
MA Tianxiang Research on traffic police gesture recognition based on object detection and template matching[J]. Modern Information Technology, 2022, 6 (20): 60- 64
[8]   徐志平. 基于深度学习的交通指挥手势识别[D]. 济南: 济南大学, 2023.
XU Zhiping. Recognition of traffic command gestures based on deep learning [D]. Jinan: University of Jinan, 2023.
[9]   方吴逸, 陈章进, 唐英杰 基于改进YOLOX-tiny算法的交警手势识别[J]. 电子测量技术, 2024, 47 (8): 100- 109
FANG Wuyi, CHEN Zhangjin, TANG Yingjie Traffic police gesture recognition based on improved YOLOX-tiny algorithm[J]. Electronic Measurement Technology, 2024, 47 (8): 100- 109
[10]   WU T, TANG S, ZHANG R, et al CGNet: a light-weight context guided network for semantic segmentation[J]. IEEE Transactions on Image Processing, 2020, 30: 1169- 1179
[11]   MISRA D, NALAMADA T, ARASANIPALAI A U, et al. Rotate to attend: convolutional triplet attention module [C]// Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision. [S.l.]: IEEE, 2021: 3139–3148.
[12]   HE J, ZHANG C, HE X, et al Visual recognition of traffic police gestures with convolutional pose machine and handcrafted features[J]. Neurocomputing, 2020, 390: 248- 259
doi: 10.1016/j.neucom.2019.07.103
[13]   ZHAO Y, LV W, XU S, et al. Detrs beat YOLOs on real-time object detection [C]// Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Seattle: IEEE, 2024: 16965–16974.
[14]   WANG C, HE W, NIE Y, et al Gold-YOLO: efficient object detector via gather-and-distribute mechanism[J]. Advances in Neural Information Processing Systems, 2023, 36: 51094- 51112
[15]   JOCHER G, CHAURASIA A, QIU J. YOLOv5 [EB/OL]. (2021–07–08)[2024–04–09]. https://github.com/ultralytics/yolov5.
[16]   YASEEN M. What is YOLOv8: an in-depth exploration of the internal features of the next-generation object detector [EB/OL]. (2024–08–28)[2026–07–02]. https://arxiv.org/abs/2408.15857.
[17]   WANG C Y, YEH I H, MARK LIAO H Y. YOLOv9: learning what you want to learn using programmable gradient information [C]// European Conference on Computer Vision. Cham: Springer, 2024: 1–21.
[18]   WANG A, CHEN H, LIU L, et al YOLOv10: real-time end-to-end object detection[J]. Advances in Neural Information Processing Systems, 2024, 37: 107984- 108011
[19]   KHANAM R, HUSSAIN M. YOLOv11: an overview of the key architectural enhancements [EB/OL]. (2024–10–23)[2026–07–02]. https://doi.org/10.48550/arXiv.2410.17725.
[20]   BOCHKOVSKIY A, WANG C Y, LIAO H Y M. YOLOv4: optimal speed and accuracy of object detection [EB/OL]. (2020–04–23)[2024–11–20]. https://arxiv.org/abs/2004.10934.
[1] Tiangen CHANG,Guofu TIAN,Yuanyuan TANG,Mingxue CAO. Model predictive control parameter optimization in autonomous driving considering both subjective and objective factors[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(8): 1638-1649.
[2] Ping WANG,Anzhi XU,Hongli ZHAO,Xiaoyuan WEI,Fulong YANG. Real-time debris flow detection method combining fluid automatic annotation and lightweight YOLOv8n[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(7): 1416-1426.
[3] Jian XIAO,Xiaoyuan YANG,Xinze HE,Lin CHEN,Xin HU. Lightweight rebar surface defect detection algorithm based on global information perception[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(7): 1438-1451.
[4] Baijing WU,Guanghui YAN,Long MA,Wenxin CHENG,Yaning HUANG. Small-target water-floating garbage detection based on edge perception and cross-scale feature enhancement[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(7): 1452-1463.
[5] Xinmiao YU,Nan XIA,Jiahong JIANG,Ziying HAO,Yunsheng BA. Low-light target detection based on multi-scale feature similarity matching[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(7): 1464-1474.
[6] Wenqiang CHEN,Linyue FENG,Dongdan WANG,Yulei GU,Xuan ZHAO. Vehicle trajectory prediction model integrating dynamic risk map and multivariate attention mechanism[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(3): 455-467.
[7] Juntao LV,Jueyu QI,Haochen YU,Lei MA,Huimin MA,Tianyu HU. Current status and future prospect of integrated simulation platform for autonomous driving[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(3): 513-526.
[8] Weiqun LUO,Jingwei LU,Jiadi WU,Yuying LIANG,Chuanpeng SHEN,Rui ZHU. Lightweight detection model for typical environmental terrain target in Tibetan Plateau[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(3): 594-603.
[9] Jian XIAO,Xinze HE,Hongliang CHENG,Xiaoyuan YANG,Xin HU. Aerial small target detection algorithm based on multi-scale feature enhancement[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(1): 19-31.
[10] Xiao’an BAO,Shuyou PENG,Na ZHANG,Xiaomei TU,Qingqi ZHANG,Biao WU. Object detection algorithm based on multi-azimuth perception deep fusion detection head[J]. Journal of ZheJiang University (Engineering Science), 2026, 60(1): 32-42.
[11] Chaoqun DONG,Zhan WANG,Ping LIAO,Shuai XIE,Yujie RONG,Jingsong ZHOU. Lightweight YOLOv5s-OCG rail sleeper crack detection algorithm[J]. Journal of ZheJiang University (Engineering Science), 2025, 59(9): 1838-1845.
[12] Jiarui FU,Zhaofei LI,Hao ZHOU,Wei HUANG. Camouflaged object detection based on Convnextv2 and texture-edge guidance[J]. Journal of ZheJiang University (Engineering Science), 2025, 59(8): 1718-1726.
[13] Huizhi XU,Xiuqing WANG. Perception of distance and speed of front vehicle based on vehicle image features[J]. Journal of ZheJiang University (Engineering Science), 2025, 59(6): 1219-1232.
[14] Shenchong LI,Xinhua ZENG,Chuanqu LIN. Multi-task environment perception algorithm for autonomous driving based on axial attention[J]. Journal of ZheJiang University (Engineering Science), 2025, 59(4): 769-777.
[15] Wenqiang CHEN,Dongdan WANG,Wenying ZHU,Yongjie WANG,Tao WANG. Vehicle multimodal trajectory prediction model based on spatio-temporal graph attention network[J]. Journal of ZheJiang University (Engineering Science), 2025, 59(3): 443-450.