Please wait a minute...
JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE)  2018, Vol. 52 Issue (4): 694-702    DOI: 10.3785/j.issn.1008-973X.2018.04.012
Automatic Technology     
Vehicle category recognition based on deep convolutional neural network
YUAN Gong-ping, TANG Yi-ping, HAN Wang-ming, CHEN Qi
School of Information Engineering, Zhejiang University of Technology, Hangzhou 310023, China
Download:   PDF(4177KB) HTML
Export: BibTeX | EndNote (RIS)      

Abstract  

A novel detection model was proposed to solve the problems of low detection accuracy, difficulty in adapting to changeable climate environment, extracting the vehicles from the video accurately, meeting fine classification based on visual method, and giving attention to both the recognition accuracy and the detection efficiency and so on in the existing vehicle identification and classification. The problems contain three consecutive stages:vehicle detection, features extraction and classification based on deep convolutional neural network. The deep learning network was used to automatically complete vehicle feature extraction and logical regression was performed on the feature map to extract the region of interest from the complex background. Then vehicle recognition was implemented to train the existing features through a softmax classifier. The central loss function was introduced to optimize this problem and improve inter-class dispension and intra-class compactness as much as possible in order to optimize the problem that softmax will cause large class spacing in deep convolutional neural network. Experiments on BIT-Vehicle dataset demonstrated that the identification average accuracy of our algorithm was about 89.67%, and the recognition rate was about 159 ms. The recognition accuracy increased by approximately 20% compared with conventional machine learning methods, and the rate increased by at least 10 times. Robustness was significantly improved. The recognition accuracy increased by approximately 0.6% and the rate increased by at least 0.29 times compared with the unimproved deep convolution neural network.



Received: 12 January 2017     
CLC:  TP391  
Cite this article:

YUAN Gong-ping, TANG Yi-ping, HAN Wang-ming, CHEN Qi. Vehicle category recognition based on deep convolutional neural network. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2018, 52(4): 694-702.

URL:

http://www.zjujournals.com/eng/10.3785/j.issn.1008-973X.2018.04.012     OR     http://www.zjujournals.com/eng/Y2018/V52/I4/694


基于深度卷积神经网络的车型识别方法

针对现有车辆车型视觉识别技术中的检测精度不高、难以适应天气环境变化、难以从视频图像中准确提取出用于识别的车辆图像、难以对车辆车型子类进行识别分类、难以兼顾识别精度和检测效率等不足,将深度卷积神经网络引入车辆目标定位、识别和分类(子类)问题中.利用深度卷积神经网络自动完成车型的深度特征学习,在特征图上进行逻辑回归,从道路复杂背景中提取出感兴趣区域;利用softmax分类器训练特征实现车型识别;为了优化softmax在深度卷积神经网络分类过程中出现的类内间距大的问题,引入中心损失函数对softmax损失函数进行优化,提高类间分散性与类内紧密性.在BIT-Vehicle车型数据集中的实验结果显示,提出方法的平均精度为89.67%,检测和识别时间为159 ms;与传统的分类方法相比,识别精度提高约20%,效率提高10倍以上,检测鲁棒性有明显提升;与未改进前的深度卷积神经网络相比,检测精度提高0.6%,速度提高0.29倍.

[1] YIN Q, CAO Z M, JIANG Y N, et al. Learning deep face representation:U.S. Patent 20150347820[P]. 2015-12-03.
[2] WEI W, ZHANG Q S, WANG M J. A method of vehicle classification using models and neural networks[C]//IEEE 2001 International Conference on Semiannual Vehicular Technology 2001 Spring Conference (VTC). Israel:IEEE, 2001:3022-3026.
[3] LI L Y, HUANG W M, GU I Y H, et al. Foreground object detection from videos containing complex background[C]//11th ACM International Conference on Multimedia. Berkeley:ACM, 2003:2-10.
[4] 张旭东, 钱玮, 高隽, 等. 基于稀疏贝叶斯分类器的汽车车型识别[J].小型微型计算机系统, 2005, 26(10):1839-2841. ZHANG Xu-dong, QIAN Wei, GAO Jun, et al. Vehicle model recognition system based on sparse Bayesian classification[J]. Journal of Chinese Computer Systems.2005, 26(10):1839-2841.
[5] XIA L M. Vehicle recognition using boosting neural network classifiers[C]//Proceedings of the 6th World Congress on Intelligent Control and Automation (ICA). Dalian:[s. n.], 2006:9641-9644.
[6] SIDDIQUE M N H, TOKHI M O. Training neural networks:backpropagation VS. genetic algorithms[C]//International Joint Conference on Neural Networks. Washington, DC:IEEE, 2001:2673-2678.
[7] 王守觉.仿生模式识别(拓扑模式识别)一种模式识别新模型的理论与应用[J].电子学报, 2002, 30(10):1417-1420. WANG Shou-jue. Bionic (topological) pattern recognition a new model of pattern recognition theory and its applications[J]. Acta Electronica Sinica,2002, 30(10):1417-1420.
[8] 陈爱斌. 基于支持向量机的车型识别[D].湖南:中南大学, 2004:32. CHEN Ai-bin. Vehicle identification based on support vector machine[D].Hunan:Central South University,2014:32.
[9] YANG K H, SHAN G L, ZHAO L L. Application of least squares support vector machine on vehicle recognition[C]//International Conference on Intelligent Systems Design and Applications (ISDA). Jinan:IEEE, 2006:217-221.
[10] 武宏伟, 马钱. 一种基于支持向量机的车型自动分类器设计方案[J].计算机应用, 2005(4):10-12. WU Hong-wei, MA Qian. A design scheme of automatic vehicle classification based on support vector machine[J]. Journal of Computer Application, 2005(4):10-12.
[11] MA X, GRIMSON W E L. Edge-based rich representation for vehicle classification vision[C]//10th IEEE International Conference on Computer Vision (ICCV). Beijing:IEEE, 2005:1185-1192.
[12] GE F X, SHI Y, SUN B,et al. Sparse representation based classification by using PCA-SIFT descriptors[C]//IEEE International Conference on Information Science and Technology (ICIST).Guangdong:IEEE, 2014:429-432.
[13] HAN F,SHAN Y,CEKANDER R,et al. A two-stage approach to people and vehicle detection with hog-based SVM[C]//Performance Metrics for Intelligent Systems Workshop in conjunction with the IEEE Safety, Security, and Rescue Robotics Conference (PerMIS, SSRR). Washington, D.C:IEEE, 2006:133-140.
[14] GIRSHICK R, DONAHUE J, DARRELL T, et al. Rich feature hierarchies for accurate object detection and semantic segmentation[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Columbus:IEEE, 2014:580-587.
[15] GIRSHICK R. Fast R-CNN[C]//Proceedings of the IEEE International Conference on Computer Vision (ICCV). Boston:IEEE, 2015:1440-1448.
[16] REN S Q, HE K M, GIRSHICK R, et al. Faster rcnn:towards real-time object detection with region proposal networks[C]//Advances in Neural Information Processing Systems (NIPS). Montreal:[s. n.], 2015:91-99.
[17] HE K M, ZHANG X Y, REN S Q, et al. Deep Residual Learning for Image Recognition[C]//Computer Vision and Pattern Recognition (CVPR). Las Vegas:[s. n.], 2016:770-778.
[18] WEN Y D, ZHANG K P, LI Z F, et al. A discriminative feature learning approach for deep face recognition[C]//European Conference on Computer Vision (ECCV). Amsterdam:[s. n.], 2016:499-515.
[19] KRIZHEVSKY A, SUTSKEVER I, HINTON G E. ImageNet classification with deep convolutional neural networks[C]//International Conference on Neural Information Processing Systems (NIPS). Lake Tahoe:[s. n.], 2012:1097-1105.
[20] ZEILER M D, FERGUS R. Visualizing and understanding convolutional neural networks[C]//European Conference on Computer Vision. Springer International Publishing (ECCV). Zurich:[s. n.], 2014:818-833.
[21] LECUN Y, CORTES C, BURGER C J. The mnist database of handwritten digits. 1998-11. http://yann.lecun.com/exdb/mnist/.
[22] ZHEN D, WU Y W, PEI M T, et al. Vehicle type classification using a semisupervised convolutional neural network[J]. IEEE Transactions on Intelligent Transportation Systems, 2015, 16(4):2247-2256.
[23] UIJLINGS J R R, SANDE K E A V D, GEVERS T, et al. Selective search for object recognition[J]. International Journal of Computer Vision, 2013, 104(2):154-171.
[24] DOLLAR P, ZITNICK C L. Structured forests for fast edge detection[C]//IEEE International Conference on Computer Vision (ICCV). Sydney:IEEE, 2013:1841-1848.

[1] HAN Yong, NING Lian-ju, ZHENG Xiao-lin, LIN Wei-hua, SUN Zhong-yuan. Matrix factorization recommendation based on social information and item exposure[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2019, 53(1): 89-98.
[2] ZHENG Zhou, ZHANG Xue-chang, ZHENG Si-ming, SHI Yue-ding. Liver segmentation in CT images based on region-growing and unified level set method[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2018, 52(12): 2382-2396.
[3] ZHAO Li-ke, ZHENG Shun-yi, WANG Xiao-nan, HUANG Xia. Rigid object position and orientation measurement based on monocular sequence[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2018, 52(12): 2372-2381.
[4] HE Jie-guang, PENG Zhi-ping, CUI De-long, LI Qi-rui. Teaching-learning-based optimization algorithm with local dimension improvement[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2018, 52(11): 2159-2170.
[5] LI Zhi, SHAN Hong, MA Tao, HUANG Jun. Group discovery of mobile terminal users based on reverse-label propagation algorithm[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2018, 52(11): 2171-2179.
[6] WANG Shuo-peng, YANG Peng, SUN Hao. Construction process optimization of fingerprint database for auditory localization[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2018, 52(10): 1973-1979.
[7] WEI Xiao-feng, CHENG Cheng-qi, CHEN Bo, WANG Hai-yan. Chain code based on independent edge number[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2018, 52(9): 1686-1693.
[8] CHEN Rong-hua, WANG Ying-han, BU Jia-jun, YU Zhi, GAO Fei. Website accessibility sampling evaluation based on KNN and local regression[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2018, 52(9): 1702-1708.
[9] ZHANG Cheng-zhi, FENG Hua-jun, XU Zhi-hai, LI Qi, CHEN Yue-ting. Piecewise noise variance estimation of images based on wavelet transform[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2018, 52(9): 1804-1810.
[10] LIU Zhou-zhou, LI Shi-ning, LI Bin, WANG Hao, ZHANG Qian-yun, ZHENG Ran. New elastic collision optimization algorithm and its application in sensor cloud resource scheduling[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2018, 52(8): 1431-1443.
[11] WANG Yong-chao, ZHU Kai-lin, WU Qi-xuan, LU Dong-ming. Adaptive display technology of high precision model based on local rendering[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2018, 52(8): 1461-1466.
[12] SUN Nian, LI Yu-qiang, LIU Ai-hua, LIU Chun, LI Wei-wei. Microblog sentiment analysis based on collaborative learning under loose conditions[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2018, 52(8): 1452-1460.
[13] ZHENG Shou-guo, CUI Yan-min, WANG Qing, YANG Fei, CHENG Liang. Design of field data acquisition platform for aircraft assembly[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2018, 52(8): 1526-1534.
[14] BI Xiao-jun, WANG Chao. Many-objective evolutionary algorithm based on hyperplane projection[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2018, 52(7): 1284-1293.
[15] ZHANG Ting-rong, TENG Qi-zhi, LI Zheng-ji, QING Lin-bo, HE Xiao-hai. Super-resolution reconstruction for three-dimensional core CT image[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2018, 52(7): 1294-1301.