|
|
Large margin metric learning based vehicle re-identification method |
Shi-lin ZHANG(),Si-ming MA,Zi-qian GU |
Beijing Key Laboratory of Traffic Intelligent Control, North China University of Technology, Beijing 100144, China |
|
|
Abstract In the present vehicle re-identification methods, it is hard to separate the samples near the decision boundaries in the embedding feature space because of the multi-view vehicle appearance. A large margin metric learning method was proposed to tackle the above problem. In the representation stage, a large margin loss function was presented to tackle the identity confusion issue among similar vehicles effectively. Meanwhile, an invader-defector sampler was adopted, which was used to find the hard samples in the training dataset to train the network specifically and speed up the training process. A kernelized re-rank method was adopted to further enhance the re-identification performance in the retrieval stage. Experiments on three common databases show that the proposed method can achieve a higher vehicle re-identification accuracy, and at the same time the time cost of training and the inference procedure are improved. Theoretical analysis and experiments also indicate that, the large margin metric learning method can mine the hard samples near the decision boundaries, and can solve the multi-view issue in the vehicle re-identification domain.
|
Received: 29 June 2020
Published: 10 June 2021
|
|
Fund: 国家自然科学基金资助项目(61403002);北方工业大学优秀青年人才资助项目 |
基于大边距度量学习的车辆再识别方法
在目前的车辆再识别方法中,车辆在拍摄过程中的多视角会导致特征嵌入空间中决策边界附近样本较难区分. 针对该问题,提出通过最大化边界距离提升车辆再识别准确率. 在特征表示阶段,设计了大边界损失度量函数,可以有效处理相似车辆的混淆问题;采用入侵叛逃采样策略,可以在训练样本中找出更容易混淆的难样本以更有针对性地训练网络,并加快网络的训练速度. 在车辆检索阶段,提出基于核函数的重排序方法,可以提高车辆再识别的准确率. 在3个公共数据集上的实验结果显示,车辆再识别的准确率得到提高,同时训练和推理效率得到改善. 理论分析和实验表明,大边距度量学习通过挖掘决策边界的难样本,可以有效解决车辆再识别中的多视角问题.
关键词:
车辆再识别,
特征嵌入,
度量学习,
损失函数,
采样策略,
核函数
|
|
[1] |
LIU X C, LIU W, MA H D, et al. Large-scale vehicle re-identification in urban surveillance videos [C]// IEEE International Conference on Multimedia and Expo. Seattle: IEEE, 2016: 1-6.
|
|
|
[2] |
LIU X C. A deep learning-based approach to progressive vehicle re-identification for urban surveillance [C]// 2016 European Conference on Computer Vision. Netherlands: Springer, 2016: 869-884.
|
|
|
[3] |
ZHANG Y, LIU D, ZHA Z J. Improving triplet-wise training of convolutional neural network for vehicle re-identification [C]// 2017 IEEE International Conference on Multimedia and Expo. Hongkong: IEEE, 2017: 1386-1391.
|
|
|
[4] |
ZHOU K Y, YANG Y X, CAVALLARO A, et al. Omni-scale feature learning for person re-identification [C]// 2019 International Conference of Computer Vision. Seoul: IEEE, 2019: 3701-3711.
|
|
|
[5] |
HE K M, ZHANG X Y. Deep residual learning for image recognition [C]// 2016 IEEE Conference on Computer Vision and Pattern Recognition. Nevada: IEEE, 2016: 770-778.
|
|
|
[6] |
BAI Y, LOU Y H, GAO F, et al Group-sensitive triplet embedding for vehicle re-identification[J]. IEEE Transactions on Multimedia, 2018, 2385- 2399
|
|
|
[7] |
SIMONYAN K, ZISSERME N. Very deep convolutional networks for largescale image recognition [C]// 2015 International Conference on Learning Representations. San Diego: IEEE, 2015: 1-14.
|
|
|
[8] |
CHU R H, SUN Y F. Vehicle re-identification with viewpoint-aware metric learning [C]// 2019 International Conference of Computer Vision. Seoul: IEEE, 2019: 8281-8290.
|
|
|
[9] |
PIRAZ K. A dual-path model with adaptive attention for vehicle re-identification [C]// 2019 International Conference of Computer Vision. Seoul: IEEE, 2019: 6131-6140.
|
|
|
[10] |
HE B. Part-regularized near-duplicate vehicle re-identification [C]// 2019 International Conference of Computer Vision and Pattern Recognition. Long Beach: IEEE, 2019: 3992-4000.
|
|
|
[11] |
ZHU J Q Vehicle re-identification using quadruple directional deep learning features[J]. IEEE Transactions on Intelligent Transportation System, 2019, 21 (1): 410- 420
|
|
|
[12] |
GUO H, ZHAO C. Learning coarse-to-fine structured feature embedding for vehicle re-identification [C]// 2018 the 32nd AAAI Conference on Artificial Intelligence. New Orleans: AAAI, 2018: 6853-6860.
|
|
|
[13] |
ZHENG Z, ZHENG L, YANG Y A discriminatively learned cnn embedding for personre-identification[J]. ACM Transactions on Multime-dia Computing, Communications, and Applications, 2017, 14 (1): 1- 20
|
|
|
[14] |
LIU X, LIU W Provid: progressive and multimodal vehicle reidentification for large-scale urban surveillance[J]. IEEE Transactions on Multimedia, 2018, 20 (3): 645- 658
doi: 10.1109/TMM.2017.2751966
|
|
|
[15] |
YU R, DOU Z, BAI S Hard-aware point-to-set deep metric for person re-identification[J]. Lecture Notes in Computer Science, 2018, 196- 212
|
|
|
[16] |
CORTES C, VAPNIK V Support-vector networks[J]. Machine Learning, 1995, 20 (3): 273- 297
|
|
|
[17] |
ZHONG Z, ZHENG L. Re-ranking person re-identification with k-reciprocal encoding [C]// 2017 International Conference of Computer Vision and Pattern Recognition. Honolulu: IEEE, 2019: 3652-3661.
|
|
|
[18] |
LOU Y, BAI Y. Veri-wild: a large dataset and anew method for vehicle re-identification in the wild [C]// 2019 IEEE Conference on Computer Vision and Pattern Recognition. Honolulu: IEEE, 2019: 3230-3238.
|
|
|
[19] |
LIU H, TIAN Y. Deep relative distance learning: tell the difference between similar vehicles [C]// 2016 IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas: IEEE, 2019: 2167–2175.
|
|
|
[20] |
MAATEN L, HINTON G Visualizing data using t-SNE[J]. Journal of Machine Learning Review, 2008, 9: 2579- 2605
|
|
|
[21] |
LIU Y, TIAN Y. Deep relative distance learning: tell the difference between similar vehicles [C]// 2016 IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas: IEEE, 2019: 2167-2175.
|
|
|
|
Viewed |
|
|
|
Full text
|
|
|
|
|
Abstract
|
|
|
|
|
Cited |
|
|
|
|
|
Shared |
|
|
|
|
|
Discussed |
|
|
|
|