|
|
|
| Pose-guided dual-branch network for clothing-changing person re-identification |
Siyao ZHOU( ),Nan XIA*( ),Jiahong JIANG |
| School of Information Science and Engineering, Dalian Polytechnic University, Dalian 116034, China |
|
|
|
Abstract A pose-guided dual-branch clothing-changing person re-identification network (PGNet) was proposed to address the issue of reduced recognition accuracy in the clothing-changing person re-identification tasks caused by complex environments and clothing variations. The network adopted a dual-branch architecture based on appearance features and guided by pose features. To effectively remove the interference of clothing-related information, reduce its impact on model performance, and preserve the deep representational features, a multi-level feature fusion module was designed. An action-related adjacency matrix and a natural topology adjacency matrix were constructed and combined to form a dual adjacency matrix, which was input into the graph convolutional network. An adjacency matrix weighting mechanism was introduced to enhance the model’s ability to capture pose features. A bilinear multi-feature pooling method was adopted to enhance the complementarity between the pose features and the appearance features, thereby improving the recognition accuracy. Experimental results demonstrated that the PGNet achieved mAP values of 60.5%, 84.7%, 15.7%, 22.6%, and Rank-1 accuracies of 63.7%, 93.3%, 59.5%, 41.2% on the clothing-changing datasets of PRCC, VC-Clothes, Celeb-reID, and Celeb-reID-light, respectively, outperforming other comparative methods such as SirNet. The proposed method can effectively reduce the impact of clothing variations and significantly improve the recognition accuracy.
|
|
Received: 24 January 2025
Published: 15 December 2025
|
|
|
| Fund: 教育部产学合作协同育人资助项目(220603231024713). |
|
Corresponding Authors:
Nan XIA
E-mail: 220520854000543@xy.dlpu.edu.cn;xianan@dlpu.edu.cn
|
姿态引导的双分支换装行人重识别网络
针对换装行人重识别任务中由复杂环境和行人服装变化等因素导致的识别精度下降的问题,提出姿态引导的双分支换装行人重识别网络PGNet,该网络采用以外观特征为基础、由姿态特征引导的双分支结构. 为了有效去除服装相关信息的干扰,降低其对模型性能的影响,同时保留深度表征特征,设计多层次特征融合模块;构建动作关联和自然拓扑邻接矩阵,组合为双重矩阵后输入图卷积网络,并引入邻接矩阵加权机制以增强模型对姿态特征的捕捉能力;采用双线性多特征池化方法增强姿态与外观特征的互补性,从而提升识别精度. 实验结果表明,PGNet在换装数据集PRCC、VC-Clothes、Celeb-reID以及Celeb-reID-light上的mAP指标分别为60.5%、84.7%、15.7%、22.6%,Rank-1指标分别为63.7%、93.3%、59.5%、41.2%,优于SirNet等其他对比方法,验证了所提方法能够有效降低服装变化的影响,并显著提高识别精度.
关键词:
换装行人重识别,
姿态引导,
特征融合,
图卷积网络,
注意力机制
|
|
| [1] |
ZHAO Z, LIU B, LU Y, et al Joint identity-aware mixstyle and graph-enhanced prototype for clothes-changing person re-identification[J]. IEEE Transactions on Multimedia, 2023, 26: 3457- 3468
|
|
|
| [2] |
SUN Y, ZHENG L, YANG Y, et al. Beyond part models: person retrieval with refined part pooling (and a strong convolutional baseline) [C]// Proceedings of the European Conference on Computer Vision. Munich: Springer, 2018: 501–518.
|
|
|
| [3] |
闫禹铭, 何剑锋, 李殊昭, 等 现实场景下行人身份识别[J]. 浙江大学学报: 工学版, 2021, 55 (11): 2022- 2032 YAN Yuming, HE Jianfeng, LI Shuzhao, et al Identity recognition under real scenes[J]. Journal of Zhejiang University: Engineering science, 2021, 55 (11): 2022- 2032
|
|
|
| [4] |
HE W, DENG Y, TANG S, et al. Instruct-ReID: a multi-purpose person re-identification task with instructions [C]// Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Seattle: IEEE, 2024: 17521–17531.
|
|
|
| [5] |
YE M, SHEN J, LIN G, et al Deep learning for person re-identification: a survey and outlook[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2022, 44 (6): 2872- 2893
doi: 10.1109/TPAMI.2021.3054775
|
|
|
| [6] |
HE S, LUO H, WANG P, et al. TransReID: Transformer-based object re-identification [C]// Proceedings of the IEEE/CVF International Conference on Computer Vision. Montreal: IEEE, 2021: 14993–15002.
|
|
|
| [7] |
DING Y, MAO R, ZHU H, et al. Discriminative pedestrian features and gated channel attention for clothes-changing person re-identification [C]// Proceedings of the IEEE International Conference on Multimedia and Expo. Niagara Falls: IEEE, 2024: 1–6.
|
|
|
| [8] |
HUANG Y, WU Q, XU J, et al. Clothing status awareness for long-term person re-identification [C]// Proceedings of the IEEE/CVF International Conference on Computer Vision. Montreal: IEEE, 2021: 11875–11884.
|
|
|
| [9] |
YANG Z, ZHONG X, ZHONG Z, et al Win-win by competition: auxiliary-free cloth-changing person re-identification[J]. IEEE Transactions on Image Processing, 2023, 32: 2985- 2999
doi: 10.1109/TIP.2023.3277389
|
|
|
| [10] |
WANG L, ZHANG Y, LU T, et al Multi feature fusion attention learning for clothing-changing person re-identification[J]. IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences, 2022, 105 (8): 1170- 1174
|
|
|
| [11] |
YANG S, KANG B, LEE Y Sampling agnostic feature representation for long-term person re-identification[J]. IEEE Transactions on Image Processing, 2022, 31: 6412- 6423
doi: 10.1109/TIP.2022.3207024
|
|
|
| [12] |
GU X, CHANG H, MA B, et al. Clothes-changing person re-identification with RGB modality only [C]// Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. New Orleans: IEEE, 2022: 1060–1069.
|
|
|
| [13] |
WANG Q, QIAN X, FU Y, et al. Co-attention aligned mutual cross-attention for cloth-changing person re-identification [C]// Proceedings of the Asian Conference on Computer Vision. Macau: Springer, 2022: 2270–2288.
|
|
|
| [14] |
LIU X, LIU K, GUO J, et al Pose-guided attention learning for cloth-changing person re-identification[J]. IEEE Transactions on Multimedia, 2023, 26 (8): 5490- 5498
|
|
|
| [15] |
GUO P, LIU H, WU J, et al. Semantic-aware consistency network for cloth-changing person re-identification [C]// Proceedings of the 31st ACM International Conference on Multimedia. Ottawa: ACM, 2023: 8730–8739.
|
|
|
| [16] |
ZHU K, GUO H, LIU Z, et al. Identity-guided human semantic parsing for person re-identification [C]// Proceedings of the European Conference on Computer Vision. Glasgow: Springer, 2020: 346–363.
|
|
|
| [17] |
LIU F, YE M, DU B Dual level adaptive weighting for cloth-changing person re-identification[J]. IEEE Transactions on Image Processing, 2023, 32: 5075- 5086
doi: 10.1109/TIP.2023.3310307
|
|
|
| [18] |
MU J, LI Y, LI J, et al. Learning clothes-irrelevant cues for clothes-changing person re-identification [C]// Proceedings of the 33rd British Machine Vision Conference. London: BMVA, 2022: 337.
|
|
|
| [19] |
ZHANG G, LIU J, CHEN Y, et al. Multi-biometric unified network for cloth-changing person re-identification [C]// Proceedings of the IEEE International Conference on Multimedia and Expo. Taipei: IEEE, 2022: 1–6.
|
|
|
| [20] |
LI Y Utilizing silhouette and head information for improved cloth-changing person re-identification[J]. Advances in Engineering Technology Research, 2024, 11 (1): 614
doi: 10.56028/aetr.11.1.614.2024
|
|
|
| [21] |
NGUYEN V D, KHALDI K, NGUYEN D, et al. Contrastive viewpoint-aware shape learning for long-term person re-identification [C]// Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision. Waikoloa: IEEE, 2024: 1030–1038.
|
|
|
| [22] |
JIANG J, XIA N A dual-channel network based on occlusion feature compensation for human pose estimation[J]. Image and Vision Computing, 2024, 151: 105290
doi: 10.1016/j.imavis.2024.105290
|
|
|
| [23] |
JIANG J, XIA N, YU X A feature matching and compensation method based on importance weighting for occluded human pose estimation[J]. Journal of King Saud University: Computer and Information Sciences, 2024, 36 (5): 102061
doi: 10.1016/j.jksuci.2024.102061
|
|
|
| [24] |
TU Z, ZHANG J, LI H, et al Joint-bone fusion graph convolutional network for semi-supervised skeleton action recognition[J]. IEEE Transactions on Multimedia, 2022, 25: 1819- 1831
|
|
|
| [25] |
SUN R, CHEN L, ZHANG L, et al Robust visible-infrared person re-identification based on polymorphic mask and wavelet graph convolutional network[J]. IEEE Transactions on Information Forensics and Security, 2024, 19: 2800- 2813
doi: 10.1109/TIFS.2024.3354377
|
|
|
| [26] |
HUANG M, HOU C, YANG Q, et al Reasoning and tuning: graph attention network for occluded person re-identification[J]. IEEE Transactions on Image Processing, 2023, 32: 1568- 1582
doi: 10.1109/TIP.2023.3247159
|
|
|
| [27] |
LIAN Y, HUANG W, LIU S, et al Person re-identification using local relation-aware graph convolutional network[J]. Sensors, 2023, 23 (19): 8138
doi: 10.3390/s23198138
|
|
|
| [28] |
WANG J, SUN K, CHENG T, et al Deep high-resolution representation learning for visual recognition[J]. IEEE transactions on Pattern Analysis and Machine Intelligence, 2021, 43 (10): 3349- 3364
doi: 10.1109/TPAMI.2020.2983686
|
|
|
| [29] |
DENG J, DONG W, SOCHER R, et al. ImageNet: a large-scale hierarchical image database [C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Miami: IEEE, 2009: 248–255.
|
|
|
| [30] |
LI P, XU Y, WEI Y, et al Self-correction for human parsing[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2022, 44 (6): 3260- 3271
doi: 10.1109/TPAMI.2020.3048039
|
|
|
| [31] |
HOSSAIN S, UMER S, ROUT R K, et al Fine-grained image analysis for facial expression recognition using deep convolutional neural networks with bilinear pooling[J]. Applied Soft Computing, 2023, 134: 109997
doi: 10.1016/j.asoc.2023.109997
|
|
|
| [32] |
YANG Q, WU A, ZHENG W S Person re-identification by contour sketch under moderate clothing change[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2021, 43 (6): 2029- 2046
doi: 10.1109/TPAMI.2019.2960509
|
|
|
| [33] |
SHU X, WANG X, ZANG X, et al Large-scale spatio-temporal person re-identification: algorithms and benchmark[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2022, 32 (7): 4390- 4403
|
|
|
|
Viewed |
|
|
|
Full text
|
|
|
|
|
Abstract
|
|
|
|
|
Cited |
|
|
|
|
| |
Shared |
|
|
|
|
| |
Discussed |
|
|
|
|