Please wait a minute...
浙江大学学报(工学版)  2026, Vol. 60 Issue (9): 1991-1997    DOI: 10.3785/j.issn.1008-973X.2026.09.016
计算机技术、自动控制技术     
半监督多视图相似性和鉴别表示联合学习
郝亚如1(),艾远高1,张鹏1,吴慰2,*()
1. 中国长江电力股份有限公司 三峡水力发电厂,湖北 宜昌 443134
2. 浙江大学 海南研究院,海南 三亚 572025
Semi-supervised multi-view similarity and discriminative representation joint learning
Yaru HAO1(),Yuangao AI1,Peng ZHANG1,Wei WU2,*()
1. Three Gorges Hydropower Plant, China Yangtze Power Limited Company, Yichang 443134, China
2. Hainan Institute, Zhejiang University, Sanya 572025, China
 全文: PDF(1175 KB)   HTML
摘要:

针对现有半监督多视图学习方法视图间互补信息挖掘不充分的问题,提出半监督多视图相似性和鉴别表示联合学习方法(SMLSDR). 在标签空间,通过构建各视图深度特定表示学习网络来充分挖掘和利用视图间的互补信息.在无标签空间,采用基于局部结构的相似矩阵交叉融合策略来充分挖掘和利用视图间的互补信息. 利用谱聚类设计标签传播策略,实现半监督学习. 在机器学习领域5个多视图数据上进行大量的实验,验证SMLSDR的有效性. 实验结果表明,所提方法SMLSDR的性能优于基线方法.进一步的消融实验证明,标签空间的深度鉴别表示学习和无标签空间的相似矩阵融合都对半监督分类有一定的贡献.

关键词: 多视图表示学习半监督学习鉴别信息结构信息谱聚类    
Abstract:

A semi-supervised multi-view similarity and discriminative representation joint learning method (SMLSDR) was proposed aiming at the problem that existing semi-supervised multi-view learning methods fail to fully mine complementary information among different views. In the labeled space, a deep view-specific representation learning network was constructed to fully explore and utilize complementary information across views. In the unlabeled space, a local structure-based cross fusion strategy of similarity matrices was adopted to fully excavate and use inter-view complementary information. Spectral clustering was employed to design a label propagation strategy in order to realize semi-supervised learning. Extensive experiments were conducted on five multi-view datasets in the field of machine learning to verify the effectiveness of SMLSDR. The experimental results demonstrated that the proposed SMLSDR outperformed baseline methods. Further ablation experiments prove that both deep discriminative representation learning in labeled space and similarity matrix fusion in unlabeled space contribute positively to semi-supervised classification.

Key words: multi-view representation learning    semi-supervised learning    discriminative information    structural information    spectral clustering
收稿日期: 2025-09-24 出版日期: 2026-07-20
CLC:  TP 311  
基金资助: 国家自然科学基金资助项目(62561057,62566020);浙江大学自主部署启动项目(6602-A12202).
通讯作者: 吴慰     E-mail: hyr2018@whu.edu.cn;wuweiux@zju.edu.cn
作者简介: 郝亚如(1991—),女,博士,从事模式识别与机器学习研究. orcid.org/0000-0002-4463-4844. E-mail:hyr2018@whu.edu.cn
服务  
把本文推荐给朋友
加入引用管理器
E-mail Alert
作者相关文章  
郝亚如
艾远高
张鹏
吴慰

引用本文:

郝亚如,艾远高,张鹏,吴慰. 半监督多视图相似性和鉴别表示联合学习[J]. 浙江大学学报(工学版), 2026, 60(9): 1991-1997.

Yaru HAO,Yuangao AI,Peng ZHANG,Wei WU. Semi-supervised multi-view similarity and discriminative representation joint learning. Journal of ZheJiang University (Engineering Science), 2026, 60(9): 1991-1997.

链接本文:

https://www.zjujournals.com/eng/CN/10.3785/j.issn.1008-973X.2026.09.016        https://www.zjujournals.com/eng/CN/Y2026/V60/I9/1991

图 1  SMLSDR的整体架构和训练流程
数据集视图数视图描述类别数样本数
WebKB2Page(3000)、Link(1840)21 051
AD3Base URL(495)、Image URL(457)、Target URL(472)23 279
Caltech-76Gabor(48)、WM(40)、CENTRIST(254)、HOG(1984)、GIST(512)、LBP(928)71 474
NUS-Object5CH(64)、BCM(225)、CORR(144)、EDH(73)、WT(128)3130 000
Noisy MNIST2Rotate(784)、Noise(784)1070 000
表 1  数据集介绍与统计
图 2  对比方法在WebKB上的性能比较
图 3  对比方法在AD上的性能比较
图 4  对比方法在Caltech-7上的性能比较
图 5  对比方法在NUS-Object上的性能比较
图 6  对比方法在Noisy MNIST上的性能比较
数据集Acc/%
SMLSDR?DDR?SMF
WebKB99.2196.3394.85
AD97.5895.2494.76
Caltech-797.5695.4393.42
NUS-Object44.8640.2836.45
Noisy MNIST98.8597.1496.55
表 2  SMLSDR在所有数据集上的性能
数据集Acc/%
LFGCFLCF
WebKB95.3197.8999.23
AD94.8596.5297.81
Caltech-792.6394.7597.76
NUS-Object37.3638.8544.68
Noisy MNIST95.8196.6498.78
表 3  相似矩阵融合策略在所有数据集上的性能对比
图 7  不同数据集上参数K对SMLSDR模型性能的影响
1 GUO T, WANG D, JIANG Z, et al. An enhanced deep convolutional neural network for person re-identification [C]//Proceedings of the IEEE International Conference on Multimedia and Expo Workshops. San Diego: IEEE, 2018: 1–6.
2 CAI J, DAN W, ZHANG X ℓ0-based sparse canonical correlation analysis with application to cross-language document retrieval[J]. Neurocomputing, 2019, 329: 32- 45
doi: 10.1016/j.neucom.2018.09.089
3 YU B X B, LIU Y, ZHANG X, et al MMNet: a model-based multimodal network for human action recognition in RGB-D videos[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023, 45 (3): 3522- 3538
doi: 10.1109/TPAMI.2022.3177813
4 LI Y, FAUTEUX F, ZOU J, et al Personalized prediction of genes with tumor-causing somatic mutations based on multi-modal deep Boltzmann machine[J]. Neurocomputing, 2019, 324: 51- 62
doi: 10.1016/j.neucom.2018.02.096
5 DUTTA P, MISHRA P, SAHA S Incomplete multi-view gene clustering with data regeneration using Shape Boltzmann machine[J]. Computers in Biology and Medicine, 2020, 125: 103965
doi: 10.1016/j.compbiomed.2020.103965
6 WANG M, SHAO W, HAO X, et al Identify consistent cross-modality imaging genetic patterns via discriminant sparse canonical correlation analysis[J]. IEEE/ACM Transactions on Computational Biology and Bioinformatics, 2021, 18 (4): 1549- 1561
doi: 10.1109/TCBB.2019.2944825
7 TRIVEDI A, RAI P, DUVALL S L, et al. Exploiting tag and word correlations for improved webpage clustering [C]//Proceedings of the 2nd International Workshop on Search and Mining User-Generated Contents. Toronto: ACM, 2010: 3-12.
8 LIU Y, LI Y, YUAN Y H, et al. Supervised deep canonical correlation analysis for multiview feature learning [C]//Neural Information Processing. Cham: Springer, 2017: 575–582.
9 QIU J L, LIU W, LU B L. Multi-view emotion recognition using deep canonical correlation analysis [C]//Neural Information Processing. Cham: Springer, 2018: 221–231.
10 ZHOU R, SHEN Y D. End-to-end adversarial-attention network for multi-modal clustering [C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Seattle: IEEE, 2020: 14607–14616.
11 TROSTEN D J, LØKSE S, JENSSEN R, et al. Reconsidering representation alignment for multi-view clustering [C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Nashville: IEEE, 2021: 1255–1265.
12 LIANG B, ZHENG L Specificity and latent correlation learning for action recognition using synthetic multi-view data from depth maps[J]. IEEE Transactions on Image Processing, 2017, 26 (12): 5560- 5574
doi: 10.1109/TIP.2017.2740122
13 LUO S, ZHANG C, ZHANG W, et al. Consistent and specific multi-view subspace clustering [C]// AAAI Conference on Artificial Intelligence. Palo Alto: AAAI, 2018: 3730-3737.
14 HU J, LU J, TAN Y P Sharable and individual multi-view metric learning[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2018, 40 (9): 2281- 2288
doi: 10.1109/TPAMI.2017.2749576
15 ZHOU T, ZHANG C, GONG C, et al Multiview latent space learning with feature redundancy minimization[J]. IEEE Transactions on Cybernetics, 2020, 50 (4): 1655- 1668
doi: 10.1109/TCYB.2018.2883673
16 LI Y, ZHU X, LI J, et al A curriculum-based pseudo-labeling method with attention-based fusion for semi-supervised multi-view learning[J]. Information Fusion, 2024, 103: 102128
17 HU P, PENG J, LI X, et al Rethinking consistency regularization for semi-supervised learning[J]. IEEE Transactions on Neural Networks and Learning Systems, 2025, 36 (1): 1182- 1196
18 KARASUYAMA M, MAMITSUKA H Multiple graph label propagation by sparse integration[J]. IEEE Transactions on Neural Networks and Learning Systems, 2013, 24 (12): 1999- 2012
doi: 10.1109/TNNLS.2013.2271327
19 BO X, KANG Z, ZHAO Z, et al. Latent multi-view semi-supervised classification [C]//Asian Conference on Machine Learning. Berlin: Springer, 2019: 348–362.
20 LIANG N, YANG Z, LI Z, et al Semi-supervised multi-view learning by using label propagation based non-negative matrix factorization[J]. Knowledge-Based Systems, 2021, 228: 107244
doi: 10.1016/j.knosys.2021.107244
21 BAHRAMI S, DORNAIKA F, BOSAGHZADEH A Joint auto-weighted graph fusion and scalable semi-supervised learning[J]. Information Fusion, 2021, 66: 213- 228
doi: 10.1016/j.inffus.2020.09.007
22 NIE F, CAI G, LI J, et al Auto-weighted multi-view learning for image clustering and semi-supervised classification[J]. IEEE Transactions on Image Processing, 2018, 27 (3): 1501- 1511
doi: 10.1109/TIP.2017.2754939
23 KANG Z, LU X, YI J, et al. Self-weighted multiple kernel learning for graph-based clustering and semi-supervised classification [C]//Proceedings of the 27th International Joint Conference on Artificial Intelligence. Palo Alto: AAAI, 2018: 2312-2318.
24 XUE Z, DU J, DU D, et al Deep constrained low-rank subspace learning for multi-view semi-supervised classification[J]. IEEE Signal Processing Letters, 2019, 26 (8): 1177- 1181
doi: 10.1109/LSP.2019.2923857
25 XIE Y, ZHANG W, QU Y, et al Hyper-Laplacian regularized multilinear multiview self-representations for clustering and semisupervised learning[J]. IEEE Transactions on Cybernetics, 2020, 50 (2): 572- 586
doi: 10.1109/TCYB.2018.2869789
26 NIE F, TIAN L, WANG R, et al Multiview semi-supervised learning model for image classification[J]. IEEE Transactions on Knowledge and Data Engineering, 2020, 32 (12): 2389- 2400
doi: 10.1109/TKDE.2019.2920985
27 ZHAO C, LI Y, ZHANG X, et al Generative-contrastive collaborative learning for semi-supervised multi-view classification[J]. IEEE Transactions on Multimedia, 2024, 26: 6800- 6813
28 HUANG A, CHEN W, ZHAO T, et al Joint learning of latent similarity and local embedding for multi-view clustering[J]. IEEE Transactions on Image Processing, 2021, 30: 6772- 6784
doi: 10.1109/TIP.2021.3096086
29 WANG B, JIANG J, WANG W, et al. Unsupervised metric fusion by cross diffusion [C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. New York: IEEE, 2012: 2997–3004.
30 WU F, JING X, WEI P, et al Semi-supervised multi-view graph convolutional networks with application to webpage classification[J]. Information Sciences, 2022, 591: 142- 154
doi: 10.1016/j.ins.2022.01.013
31 CHUA T S, TANG J, HONG R, et al. NUS-WIDE: a real-world web image database from National University of Singapore [C]//Proceedings of the ACM International Conference on Image and Video Retrieval. New York: ACM, 2009: 1-9.
32 LIU Y, WANG L, BAI Y, et al. Generative view-correlation adaptation for semi-supervised multi-view learning [C]// European Conference on Computer Vision. Heidelberg: Springer, 2020: 318–334.
33 JIA X, JING X Y, ZHU X, et al Semi-supervised multi-view deep discriminant representation learning[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2021, 43 (7): 2496- 2509
doi: 10.1109/TPAMI.2020.2973634
34 WANG X, FU L, ZHANG Y, et al MMatch: semi-supervised discriminative representation learning for multi-view classification[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2022, 32 (9): 6425- 6436
doi: 10.1109/TCSVT.2022.3159371
35 JIA X, JING X, ZHU X, et al Co-embedding: a semi-supervised multi-view representation learning approach[J]. Neural Computing and Applications, 2022, 34 (6): 4437- 4457
doi: 10.1007/s00521-021-06599-y
36 GUO W, WANG Z, DU W Robust semi-supervised multi-view graph learning with sharable and individual structure[J]. Pattern Recognition, 2023, 140: 109565
doi: 10.1016/j.patcog.2023.109565
[1] 陈捷丰,姚金良. 基于自相似嵌入和全局特征重排序的图像检索方法[J]. 浙江大学学报(工学版), 2025, 59(6): 1130-1139.
[2] 杨凯博,钟铭恩,谭佳威,邓智颖,周梦丽,肖子佶. 基于半监督学习的多场景火灾小规模稀薄烟雾检测[J]. 浙江大学学报(工学版), 2025, 59(3): 546-556.
[3] 刘半藤,叶赞挺,秦海龙,王柯,郑启航,王章权. 基于距离度量损失框架的半监督学习方法[J]. 浙江大学学报(工学版), 2023, 57(4): 744-752.
[4] 苏扬,张程,胡恩良. 基于平衡化谱聚类算法的高拱坝结构地震易损性研究[J]. 浙江大学学报(工学版), 2023, 57(11): 2254-2265.
[5] 凤丽洲,杨阳,王友卫,杨贵军. 基于Transformer和知识图谱的新闻推荐新方法[J]. 浙江大学学报(工学版), 2023, 57(1): 133-143.
[6] 史文韬,李红艳,崔建国,马熠阳,张翀,董颖虹. 极小降压空间下城市供水管网的DMA分区方法[J]. 浙江大学学报(工学版), 2022, 56(8): 1533-1541.
[7] 刘清清,周志勇,范国华,钱旭升,胡冀苏,陈光强,戴亚康. 基于3D scSE-UNet的肝脏CT图像半监督学习分割方法[J]. 浙江大学学报(工学版), 2021, 55(11): 2033-2044.
[8] 丰小月, 梁艳春, 林希珣, 管仁初. 永恒语言学习研究与发展[J]. 浙江大学学报(工学版), 2017, 51(1): 82-88.
[9] 赵伟明, 王殿海, 朱文韬, 戴美伟. 基于改进NJW算法的交通控制时段划分[J]. 浙江大学学报(工学版), 2014, 48(12): 2259-2265.
[10] 林亦宁, 韦巍, 戴渊明. 半监督Hough Forest跟踪算法[J]. J4, 2013, 47(6): 977-983.
[11] 姚伏天, 钱沄涛, 李吉明. 空间约束半监督高斯过程下的高光谱图像分类[J]. J4, 2012, 46(7): 1295-1300.
[12] 陈伟, 张成, 王灿,卜佳俊, 陈纯, 陈宏. 新闻数据流的在线事件检测[J]. J4, 2011, 45(6): 1006-1012.