|
|
|
| Aspect-based sentiment analysis via knowledge-enhanced graph Transformer |
Wenjun ZHENG1,2( ),Zhikun LI1,Shoufei HAN1,2,3,*( ) |
1. School of Artificial Intelligence, Anhui University of Science and Technology, Hefei 231131, China 2. State Key Laboratory of Digital Intelligent Technology for Unmanned Coal Mining, Anhui University of Science and Technology, Huainan 232001, China 3. Key Laboratory of Computing Power Network and Information Security, Ministry of Education, Qilu University of Technology (Shandong Academy of Sciences), Jinan 250300, China |
|
|
|
Abstract A knowledge-enhanced graph Transformer network (K-GTNet) was proposed in order to address the reasoning limitation of existing aspect-based sentiment analysis method caused by insufficient feature interaction and lack of knowledge utilization. A logical framework of “prior knowledge guidance–local syntactic modeling–global semantic reasoning” was constructed to achieve a deep understanding of complex textual sentiment. External sentiment knowledge and internal syntactic structure were fused to construct a graph representation with edge dependency weight. Neighborhood information was aggregated on this graph through a graph neural network, and local sentiment feature centered on aspect term was captured. The extracted local-aware feature sequence was fed into a Transformer. Global contextual dependency was built through self-attention mechanism, and robust aspect sentiment polarity classification was achieved. Experiments conducted on five benchmark datasets demonstrated that K-GTNet achieved average accuracy of 84.95% and F1 of 77.96%, outperforming mainstream baseline model.
|
|
Received: 02 August 2025
Published: 06 May 2026
|
|
|
| Fund: 安徽理工大学青年基金资助项目(QNYB202204);国家自然科学基金资助项目(62306279);中国博士后面上基金资助项目(2424M760592);算力互联网与信息安全教育部重点实验室开放基金资助项目(2024Y005). |
|
Corresponding Authors:
Shoufei HAN
E-mail: zwj@aust.edu.cn;hanshoufei@gmail.com
|
知识增强图Transformer的方面级情感分析
针对现有方面级情感分析方法因特征交互不足与知识利用缺失而导致的推理局限,提出知识增强的图Transformer网络(K-GTNet). 通过构建“先验知识引导—局部句法建模—全局语义推理”的逻辑框架,实现对复杂文本情感的深入理解. 该方法融合外部情感知识与内部句法结构,构建带有边依赖权重的图表示. 通过图神经网络在该图上进行邻域信息聚合,捕捉以方面词为中心的局部情感特征. 将提取的局部感知特征序列输入Transformer,通过自注意力机制建立全局上下文依赖,实现鲁棒的方面情感极性判别. 在5个基准数据集上进行实验验证,K-GTNet的平均准确率达到84.95%,F1达到77.96%,优于主流的基线模型.
关键词:
自然语言处理,
情感分析,
知识增强,
图神经网络,
Transformer
|
|
| [21] |
ZHAO A, YU Y Knowledge-enabled BERT for aspect-based sentiment analysis[J]. Knowledge-Based Systems, 2021, 227: 107220
doi: 10.1016/j.knosys.2021.107220
|
|
|
| [22] |
ZHANG Z, ZHOU Z, WANG Y. SSEGCN: syntactic and semantic enhanced graph convolutional network for aspect-based sentiment analysis [C]//Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Seattle: ACL, 2022: 4916–4925.
|
|
|
| [23] |
HAN Y, ZHOU X, WANG G, et al Fusing sentiment knowledge and inter-aspect dependency based on gated mechanism for aspect-level sentiment classification[J]. Neurocomputing, 2023, 551: 126462
doi: 10.1016/j.neucom.2023.126462
|
|
|
| [24] |
WU H, ZHOU D, SUN C, et al LSOIT: lexicon and syntax enhanced opinion induction tree for aspect-based sentiment analysis[J]. Expert Systems with Applications, 2024, 235: 121137
doi: 10.1016/j.eswa.2023.121137
|
|
|
| [1] |
LIU X, HOU R, GAN Y, et al. Aspect-oriented opinion alignment network for aspect-based sentiment classification [C]//Proceedings of the 26th European Conference on Artificial Intelligence. Ohmsha: IOS, 2023: 1552-1559.
|
|
|
| [2] |
陈巧红, 孙佳锦, 漏杨波, 等 基于多任务学习与层叠Transformer的多模态情感分析模型[J]. 浙江大学学报: 工学版, 2023, 57 (12): 2421- 2429 CHEN Qiaohong, SUN Jiajin, LOU Yangbo, et al Multimodal sentiment analysis model based on multi-task learning and stacked cross-modal Transformer[J]. Journal of Zhejiang University: Engineering Science, 2023, 57 (12): 2421- 2429
|
|
|
| [3] |
WANG Y, HUANG M, ZHU X, et al. Attention-based LSTM for aspect-level sentiment classification [C]//Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing. Austin: ACL, 2016: 606–615.
|
|
|
| [4] |
ZHU C, YI B, LUO L Base on contextual phrases with cross-correlation attention for aspect-level sentiment analysis[J]. Expert Systems with Applications, 2024, 241: 122683
doi: 10.1016/j.eswa.2023.122683
|
|
|
| [5] |
程艳, 胡建生, 赵松华, 等 融合Transformer和交互注意力网络的方面级情感分类模型[J]. 智能系统学报, 2024, 19 (3): 728- 737 CHENG Yan, HU Jiansheng, ZHAO Songhua, et al Aspect-level sentiment classification model combining Transformer and interactive attention network[J]. CAAI Transactions on Intelligent Systems, 2024, 19 (3): 728- 737
doi: 10.11992/tis.202303016
|
|
|
| [6] |
PHAN H T, NGUYEN N T, HWANG D Aspect-level sentiment analysis: a survey of graph convolutional network methods[J]. Information Fusion, 2023, 91: 149- 172
doi: 10.1016/j.inffus.2022.10.004
|
|
|
| [7] |
SHANG W, CHAI J, CAO J, et al Aspect-level sentiment analysis based on aspect-sentence graph convolution network[J]. Information Fusion, 2024, 104: 102143
doi: 10.1016/j.inffus.2023.102143
|
|
|
| [8] |
程艳芬, 吴家俊, 何凡 基于关系门控图卷积网络的方面级情感分析[J]. 浙江大学学报: 工学版, 2023, 57 (3): 437- 445 CHENG Yanfen, WU Jiajun, HE Fan Aspect level sentiment analysis based on relation gated graph convolutional network[J]. Journal of Zhejiang University: Engineering Science, 2023, 57 (3): 437- 445
|
|
|
| [9] |
ZHAO X, PENG H, DAI Q, et al. RDGCN: reinforced dependency graph convolutional network for aspect-based sentiment analysis [C]//Proceedings of the 17th ACM International Conference on Web Search and Data Mining. Merida, Mexico: ACM, 2024: 976-984.
|
|
|
| [10] |
LI R, CHEN H, FENG F, et al DualGCN: exploring syntactic and semantic information for aspect-based sentiment analysis[J]. IEEE Transactions on Neural Networks and Learning Systems, 2024, 35 (6): 7642- 7656
doi: 10.1109/TNNLS.2022.3219615
|
|
|
| [11] |
WANG Z, ZHANG B, YANG R, et al. DAGCN: distance-based and aspect-oriented graph convolutional network for aspect-based sentiment analysis [C]//Proceedings of the Findings of the Association for Computational Linguistics: NAACL 2024. Mexico City: ACL, 2024: 1863–1876.
|
|
|
| [12] |
CHEN B, OUYANG Q, LUO Y, et al. S2GSL: incorporating segment to syntactic enhanced graph structure learning for aspect-based sentiment analysis [C]//Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). Bangkok: ACL, 2024: 13366–13379.
|
|
|
| [13] |
YIN S, ZHONG G. TextGT: a double-view graph transformer on text for aspect-based sentiment analysis [C]//Proceedings of the AAAI Conference on Artificial Intelligence. Palo Alto: AAAI, 2024: 19404-19412.
|
|
|
| [14] |
LIANG B, SU H, GUI L, et al Aspect-based sentiment analysis via affective knowledge enhanced graph convolutional networks[J]. Knowledge-Based Systems, 2022, 235: 107643
doi: 10.1016/j.knosys.2021.107643
|
|
|
| [15] |
段文杰, 邓金科, 张顺香, 等 基于多层次知识增强的方面级情感分析模型[J]. 智能系统学报, 2024, 19 (5): 1287- 1297 DUAN Wenjie, DENG Jinke, ZHANG Shunxiang, et al Aspect-based sentiment analysis model based on multilevel knowledge enhancement[J]. CAAI Transactions on Intelligent Systems, 2024, 19 (5): 1287- 1297
doi: 10.11992/tis.202308044
|
|
|
| [16] |
ZHONG Q, DING L, LIU J, et al Knowledge graph augmented network towards multiview representation learning for aspect-based sentiment analysis[J]. IEEE Transactions on Knowledge and Data Engineering, 2023, 35 (10): 10098- 10111
doi: 10.1109/TKDE.2023.3250499
|
|
|
| [17] |
何勇禧, 韩虎, 孔博 基于多依赖图和知识融合的方面级情感分析模型[J]. 浙江大学学报: 工学版, 2024, 58 (4): 737- 747 HE Yongxi, HAN Hu, KONG Bo Aspect-based sentiment analysis model based on multi-dependency graph and knowledge fusion[J]. Journal of Zhejiang University: Engineering Science, 2024, 58 (4): 737- 747
|
|
|
| [18] |
WAN B, WU P, HAN P, et al Aspect-based sentiment analysis by knowledge and attention integrated graph convolutional network[J]. Applied Soft Computing, 2025, 171: 112763
doi: 10.1016/j.asoc.2025.112763
|
|
|
| [19] |
BAI H, WANG D L, FENG S, et al EKBSA: a Chinese sentiment analysis model by enhancing K-BERT[J]. Journal of Computer Science and Technology, 2025, 40 (1): 60- 72
doi: 10.1007/s11390-024-2870-9
|
|
|
|
Viewed |
|
|
|
Full text
|
|
|
|
|
Abstract
|
|
|
|
|
Cited |
|
|
|
|
| |
Shared |
|
|
|
|
| |
Discussed |
|
|
|
|