基于多任务学习与层叠 Transformer 的多模态情感分析模型

陈巧红,孙佳锦,漏杨波,方志坚

Multimodal sentiment analysis model based on multi-task learning and stacked cross-modal Transformer

Qiao-hong CHEN,Jia-jin SUN,Yang-bo LOU,Zhi-jian FANG

表 5 SIMS数据集上的模态融合顺序实验结果

Tab.5 Results of mode fusion sequence in SIMS dataset

模态融合顺序 Acc2/% F1/% Acc3/% MAE Corr V→(A→T) 84.18 83.89 71.42 38.85 64.89 A→(V→T) 83.04 83.02 70.41 43.74 57.35 V→(T→A) 83.04 82.82 70.55 43.33 58.55 T→(V→A) 83.82 83.63 70.59 43.08 59.62 T→(A→V) 82.94 83.02 70.41 42.92 58.42 A→(T→V) 83.71 83.88 71.07 41.08 61.16