Please wait a minute...
Journal of ZheJiang University (Engineering Science)  2019, Vol. 53 Issue (11): 2163-2167    DOI: 10.3785/j.issn.1008-973X.2019.11.014
Computer Technology and Control Engineering     
Aggregate graph embedding method based on non-uniform neighbor nodes sampling
Si CHEN(),Xiao-dong CAI*(),Zhen-zhen HOU,Bo LI
School of Information and Communication, Guilin University of Electronic Technology, Guilin 541004, China
Download: HTML     PDF(562KB) HTML
Export: BibTeX | EndNote (RIS)      

Abstract  

Aiming at the problem that the uniform sampling function is widely used in aggregate graph embedding methods to construct neighborhoods for nodes in a graph, i.e. neighbor nodes are sampled randomly, and the differences of their properties are neglected, a non-uniform neighbor nodes sampling method was proposed. The neighbor nodes of the target node with larger degrees are sampled preferentially. Some neighbor nodes with lower degrees are hidden so that they do not appear during the sampling process. The remaining nodes in the neighbor node set are randomly sampled to preserve sampling randomness, then these randomly sampled nodes and the preferentially sampled nodes form the neighborhood of the target node. The proposed non-uniform neighbor nodes sampling method was applied to the graph embedding process. Experimental results showed that the proposed method can be used to improve the classification F1 score of graph embedding to 91.7% on the Reddit dataset, and the results was superior than that of several known graph embedding methods. Experiments on the overlapping community dataset PPI also confirmed that the proposed method can be used to generate embedding with higher quality for graph data.



Key wordsgraph embedding      network embedding      non-uniform sampling      graph convolutional network      neighborhood aggregation     
Received: 19 September 2018      Published: 21 November 2019
CLC:  TP 183  
Corresponding Authors: Xiao-dong CAI     E-mail: 646299680@qq.com;caixiaodong@guet.edu.cn
Cite this article:

Si CHEN,Xiao-dong CAI,Zhen-zhen HOU,Bo LI. Aggregate graph embedding method based on non-uniform neighbor nodes sampling. Journal of ZheJiang University (Engineering Science), 2019, 53(11): 2163-2167.

URL:

http://www.zjujournals.com/eng/10.3785/j.issn.1008-973X.2019.11.014     OR     http://www.zjujournals.com/eng/Y2019/V53/I11/2163


基于非均匀邻居节点采样的聚合式图嵌入方法

针对已有聚合式图嵌入方法多采用均匀采样函数为图中节点构建邻域,即仅随机采样邻居节点,而忽略各邻居节点自身性质的差异的问题,提出基于度值的非均匀邻居节点采样方法. 针对目标节点,优先采样其度值较大的邻居节点;隐藏一批度值较小的邻居节点,使它们在采样过程中不出现;在邻居节点集中随机采样剩余的节点以保留一定的采样随机性,这些随机采样的节点与优先采样的节点组成目标节点的邻域. 将所提出的非均匀邻居节点采样方法应用于图嵌入过程,在Reddit数据集上的图嵌入分类F1分数为91.7%,该结果优于几个知名的图嵌入方法的结果. 在重叠社团数据集PPI上的实验证实提出方法能够为图数据生成更高质量的嵌入.


关键词: 图嵌入,  网络嵌入,  非均匀采样,  图卷积网络,  邻域聚合 
Fig.1 Neighbor nodes sampling and neighborhood aggregation
Fig.2 Flow block chart of graph embedding
方法 F1分数 方法 F1分数
Random 0.043 GraphSAGE 0.897
DeepWalk 0.324 NonUniform 0.917
RawFeatures 0.585
Tab.1 Experimental results of F1 score on Reddit dataset
方法 F1分数 方法 F1分数
Random 0.396 RawFeatures 0.422
GraphSAGE 0.447 NonUniform 0.458
Tab.2 Experimental results of F1 score on PPI dataset
数据集 F1分数
NonUniform NonUniform-1
Reddit 0.917 0.911
PPI 0.458 0.453
Tab.3 Difference of F1 score between NonUniform and NonUniform-1
[1]   HAMILTON W L, YING R, LESKOVEC J Representation learning on graphs: methods and applications[J]. IEEE Data Engineering Bulletin, 2017, 40 (3): 52- 74
[2]   GOYAL P, FERRARA E Graph embedding techniques, applications, and performance: a survey[J]. Knowledge Based Systems, 2017, 151: 78- 94
[3]   BELKIN M, NIYOGI P. Laplacian eigenmaps and spectral techniques for embedding and clustering [C] // Advances in Neural Information Processing Systems 14. Vancouver: NIPS, 2001: 585-591.
[4]   ROWEIS S T, SAUL L K Nonlinear dimensionality reduction by locally linear embedding[J]. Science, 2000, 290 (5500): 2323- 2326
doi: 10.1126/science.290.5500.2323
[5]   CAO S, LU W, XU Q. GraRep: learning graph representations with global structural information [C]// ACM International Conference on Information and Knowledge Management. Melbourne: ACM, 2015: 891-900.
[6]   PEROZZI B, AL-RFOU R, SKIENA S. DeepWalk: online learning of social representations [C]// ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. New York: ACM, 2014: 701-710.
[7]   GROVER A, LESKOVEC J. Node2vec: scalable feature learning for networks [C]// ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. San Francisco: ACM, 2016: 855-864.
[8]   KIPFT N, WELLING M. Semi-supervised classification with graph convolutional networks [C]// International Conference on Learning Representations. San Juan: ICLR, 2016.
[9]   DEFFERRARD M, BRESSON X, VANDERGHEYNST P. Convolutional neural networks on graphs with fast localized spectral filtering [C]// Advances in Neural Information Processing Systems 29. Barcelona: NIPS, 2016: 3837-3845.
[10]   WANG D, CUI P, ZHU W. Structural deep network embedding [C]// ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. San Francisco: ACM, 2016: 1225-1234.
[11]   HAMILTON W L, YING R, LESKOVEC J. Inductive representation learning on large graphs [C]// Advances in Neural Information Processing Systems 30. Long Beach: NIPS, 2017.
[1] Shi-da CHEN,Qiang LIU,Liang HAN. Gradient sparsification compression approach to reducing communication in distributed training[J]. Journal of ZheJiang University (Engineering Science), 2021, 55(2): 386-394.
[2] Chuang LIU,Jun LIANG. Vehicle motion trajectory prediction based on attention mechanism[J]. Journal of ZheJiang University (Engineering Science), 2020, 54(6): 1156-1163.
[3] Ping YANG,Dan WANG,Zi-jian KAGN,Tong LI,Li-hua FU,Yue-ren YU. Prediction model of paroxysmal atrial fibrillation based on pattern recognition and ensemble CNN-LSTM[J]. Journal of ZheJiang University (Engineering Science), 2020, 54(5): 1039-1048.
[4] Hao LI,Wen-jie ZHAO,Bo HAN. Convolutional neural network acceleration algorithm based on filters pruning[J]. Journal of ZheJiang University (Engineering Science), 2019, 53(10): 1994-2002.
[5] CUI Li-li, ZHANG Hua-guang, LUO Yan-hong. Adaptive critic design of nonlinear system with unknown control direction[J]. Journal of ZheJiang University (Engineering Science), 2012, 46(5): 853-857.
[6] ZHU Bei-dou, GONG Guo-fang, ZHOU Ru-lin, LIU Guo-bin. Identification of strata with BP neural network
based on parameters of shield driving
[J]. Journal of ZheJiang University (Engineering Science), 2011, 45(5): 851-857.
[7] MA Yu-Liang, XU Wen-Liang, MENG Meng, LUO Zhi-Ceng, YANG Jia-Jiang. Adaptive control for intelligent lower limb prosthesis based on
neural network
[J]. Journal of ZheJiang University (Engineering Science), 2010, 44(7): 1373-1376.
[8] DIAO Qing-Ying, GAO An-Chun. Ant conlony optimizationbased approach for selective neural network ensemble[J]. Journal of ZheJiang University (Engineering Science), 2009, 43(09): 1568-1573.
[9] ZHANG Jian-Hai, ZHANG Sen-Lin, LIU Mei-Qin. Robust stability analysis of delayed discretetime standard neural network model[J]. Journal of ZheJiang University (Engineering Science), 2009, 43(8): 1383-1388.