基于元路径属性融合的异质网络表示学习

Heterogeneous network representation learning based on metapath attribute fusion

摘要

针对信息网络的表示学习进行研究,提出了一种基于元路径信息融合的异质图神经网络(metapath attribute fusion graph neural network, MAFGNN),通过在异质网络中引入元路径之前将目标节点的邻居信息包括元路径信息融入到节点中,实现目标节点和邻居信息的融合。该方法首先将不同类型的节点属性特征进行维度转换便于后续的融合操作,通过计算目标节点和邻居节点权重值完成目标节点信息的融合操作。然后根据特定元路径对目标节点进行融合,最后在不同元路径间实现不同语义信息的融合操作。在多个异质信息数据集上进行实验表明,MAFGNN模型在处理异质网络节点嵌入方面相比于最先进的基准实验有最好的性能和更加准确的预测结果。

Abstract

Focusing on the research on representation learning of information networks, a metapath attribute fusion graph neural network (MAFGNN) based on metapath information fusion is proposed, which is to integrate the neighbor information of the target node, including the metapath information, into the node before introducing the metapath in the heterogeneous network to achieve the fusion of target node and neighbor information. This method first converts the attribute features of different types of nodes into dimensions to facilitate subsequent fusion operations. The fusion operation of target node information is completed by calculating the weight values of target nodes and neighbor nodes. Then target nodes are fused according to specific metapaths, and finally different semantic information is fused between different metapaths. Experiments on multiple heterogeneous information datasets show that the MAFGNN model has the best performance and more accurate prediction results than the most advanced benchmark experiments in dealing with heterogeneous network node embedding.

关键词

元路径 / 异质信息网络 / 异质图嵌入 / 信息融合 / 注意力机制

Key words

metapath / heterogeneous information network / heterogeneous graph embedding / information fusion / attention mechanism

参考文献

[1] ATWOOD J, TOWSLEY D. Diffusion—convolutional neural networks[J]. Advances in Neural Information Processing Systems, 2016, 29: 2001-2009.

[2] SHI Chuan, LI Yitong, ZHANG Jiawei, et al. A survey of heterogeneous information network analysis[J]. IEEE Transactions on Knowledge and Data Engineering, 2016, 29(1): 17-37.

[3] SUN Yizhou, HAN Jiawei. Mining heterogeneous information networks: a structural analysis approach[J]. Association for Computing Machinery, 2013, 14(2): 20-28.

[4] CUI Peng, WANG Xiao, PEI Jian, et al. A survey on network embedding[J]. IEEE Transactions on Knowledge and Data Engineering, 2018, 31(5): 833-852.

[5] CAO B, LIU N N, YANG Q. Transfer learning for collective link prediction in multiple heterogenous domains[C]// WROBEL S. Proceedings of the 27th International Conference on Machine Learning. Haifa, Israel: DAUMÉ III H, 2010: 159-166.

[6] MIKOLOV T, CHEN K, CORRADO G, et al. Efficient estimation of word representations in vector space[EB/OL]. (2013—09—07)[2023—09—23]. https://arxiv.org/abs/1301.3781.

[7] PEROZZI B, AL—RFOU R, SKIENA S. Deepwalk: online learning of social representations[C]// MACSKASSY S. Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. New York: Association for Computing Machinery, 2014: 701-710.

[8] DONG Y, CHAWLA N V, SWAMI A. Metapath2vec: scalable representation learning for heterogeneous networks[C]// MATWIN S. Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. Halifax, Canada: Association for Computing Machinery, 2017: 135-144.

[9] SUN Yizhou, HAN Jiawei, YAN Xifeng, et al. Pathsim: metapath—based top—k similarity search in heterogeneous information networks[J]. Proceedings of the VLDB Endowment, 2011, 4(11): 992-1003.

[10] LEE S, PARK C, YU H. BHIN2vec: balancing the type of relation in heterogeneous information network[C]// ZHU Wenwu. Proceedings of the 28th ACM International Conference on Information and Knowledge Management. New York: Association for Computing Machinery, 2019: 619-628.

[11] WANG X, JI H, SHI C, et al. Heterogeneous graph attention network[C]// LIN G. The World Wide Web Conference. New York: Association for Computing Machinery, 2019: 2022-2032.

[12] FU Xinyu, ZHANG Jiani, MENG Ziqiao, et al. MAGNN: metapath aggregated graph neural network for heterogeneous graph embedding[C]// HUANG Y N. Proceedings of The Web Conference 2020. Taipei: Association for Computing Machinery, 2020: 2331-2341.

[13] WANG Xiao, LU Yuanfu, SHI Chuan, et al. Dynamic heterogeneous information network embedding with meta—path based proximity[J]. IEEE Transactions on Knowledge and Data Engineering, 2020, 34(3): 1117-1132.

[14] XUE Hansheng, YANG Luwei, JIANG Wen, et al. Modeling dynamic heterogeneous network for link prediction using hierarchical attention with temporal RNN[C]// BIET D. Machine Learning and Knowledge Discovery in Databases. Ghent, Belgium: Springer, 2020: 282-298.

[15] MIKOLOV T, SUTSKEVER I, CHEN K, et al. Distributed representations of words and phrases and their compositionality[J]. Advances in Neural Information Processing Systems, 2013, 26: 3111-3119.

[16] TANG Jian, QU Meng, WANG Mingzhe, et al. LINE: large—scale information network embedding[C]// GANGEMI A. Proceedings of the 24th International Conference on World Wide Web. Florence, Italy: Association for Computing Machinery, 2015: 1067-1077.

[17] RIBEIRO L F R, SAVERESE P H P, FIGUEIREDO D R. Struc2vec: learning node representations from structural identity[C]// MATWIN S. Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. Halifax, Canada: Association for Computing Machinery, 2017: 385-394.

[18] WU Zonghan, PAN Shirui, CHEN Fengwen, et al. A comprehensive survey on graph neural networks[J]. IEEE Transactions on Neural Networks and Learning Systems, 2020, 32(1): 4-24.

[19] KIPF T N, WELLING M. Semi—supervised classification with graph convolutional networks[EB/OL]. (2017—02—22)[2023—09—23]. https://arxiv.org/abs/1609.02907.

[20] VELIČKOVIĆ P, CUCURULL G, CASANOVA A, et al. Graph attention networks[EB/OL]. (2018—02—04)[2023—09—23]. https://arxiv.org/abs/1710.10903.

[21] VASWANI A, SHAZEER N, PARMAR N, et al. Attention is all you need[J]. Advances in Neural Information Processing Systems, 2017, 30: 6000-6010.

[22] FU T, LEE W C, LEI Z. HIN2Vec: explore meta—paths in heterogeneous information networks for representation learning[C]// LIM E P. Proceedings of the 2017 ACM on Conference on Information and Knowledge Management. Singapore: Association for Computing Machinery, 2017: 1797-1806.

[23] SHANG Jingbo, QU Meng, LIU Jialu, et al. Meta—path guided embedding for similarity search in large—scale heterogeneous information networks[EB/OL]. (2016—10—31)[2023—09—23]. https://arxiv.org/abs/1610.09769.

[24] GUAN Mengya, CAI Xinjun, SHANG Jiaxing, et al. HMSG: heterogeneous graph neural network based on metapath subgraph learning[EB/OL]. (2021—09—07)[2023—09—23]. https://arxiv.org/abs/2109.02868.

[25] ZHOU Sheng, BU Jiajun, WANG Xin, et al. HAHE: hierarchical attentive heterogeneous information network embedding[EB/OL]. (2019—05—14)[2023—09—23]. https://arxiv.org/abs/1902.01475.

[26] ZHANG Chuxu, SONG Dongjin, HUANG Chao, et al. Heterogeneous graph neural network[C]// TEREDesai A. Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. Anchorage, USA: Association for Computing Machinery, 2019: 793-803.

[27] BOLYA D, FU C Y, DAI X L, et al. Hydra attention: efficient attention with many heads[EB/OL]. (2023—02—12)[ 2023—09—23]. https://arxiv.org/abs/2209.07484.

基金资助

河北省自然科学基金资助项目(F2021205014)

河北省高等学校科学技术研究项目(ZD2022139)

中央引导地方科技发展资金项目(226Z1808G)