Please wait a minute...
Frontiers of Computer Science

ISSN 2095-2228

ISSN 2095-2236(Online)

CN 10-1014/TP

Postal Subscription Code 80-970

2018 Impact Factor: 1.129

Front. Comput. Sci.    2020, Vol. 14 Issue (6) : 146322    https://doi.org/10.1007/s11704-020-8440-6
RESEARCH ARTICLE
Text-enhanced network representation learning
Yu ZHU1,2,3,4, Zhonglin YE1,2,3, Haixing ZHAO1,2,3(), Ke ZHANG5
1. School of Computer, Qinghai Normal University, Xining 810008, China
2. Key Laboratory of Tibetan Information Processing and Machine Translation, Xining 810008, China
3. Key Laboratory of Tibetan Information Processing, Ministry of Education, Xining 810008, China
4. Department of Computer Technology and Applications, Qinghai University, Xining 810016, China
5. School of Information Engineering, Huzhou University, Huzhou 313000, China
 Download: PDF(557 KB)  
 Export: BibTeX | EndNote | Reference Manager | ProCite | RefWorks
Abstract

Network representation learning called NRL for short aims at embedding various networks into lowdimensional continuous distributed vector spaces. Most existing representation learning methods focus on learning representations purely based on the network topology, i.e., the linkage relationships between network nodes, but the nodes in lots of networks may contain rich text features, which are beneficial to network analysis tasks, such as node classification, link prediction and so on. In this paper, we propose a novel network representation learning model, which is named as Text-Enhanced Network Representation Learning called TENR for short, by introducing text features of the nodes to learn more discriminative network representations, which come from joint learning of both the network topology and text features, and include common influencing factors of both parties. In the experiments, we evaluate our proposed method and other baseline methods on the task of node classification. The experimental results demonstrate that our method outperforms other baseline methods on three real-world datasets.

Keywords network representation      network topology      text features      joint learning     
Corresponding Author(s): Haixing ZHAO   
Just Accepted Date: 12 February 2020   Issue Date: 20 July 2020
 Cite this article:   
Yu ZHU,Zhonglin YE,Haixing ZHAO, et al. Text-enhanced network representation learning[J]. Front. Comput. Sci., 2020, 14(6): 146322.
 URL:  
https://academic.hep.com.cn/fcs/EN/10.1007/s11704-020-8440-6
https://academic.hep.com.cn/fcs/EN/Y2020/V14/I6/146322
1 G Tsoumakas, I Katakis. Multi-label classification: an overview. International Journal of Data Warehousing and Mining, 2007, 3(3): 1–13
https://doi.org/10.4018/jdwm.2007070101
2 C C Tu, Z Y Liu, M S Sun. Inferring correspondences from multiple sources for microblog user tags. In: Proceedings of the 3rd Chinese National Conference on Social Media Processing. 2014, 1–12
https://doi.org/10.1007/978-3-662-45558-6_1
3 H F Yu, P Jain, P Kar, I S Dhillon. Large-scale multi-label learning with missing labels. In: Proceedings of the 31st International Conference on Machine Learning. 2014, 593–601
4 D Libennowell, J M Kleinberg. The link-prediction problem for social networks. Journal of the Association for Information Science and Technology, 2007, 58(7): 1019–1031
https://doi.org/10.1002/asi.20591
5 B Perozzi, R Al-Rfou, S Skiena. DeepWalk: online learning of social representations. In: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2014, 701–710
https://doi.org/10.1145/2623330.2623732
6 A Grover, J Leskovec. Node2vec: scalable feature learning for networks. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2016, 855–864
https://doi.org/10.1145/2939672.2939754
7 J Tang, M Qu, M Z Wang, M Zhang, J Yan, Q Z Mei. Line: large-scale information network embedding. In: Proceedings of the 24th International Conference on World Wide Web. 2015, 1067–1077
https://doi.org/10.1145/2736277.2741093
8 S S Cao, W Lu, Q K Xu. Grarep: learning graph representations with global structural information. In: Proceedings of the 24th International Conference on Information and Knowledge Management. 2015, 891–900
https://doi.org/10.1145/2806416.2806512
9 D X Wang, P Cui, W W Zhu. Structural deep network embedding. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2016, 1225–1234
https://doi.org/10.1145/2939672.2939753
10 H C Chen, B Perozzi, Y F Hu, S Skiena. HARP: hierarchical representation learning for networks. In: Proceedings of the 32nd AAAI Conference on Artificial Intelligence. 2018, 2127–2134
11 C Yang, Z Y Liu, D L Zhao, M S Sun, E Y Chang. Network representation learning with rich text information. In: Proceedings of the 24th International Joint Conference on Artificial Intelligence. 2015, 2111–2117
12 C C Tu, H Liu, Z Y Liu, M S Sun. CANE: context-aware network embedding for relation modeling. In: Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics. 2017, 1722–1731
https://doi.org/10.18653/v1/P17-1158
13 T Mikolov, I Sutskever, K Chen, G Corrado, J Dean. Distributed representations of words and phrases and their compositionality. In: Proceedings of the 26th International Conference on Neural Information Processing Systems. 2013, 3111–3119
14 C C Tu, W C Zhang, Z Y Liu, M S Sun. Max-Margin DeepWalk: discriminative learning of network representation. In: Proceedings of the 25th International Joint Conference on Artificial Intelligence. 2016, 3889–3895
15 C C Tu, X K Zeng, H Wang, Z Y Zhang, Z Y Liu, M S Sun, B Zhang, L Y Lin. A unified framework for community detection and network representation learning. IEEE Transactions on Knowledge and Data Engineering, 2019, 31(6): 1051–1065
https://doi.org/10.1109/TKDE.2018.2852958
16 C Z Li, S Z Wang, D J Yang, Z J Li, Y Yang, X M Zhang, J S Zhou. PPNE: property preserving network embedding. In: Proceedings of the 22nd International Conference on Database Systems for Advanced Applications. 2017, 163–179
https://doi.org/10.1007/978-3-319-55753-3_11
17 D J Yang, S Z Wang, C Z Li, X M Zhang, Z J Li. From properties to links: deep network embedding on incomplete graphs. In: Proceedings of the 26th ACM International Conference on Information and Knowledge Management. 2017, 367–376
https://doi.org/10.1145/3132847.3132975
18 X F Sun, J Guo, X Ding, T Liu. A general framework for contentenhanced network representation learning. 2016, arXiv preprint arXiv:1610.02906
19 S R Pan, J Wu, X Q Zhu, C Q Zhang, Y Wang. Tri-party deep network representation. In: Proceedings of the 25th International Joint Conference on Artificial Intelligence. 2016, 1895–1901
20 H Zhou, Z Y Zhao, C Li, Y Q Liang, Q T Zeng. Rank2vec: learning node embeddings with local structure and global ranking. Expert Systems with Applications, 2019, 136: 276–287
https://doi.org/10.1016/j.eswa.2019.06.045
21 T Mikolov, K Chen, G Corrado, J Dean. Efficient estimation of word representations in vector space. In: Proceedings of the 1st International Conference on Learning Representations. 2013
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed