|
|
Text-enhanced network representation learning |
Yu ZHU1,2,3,4, Zhonglin YE1,2,3, Haixing ZHAO1,2,3( ), Ke ZHANG5 |
1. School of Computer, Qinghai Normal University, Xining 810008, China 2. Key Laboratory of Tibetan Information Processing and Machine Translation, Xining 810008, China 3. Key Laboratory of Tibetan Information Processing, Ministry of Education, Xining 810008, China 4. Department of Computer Technology and Applications, Qinghai University, Xining 810016, China 5. School of Information Engineering, Huzhou University, Huzhou 313000, China |
|
|
Abstract Network representation learning called NRL for short aims at embedding various networks into lowdimensional continuous distributed vector spaces. Most existing representation learning methods focus on learning representations purely based on the network topology, i.e., the linkage relationships between network nodes, but the nodes in lots of networks may contain rich text features, which are beneficial to network analysis tasks, such as node classification, link prediction and so on. In this paper, we propose a novel network representation learning model, which is named as Text-Enhanced Network Representation Learning called TENR for short, by introducing text features of the nodes to learn more discriminative network representations, which come from joint learning of both the network topology and text features, and include common influencing factors of both parties. In the experiments, we evaluate our proposed method and other baseline methods on the task of node classification. The experimental results demonstrate that our method outperforms other baseline methods on three real-world datasets.
|
Keywords
network representation
network topology
text features
joint learning
|
Corresponding Author(s):
Haixing ZHAO
|
Just Accepted Date: 12 February 2020
Issue Date: 20 July 2020
|
|
1 |
G Tsoumakas, I Katakis. Multi-label classification: an overview. International Journal of Data Warehousing and Mining, 2007, 3(3): 1–13
https://doi.org/10.4018/jdwm.2007070101
|
2 |
C C Tu, Z Y Liu, M S Sun. Inferring correspondences from multiple sources for microblog user tags. In: Proceedings of the 3rd Chinese National Conference on Social Media Processing. 2014, 1–12
https://doi.org/10.1007/978-3-662-45558-6_1
|
3 |
H F Yu, P Jain, P Kar, I S Dhillon. Large-scale multi-label learning with missing labels. In: Proceedings of the 31st International Conference on Machine Learning. 2014, 593–601
|
4 |
D Libennowell, J M Kleinberg. The link-prediction problem for social networks. Journal of the Association for Information Science and Technology, 2007, 58(7): 1019–1031
https://doi.org/10.1002/asi.20591
|
5 |
B Perozzi, R Al-Rfou, S Skiena. DeepWalk: online learning of social representations. In: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2014, 701–710
https://doi.org/10.1145/2623330.2623732
|
6 |
A Grover, J Leskovec. Node2vec: scalable feature learning for networks. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2016, 855–864
https://doi.org/10.1145/2939672.2939754
|
7 |
J Tang, M Qu, M Z Wang, M Zhang, J Yan, Q Z Mei. Line: large-scale information network embedding. In: Proceedings of the 24th International Conference on World Wide Web. 2015, 1067–1077
https://doi.org/10.1145/2736277.2741093
|
8 |
S S Cao, W Lu, Q K Xu. Grarep: learning graph representations with global structural information. In: Proceedings of the 24th International Conference on Information and Knowledge Management. 2015, 891–900
https://doi.org/10.1145/2806416.2806512
|
9 |
D X Wang, P Cui, W W Zhu. Structural deep network embedding. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2016, 1225–1234
https://doi.org/10.1145/2939672.2939753
|
10 |
H C Chen, B Perozzi, Y F Hu, S Skiena. HARP: hierarchical representation learning for networks. In: Proceedings of the 32nd AAAI Conference on Artificial Intelligence. 2018, 2127–2134
|
11 |
C Yang, Z Y Liu, D L Zhao, M S Sun, E Y Chang. Network representation learning with rich text information. In: Proceedings of the 24th International Joint Conference on Artificial Intelligence. 2015, 2111–2117
|
12 |
C C Tu, H Liu, Z Y Liu, M S Sun. CANE: context-aware network embedding for relation modeling. In: Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics. 2017, 1722–1731
https://doi.org/10.18653/v1/P17-1158
|
13 |
T Mikolov, I Sutskever, K Chen, G Corrado, J Dean. Distributed representations of words and phrases and their compositionality. In: Proceedings of the 26th International Conference on Neural Information Processing Systems. 2013, 3111–3119
|
14 |
C C Tu, W C Zhang, Z Y Liu, M S Sun. Max-Margin DeepWalk: discriminative learning of network representation. In: Proceedings of the 25th International Joint Conference on Artificial Intelligence. 2016, 3889–3895
|
15 |
C C Tu, X K Zeng, H Wang, Z Y Zhang, Z Y Liu, M S Sun, B Zhang, L Y Lin. A unified framework for community detection and network representation learning. IEEE Transactions on Knowledge and Data Engineering, 2019, 31(6): 1051–1065
https://doi.org/10.1109/TKDE.2018.2852958
|
16 |
C Z Li, S Z Wang, D J Yang, Z J Li, Y Yang, X M Zhang, J S Zhou. PPNE: property preserving network embedding. In: Proceedings of the 22nd International Conference on Database Systems for Advanced Applications. 2017, 163–179
https://doi.org/10.1007/978-3-319-55753-3_11
|
17 |
D J Yang, S Z Wang, C Z Li, X M Zhang, Z J Li. From properties to links: deep network embedding on incomplete graphs. In: Proceedings of the 26th ACM International Conference on Information and Knowledge Management. 2017, 367–376
https://doi.org/10.1145/3132847.3132975
|
18 |
X F Sun, J Guo, X Ding, T Liu. A general framework for contentenhanced network representation learning. 2016, arXiv preprint arXiv:1610.02906
|
19 |
S R Pan, J Wu, X Q Zhu, C Q Zhang, Y Wang. Tri-party deep network representation. In: Proceedings of the 25th International Joint Conference on Artificial Intelligence. 2016, 1895–1901
|
20 |
H Zhou, Z Y Zhao, C Li, Y Q Liang, Q T Zeng. Rank2vec: learning node embeddings with local structure and global ranking. Expert Systems with Applications, 2019, 136: 276–287
https://doi.org/10.1016/j.eswa.2019.06.045
|
21 |
T Mikolov, K Chen, G Corrado, J Dean. Efficient estimation of word representations in vector space. In: Proceedings of the 1st International Conference on Learning Representations. 2013
|
|
Viewed |
|
|
|
Full text
|
|
|
|
|
Abstract
|
|
|
|
|
Cited |
|
|
|
|
|
Shared |
|
|
|
|
|
Discussed |
|
|
|
|