Please wait a minute...
Frontiers of Computer Science

ISSN 2095-2228

ISSN 2095-2236(Online)

CN 10-1014/TP

Postal Subscription Code 80-970

2018 Impact Factor: 1.129

Front. Comput. Sci.    2021, Vol. 15 Issue (1) : 151603    https://doi.org/10.1007/s11704-020-9182-1
RESEARCH ARTICLE
Adversarial network embedding using structural similarity
Zihan ZHOU, Yu GU(), Ge YU
School of Computer Science and Engineering, Northeastern University, Shenyang 110819, China
 Download: PDF(548 KB)  
 Export: BibTeX | EndNote | Reference Manager | ProCite | RefWorks
Abstract

Network embedding which aims to embed a given network into a low-dimensional vector space has been proved effective in various network analysis and mining tasks such as node classification, link prediction and network visualization. The emerging network embedding methods have shifted of emphasis in utilizing mature deep learning models. The neuralnetwork based network embedding has become a mainstream solution because of its high efficiency and capability of preserving the nonlinear characteristics of the network. In this paper, we propose Adversarial Network Embedding using Structural Similarity (ANESS), a novel, versatile, low-complexity GANbased network embedding model which utilizes the inherent vertex-to-vertex structural similarity attribute of the network. ANESS learns robustness and effective vertex embeddings via a adversarial training procedure. Specifically, our method aims to exploit the strengths of generative adversarial networks in generating high-quality samples and utilize the structural similarity identity of vertexes to learn the latent representations of a network. Meanwhile, ANESS can dynamically update the strategy of generating samples during each training iteration. The extensive experiments have been conducted on the several benchmark network datasets, and empirical results demonstrate that ANESS significantly outperforms other state-of-theart network embedding methods.

Keywords network embedding      structural similarity      generative adversarial network     
Corresponding Author(s): Yu GU   
Just Accepted Date: 10 January 2020   Issue Date: 24 September 2020
 Cite this article:   
Zihan ZHOU,Yu GU,Ge YU. Adversarial network embedding using structural similarity[J]. Front. Comput. Sci., 2021, 15(1): 151603.
 URL:  
https://academic.hep.com.cn/fcs/EN/10.1007/s11704-020-9182-1
https://academic.hep.com.cn/fcs/EN/Y2021/V15/I1/151603
1 P Cui, X Wang, J Pei, W W Zhu. A survey on network embedding. IEEE Transactions on Knowledge and Data Engineering, 2019, 31(5): 833–852
https://doi.org/10.1109/TKDE.2018.2849727
2 B Perozzi, R Al-Rfou, S Skiena. Deepwalk: online learning of social representations. In: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2014, 701–710
https://doi.org/10.1145/2623330.2623732
3 G Tsoumakas, I Katakis. Multi-label classification: an overview. International Journal of Data Warehousing and Mining, 2007, 3(3): 1–13
https://doi.org/10.4018/jdwm.2007070101
4 XW Xu, N Yuruk, Z D Feng, T A Schweiger. Scan: a structural clustering algorithm for networks. In: Proceedings of the 13th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2007, 824–833
https://doi.org/10.1145/1281192.1281280
5 L Maaten, G Hinton. Visualizing data using t-SNE. Journal of Machine Learning Research, 2008, 9(Nov): 2579–2605
6 D Liben-Nowell, J Kleinberg. The link-prediction problem for social networks. Journal of the American Society for Information Science and Technology, 2007, 58(7): 1019–1031
https://doi.org/10.1002/asi.20591
7 J Lee, R Tukhvatov. Evaluations of similarity measures on vk for link prediction. Data Science and Engineering, 2018, 3(3): 277–289
https://doi.org/10.1007/s41019-018-0073-5
8 J Tang, M Qu, MZ Wang, M Zhang, J Yan, Q Z Mei. Line: large-scale information network embedding. In: Proceedings of the 24th International Conference on World Wide Web. 2015, 1067–1077
https://doi.org/10.1145/2736277.2741093
9 A Grover, J Leskovec. Node2vec: scalable feature learning for networks. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2016, 855–864
https://doi.org/10.1145/2939672.2939754
10 D X Wang, P Cui, W W Zhu. Structural deep network embedding. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2016, 1225–1234
https://doi.org/10.1145/2939672.2939753
11 Y F Ban, J H Pu, Y J Chen, Y H Wang. Negan: network embedding based on generative adversarial networks. In: Proceedings of the International Joint Conference on Neural Networks. 2018, 1–8
https://doi.org/10.1109/IJCNN.2018.8489481
12 H W Wang, J Wang, J L Wang, M Zhao, W N Zhang, F Z Zhang, X Xie, M Y Guo. Graphgan: graph representation learning with generative adversarial nets. In: Proceedings of the AAAI Conference on Artificial Intelligence. 2018, 2508–2515
13 Q Y Dai, Q Li, J Tang, D Wang. Adversarial network embedding. In: Proceedings of the AAAI Conference on Artificial Intelligence. 2018, 2167–2174
14 H C Gao, H Huang. Self-paced network embedding. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2018, 1406–1415
https://doi.org/10.1145/3219819.3220041
15 L Sang, M Xu, S Qian, X D Wu. AAANE: attention-based adversarial autoencoder for multi-scale network embedding. In: Proceedings of the Pacific-Asia Conference on Knowledge Discovery and Data Mining. 2019, 3–14
https://doi.org/10.1007/978-3-030-16142-2_1
16 I Goodfellow, J Pouget-Abadie, M Mirza, B Xu, D Warde-Farley, S Ozair, A Courville, Y Bengio. Generative adversarial nets. In: Proceedings of Advances in Neural Information Processing Systems. 2014, 2672–2680
17 S S Cao, W Lu, Q K Xu. Grarep: learning graph representations with global structural information. In: Proceedings of the 24th ACM International Conference on Information and Knowledge Management. 2015, 891–900
https://doi.org/10.1145/2806416.2806512
18 C Yang, M S Sun, Z Y Liu, C C Tu. Fast network embedding enhancement via high order proximity approximation. In: Proceedings of the 26th International Joint Conference on Artificial Intelligence. 2017, 19–25
https://doi.org/10.24963/ijcai.2017/544
19 X Wang, P Cui, J Wang, J Pei, W W Zhu, S Q Yang. Community preserving network embedding. In: Proceedings of the AAAI Conference on Artificial Intelligence. 2017, 203–209
20 S Wold, K Esbensen, P Geladi. Principal component analysis. Journal of Chemometrics and Intelligent Laboratory Systems, 1987, 2(1): 37–52
https://doi.org/10.1016/0169-7439(87)80084-9
21 L D Lathauwer, B D Moor, J Vandewalle. A multilinear singular value decomposition. Journal of Matrix Analysis and Applications, 2000, 21(4): 1253–1278
https://doi.org/10.1137/S0895479896305696
22 T Mikolov, I Sutskever, K Chen, G S Corrado, J Dean. Distributed representations of words and phrases and their compositionality. In: Proceedings of Advances in Neural Information Processing Systems. 2013, 3111–3119
23 T S Lyu, Y Zhang, Y Zhang. Enhancing the network embedding quality with structural similarity. In: Proceedings of the 26th ACM International Conference on Information and Knowledge Management. 2017, 147–156
https://doi.org/10.1145/3132847.3132900
24 S S Cao, u W L, Q K Xu. Deep neural networks for learning graph representations. In: Proceedings of the AAAI Conference on Artificial Intelligence. 2016, 1145–1152
25 T N Kipf, M Welling. Variational graph auto-encoders. 2016, arXiv preprint arXiv:1611.07308
26 T N Kipf, M Welling. Semi-supervised classification with graph convolutional networks. In: Proceedings of International Conference on Learning Representations. 2017
27 P Velikovi, W Fedus, W L Hamilton, P Liò, Y Bengio, R D Hjelm. Deep graph infomax. In: Proceedings of International Conference on Learning Representations. 2019
28 H C Gao, J Pei, H Huang. Progan: network embedding via proximity generative adversarial network. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2019, 1308–1316
https://doi.org/10.1145/3292500.3330866
29 Y W Sun, S H Wang, T Hsieh, X F Tang, V G Honavar. MEGAN: a generative adversarial network for multi-view network embedding. In: Proceedings of the 28th International Joint Conference on Artificial Intelligence. 2019, 3527–3533
https://doi.org/10.24963/ijcai.2019/489
30 B Hu, Y Fang, C Shi. Adversarial learning on heterogeneous information networks. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2019, 120–129
https://doi.org/10.1145/3292500.3330970
31 W C Yu, C Zheng, W Cheng, C C Aggarwal, D J Song, B Zong, H F Chen, W Wang. Learning deep network representations with adversarially regularized autoencoders. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2018, 2663–2671
https://doi.org/10.1145/3219819.3220000
32 L J Chang, W Li, X M Lin, L Qin, W J Zhang. Pscan: fast and exact structural graph clustering. In: Proceedings of the 32nd IEEE International Conference on Data Engineering. 2016, 253–264
https://doi.org/10.1109/ICDE.2016.7498245
33 C Yang, Z Y Liu, D L Zhao, M S Sun, E Y Chang. Network representation learning with rich text information. In: Proceedings of the 24th International Joint Conference on Artificial Intelligence. 2015, 2111–2117
[1] Article highlights Download
[1] Zihou WANG, Yanni HAN, Tao LIN, Yuemei XU, Song CI, Hui TANG. Topology-aware virtual network embedding based on closeness centrality[J]. Front Comput Sci, 2013, 7(3): 446-457.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed