|
|
Adversarial network embedding using structural similarity |
Zihan ZHOU, Yu GU(), Ge YU |
School of Computer Science and Engineering, Northeastern University, Shenyang 110819, China |
|
|
Abstract Network embedding which aims to embed a given network into a low-dimensional vector space has been proved effective in various network analysis and mining tasks such as node classification, link prediction and network visualization. The emerging network embedding methods have shifted of emphasis in utilizing mature deep learning models. The neuralnetwork based network embedding has become a mainstream solution because of its high efficiency and capability of preserving the nonlinear characteristics of the network. In this paper, we propose Adversarial Network Embedding using Structural Similarity (ANESS), a novel, versatile, low-complexity GANbased network embedding model which utilizes the inherent vertex-to-vertex structural similarity attribute of the network. ANESS learns robustness and effective vertex embeddings via a adversarial training procedure. Specifically, our method aims to exploit the strengths of generative adversarial networks in generating high-quality samples and utilize the structural similarity identity of vertexes to learn the latent representations of a network. Meanwhile, ANESS can dynamically update the strategy of generating samples during each training iteration. The extensive experiments have been conducted on the several benchmark network datasets, and empirical results demonstrate that ANESS significantly outperforms other state-of-theart network embedding methods.
|
Keywords
network embedding
structural similarity
generative adversarial network
|
Corresponding Author(s):
Yu GU
|
Just Accepted Date: 10 January 2020
Issue Date: 24 September 2020
|
|
1 |
P Cui, X Wang, J Pei, W W Zhu. A survey on network embedding. IEEE Transactions on Knowledge and Data Engineering, 2019, 31(5): 833–852
https://doi.org/10.1109/TKDE.2018.2849727
|
2 |
B Perozzi, R Al-Rfou, S Skiena. Deepwalk: online learning of social representations. In: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2014, 701–710
https://doi.org/10.1145/2623330.2623732
|
3 |
G Tsoumakas, I Katakis. Multi-label classification: an overview. International Journal of Data Warehousing and Mining, 2007, 3(3): 1–13
https://doi.org/10.4018/jdwm.2007070101
|
4 |
XW Xu, N Yuruk, Z D Feng, T A Schweiger. Scan: a structural clustering algorithm for networks. In: Proceedings of the 13th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2007, 824–833
https://doi.org/10.1145/1281192.1281280
|
5 |
L Maaten, G Hinton. Visualizing data using t-SNE. Journal of Machine Learning Research, 2008, 9(Nov): 2579–2605
|
6 |
D Liben-Nowell, J Kleinberg. The link-prediction problem for social networks. Journal of the American Society for Information Science and Technology, 2007, 58(7): 1019–1031
https://doi.org/10.1002/asi.20591
|
7 |
J Lee, R Tukhvatov. Evaluations of similarity measures on vk for link prediction. Data Science and Engineering, 2018, 3(3): 277–289
https://doi.org/10.1007/s41019-018-0073-5
|
8 |
J Tang, M Qu, MZ Wang, M Zhang, J Yan, Q Z Mei. Line: large-scale information network embedding. In: Proceedings of the 24th International Conference on World Wide Web. 2015, 1067–1077
https://doi.org/10.1145/2736277.2741093
|
9 |
A Grover, J Leskovec. Node2vec: scalable feature learning for networks. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2016, 855–864
https://doi.org/10.1145/2939672.2939754
|
10 |
D X Wang, P Cui, W W Zhu. Structural deep network embedding. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2016, 1225–1234
https://doi.org/10.1145/2939672.2939753
|
11 |
Y F Ban, J H Pu, Y J Chen, Y H Wang. Negan: network embedding based on generative adversarial networks. In: Proceedings of the International Joint Conference on Neural Networks. 2018, 1–8
https://doi.org/10.1109/IJCNN.2018.8489481
|
12 |
H W Wang, J Wang, J L Wang, M Zhao, W N Zhang, F Z Zhang, X Xie, M Y Guo. Graphgan: graph representation learning with generative adversarial nets. In: Proceedings of the AAAI Conference on Artificial Intelligence. 2018, 2508–2515
|
13 |
Q Y Dai, Q Li, J Tang, D Wang. Adversarial network embedding. In: Proceedings of the AAAI Conference on Artificial Intelligence. 2018, 2167–2174
|
14 |
H C Gao, H Huang. Self-paced network embedding. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2018, 1406–1415
https://doi.org/10.1145/3219819.3220041
|
15 |
L Sang, M Xu, S Qian, X D Wu. AAANE: attention-based adversarial autoencoder for multi-scale network embedding. In: Proceedings of the Pacific-Asia Conference on Knowledge Discovery and Data Mining. 2019, 3–14
https://doi.org/10.1007/978-3-030-16142-2_1
|
16 |
I Goodfellow, J Pouget-Abadie, M Mirza, B Xu, D Warde-Farley, S Ozair, A Courville, Y Bengio. Generative adversarial nets. In: Proceedings of Advances in Neural Information Processing Systems. 2014, 2672–2680
|
17 |
S S Cao, W Lu, Q K Xu. Grarep: learning graph representations with global structural information. In: Proceedings of the 24th ACM International Conference on Information and Knowledge Management. 2015, 891–900
https://doi.org/10.1145/2806416.2806512
|
18 |
C Yang, M S Sun, Z Y Liu, C C Tu. Fast network embedding enhancement via high order proximity approximation. In: Proceedings of the 26th International Joint Conference on Artificial Intelligence. 2017, 19–25
https://doi.org/10.24963/ijcai.2017/544
|
19 |
X Wang, P Cui, J Wang, J Pei, W W Zhu, S Q Yang. Community preserving network embedding. In: Proceedings of the AAAI Conference on Artificial Intelligence. 2017, 203–209
|
20 |
S Wold, K Esbensen, P Geladi. Principal component analysis. Journal of Chemometrics and Intelligent Laboratory Systems, 1987, 2(1): 37–52
https://doi.org/10.1016/0169-7439(87)80084-9
|
21 |
L D Lathauwer, B D Moor, J Vandewalle. A multilinear singular value decomposition. Journal of Matrix Analysis and Applications, 2000, 21(4): 1253–1278
https://doi.org/10.1137/S0895479896305696
|
22 |
T Mikolov, I Sutskever, K Chen, G S Corrado, J Dean. Distributed representations of words and phrases and their compositionality. In: Proceedings of Advances in Neural Information Processing Systems. 2013, 3111–3119
|
23 |
T S Lyu, Y Zhang, Y Zhang. Enhancing the network embedding quality with structural similarity. In: Proceedings of the 26th ACM International Conference on Information and Knowledge Management. 2017, 147–156
https://doi.org/10.1145/3132847.3132900
|
24 |
S S Cao, u W L, Q K Xu. Deep neural networks for learning graph representations. In: Proceedings of the AAAI Conference on Artificial Intelligence. 2016, 1145–1152
|
25 |
T N Kipf, M Welling. Variational graph auto-encoders. 2016, arXiv preprint arXiv:1611.07308
|
26 |
T N Kipf, M Welling. Semi-supervised classification with graph convolutional networks. In: Proceedings of International Conference on Learning Representations. 2017
|
27 |
P Velikovi, W Fedus, W L Hamilton, P Liò, Y Bengio, R D Hjelm. Deep graph infomax. In: Proceedings of International Conference on Learning Representations. 2019
|
28 |
H C Gao, J Pei, H Huang. Progan: network embedding via proximity generative adversarial network. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2019, 1308–1316
https://doi.org/10.1145/3292500.3330866
|
29 |
Y W Sun, S H Wang, T Hsieh, X F Tang, V G Honavar. MEGAN: a generative adversarial network for multi-view network embedding. In: Proceedings of the 28th International Joint Conference on Artificial Intelligence. 2019, 3527–3533
https://doi.org/10.24963/ijcai.2019/489
|
30 |
B Hu, Y Fang, C Shi. Adversarial learning on heterogeneous information networks. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2019, 120–129
https://doi.org/10.1145/3292500.3330970
|
31 |
W C Yu, C Zheng, W Cheng, C C Aggarwal, D J Song, B Zong, H F Chen, W Wang. Learning deep network representations with adversarially regularized autoencoders. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2018, 2663–2671
https://doi.org/10.1145/3219819.3220000
|
32 |
L J Chang, W Li, X M Lin, L Qin, W J Zhang. Pscan: fast and exact structural graph clustering. In: Proceedings of the 32nd IEEE International Conference on Data Engineering. 2016, 253–264
https://doi.org/10.1109/ICDE.2016.7498245
|
33 |
C Yang, Z Y Liu, D L Zhao, M S Sun, E Y Chang. Network representation learning with rich text information. In: Proceedings of the 24th International Joint Conference on Artificial Intelligence. 2015, 2111–2117
|
|
Viewed |
|
|
|
Full text
|
|
|
|
|
Abstract
|
|
|
|
|
Cited |
|
|
|
|
|
Shared |
|
|
|
|
|
Discussed |
|
|
|
|