Please wait a minute...
Frontiers of Computer Science

ISSN 2095-2228

ISSN 2095-2236(Online)

CN 10-1014/TP

邮发代号 80-970

2019 Impact Factor: 1.275

Frontiers of Computer Science  2025, Vol. 19 Issue (7): 197324   https://doi.org/10.1007/s11704-024-3577-3
  本期目录
Simplified multi-view graph neural network for multilingual knowledge graph completion
Bingbing DONG1,2, Chenyang BU1,2, Yi ZHU1,2,3, Shengwei JI4, Xindong WU1,2()
1. Key Laboratory of Knowledge Engineering with Big Data (the Ministry of Education of China),Hefei University of Technology, Hefei 230009, China
2. School of Computer Science and Information Engineering, Hefei University of Technology, Hefei 230009, China
3. School of Information Engineering, Yangzhou University, Yangzhou 225127, China
4. School of Artificial Intelligence and Big Data, Hefei University, Hefei 230000, China
 全文: PDF(14324 KB)   HTML
Abstract

Knowledge graph completion (KGC) aims to fill in missing entities and relations within knowledge graphs (KGs) to address their incompleteness. Most existing KGC models suffer from knowledge coverage as they are designed to operate within a single KG. In contrast, Multilingual KGC (MKGC) leverages seed pairs from different language KGs to facilitate knowledge transfer and enhance the completion of the target KG. Previous studies on MKGC based on graph neural networks (GNNs) have primarily focused on using relation-aware GNNs to capture the combined features of neighboring entities and relations. However, these studies still have some shortcomings, particularly in the context of MKGCs. First, each language’s specific semantics, structures, and expressions contribute to the increased heterogeneity of the KG. Therefore, the completion of MKGCs necessitates a thorough consideration of the heterogeneity of the KG and the effective integration of its heterogeneous features. Second, MKGCs typically have a large graph scale due to the need to store and manage information from multiple languages. However, current relation-aware GNNs often inherit complex GNN operations, resulting in unnecessary complexity. Therefore, it is necessary to simplify GNN operations. To address these limitations, we propose a Simplified Multi-view Graph Neural Network (SM-GNN) for MKGC. SM-GNN incorporates two simplified multi-view GNNs as components. One GNN is utilized for learning multi-view graph features to complete the KG. The other generates new alignment pairs, facilitating knowledge transfer between different views of the KG. We simplify the two multi-view GNNs by retaining feature propagation while discarding linear transformation and nonlinear activation to reduce unnecessary complexity and effectively leverage graph contextual information. Extensive experiments demonstrate that our proposed model outperforms competing baselines. The code and dataset are available at the website of github.com/dbbice/SM-GNN.

Key wordsmulti-view    knowledge graph    graph neural network    multilingual knowledge graph completion
收稿日期: 2023-07-19      出版日期: 2024-09-11
Corresponding Author(s): Xindong WU   
 引用本文:   
. [J]. Frontiers of Computer Science, 2025, 19(7): 197324.
Bingbing DONG, Chenyang BU, Yi ZHU, Shengwei JI, Xindong WU. Simplified multi-view graph neural network for multilingual knowledge graph completion. Front. Comput. Sci., 2025, 19(7): 197324.
 链接本文:  
https://academic.hep.com.cn/fcs/CN/10.1007/s11704-024-3577-3
https://academic.hep.com.cn/fcs/CN/Y2025/V19/I7/197324
Fig.1  
Fig.2  
Fig.3  
DatasetLanguage#Entity#Relation#Triple#Aligned links
DBP-5LEN139968318016716916
FR131761784901516877
ES123821445406616347
JA118051282877416263
EL5231111138399042
E-PKGEN165442110053121382
FR17068218001524812
ES9595213016320184
JA264221167035175
DE17223217587024696
IT15670217129223827
Tab.1  
Method Align. EL JA FR ES EN
H@1 H@10 MRR H@1 H@10 MRR H@1 H@10 MRR H@1 H@10 MRR H@1 H@10 MRR
Monolingual baselines
TransE[11] 0% 13.1 43.7 24.3 21.1 48.5 25.3 13.5 45.0 24.4 17.5 48.8 27.6 7.3 29.3 16.9
RotatE[12] 0% 14.5 36.2 26.2 26.4 60.2 39.8 21.2 53.9 33.8 23.2 55.5 35.1 12.3 30.4 20.7
DisMult[46] 0% 8.9 11.3 9.8 9.3 27.5 15.8 7.4 22.4 13.2 6.1 23.8 14.5 8.8 30.0 18.3
KG-BERT[27] 0% 17.3 40.1 27.3 26.9 59.8 38.7 21.9 54.1 34.0 23.5 55.9 35.4 12.9 31.9 21.0
Multilingual baselines
KEnS[15] 100% 26.4 66.1 ? 32.9 64.8 ? 22.3 60.9 ? 25.2 62.6 ? 14.4 39.6 ?
SS-AGA[16] 100% 30.8 58.6 35.3 34.6 66.9 42.9 25.5 61.9 36.6 27.1 65.5 38.4 16.3 41.3 23.1
AlignKGC[43] 50% 58.2 88.6 69.4 49.3 78.7 60.1 48.4 79.4 59.5 48.0 76.6 58.0 31.7 59.8 41.3
JMAC[17] 50% 55.2 97.5 71.7 53.3 91.4 66.8 49.3 91.3 64.5 45.4 88.2 61.0 29.5 72.7 44.6
SM-GNN 50% 62.6 98.0 76.9 59.4 94.2 72.5 56.8 94.3 71.2 54.9 91.3 69.0 36.6 74.5 50.3
Tab.2  
Method Align. DE EN ES FR IT JA
H@1 H@10 MRR H@1 H@10 MRR H@1 H@10 MRR H@1 H@10 MRR H@1 H@10 MRR H@1 H@10 MRR
Monolingual baselines
TransE [11] 0% 21.2 65.5 37.4 23.2 67.5 39.4 17.2 58.4 33.0 20.8 66.9 37.5 22.0 63.8 37.8 25.1 72.7 43.6
RotatE [12] 0% 22.3 64.3 38.2 24.2 66.8 40.0 18.3 58.9 33.7 22.1 64.3 38.2 22.5 64.0 38.1 26.3 71.9 41.8
DisMult [46] 0% 21.4 54.5 35.4 23.8 60.1 37.2 17.9 46.2 30.9 20.7 53.5 35.1 22.8 51.8 34.8 25.9 62.6 38.0
KG-BERT [27] 0% 21.8 64.7 38.4 24.3 66.4 39.6 18.7 58.8 33.2 22.3 67.2 38.3 22.9 63.7 37.2 26.9 72.4 44.1
Multilingual baselines
KEnS [15] 100% 24.3 65.8 ? 26.2 69.5 ? 21.3 59.5 ? 25.4 68.2 ? 25.1 64.6 ? 33.5 73.6 ?
SS-AGA [16] 100% 24.6 66.3 39.4 26.5 69.8 41.5 21.0 60.1 36.3 25.9 68.7 40.2 24.9 63.8 38.4 33.9 74.1 48.3
JMAC [17] 50% 34.7 71.5 48.9 46.2 78.5 59.4 34.8 68.7 47.9 34.2 73.1 49.2 40.5 73.0 54.0 58.1 81.9 67.3
SM-GNN 50% 38.4 74.6 52.3 47.4 79.7 60.1 34.5 68.5 47.7 37.3 76.8 52.3 41.2 74.4 54.4 59.9 81.8 68.1
Tab.3  
Fig.4  
MethodELJAFRESEN
H@1H@10MRRH@1H@10MRRH@1H@10MRRH@1H@10MRRH@1H@10MRR
JMAC [17]55.297.571.753.391.466.849.391.364.545.488.261.029.572.744.6
SM-GNN62.698.076.959.494.272.556.894.371.254.991.369.036.674.550.3
(i) w/ multi-view57.897.873.654.492.468.654.693.168.952.791.066.934.974.949.4
(ii) w/o simplify58.597.774.056.993.570.656.594.070.752.791.167.334.774.348.8
(iii) w/o consistent63.097.676.654.593.468.956.893.470.753.990.567.936.274.750.1
Tab.4  
Fig.5  
Fig.6  
Method Overall
Hits@1 Hits@10 MRR
AlignKGC [43] 84.8 91.9 ?
SS-AGA[16] 34.1 40.1 37.4
PSR[49] 77.2 88.4 81.2
RDGCN[45] 89.3 94.9 91.9
JMAC[17] 93.4 97.5 95.1
SM-GNN 93.9 97.6 95.5
Tab.5  
Fig.7  
Fig.8  
  
  
  
  
  
1 J, Yan C, Wang W, Cheng M, Gao A Zhou . A retrospective of knowledge graphs. Frontiers of Computer Science, 2018, 12( 1): 55–74
2 S, Ji S, Pan E, Cambria P, Marttinen P S Yu . A survey on knowledge graphs: representation, acquisition, and applications. IEEE Transactions on Neural Networks and Learning Systems, 2022, 33( 2): 494–514
3 Y, Liu K, Zhang Z, Huang K, Wang Y, Zhang Q, Liu E Chen . Enhancing hierarchical text classification through knowledge graph integration. In: Proceedings of the Association for Computational Linguistics. 2023, 5797−5810
4 Wu X, Jiang T, Zhu Y, Bu C. Knowledge graph for China’s genealogy. In: Proceedings of 2020 IEEE International Conference on Knowledge Graph. 2020, 529−535
5 Bu C, Zhang J, Yu X, Wu L, Wu X. Which companies are likely to invest: knowledge-graph-based recommendation for investment promotion. In: Proceedings of 2022 IEEE International Conference on Data Mining. 2022, 11−20
6 Q, Lin R, Mao J, Liu F, Xu E Cambria . Fusing topology contexts and logical rules in language models for knowledge graph completion. Information Fusion, 2023, 90: 253–264
7 D, Xu T, Xu S, Wu J, Zhou E Chen . Relation-enhanced negative sampling for multimodal knowledge graph completion. In: Proceedings of the 30th ACM International Conference on Multimedia. 2022, 3857−3866
8 F, Liu Y, Shen T, Zhang H Gao . Entity-related paths modeling for knowledge base completion. Frontiers of Computer Science, 2020, 14( 5): 145311
9 S, Choudhary T, Luthra A, Mittal R Singh . A survey of knowledge graph embedding and their applications. 2021, arXiv preprint arXiv: 2107.07842
10 A, Rossi D, Barbosa D, Firmani A, Matinata P Merialdo . Knowledge graph embedding for link prediction: a comparative analysis. ACM Transactions on Knowledge Discovery from Data, 2021, 15( 2): 14
11 A, Bordes N, Usunier A, Garcia-Durán J, Weston O Yakhnenko . Translating embeddings for modeling multi-relational data. In: Proceedings of the 26th International Conference on Neural Information Processing Systems. 2013, 2787−2795
12 Z, Sun Z-H, Deng J-Y, Nie J Tang . RotatE: knowledge graph embedding by relational rotation in complex space. In: Proceedings of the 7th International Conference on Learning Representations. 2019
13 R, Li Y, Cao Q, Zhu G, Bi F, Fang Y, Liu Q Li . How does knowledge graph embedding extrapolate to unseen data: a semantic evidence view. In: Proceedings of the 36th AAAI Conference on Artificial Intelligence. 2022, 5781−5791
14 Q, Wang Z, Mao B, Wang L Guo . Knowledge graph embedding: a survey of approaches and applications. IEEE Transactions on Knowledge and Data Engineering, 2017, 29( 12): 2724–2743
15 X, Chen M, Chen C, Fan A, Uppunda Y, Sun C Zaniolo . Multilingual knowledge graph completion via ensemble knowledge transfer. In: Proceedings of the Association for Computational Linguistics. 2020, 3227−3238
16 Z, Huang Z, Li H, Jiang T, Cao H, Lu B, Yin K, Subbian Y, Sun W Wang . Multilingual knowledge graph completion with self-supervised adaptive graph alignment. In: Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics. 2022, 474−485
17 V, Tong D Q, Nguyen T T, Huynh T T, Nguyen Q V H, Nguyen M Niepert . Joint multilingual knowledge graph completion and alignment. In: Proceedings of the Association for Computational Linguistics. 2022, 4646−4658
18 Z, Li Q, Zhang F, Zhu D, Li C, Zheng Y Zhang . Knowledge graph representation learning with simplifying hierarchical feature propagation. Information Processing & Management, 2023, 60( 4): 103348
19 T, Dettmers P, Minervini P, Stenetorp S Riedel . Convolutional 2D knowledge graph embeddings. In: Proceedings of the 32nd AAAI Conference on Artificial Intelligence. 2018, 1811−1818
20 Z, Yao W, Zhang M, Chen Y, Huang Y, Yang H Chen . Analogical inference enhanced knowledge graph embedding. In: Proceedings of the 37th AAAI Conference on Artificial Intelligence. 2023, 4801−4808
21 T, Le N, Le B Le . Knowledge graph embedding by relational rotation and complex convolution for link prediction. Expert Systems with Applications, 2023, 214: 119122
22 N, Fanourakis V, Efthymiou D, Kotzinos V Christophides . Knowledge graph embedding methods for entity alignment: experimental review. Data Mining and Knowledge Discovery, 2023, 37( 5): 2070–2137
23 C, Liu L, Li X, Yao L Tang . A survey of recommendation algorithms based on knowledge graph embedding. In: Proceedings of the 2019 IEEE International Conference on Computer Science and Educational Informatization. 2019, 168−171
24 Z, Shokrzadeh M R, Feizi-Derakhshi M A, Balafar J B Mohasefi . Knowledge graph-based recommendation system enhanced by neural collaborative filtering and knowledge graph embedding. Ain Shams Engineering Journal, 2024, 15( 1): 102263
25 Z, Wang J, Zhang J, Feng Z Chen . Knowledge graph embedding by translating on hyperplanes. In: Proceedings of the 28th AAAI Conference on Artificial Intelligence. 2014, 1112−1119
26 Y, Lin Z, Liu M, Sun Y, Liu X Zhu . Learning entity and relation embeddings for knowledge graph completion. In: Proceedings of the 29th AAAI Conference on Artificial Intelligence. 2015, 2181−2187
27 Yao L, Mao C S, Luo Y. KG-BERT: Bert for knowledge graph completion. 2019, arXiv preprint arXiv:1909.03193
28 L, Yao C, Mao Y Luo . Graph convolutional networks for text classification. In: Proceedings of the 33rd AAAI Conference on Artificial Intelligence. 2019, 7370−7377
29 X, He K, Deng X, Wang Y, Li Y D, Zhang M Wang . LightGCN: simplifying and powering graph convolution network for recommendation. In: Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 2020, 639−648
30 K L, Mao J M, Zhu X, Xiao B, Lu Z W, Wang X Q He . UltraGCN: Ultra simplification of graph convolutional networks for recommendation. In: Proceedings of the 30th ACM International Conference on Information & Knowledge Management. 2021, 1253−1262
31 M, Schlichtkrull T N, Kipf P, Bloem Den Berg R, Van I, Titov M Welling . Modeling relational data with graph convolutional networks. In: Proceedings of the 15th International Conference on the Semantic Web. 2018, 593−607
32 S, Vashishth S, Sanyal V, Nitin P P Talukdar . Composition-based multi-relational graph convolutional networks. In: Proceedings of the 8th International Conference on Learning Representations. 2020
33 F, Wu A H Jr, Souza T, Zhang C, Fifty T, Yu K Q Weinberger . Simplifying graph convolutional networks. In: Proceedings of the 36th International Conference on Machine Learning. 2019, 6861−6871
34 H, Wang S, Dai W, Su H, Zhong Z, Fang Z, Huang S, Feng Z, Chen Y, Sun D Yu . Simple and effective relation-based embedding propagation for knowledge representation learning. In: Proceedings of the 31st International Joint Conference on Artificial Intelligence. 2022, 2755−2761
35 T, Jiang C, Bu Y, Zhu X Wu . Integrating symbol similarities with knowledge graph embedding for entity alignment: an unsupervised framework. Intelligent Computing, 2023, 2: 0021
36 T T, Jiang C Y, Bu Y, Zhu X D Wu . Combining embedding-based and symbol-based methods for entity alignment. Pattern Recognition, 2022, 124: 108433
37 T T, Jiang C Y, Bu Y, Zhu X D Wu . Two-stage entity alignment: combining hybrid knowledge graph embedding with similarity-based relation alignment. In: Proceedings of the 16th Pacific Rim International Conference on Artificial Intelligence. 2019, 162−175
38 H, Zhu R, Xie Z, Liu M Sun . Iterative entity alignment via joint knowledge embeddings. In: Proceedings of the 26th International Joint Conference on Artificial Intelligence. 2017, 4258−4264
39 J, Zhu C, Huang Meo P De . DFMKE: a dual fusion multi-modal knowledge graph embedding framework for entity alignment. Information Fusion, 2023, 90: 111–119
40 M, Chen Y, Tian M, Yang C Zaniolo . Multilingual knowledge graph embeddings for cross-lingual knowledge alignment. In: Proceedings of the 26th International Joint Conference on Artificial Intelligence. 2017, 1511−1517
41 Z, Sun W, Hu Q, Zhang Y Qu . Bootstrapping entity alignment with knowledge graph embedding. In: Proceedings of the 27th International Joint Conference on Artificial Intelligence. 2018, 4396−4402
42 Wang Z, Lv Q, Lan X, Zhang Y. Cross-lingual knowledge graph alignment via graph convolutional networks. In: Proceedings of 2018 Conference on Empirical Methods in Natural Language Processing. 2018, 349−357
43 H, Singh S, Chakrabarti P, Jain S R, Choudhury Mausam. Multilingual knowledge graph completion with joint relation and entity alignment. In: Proceedings of the 3rd Conference on Automated Knowledge Base Construction. 2021
44 M U, Akhtar J, Liu Z, Xie X, Liu S, Ahmed B Huang . Entity alignment based on relational semantics augmentation for multilingual knowledge graphs. Knowledge-Based Systems, 2022, 252: 109494
45 Y, Wu X, Liu Y, Feng Z, Wang R, Yan D Zhao . Relation-aware entity alignment for heterogeneous knowledge graphs. In: Proceedings of the 28th International Joint Conference on Artificial Intelligence. 2019, 5278−5284
46 B, Yang W T, Yih X, He J, Gao L Deng . Embedding entities and relations for learning and inference in knowledge bases. In: Proceedings of the 3rd International Conference on Learning Representations. 2015
47 Devlin J, Chang M-W, Lee K, Toutanova K. BERT: pre-training of deep bidirectional transformers for language understanding. In: Proceedings of 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 2019, 4171−4186
48 J Demšar . Statistical comparisons of classifiers over multiple data sets. The Journal of Machine Learning Research, 2006, 7: 1–30
49 X, Mao W, Wang Y, Wu M Lan . Are negative samples necessary in entity alignment?: an approach with high performance, scalability and robustness. In: Proceedings of the 30th ACM International Conference on Information & Knowledge Management. 2021, 1263−1273
[1] Highlights Download
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed