Please wait a minute...
Frontiers of Computer Science

ISSN 2095-2228

ISSN 2095-2236(Online)

CN 10-1014/TP

Postal Subscription Code 80-970

2018 Impact Factor: 1.129

Front. Comput. Sci.    2023, Vol. 17 Issue (6) : 176347    https://doi.org/10.1007/s11704-023-2744-2
Artificial Intelligence
Lexical simplification via single-word generation
Jipeng QIANG(), Yang LI, Yun LI, Yunhao YUAN, Yi ZHU
Department of Computer Science, Yangzhou University, Yangzhou 225127, China
 Download: PDF(414 KB)   HTML
 Export: BibTeX | EndNote | Reference Manager | ProCite | RefWorks
Corresponding Author(s): Jipeng QIANG   
Just Accepted Date: 22 March 2023   Issue Date: 17 April 2023
 Cite this article:   
Jipeng QIANG,Yang LI,Yun LI, et al. Lexical simplification via single-word generation[J]. Front. Comput. Sci., 2023, 17(6): 176347.
 URL:  
https://academic.hep.com.cn/fcs/EN/10.1007/s11704-023-2744-2
https://academic.hep.com.cn/fcs/EN/Y2023/V17/I6/176347
LexMTurk BenchLS NNSeval
PRE REC F1 PRE REC F1 PRE REC F1
Glava? 0.151 0.122 0.135 0.142 0.191 0.163 0.105 0.141 0.121
Embed 0.177 0.140 0.156 0.180 0.252 0.210 0.118 0.161 0.136
BERT-LS 0.287 0.223 0.251 0.231 0.314 0.265 0.185 0.246 0.211
LSBert 0.306 0.238 0.268 0.244 0.331 0.281 0.194 0.260 0.222
PaGeLS 0.371 0.297 0.330 0.287 0.382 0.327 0.221 0.284 0.249
w/o Ranking 0.337 0.270 0.300 0.264 0.352 0.301 0.206 0.266 0.232
Tab.1  Evaluation result of simplification candidate generation
LexMTurk BenchLS NNSeval
PR ACC PR ACC PR ACC
Glava? 0.710 0.682 0.480 0.252 0.456 0.197
Embed 0.578 0.396 0.423 0.423 0.297 0.297
BERT-LS 0.770 0.770 0.604 0.604 0.420 0.420
LSBert 0.864 0.792 0.697 0.616 0.526 0.436
PaGeLS 0.874 0.874 0.723 0.723 0.527 0.527
Tab.2  Full pipeline evaluation results using precision and accuracy
Pred Freq BARTS LexMTurk BenchLS NNSeval
PR ACC PR ACC PR ACC
× × 0.738 0.738 0.658 0.658 0.469 0.469
× × 0.372 0.372 0.254 0.254 0.117 0.117
× × 0.832 0.832 0.680 0.680 0.506 0.506
× 0.850 0.850 0.675 0.675 0.448 0.448
× 0.842 0.842 0.719 0.719 0.502 0.502
× 0.756 0.756 0.644 0.644 0.397 0.397
0.874 0.874 0.723 0.723 0.527 0.527
Tab.3  Results of ranking feature ablation study
1 S, Devlin J Tait . The use of a psycholinguistic database in the simpli cation of text for aphasic readers. Linguistic Databases, 1998, 1: 161–173
2 Paetzold G H, Specia L. Unsupervised lexical simplification for non-native speakers. In: Proceedings of the 30th AAAI Conference on Artificial Intelligence. 2016, 3761–3767
3 J, Qiang Y, Li Y, Zhu Y, Yuan X Wu . Lexical simplification with pretrained encoders. In: Proceedings of the 34th AAAI Conference on Artificial Intelligence. 2020, 8649–8656
4 J, Qiang Y, Li Y, Zhu Y, Yuan Y, Shi X Wu . LSBert: lexical simplification based on BERT. IEEE/ACM Transactions on Audio, Speech, and Language Processing, 2021, 29: 3064–3076
5 J, Devlin M W, Chang K, Lee K Toutanova . BERT: pre-training of deep bidirectional transformers for language understanding. In: Proceedings of 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 2019, 4171–4186
6 W, Yuan G, Neubig P Liu . BARTScore: evaluating generated text as text generation. In: Proceedings of the 35th Conference on Neural Information Processing Systems. 2021, 27263–27277
7 J E, Hu A, Singh N, Holzenberger M, Post Durme B Van . Large-scale, diverse, paraphrastic bitexts via sampling and clustering. In: Proceedings of the 23rd Conference on Computational Natural Language Learning. 2019, 44–54
8 L, Qian H, Zhou Y, Bao M, Wang L, Qiu W, Zhang Y, Yu L Li . Glancing transformer for non-autoregressive neural machine translation. In: Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing. 2021, 1993–2003
9 B, Wei M, Wang H, Zhou J, Lin J, Xie X Sun . Imitation learning for non-autoregressive neural machine translation. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. 2019, 1304–1312
10 G, Glavaš S Štajner . Simplifying lexical simplification: do we need simplified corpora? In: Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing. 2015, 63–68
[1] FCS-22744-OF-JQ_suppl_1 Download
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed