Please wait a minute...
Frontiers of Computer Science

ISSN 2095-2228

ISSN 2095-2236(Online)

CN 10-1014/TP

邮发代号 80-970

2019 Impact Factor: 1.275

Frontiers of Computer Science  2025, Vol. 19 Issue (3): 193327   https://doi.org/10.1007/s11704-024-40044-2
  本期目录
Towards efficient and effective unlearning of large language models for recommendation
Hangyu WANG1, Jianghao LIN1, Bo CHEN2, Yang YANG2, Ruiming TANG2, Weinan ZHANG1, Yong YU1()
1. Computer Science and Technology, Shanghai Jiao Tong University, Shanghai 200240, China
2. Huawei Noah’s Ark Lab, Shenzhen 518129, China
 全文: PDF(406 KB)   HTML
收稿日期: 2024-01-10      出版日期: 2024-09-19
Corresponding Author(s): Yong YU   
 引用本文:   
. [J]. Frontiers of Computer Science, 2025, 19(3): 193327.
Hangyu WANG, Jianghao LIN, Bo CHEN, Yang YANG, Ruiming TANG, Weinan ZHANG, Yong YU. Towards efficient and effective unlearning of large language models for recommendation. Front. Comput. Sci., 2025, 19(3): 193327.
 链接本文:  
https://academic.hep.com.cn/fcs/CN/10.1007/s11704-024-40044-2
https://academic.hep.com.cn/fcs/CN/Y2025/V19/I3/193327
Fig.1  
Fig.2  
Metrics Effectiveness Efficiency
AUC ↑ ACC ↑ LL ↓ JSD ↓ L2-norm ↓ Time (s) ↓ #Params ↓
Original 77.44 70.60 56.78 − − 9048 2.2×108
Retrain 76.85 69.98 57.35 − − 5279 2.2×108
SISA 75.35 68.52 58.89 2.05 9.82 3042 8.9×108
RecEraser 75.59 68.84 58.86 2.03 9.64 4009 8.9×108
NegKL 75.65 69.19 59.34 3.67 12.47 1805 2.2×108
NegGrad 75.97 69.31 59.20 4.64 14.13 1940 2.2×108
Bad-T 75.61 69.41 58.83 4.35 14.95 1684 2.2×108
E2URec 76.34 69.76 57.75 1.91 9.51 941 1.7×106
Tab.1  
Metrics Effectiveness Efficiency
AUC ↑ ACC ↑ LL ↓ JSD ↓ L2-norm ↓ Time (s) ↓ #Params ↓
Original 73.52 70.67 55.46 − − 9152 2.2×108
Retrain 73.39 70.53 55.56 − − 5448 2.2×108
SISA 72.19 70.07 56.76 2.04 8.85 3008 8.9×108
RecEraser 72.29 69.93 56.57 1.66 7.71 3208 8.9×108
NegKL 72.88 70.15 56.38 2.02 10.01 1866 2.2×108
NegGrad 72.85 70.26 57.21 2.56 10.44 1608 2.2×108
Bad-T 72.75 70.13 61.43 8.02 19.09 1753 2.2×108
E2URec 73.41 70.42 55.48 0.90 6.54 800 1.7×106
Tab.2  
Variants MovieLens-1M GoodReads
AUC ↑ JSD ↓ AUC ↑ JSD ↓
E2URec 76.34 1.91 73.41 0.90
w/o L FGT 76.25 2.62 73.40 1.25
w/o L REM 75.75 2.27 72.98 0.99
Tab.3  
1 C, Raffel N, Shazeer A, Roberts K, Lee S, Narang M, Matena Y, Zhou W, Li P J Liu . Exploring the limits of transfer learning with a unified text-to-text transformer. The Journal of Machine Learning Research, 2020, 21( 1): 140
2 L, Bourtoule V, Chandrasekaran C A, Choquette-Choo H, Jia A, Travers B, Zhang D, Lie N Papernot . Machine unlearning. In: Proceedings of 2021 IEEE Symposium on Security and Privacy. 2021, 141−159
3 C, Chen F, Sun M, Zhang B Ding . Recommendation unlearning. In: Proceedings of the ACM Web Conference 2022. 2022, 2768−2777
4 A, Golatkar A, Achille S Soatto . Eternal sunshine of the spotless net: Selective forgetting in deep networks. In: Proceedings of 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2020, 9301−9309
5 V S, Chundawat A K, Tarun M, Mandal M Kankanhalli . Can bad teaching induce forgetting? Unlearning in deep networks using an incompetent teacher. In: Proceedings of the 37th AAAI Conference on Artificial Intelligence. 2023, 7210−7217
6 Chen J A, Yang D Y. Unlearn what you want to forget: Efficient unlearning for LLMs. In: Proceedings of 2023 Conference on Empirical Methods in Natural Language Processing. 2023, 12041−12052
[1] Highlights Download
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed