1. College of Computer Science and Software Engineering, Shenzhen University, Shenzhen 518060, China 2. National Engineering Laboratory for Big Data System Computing Technology, Shenzhen University, Shenzhen 518060, China
Session-based recommendation (SBR) and multi-behavior recommendation (MBR) are both important problems and have attracted the attention of many researchers and practitioners. Different from SBR that solely uses one single type of behavior sequences and MBR that neglects sequential dynamics, heterogeneous SBR (HSBR) that exploits different types of behavioral information (e.g., examinations like clicks or browses, purchases, adds-to-carts and adds-to-favorites) in sequences is more consistent with real-world recommendation scenarios, but it is rarely studied. Early efforts towards HSBR focus on distinguishing different types of behaviors or exploiting homogeneous behavior transitions in a sequence with the same type of behaviors. However, all the existing solutions for HSBR do not exploit the rich heterogeneous behavior transitions in an explicit way and thus may fail to capture the semantic relations between different types of behaviors. However, all the existing solutions for HSBR do not model the rich heterogeneous behavior transitions in the form of graphs and thus may fail to capture the semantic relations between different types of behaviors. The limitation hinders the development of HSBR and results in unsatisfactory performance. As a response, we propose a novel behavior-aware graph neural network (BGNN) for HSBR. Our BGNN adopts a dual-channel learning strategy for differentiated modeling of two different types of behavior sequences in a session. Moreover, our BGNN integrates the information of both homogeneous behavior transitions and heterogeneous behavior transitions in a unified way. We then conduct extensive empirical studies on three real-world datasets, and find that our BGNN outperforms the best baseline by 21.87%, 18.49%, and 37.16% on average correspondingly. A series of further experiments and visualization studies demonstrate the rationality and effectiveness of our BGNN. An exploratory study on extending our BGNN to handle more than two types of behaviors show that our BGNN can easily and effectively be extended to multi-behavior scenarios.
Y, Hu Y, Koren C Volinsky . Collaborative filtering for implicit feedback datasets. In: Proceedings of the 8th IEEE International Conference on Data Mining. 2008, 263–272
2
X, He L, Liao H, Zhang L, Nie X, Hu T S Chua . Neural collaborative filtering. In: Proceedings of the 26th International Conference on World Wide Web. 2017, 173–182
3
S, Wang L, Cao Y, Wang Q Z, Sheng M A, Orgun D Lian . A survey on session-based recommender systems. ACM Computing Surveys, 2022, 54( 7): 154
4
W, Chen P, Ren F, Cai F, Sun Rijke M De . Multi-interest diversification for end-to-end sequential recommendation. ACM Transactions on Information System, 2021, 40( 1): 20
5
W, Meng D, Yang Y Xiao . Incorporating user micro-behaviors and item knowledge into multi-task learning for session-based recommendation. In: Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 2020, 1091–1100
6
W, Wen W, Zhang S, Liu Q, Liu B, Zhang L, Lin H Zha . Beyond clicks: modeling multi-relational item graph for session-based target behavior prediction. In: Proceedings of the Web Conference 2020. 2020, 3056–3062
7
J, Wang R, Louca D, Hu C, Cellier J, Caverlee L Hong . Time to shop for valentine’s day: shopping occasions and sequential recommendation in E-commerce. In: Proceedings of the 13th International Conference on Web Search and Data Mining. 2020, 645–653
8
Q, Liu S, Wu L Wang . Multi-behavioral sequential prediction with recurrent log-bilinear model. IEEE Transactions on Knowledge and Data Engineering, 2017, 29( 6): 1254–1267
9
Z, Li H, Zhao Q, Liu Z, Huang T, Mei E Chen . Learning from history and present: next-item recommendation via discriminatively exploiting user behaviors. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 2018, 1734–1743
10
M, Zhou Z, Ding J, Tang D Yin . Micro behaviors: a new perspective in E-commerce recommender systems. In: Proceedings of the 11th ACM International Conference on Web Search and Data Mining. 2018, 727–735
11
Y, Gu Z, Ding S, Wang L, Zou Y, Liu D Yin . Deep multifaceted transformers for multi-objective ranking in large-scale E-commerce recommender systems. In: Proceedings of the 29th ACM International Conference on Information & Knowledge Management. 2020, 2493–2500
12
Xie R, Ling C, Wang Y, Wang R, Xia F, Lin L. Deep feedback network for recommendation. In: Proceedings of the 29th International Joint Conference on Artificial Intelligence. 2020, 2519–2525
13
B, Sarwar G, Karypis J, Konstan J Riedl . Item-based collaborative filtering recommendation algorithms. In: Proceedings of the 10th International Conference on World Wide Web. 2001, 285–295
14
D, Jannach M Ludewig . When recurrent neural networks meet the neighborhood for session-based recommendation. In: Proceedings of the 11th ACM Conference on Recommender Systems. 2017, 306–310
15
S, Rendle C, Freudenthaler Z, Gantner L Schmidt-Thieme . BPR: Bayesian personalized ranking from implicit feedback. In: Proceedings of the 25th Conference on Uncertainty in Artificial Intelligence. 2009, 452–461
16
S, Rendle C, Freudenthaler L Schmidt-Thieme . Factorizing personalized markov chains for next-basket recommendation. In: Proceedings of the 19th International Conference on World Wide Web. 2010, 811–820
17
He R, McAuley J. Fusing similarity models with Markov chains for sparse sequential recommendation. In: Proceedings of the 16th IEEE International Conference on Data Mining. 2016, 191–200
18
T, Donkers B, Loepp J Ziegler . Sequential user-based recurrent neural network recommendations. In: Proceedings of the 11th ACM Conference on Recommender Systems. 2017, 152–160
19
M, Quadrana A, Karatzoglou B, Hidasi P Cremonesi . Personalizing session-based recommendations with hierarchical recurrent neural networks. In: Proceedings of the 11th ACM Conference on Recommender Systems. 2017, 130–137
20
B, Hidasi A, Karatzoglou L, Baltrunas D Tikk . Session-based recommendations with recurrent neural networks. In: Proceedings of the 4th International Conference on Learning Representations. 2016
21
F, Yu Q, Liu S, Wu L, Wang T Tan . A dynamic recurrent model for next basket recommendation. In: Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2016, 729–732
22
Li J, Ren P, Chen Z, Ren Z, Lian T, Ma J. Neural attentive session-based recommendation. In: Proceedings of 2017 ACM on Conference on Information and Knowledge Management. 2017, 1419–1428
23
Q, Liu Y, Zeng R, Mokhosi H Zhang . STAMP: short-term attention/memory priority model for session-based recommendation. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 2018, 1831–1839
24
G, Zhou X, Zhu C, Song Y, Fan H, Zhu X, Ma Y, Yan J Li H, Jin K Gai . Deep interest network for click-through rate prediction. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 2018, 1059–1068
25
S, Wu Y, Tang Y, Zhu L, Wang X, Xie T Tan . Session-based recommendation with graph neural networks. In: Proceedings of the 33rd AAAI Conference on Artificial Intelligence. 2019, 346–353
26
C, Xu P, Zhao Y, Liu V S, Sheng J, Xu F, Zhuang J, Fang X Zhou . Graph contextualized self-attention network for session-based recommendation. In: Proceedings of the 28th International Joint Conference on Artificial Intelligence. 2019, 3940–3946
27
R, Qiu J, Li Z, Huang H Yin . Rethinking the item order in session-based recommendation with graph neural networks. In: Proceedings of the 28th ACM International Conference on Information and Knowledge Management. 2019, 579–588
28
X, Xia H, Yin J, Yu Q, Wang L, Cui X Zhang . Self-supervised hypergraph convolutional networks for session-based recommendation. In: Proceedings of the 35th AAAI Conference on Artificial Intelligence. 2021, 4503–4518
29
Wang J, Ding K, Zhu Z, Caverlee J. Session-based recommendation with hypergraph attention networks. In: Proceedings of 2021 SIAM International Conference on Data Mining. 2021, 82–90
30
C, Huang J, Chen L, Xia Y, Xu P, Dai Y, Chen L, Bo J, Zhao J X Huang . Graph-enhanced multi-task learning of multi-level transition dynamics for session-based recommendation. In: Proceedings of the 35th AAAI Conference on Artificial Intelligence. 2021, 4123–4130
31
Z, Wang W, Wei G, Cong X L, Li X L, Mao M Qiu . Global context enhanced graph neural networks for session-based recommendation. In: Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 2020, 169–178
32
J, Tang K Wang . Personalized top-N sequential recommendation via convolutional sequence embedding. In: Proceedings of the 11th ACM International Conference on Web Search and Data Mining. 2018, 565–573
33
F, Yuan A, Karatzoglou I, Arapakis J M, Jose X He . A simple convolutional generative network for next item recommendation. In: Proceedings of the 12th ACM International Conference on Web Search and Data Mining. 2019, 582–590
34
C K, Wang J McAuley . Self-attentive sequential recommendation. In: Proceedings of 2018 IEEE International Conference on Data Mining. 2018, 197–206
35
F, Sun J, Liu J, Wu C, Pei X, Lin W, Ou P Jiang . BERT4Rec: sequential recommendation with bidirectional encoder representations from transformer. In: Proceedings of the 28th ACM International Conference on Information and Knowledge Management. 2019, 1441–1450
36
K, Zhou H, Wang W X, Zhao Y, Zhu S, Wang F, Zhang Z, Wang J R Wen . S3-Rec: self-supervised learning for sequential recommendation with mutual information maximization. In: Proceedings of the 29th ACM International Conference on Information & Knowledge Management. 2020, 1893–1902
37
C, Ma L, Ma Y, Zhang J, Sun X, Liu M Coates . Memory augmented graph neural networks for sequential recommendation. In: Proceedings of the 34th AAAI Conference on Artificial Intelligence. 2020, 5045–5052
38
J, Chang C, Gao Y, Zheng Y, Hui Y, Niu Y, Song D, Jin Y Li . Sequential recommendation with graph neural networks. In: Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2021, 378–387
39
X, Chen L, Li W, Pan Z Ming . A survey on heterogeneous one-class collaborative filtering. ACM Transactions on Information Systems, 2020, 38( 4): 35
40
B, Loni R, Pagano M, Larson A Hanjalic . Bayesian personalized ranking with multi-channel user feedback. In: Proceedings of the 10th ACM Conference on Recommender Systems. 2016, 361–364
41
Gao C, He X, Gan D, Chen X, Feng F, Li Y, Chua T S, Jin D. Neural multi-task recommendation from multi-behavior data. In: Proceedings of the 35th IEEE International Conference on Data Engineering. 2019, 1554–1557
42
B, Jin C, Gao X, He D, Jin Y Li . Multi-behavior recommendation with graph convolutional networks. In: Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 2020, 659–668
43
L, Xia C, Huang Y, Xu P, Dai B, Zhang L Bo . Multiplex behavioral relation learning for recommendation via memory augmented transformer network. In: Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 2020, 2397–2406
44
C, Chen M, Zhang Y, Zhang W, Ma Y, Liu S Ma . Efficient heterogeneous collaborative filtering without negative sampling for recommendation. In: Proceedings of the 34th AAAI Conference on Artificial Intelligence. 2020, 19–26
45
L, Xia C, Huang Y, Xu P, Dai X, Zhang H, Yang J, Pei L Bo . Knowledge-enhanced hierarchical graph transformer network for multi-behavior recommendation. In: Proceedings of the 35th AAAI Conference on Artificial Intelligence. 2021, 4486–4493
46
C, Chen W, Ma M, Zhang Z, Wang X, He C, Wang Y, Liu S Ma . Graph heterogeneous multi-relational recommendation. In: Proceedings of the 35th AAAI Conference on Artificial Intelligence. 2021, 3958–3966
47
L, Guo L, Hua R, Jia B, Zhao X, Wang B Cui . Buying or browsing?: predicting real-time purchasing intent using attention-based deep network with multiple behavior. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 2019, 1984–1992
48
W L, Hamilton R, Ying J Leskovec . Inductive representation learning on large graphs. In: Proceedings of the 31st International Conference on Neural Information Processing Systems. 2017, 1025–1035
49
X, Glorot Y Bengio . Understanding the difficulty of training deep feedforward neural networks. In: Proceedings of the 13th International Conference on Artificial Intelligence and Statistics. 2010, 249–256
50
der Maaten L, van G Hinton . Visualizing data using t-SNE. Journal of Machine Learning Research, 2008, 9( 86): 2579–2605
51
C, Wang W, Ma M, Zhang C, Chen Y, Liu S Ma . Toward dynamic user intention: temporal evolutionary effects of item relations in sequential recommendation. ACM Transactions on Information Systems, 2021, 39( 2): 16
