|
|
NEXT: a neural network framework for next POI recommendation |
Zhiqian ZHANG1, Chenliang LI1( ), Zhiyong WU2, Aixin SUN3, Dengpan YE1, Xiangyang LUO4 |
1. Key Laboratory of Aerospace Information Security and Trusted Computing, Ministry of Education, School of Cyber Science and Engineering,Wuhan University,Wuhan 430072, China 2. Department of Computer Science, The University of Hong Kong, Pokfulam Road, Hong Kong 999077, China 3. School of Computer Science and Engineering, Nanyang Technological University, Singapore 639798, Singapore 4. State Key Lab of Mathematical Engineering and Advanced Computing, Zhengzhou 450001, China |
|
|
Abstract The task of next POI recommendations has been studied extensively in recent years. However, developing a unified recommendation framework to incorporate multiple factors associated with both POIs and users remains challenging, because of the heterogeneity nature of these information. Further, effective mechanisms to smoothly handle cold-start cases are also a difficult topic. Inspired by the recent success of neural networks in many areas, in this paper, we propose a simple yet effective neural network framework, named NEXT, for next POI recommendations. NEXT is a unified framework to learn the hidden intent regarding user’s next move, by incorporating different factors in a unified manner. Specifically, in NEXT, we incorporatemeta-data information, e.g., user friendship and textual descriptions of POIs, and two kinds of temporal contexts (i.e., time interval and visit time). To leverage sequential relations and geographical influence, we propose to adopt DeepWalk, a network representation learning technique, to encode such knowledge. We evaluate the effectiveness of NEXT against other state-of-the-art alternatives and neural networks based solutions. Experimental results on three publicly available datasets demonstrate that NEXT significantly outperforms baselines in real-time next POI recommendations. Further experiments show inherent ability of NEXT in handling cold-start.
|
Keywords
POI
neural networks
POI recommendation
|
Corresponding Author(s):
Chenliang LI
|
Just Accepted Date: 30 November 2018
Online First Date: 17 September 2019
Issue Date: 16 October 2019
|
|
1 |
X He, L Liao, H Zhang, L Nie, X Hu, T S Chua. Neural collaborative filtering. In: Proceedings of International Conference on World Wide Web. 2017, 173–182
https://doi.org/10.1145/3038912.3052569
|
2 |
C Cheng, H Yang, M R Lyu, I King. Where you like to go next: successive point-of-interest recommendation. In: Proceedings of International Joint Conference on Artificial Intelligence. 2013, 2605–2611
|
3 |
S Feng, X Li, Y Zeng, G Cong, Y M Chee, Q Yuan. Personalized ranking metric embedding for next new POI recommendation. In: Proceedings of International Joint Conference on Artificial Intelligence. 2015, 2069–2075
|
4 |
M Ye, P Yin, W C Lee, D L Lee. Exploiting geographical influence for collaborative point-of-interest recommendation. In: Proceedings of International ACM SIGIR Conference on Research and Development in Information Retrieval. 2011, 325–334
https://doi.org/10.1145/2009916.2009962
|
5 |
X Li, G Cong, X L Li, T A N Pham, S Krishnaswamy. Rank-GeoFM: a ranking based geographical factorization method for point of interest recommendation. In: Proceedings of International ACM SIGIR Conference on Research and Development in Information Retrieval. 2015, 433–442
https://doi.org/10.1145/2766462.2767722
|
6 |
M Ye, P Yin, W C Lee. Location recommendation for location-based social networks. In: Proceedings of SIGSPATIAL International Conference on Advances in Geographic Information Systems. 2010, 458–461
https://doi.org/10.1145/1869790.1869861
|
7 |
L Xiong, X Chen, T K Huang, J G Schneider, J G Carbonell. Temporal collaborative filtering with bayesian probabilistic tensor factorization. In: Proceedings of SIAM International Conference on Data Mining. 2010, 211–222
https://doi.org/10.1137/1.9781611972801.19
|
8 |
Q Yuan, G Cong, Z Ma, A Sun, N M Thalmann. Time-aware point-ofinterest recommendation. In: Proceedings of International ACM SIGIR Conference on Research and Development in Information Retrieval. 2013, 363–372
https://doi.org/10.1145/2484028.2484030
|
9 |
M Xie, H Yin, H Wang, F Xu, W Chen, S Wang. Learning graphbased POI embedding for location-based recommendation. In: Proceedings of ACMInternational Conference on Information and Knowledge Management. 2016, 15–24
https://doi.org/10.1145/2983323.2983711
|
10 |
W Zhang, J Wang. Location and time aware social collaborative retrieval for new successive point-of-interest recommendation. In: Proceedings of ACMInternational Conference on Information and Knowledge Management. 2015, 1221–1230
https://doi.org/10.1145/2806416.2806564
|
11 |
H Yin, B Cui, X Zhou, W Wang, Z Huang, S Sadiq. Joint modeling of user check-in behaviors for real-time point-of-interest recommendation. ACM Transaction on Information Systems, 2016, 35(2): 11
https://doi.org/10.1145/2873055
|
12 |
C Cheng, H Yang, I King, M R Lyu. Fused matrix factorization with geographical and social influence in location-based social networks. In: Proceedings of AAAI Conference on Artificial Intelligence. 2012, 17–23
|
13 |
B Liu, Y Fu, Z Yao, H Xiong. Learning geographical preferences for point-of-interest recommendation. In: Proceedings of ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2013, 1043–1051
https://doi.org/10.1145/2487575.2487673
|
14 |
B Liu, H Xiong, S Papadimitriou, Y Fu, Z Yao. A general geographical probabilistic factor model for point of interest recommendation. IEEE Transactions on Knowledge and Data Engineering, 2015, 27(5): 1167–1179
https://doi.org/10.1109/TKDE.2014.2362525
|
15 |
H Gao, J Tang, H Liu. gSCorr: modeling geo-social correlations for new check-ins on location-based social networks. In: Proceedings of ACM International Conference on Information and Knowledge Management. 2012, 1582–1586
https://doi.org/10.1145/2396761.2398477
|
16 |
J He, X Li, L Liao, D Song, W K Cheung. Inferring a personalized next point-of-interest recommendation model with latent behavior patterns. In: Proceedings of AAAI Conference on Artificial Intelligence. 2016, 137–143
|
17 |
S Zhao, T Zhao, H Yang, M R Lyu, I King. STELLAR: spatialtemporal latent ranking for successive point-of-interest recommendation. In: Proceedings of AAAI Conference on Artificial Intelligence. 2016, 315–322
|
18 |
T Mikolov, M Karafiát, L Burget, J Černocký, S Khudanpur. Recurrent neural network based language model. In: Proceedings of Annual Conference of the International Speech Communication Association. 2010, 1045–1048
https://doi.org/10.1109/ICASSP.2011.5947611
|
19 |
T Mikolov, K Chen, G Corrada, J Dean. Efficient estimation of word representations in vector space. 2013, arXiv preprint arXiv: 1301.3781
|
20 |
K Cho, B V Merrienboer, Ç Gülçehre, D Bahdanau, F Bougares, H Schwenk, Y Bengio. Learning phrase representations using RNN encoder-decoder for statistical machine translation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing. 2014, 1724–1734
https://doi.org/10.3115/v1/D14-1179
|
21 |
D Bahdanau, K Cho, Y Bengio. Neural machine translation by jointly learning to align and translate. In: Proceedings of International Conference on Learning Representations. 2015
|
22 |
B Wang, K Liu, J Zhao. Inner attention based recurrent neural networks for answer selection. In: Proceedings of Annual Meeting of the Association for Computational Linguistics. 2016, 1288–1297
https://doi.org/10.18653/v1/P16-1122
|
23 |
M Allamanis, H Peng, C Sutton. A convolutional attention network for extreme summarization of source code. In: Proceedings of International Conference on Machine Learning. 2016, 2091–2100
|
24 |
D E Rumelhart, G E Hinton, R J Williams. Learning internal representations by error propagation. Technical Report, DTIC Document, 1985
https://doi.org/10.21236/ADA164453
|
25 |
P J Werbos. Generalization of backpropagation with application to a recurrent gas market model. Neural Networks, 1988, 1(4): 339–356
https://doi.org/10.1016/0893-6080(88)90007-X
|
26 |
C M Bishop. Neural Networks for Pattern Recognition. Oxford: Oxford University Press, 1995
https://doi.org/10.1201/9781420050646.ptb6
|
27 |
K Hornik, M B Stinchcombe, H White. Multilayer feedforward networks are universal approximators. Neural Networks, 1989, 2(5): 359–366
https://doi.org/10.1016/0893-6080(89)90020-8
|
28 |
P Covington, J Adams, E Sargin. Deep neural networks for youtube recommendations. In: Proceedings of ACMConference on Recommender Systems. 2016, 191–198
https://doi.org/10.1145/2959100.2959190
|
29 |
D H Kim, C Park, J Oh, S Lee, H Yu. Convolutional matrix factorization for document context-aware recommendation. In: Proceedings of ACM Conference on Recommender Systems. 2016, 233–240
https://doi.org/10.1145/2959100.2959165
|
30 |
Q Liu, S Wu, L Wang, T Tan. Predicting the next location: a recurrent model with spatial and temporal contexts. In: Proceedings of AAAI Conference on Artificial Intelligence. 2016, 194–200
|
31 |
L Zheng, V Noroozi, S Y Philip. Joint deep modeling of users and items using reviews for recommendation. In: Proceedings of ACM International Conference on Web Search and Data Mining. 2017, 425–434
https://doi.org/10.1145/3018661.3018665
|
32 |
S Rendle. Factorization machines with libFM. ACM Transactions Intelligent Systems and Technology, 2012, 3(3): 57
https://doi.org/10.1145/2168752.2168771
|
33 |
J L Elman. Finding structure in time. Cognitive Science, 1990, 14(2): 179–211
https://doi.org/10.1016/0364-0213(90)90002-E
|
34 |
R Yan. i, poet: automatic poetry composition through recurrent neural networks with iterative polishing schema. In: Proceedings of International Joint Conference on Artificial Intelligence. 2016, 2238–2244
|
35 |
Y Zhang, H Dai, C Xu, J Feng, T Wang, J Bian, B Wang, T Y Liu. Sequential click prediction for sponsored search with recurrent neural networks. In: Proceedings of AAAI Conference on Artificial Intelligence. 2014, 1369–1375
|
36 |
S Hochreiter, J Schmidhuber. Long short-term memory. Neural Computation, 1997, 9(8): 1735–1780
https://doi.org/10.1162/neco.1997.9.8.1735
|
37 |
X Chen, X Qiu, C Zhu, P Liu, X Huang. Long short-term memory neural networks for Chinese word segmentation. In: Proceedings of Conference on Empirical Methods in Natural Language Processing. 2015, 1197–1206
https://doi.org/10.18653/v1/D15-1141
|
38 |
T Rocktäschel, E Grefenstette, K M Hermann, T Kociský, P Blunsom. Reasoning about entailment with neural attention. In: Proceedings of International Conference on Learning Representations. 2016
|
39 |
J Chung, C Gülçehre, K Cho, Y Bengio. Empirical evaluation of gated recurrent neural networks on sequence modeling. In: Proceedings of 2014 Workshop on Deep Learning. 2014
|
40 |
J Manotumruksa, C Macdonald, I Ounis. A deep recurrent collaborative filtering framework for venue recommendation. In: Proceedings of ACM International Conference on Information and Knowledge Management. 2017, 1429–1438
https://doi.org/10.1145/3132847.3133036
|
41 |
J Feng, Y Li, C Zhang, F Sun, F Meng, A Guo, D Jin. Deepmove: predicting human mobility with attentional recurrent networks. In: Proceedings of International Conference onWorldWideWeb. 2018, 1459–1468
https://doi.org/10.1145/3178876.3186058
|
42 |
B Perozzi, A R Rami, S Skiena. Deepwalk: online learning of social representations. In: Proceedings of ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2014, 701–710
https://doi.org/10.1145/2623330.2623732
|
43 |
E Cho, S A Myers, J Leskovec. Friendship and mobility: user movement in location-based social networks. In: Proceedings of ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2011, 1082–1090
https://doi.org/10.1145/2020408.2020579
|
44 |
J D Zhang, C Y Chow. Geosoca: exploiting geographical, social and categorical correlations for point-of-interest recommendations. In: Proceedings of International ACM SIGIR Conference on Research and Development in Information Retrieval. 2015, 443–452
https://doi.org/10.1145/2766462.2767711
|
45 |
C Yang, Z Liu, D Zhao, M Sun, E Y Chang. Network representation learning with rich text information. In: Proceedings of International Joint Conference on Artificial Intelligence. 2015, 2111–2117
|
46 |
J Chen, Q Zhang, X Huang. Incorporate group information to enhance network embedding. In: Proceedings of ACM International Conference on Information and Knowledge Management. 2016, 1901–1904
https://doi.org/10.1145/2983323.2983869
|
47 |
R Salakhutdinov, A Mnih. Probabilistic matrix factorization. In: Proceedings of International Conference on Neural Information Processing Systems. 2007, 1257–1264
|
48 |
Y Hu, Y Koren, C Volinsky. Collaborative filtering for implicit feedback datasets. In: Proceedings of IEEE International Conference on Data Mining. 2008, 263–272
https://doi.org/10.1109/ICDM.2008.22
|
49 |
N Srivastava, R Salakhutdinov. Multimodal learning with deep boltzmannmachines. In: Proceedings of International Conference on Neural Information Processing Systems. 2012, 2231–2239
|
50 |
X Glorot, A Bordes, Y Bengio. Deep sparse rectifier neural networks. In: Proceedings of International Conference on Artificial Intelligence and Statistics. 2011, 315–323
|
|
Viewed |
|
|
|
Full text
|
|
|
|
|
Abstract
|
|
|
|
|
Cited |
|
|
|
|
|
Shared |
|
|
|
|
|
Discussed |
|
|
|
|