×

Sequential graph collaborative filtering. (English) Zbl 1535.68367

Summary: Understanding collaborative and sequential information plays a major role in next-item recommendation. Although previous models have achieved considerable results, their capabilities have been limited by the basic paradigm of characterizing each user’s profile with only his/her sequential behaviors. This paper considers collaborative information over users to solve the problem. Specifically, we first reorganize all interactions as a multiplex directed heterogeneous graph (named sequential graph) to depict each user’s sequential behaviors and all users’ collaborative interactions. Second, we propose a generic vectorization algorithm to address the challenge of multiplex edges. The algorithm can implement arbitrary graph attention networks on complex graphs without graph simplification. Finally, we propose a novel sequential graph attention network (SGAT) that controls information to attentively propagate through directed heterogeneous edges. Based on the sequential graph and the vectorization algorithm, SGAT infers each user’s dynamic preference by capturing high-order sequential information among items and exploiting both latitudinally and longitudinally collaborative information over users. Extensive experiments and ablation studies on various datasets demonstrate the superiority of SGAT. The sequential graph provides an alternative way to organize users’ sequential behaviors and the vectorization algorithm can promote the development of graph mining by retaining topological structures of complex graphs.

MSC:

68T35 Theory of languages and software systems (knowledge-based systems, expert systems, etc.) for artificial intelligence
68R10 Graph theory (including graph drawing) in computer science

Software:

KGAT; LightGCN; Adam
Full Text: DOI

References:

[1] Goldberg, D.; Nichols, D.; Oki, B. M.; Terry, D., Using collaborative filtering to weave an information tapestry, Commun. ACM, 35, 12, 61-70 (1992)
[2] Koren, Y.; Bell, R.; Volinsky, C., Matrix factorization techniques for recommender systems, Computer, 42, 30-37 (2009)
[3] Hsieh, C.-K.; Yang, L.; Cui, Y.; Lin, T.-Y.; Belongie, S.; Estrin, D., Collaborative metric learning, (Proceedings of the 26th International Conference on World Wide Web (2017)), 193-201
[4] Wu, B.; Ye, Y., BSPR: Basket-sensitive personalized ranking for product recommendation, Inf. Sci., 541, 185-206 (2020)
[5] He, R.; Kang, W.-C.; McAuley, J., Translation-based recommendation, (Proceedings of the 11th ACM Conference on Recommender Systems (2017)), 161-169
[6] Kang, W.-C.; McAuley, J., Self-attentive sequential recommendation, IEEE International Conference on Data Mining, 197-206 (2018)
[7] Wu, B.; He, X.; Sun, Z.; Chen, L.; Ye, Y., ATM: An attentive translation model for next-item recommendation, IEEE Trans. Industr. Inf., 16, 3, 1448-1459 (2020)
[8] Rendle, S.; Freudenthaler, C.; Schmidt-Thieme, L., Factorizing personalized markov chains for next-basket recommendation, (Proceedings of the 19th International Conference on World Wide Web (2010)), 811-820
[9] Tang, J.; Wang, K., Personalized top-n sequential recommendation via convolutional sequence embedding, (Proceedings of the 11th ACM International Conference on Web Search and Data Mining (2018)), 565-573
[10] Hidasi, B.; Karatzoglou, A., Recurrent neural networks with top-k gains for session-based recommendations, (Proceedings of the 27th ACM International Conference on Information and Knowledge Management (2018)), 843-852
[11] Sun, F.; Liu, J.; Wu, J.; Pei, C.; Lin, X.; Ou, W.; Jiang, P., BERT4Rec: Sequential recommendation with bidirectional encoder representations from transformer, (Proceedings of the 28th ACM International Conference on Information and Knowledge Management (2019)), 1441-1450
[12] Tan, Q.; Zhang, J.; Liu, N.; Huang, X.; Yang, H.; Zhou, J.; Hu, X., Dynamic memory based attention network for sequential recommendation, (Proceedings of the 35th AAAI Conference on Artificial Intelligence (2021)), 4384-4392
[13] Wu, Z.; Pan, S.; Chen, F.; Long, G.; Zhang, C.; Yu, P. S., A comprehensive survey on graph neural networks, IEEE Trans. Neural Networks Learn. Syst., 1-21 (2020)
[14] Zhang, C.-Y.; Hu, J.; Yang, L.; Chen, C. P.; Yao, Z., Graph deconvolutional networks, Inf. Sci., 518, 330-340 (2020) · Zbl 1457.68244
[15] S. Wu, Y. Tang, Y. Zhu, L. Wang, X. Xie, T. Tan, Session-based recommendation with graph neural networks, in: Proceedings of the 33rd AAAI Conference on Artificial Intelligence, Vol. 33, 2019, pp. 346-353.
[16] Qiu, R.; Li, J.; Huang, Z.; YIn, H., Rethinking the item order in session-based recommendation with graph neural networks, (Proceedings of the 28th ACM International Conference on Information and Knowledge Management (2019)), 579-588
[17] Chang, J.; Gao, C.; Zheng, Y.; Hui, Y.; Niu, Y.; Song, Y.; Jin, D.; Li, Y., Sequential recommendation with graph neural networks, (Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval (2021)), 378-387
[18] C. Ma, L. Ma, Y. Zhang, J. Sun, X. Liu, M. Coates, Memory augmented graph neural networks for sequential recommendation, in: Proceedings of the 34th AAAI Conference on Artificial Intelligence, Vol. 34, 2020, pp. 5045-5052.
[19] Wang, Z.; Wei, W.; Cong, G.; Li, X.-L.; Mao, X.-L.; Qiu, M., Global context enhanced graph neural networks for session-based recommendation, (Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval (2020)), 169-178
[20] Jiang, Z.; Gao, Z.; Lan, J.; Yang, H.; Lu, Y.; Liu, X., Task-oriented genetic activation for large-scale complex heterogeneous graph embedding, Proceedings of the Web Conference, 1581-1591 (2020)
[21] Rendle, S.; Freudenthaler, C.; Gantner, Z.; Schmidt-Thieme, L., BPR: Bayesian personalized ranking from implicit feedback, (Proceedings of the 25th Conference on Uncertainty in Artificial Intelligence (2009)), 452-461
[22] Kabbur, S.; Ning, X.; Karypis, G., FISM: Factored item similarity models for top-n recommender systems, (Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (2013)), 659-667
[23] He, X.; He, Z.; Song, J.; Liu, Z.; Jiang, Y.-G.; Chua, T.-S., NAIS: Neural attentive item similarity model for recommendation, IEEE Trans. Knowl. Data Eng., 30, 12, 2354-2366 (2018)
[24] He, X.; Liao, L.; Zhang, H.; Nie, L.; Hu, X.; Chua, T.-S., Neural collaborative filtering, (Proceedings of the 26th International Conference on World Wide Web (2017)), 173-182
[25] Wang, X.; Zhu, W.; Liu, C., Social recommendation with optimal limited attention, (Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (2019)), 1518-1527
[26] Wu, B.; Ye, Y.; Chen, Y., Visual appearance or functional complementarity: Which aspect affects your decision making?, Inf. Sci., 476, 19-37 (2019)
[27] Wu, B.; He, X.; Yun, C.; Nie, L.; Zheng, K.; Ye, Y., Modeling product’s visual and functional characteristics for recommender systems, IEEE Trans. Knowl. Data Eng., 1-14 (2020)
[28] Hamilton, W.; Ying, Z.; Leskovec, J., Inductive representation learning on large graphs, Adv. Neural Inform. Process. Syst., 1024-1034 (2017)
[29] Tang, H.; Ji, D.; Zhou, Q., Triple-based graph neural network for encoding event units in graph reasoning problems, Inf. Sci., 544, 168-182 (2021)
[30] van den Berg, R.; Kipf, T. N.; Welling, M., Graph convolutional matrix completion, (Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (2018))
[31] Ying, R.; He, R.; Chen, K.; Eksombatchai, P.; Hamilton, W. L.; Leskovec, J., Graph convolutional neural networks for web-scale recommender systems, (Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (2018)), 974-983
[32] Wang, X.; He, X.; Wang, M.; Feng, F.; Chua, T.-S., Neural graph collaborative filtering, (Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval (2019)), 165-174
[33] He, X.; Deng, K.; Wang, X.; Li, Y.; Zhang, Y.; Wang, M., LightGCN: Simplifying and powering graph convolution network for recommendation, (Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval (2020)), 1-10
[34] Lin, Z.; Feng, L.; Yin, R.; Xu, C.; Kwoh, C. K., GLIMG: Global and local item graphs for top-n recommender systems, Inf. Sci., 580, 1-14 (2021) · Zbl 1535.68364
[35] Monti, F.; Bronstein, M.; Bresson, X., Geometric matrix completion with recurrent multi-graph neural networks, Adv. Neural Inform. Process. Syst., 3697-3707 (2017)
[36] Wang, H.; Zhang, F.; Zhang, M.; Leskovec, J.; Zhao, M.; Li, W.; Wang, Z., Knowledge-aware graph neural networks with label smoothness regularization for recommender systems, (Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (2019)), 968-977
[37] Wang, X.; He, X.; Cao, Y.; Liu, M.; Chua, T.-S., KGAT: Knowledge graph attention network for recommendation, (Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (2019)), 950-958
[38] Cen, Y.; Zou, X.; Zhang, J.; Yang, H.; Zhou, J.; Tang, J., Representation learning for attributed multiplex heterogeneous network, (Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (2019)), 1358-1368
[39] Chen, C.; Ma, W.; Zhang, M.; Wang, Z.; He, X.; Wang, C.; Liu, Y.; Ma, S., Graph heterogeneous multi-relational recommendation, (Proceedings of the 35th AAAI Conference on Artificial Intelligence (2021)), 3958-3966
[40] Xia, L.; Xu, Y.; Huang, C.; Dai, P.; Bo, L., Graph meta network for multi-behavior recommendation, (Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval (2021)), 757-766
[41] Ma, C.; Kang, P.; Liu, X., Hierarchical gating networks for sequential recommendation, (Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (2019)), 825-833
[42] Yuan, F.; He, X.; Jiang, H.; Guo, G.; Xiong, J.; Xu, Z.; Xiong, Y., Future data helps training: Modeling future contexts for session-based recommendation, Proceedings of The Web Conference, 303-313 (2020)
[43] P. Veličković, G. Cucurull, A. Casanova, A. Romero, P. Liò, Y. Bengio, Graph attention networks, in: International Conference on Learning Representations, 2018.
[44] D.P. Kingma, J.L. Ba, Adam: A method for stochastic optimization, in: International Conference on Learning Representations, 2015.
[45] Sarwat, M.; Levandoski, J. J.; Eldawy, A.; Mokbel, M. F., LARS*: An efficient and scalable location-aware recommender system, IEEE Trans. Knowl. Data Eng., 26, 1384-1399 (2014)
[46] Zhao, T.; McAuley, J.; King, I., Improving latent factor models via personalized feature projection for one class recommendation, (Proceedings of the 24th ACM International Conference on Information and Knowledge Management (2015)), 821-830
[47] McAuley, J.; Targett, C.; Shi, Q.; van den Hengel, A., Image-based recommendations on styles and substitutes, (Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval (2015)), 43-52
[48] Sun, Z.; Wu, B.; Wu, Y.; Ye, Y., APL: Adversarial pairwise learning for recommender systems, Expert Syst. Appl., 118, 573-584 (2019)
[49] Demšar, J., Statistical comparisons of classifiers over multiple data sets, J. Mach. Learn. Res.s, 7, 1, 1-30 (2006) · Zbl 1222.68184
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.