skip to main content
research-article

A Multi-View Deep Learning Approach for Cross Domain User Modeling in Recommendation Systems

Published: 18 May 2015 Publication History

Abstract

Recent online services rely heavily on automatic personalization to recommend relevant content to a large number of users. This requires systems to scale promptly to accommodate the stream of new users visiting the online services for the first time. In this work, we propose a content-based recommendation system to address both the recommendation quality and the system scalability. We propose to use a rich feature set to represent users, according to their web browsing history and search queries. We use a Deep Learning approach to map users and items to a latent space where the similarity between users and their preferred items is maximized. We extend the model to jointly learn from features of items from different domains and user features by introducing a multi-view Deep Learning model. We show how to make this rich-feature based user representation scalable by reducing the dimension of the inputs and the amount of training data. The rich user feature representation allows the model to learn relevant user behavior patterns and give useful recommendations for users who do not have any interaction with the service, given that they have adequate search and browsing history. The combination of different domains into a single model for learning helps improve the recommendation quality across all the domains, as well as having a more compact and a semantically richer user latent feature vector. We experiment with our approach on three real-world recommendation systems acquired from different sources of Microsoft products: Windows Apps recommendation, News recommendation, and Movie/TV recommendation. Results indicate that our approach is significantly better than the state-of-the-art algorithms (up to 49% enhancement on existing users and 115% enhancement on new users). In addition, experiments on a publicly open data set also indicate the superiority of our method in comparison with transitional generative topic models, for modeling cross-domain recommender systems. Scalability analysis show that our multi-view DNN model can easily scale to encompass millions of users and billions of item entries. Experimental results also confirm that combining features from all domains produces much better performance than building separate models for each domain.

References

[1]
Fabian Abel, Qi Gao, Geert-Jan Houben, and Ke Tao. Twitter-based user modeling for news recommendations. In IJCAI'13, pages 2962--2966.
[2]
Amr Ahmed, Abhimanyu Das, and Alexander J Smola. Scalable hierarchical multitask learning algorithms for conversion optimization in display advertising. In WSDM'14, pages 153--162.
[3]
Robert M Bell and Yehuda Koren. Improved neighborhood-based collaborative filtering. In KDD'13 CUP, 2007.
[4]
Cheng Chu, Sang Kyun Kim, Yi-An Lin, YuanYuan Yu, Gary Bradski, Andrew Y Ng, and Kunle Olukotun. Map-reduce for machine learning on multicore. 2007.
[5]
Adam Coates, Andrew Y Ng, and Honglak Lee. An analysis of single-layer networks in unsupervised feature learning. In AISTATS'11, pages 215--223.
[6]
Abhinandan S Das, Mayur Datar, Ashutosh Garg, and Shyam Rajaram. Google news personalization: scalable online collaborative filtering. In WWW'07, pages 271--280.
[7]
Asela Gunawardana and Christopher Meek. Tied boltzmann machines for cold start recommendations. In RECSYS'08, pages 19--26.
[8]
John A Hartigan and Manchek A Wong. Algorithm as 136: A k-means clustering algorithm. Applied statistics, pages 100--108, 1979.
[9]
Po-Sen Huang, Xiaodong He, Jianfeng Gao, Li Deng, Alex Acero, and Larry Heck. Learning deep structured semantic models for web search using clickthrough data. In CIKM'13, pages 2333--2338.
[10]
Piotr Indyk and Rajeev Motwani. Approximate nearest neighbors: towards removing the curse of dimensionality. In STOC'98, pages 604--613.
[11]
Joonseok Lee, Samy Bengio, Seungyeon Kim, Guy Lebanon, and Yoram Singer. Local collaborative ranking. In WWW'14, pages 85--96.
[12]
Bin Li, Qiang Yang, and Xiangyang Xue. Transfer learning for collaborative filtering via a rating-matrix generative model. In ICML'09, pages 617--624.
[13]
Ping Li, Trevor J Hastie, and Kenneth W Church. Very sparse random projections. In KDD'06, pages 287--296.
[14]
Greg Linden, Brent Smith, and Jeremy York. Amazon. com recommendations: Item-to-item collaborative filtering. Internet Computing, IEEE, 7(1):76--80, 2003.
[15]
Jiahui Liu, Peter Dolan, and Elin Rønby Pedersen. Personalized news recommendation based on click behavior. In IUI'10, pages 31--40.
[16]
Prem Melville, Raymond J Mooney, and Ramadass Nagarajan. Content-boosted collaborative filtering for improved recommendations. In AAAI'02.
[17]
Weike Pan, Evan Wei Xiang, Nathan Nan Liu, and Qiang Yang. Transfer learning in collaborative filtering for sparsity reduction. In AAAI'10, 2010.
[18]
Al Mamunur Rashid, George Karypis, and John Riedl. Learning preferences of new users in recommender systems: an information theoretic approach. ACM SIGKDD Explorations Newsletter, 10(2):90--100, 2008.
[19]
Jasson DM Rennie and Nathan Srebro. Fast maximum margin matrix factorization for collaborative prediction. In ICML'05, pages 713--719.
[20]
Shaghayegh Sahebi and Peter Brusilovsky. Cross-domain collaborative recommendation in a cold-start context: The impact of user profile size on the quality of recommendation. In User Modeling, Adaptation, and Personalization, pages 289--295. Springer, 2013.
[21]
Ruslan Salakhutdinov and Andriy Mnih. Bayesian probabilistic matrix factorization using markov chain monte carlo. In ICML'08, pages 880--887.
[22]
Ruslan Salakhutdinov, Andriy Mnih, and Geoffrey Hinton. Restricted boltzmann machines for collaborative filtering. In ICML'07, pages 791--798.
[23]
Badrul Sarwar, George Karypis, Joseph Konstan, and John Riedl. Item-based collaborative filtering recommendation algorithms. In WWW'01, pages 285--295. ACM, 2001.
[24]
Andrew I Schein, Alexandrin Popescul, Lyle H Ungar, and David M Pennock. Methods and metrics for cold-start recommendations. In SIGIR'02, pages 253--260.
[25]
Yang Song, Weiwei Cui, Shixia Liu, and Kuansan Wang. Online behavioral genome sequencing from usage logs: decoding the search behaviors. In WWW'14, pages 91--94.
[26]
Yang Song, Hongning Wang, and Xiaodong He. Adapting deep ranknet for personalized search. In WSDM'14, pages 83--92.
[27]
Shiliang Sun. A survey of multi-view machine learning. Neural Computing and Applications, 23(7--8):2031--2038, 2013.
[28]
Jie Tang, Sen Wu, Jimeng Sun, and Hang Su. Cross-domain collaboration recommendation. In KDD'12, pages 1285--1293.
[29]
Bruce Thompson. Canonical correlation analysis. Encyclopedia of statistics in behavioral science, 2005.
[30]
Aaron Van den Oord, Sander Dieleman, and Benjamin Schrauwen. Deep content-based music recommendation. In NIPS'13, pages 2643--2651.
[31]
Benjamin Van Durme and Ashwin Lall. Online generation of locality sensitive hash signatures. In ACL'10 Short Papers, pages 231--235.
[32]
Chong Wang and David M Blei. Collaborative topic modeling for recommending scientific articles. In KDD'11, pages 448--456.

Cited By

View all
  • (2024)Graph Agent Transformer Network With Contrast Learning for Cross-Domain Recommendation of E-CommerceJournal of Cases on Information Technology10.4018/JCIT.35524126:1(1-16)Online publication date: 17-Jul-2024
  • (2024)Dynamic Programming-Based White Box Adversarial Attack for Deep Neural NetworksAI10.3390/ai50300595:3(1216-1234)Online publication date: 24-Jul-2024
  • (2024)Privacy-preserving Cross-domain Recommendation with Federated Graph LearningACM Transactions on Information Systems10.1145/365344842:5(1-29)Online publication date: 13-May-2024
  • Show More Cited By

Index Terms

  1. A Multi-View Deep Learning Approach for Cross Domain User Modeling in Recommendation Systems

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Other conferences
      WWW '15: Proceedings of the 24th International Conference on World Wide Web
      May 2015
      1460 pages
      ISBN:9781450334693

      Sponsors

      • IW3C2: International World Wide Web Conference Committee

      In-Cooperation

      Publisher

      International World Wide Web Conferences Steering Committee

      Republic and Canton of Geneva, Switzerland

      Publication History

      Published: 18 May 2015

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. deep learning
      2. multi-view learning
      3. recommendation system
      4. user modeling

      Qualifiers

      • Research-article

      Conference

      WWW '15
      Sponsor:
      • IW3C2

      Acceptance Rates

      WWW '15 Paper Acceptance Rate 131 of 929 submissions, 14%;
      Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)246
      • Downloads (Last 6 weeks)29
      Reflects downloads up to 19 Oct 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Graph Agent Transformer Network With Contrast Learning for Cross-Domain Recommendation of E-CommerceJournal of Cases on Information Technology10.4018/JCIT.35524126:1(1-16)Online publication date: 17-Jul-2024
      • (2024)Dynamic Programming-Based White Box Adversarial Attack for Deep Neural NetworksAI10.3390/ai50300595:3(1216-1234)Online publication date: 24-Jul-2024
      • (2024)Privacy-preserving Cross-domain Recommendation with Federated Graph LearningACM Transactions on Information Systems10.1145/365344842:5(1-29)Online publication date: 13-May-2024
      • (2024)Privacy-preserving Multi-source Cross-domain Recommendation Based on Knowledge GraphACM Transactions on Multimedia Computing, Communications, and Applications10.1145/363970620:5(1-18)Online publication date: 5-Jan-2024
      • (2024)Enhancing Multi-field B2B Cloud Solution Matching via Contrastive Pre-trainingProceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3637528.3671513(4839-4849)Online publication date: 25-Aug-2024
      • (2024)EXIT: An EXplicit Interest Transfer Framework for Cross-Domain RecommendationProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3680055(4563-4570)Online publication date: 21-Oct-2024
      • (2024)MIRROR: A Multi-View Reciprocal Recommender System for Online RecruitmentProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657776(543-552)Online publication date: 10-Jul-2024
      • (2024)Identifiability of Cross-Domain Recommendation via Causal Subspace DisentanglementProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657758(2091-2101)Online publication date: 10-Jul-2024
      • (2024)User Consented Federated Recommender System Against Personalized Attribute Inference AttackProceedings of the 17th ACM International Conference on Web Search and Data Mining10.1145/3616855.3635830(276-285)Online publication date: 4-Mar-2024
      • (2024)Not All Embeddings are Created Equal: Towards Robust Cross-domain Recommendation via Contrastive LearningProceedings of the ACM Web Conference 202410.1145/3589334.3645357(3195-3206)Online publication date: 13-May-2024
      • Show More Cited By

      View Options

      Get Access

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media