Joint latent space model for social networks with multivariate attributes. (English) Zbl 1532.62077
Summary: In social, behavioral and economic sciences, researchers are interested in modeling a social network among a group of individuals, along with their attributes. The attributes can be responses to survey questionnaires and are often high dimensional. We propose a joint latent space model (JLSM) that summarizes information from the social network and the multivariate attributes in a person-attribute joint latent space. We develop a variational Bayesian expectation-maximization estimation algorithm to estimate the attribute and person locations in the joint latent space. This methodology allows for effective integration, informative visualization and prediction of social networks and attributes. Using JLSM, we explore the French financial elites based on their social networks and their career, political views and social status. We observe a division in the social circles of the French elites in accordance with the differences in their attributes. We analyze user networks and behaviors in multimodal social media systems like YouTube. A R package “jlsm” is developed to fit the models proposed in this paper and is publicly available from the CRAN repository https://cran.r-project.org/web/packages/jlsm/jlsm.pdf.
MSC:
| 62P15 | Applications of statistics to psychology |
References:
| [1] | Agarwal, A.; Xue, L., Model-based clustering of nonparametric weighted networks with application to water pollution analysis, Technometrics, 62, 161-172 (2020) |
| [2] | Airoldi, EM; Blei, DM; Fienberg, SE; Xing, EP, Mixed membership stochastic blockmodels, Journal of Machine Learning Research, 9, 1981-2014 (2008) · Zbl 1225.68143 |
| [3] | Arroyo, J., Athreya, A., Cape, J., Chen, G., Priebe, C. E., & Vogelstein, J. T. (2019). Inference for multiple heterogeneous networks with a common invariant subspace. arXiv preprint arXiv:1906.10026 · Zbl 07415085 |
| [4] | Attias, H. (1999). Inferring parameters and structure of latent variable models by variational Bayes. In Proceedings of the fifteenth conference on uncertainty in artificial intelligence (pp. 21-30). Morgan Kaufmann Publishers Inc. |
| [5] | Austin, A.; Linkletter, C.; Wu, Z., Covariate-defined latent space random effects model, Social Networks, 35, 338-346 (2013) |
| [6] | Barbillon, P., Donnet, S., Lazega, E., & Bar-Hen, A. (2015). Stochastic block models for multiplex networks: An application to networks of researchers. arXiv preprint arXiv:1501.06444 |
| [7] | Beal, M. J., et al. (2003). Variational algorithms for approximate Bayesian inference. University of London. |
| [8] | Beal, MJ; Ghahramani, Z., Variational Bayesian learning of directed graphical models with hidden variables, Bayesian Analysis, 1, 793-831 (2006) · Zbl 1331.68181 |
| [9] | Blei, DM; Kucukelbir, A.; McAuliffe, JD, Variational inference: A review for statisticians, Journal of the American Statistical Association, 112, 859-877 (2017) |
| [10] | Bollen, KA, Latent variables in psychology and the social sciences, Annual Review of Psychology, 53, 605-634 (2002) |
| [11] | Borsboom, D.; Cramer, AO, Network analysis: An integrative approach to the structure of psychopathology, Annual Review of Clinical Psychology, 9, 91-121 (2013) |
| [12] | Bramoullé, Y.; Djebbari, H.; Fortin, B., Identification of peer effects through social networks, Journal of Econometrics, 150, 41-55 (2009) · Zbl 1429.91254 |
| [13] | Celisse, A.; Daudin, JJ; Pierre, L., Consistency of maximum-likelihood and variational estimators in the stochastic block model, Electronic Journal of Statistics, 6, 1847-1899 (2012) · Zbl 1295.62028 |
| [14] | Che, C.; Jin, IH; Zhang, Z., Network mediation analysis using model-based eigenvalue decomposition, Structural Equation Modeling: A Multidisciplinary Journal, 28, 148-161 (2021) |
| [15] | Cho, Y.-S., Ver Steeg, G., Ferrara, E., & Galstyan, A. (2016). Latent space model for multi-modal social data. In Proceedings of the 25th international conference on world wide web (pp. 447-458). |
| [16] | D’Angelo, S., Alfò, M., & Murphy, T. B. (2018). Node-specific effects in latent space modelling of multidimensional networks. In 49th scientific meeting of the Italian Statistical Society. · Zbl 1541.62393 |
| [17] | D’Angelo, S.; Alfò, M.; Brendan Murphy, T., Modeling node heterogeneity in latent space models for multidimensional networks, Statistica Neerlandica, 74, 324-341 (2020) · Zbl 1541.62393 |
| [18] | D’Angelo, S., Alfò, M., & Fop, M. (2020). Model-based clustering for multivariate networks. arXiv preprint arXiv:2001.05260 |
| [19] | Daudin, JJ; Picard, F.; Robin, S., A mixture model for random graphs, Statistics and Computing, 18, 173-183 (2008) |
| [20] | Dean, DO; Bauer, DJ; Prinstein, MJ, Friendship dissolution within social networks modeled through multilevel event history analysis, Multivariate Behavioral Research, 52, 271-289 (2017) |
| [21] | Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977). Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society. Series B (Methodological) 1-38. · Zbl 0364.62022 |
| [22] | Dorans, N.; Drasgow, F., Alternative weighting schemes for linear prediction, Organizational Behavior and Human Performance, 21, 316-345 (1978) |
| [23] | Epskamp, S.; Rhemtulla, M.; Borsboom, D., Generalized network pschometrics: Combining network and latent variable models, Psychometrika, 82, 904-927 (2017) · Zbl 1402.62307 |
| [24] | Fosdick, B. K. (2013). Modeling Heterogeneity within and between Matrices and Arrays, Ph.D. thesis. |
| [25] | Fosdick, BK; Hoff, PD, Testing and modeling dependencies between a network and nodal attributes, Journal of the American Statistical Association, 110, 1047-1056 (2015) · Zbl 1373.62273 |
| [26] | Frank, KA; Zhao, Y.; Borman, K., Social capital and the diffusion of innovations within organizations: The case of computer technology in schools, Sociology of Education, 77, 148-171 (2004) |
| [27] | Fratiglioni, L.; Wang, H-X; Ericsson, K.; Maytan, M.; Winblad, B., Influence of social network on occurrence of dementia: A community-based longitudinal study, The Lancet, 355, 1315-1319 (2000) |
| [28] | Frey, MC; Detterman, DK, Scholastic assessment or g? The relationship between the scholastic assessment test and general cognitive ability, Psychological Science, 15, 373-378 (2004) |
| [29] | Friel, N.; Rastelli, R.; Wyse, J.; Raftery, AE, Interlocking directorates in Irish companies using a latent space model for bipartite networks, Proceedings of the National Academy of Sciences, 113, 6629-6634 (2016) |
| [30] | Fujimoto, K.; Wang, P.; Valente, TW, The decomposed affiliation exposure model: A network approach to segregating peer influences from crowds and organized sports, Network Science, 1, 154-169 (2013) |
| [31] | Goldsmith-Pinkham, P.; Imbens, GW, Social networks and the identification of peer effects, Journal of Business and Economic Statistics, 31, 253-264 (2013) |
| [32] | Gollini, I. (2015). lvm4net: Latent variable models for networks. Latent variable models for network data using fast inferential procedures. |
| [33] | Gollini, I.; Murphy, TB, Joint modeling of multiple network views, Journal of Computational and Graphical Statistics, 25, 246-265 (2016) |
| [34] | Gormley, IC; Murphy, TB, A mixture of experts latent position cluster model for social network data, Statistical Methodology, 7, 385-405 (2010) · Zbl 1233.62205 |
| [35] | Guhaniyogi, R.; Rodriguez, A., Joint modeling of longitudinal relational data and exogenous variables, Bayesian Analysis, 15, 477-503 (2020) · Zbl 1459.62219 |
| [36] | Guy, I., Zwerdling, N., Carmel, D., Ronen, I., Uziel, E., Yogev, S., & Ofek-Koifman, S. (2009). Personalized recommendation of social software items based on social relations. In Proceedings of the third ACM conference on Recommender systems (pp. 53-60). |
| [37] | Handcock, MS; Raftery, AE; Tantrum, JM, Model-based clustering for social networks, Journal of the Royal Statistical Society Series A, 170, 301-354 (2007) |
| [38] | Handcock, MS; Raftery, AE; Tantrum, JM, Model-based clustering for social networks, Journal of the Royal Statistical Society: Series A (Statistics in Society), 170, 301-354 (2007) |
| [39] | Hoff, PD, Bilinear mixed-effects models for dyadic data, Journal of the American Statistical Association, 100, 286-295 (2005) · Zbl 1117.62353 |
| [40] | Hoff, P. (2008). Modeling homophily and stochastic equivalence in symmetric relational data. In Advances in neural information processing systems (pp. 657-664). |
| [41] | Hoff, PD, Multiplicative latent factor models for description and prediction of social networks, Computational and Mathematical Organization Theory, 15, 261 (2009) |
| [42] | Hoff, P. D. (2018). Additive and multiplicative effects network models. arXiv preprint arXiv:1807.08038 · Zbl 07368218 |
| [43] | Hoff, PD; Raftery, AE; Handcock, MS, Latent space approaches to social network analysis, Journal of the American Statistical Association, 97, 1090-1098 (2002) · Zbl 1041.62098 |
| [44] | Huang, S., & Feng, Y. (2018). Pairwise covariates-adjusted block model for community detection. arXiv preprint arXiv:1807.03469 |
| [45] | Jensen, JLWV, Sur les fonctions convexes et les inégalités entre les valeurs moyennes, Acta Mathematica, 30, 175-193 (1906) · JFM 37.0422.02 |
| [46] | Jeon, M., Jin, I. H., Schweinberger, M. and Baugh, S. (2021). Mapping unobserved item-respondent interactions: a latent space item response model with interaction map. psychometrika 86 378-403. · Zbl 1477.62342 |
| [47] | Jin, I. H., & Jeon, M. (2018). A doubly latent space joint model for local item and person dependence in the analysis of item response data. Psychometrika 1-25. · Zbl 1431.62540 |
| [48] | Jin, IH; Jeon, M., A doubly latent space joint model for local item and person dependence in the analysis of item response data, Psychometrika, 84, 236-260 (2019) · Zbl 1431.62540 |
| [49] | Kadushin, C. (1995). Friendship among the French financial elite. American Sociological Review 202-221. |
| [50] | Kéfi, S.; Miele, V.; Wieters, EA; Navarrete, SA; Berlow, EL, How structured is the entangled bank? The surprisingly simple organization of multiplex ecological networks leads to increased persistence and resilience, PLoS Biology, 14 (2016) |
| [51] | Kim, Y., & Srivastava, J. (2007). Impact of social influence in e-commerce decision making. In Proceedings of the ninth international conference on electronic commerce (pp. 293-302). ACM. |
| [52] | Kim, H-N; Alkhaldi, A.; El Saddik, A.; Jo, G-S, Collaborative user modeling with usergenerated tags for social recommender systems, Expert Systems with Applications, 38, 8488-8496 (2011) |
| [53] | Kim, B.; Lee, KH; Xue, L.; Niu, X., A review of dynamic network models with latent variables, Statistics Surveys, 12, 105 (2018) · Zbl 1401.62103 |
| [54] | Koenig, KA; Frey, MC; Detterman, DK, ACT and general cognitive ability, Intelligence, 36, 153-160 (2008) |
| [55] | Krivitsky, P. N., Handcock, M. S. (2008). Fitting position latent cluster models for social networks with latentnet. Journal of Statistical Software 24. |
| [56] | Krivitsky, PN; Handcock, MS; Raftery, AE; Hoff, PD, Representing degree distributions, clustering, and homophily in social networks with latent cluster random effects models, Social Networks, 31, 204-213 (2009) |
| [57] | Kwon, KH; Stefanone, MA; Barnett, GA, Social network influence on online behavioral choices: exploring group formation on social network sites, American Behavioral Scientist, 58, 1345-1360 (2014) |
| [58] | Leenders, RTA, Modeling social influence through network autocorrelation: Constructing the weight matrix, Social Networks, 24, 21-47 (2002) |
| [59] | Liu, H., Jin, I. H., & Zhang, Z. (2018). Structural equation modeling of social networks: Specification, estimation, and application. Multivariate Behavioral Research 1-17. |
| [60] | Liu, F.; Lee, HJ, Use of social network information to enhance collaborative filtering performance, Expert Systems with Applications, 37, 4772-4778 (2010) |
| [61] | Liu, H.; Jin, IH; Zhang, Z.; Yuan, Y., Social network mediation analysis: A latent space approach, Psychometrika, 86, 272-298 (2021) · Zbl 1476.62248 |
| [62] | Lu, Y., Tsaparas, P., Ntoulas, A., & Polanyi, L. (2010). Exploiting social context for review quality prediction. In Proceedings of the 19th international conference on world wide web (pp. 691-700). |
| [63] | Lusher, D.; Koskinen, J.; Robins, G., Exponential random graph models for social networks: Theory, methods, and applications (2013), Cambridge University Press |
| [64] | Ma, Z.; Ma, Z.; Yuan, H., Universal latent space model fitting for large networks with edge covariates, Journal of Machine Learning Research, 21, 1-67 (2020) · Zbl 1497.68432 |
| [65] | Ma, H., Zhou, D., Liu, C., Lyu, M. R., & King, I. (2011). Recommender systems with social regularization. In Proceedings of the fourth ACM international conference on Web search and data mining (pp. 287-296). |
| [66] | Marsman, M.; Borsboom, D.; Kruis, J.; Epskamp, S.; van Bork, R.; Waldorp, L.; Maas, HVD; Maris, G., An introduction to network psychometrics: Relating Ising network models to item response theory models, Multivariate Behavioral Research, 53, 15-35 (2018) |
| [67] | Matias, C., & Miele, V. (2016). Statistical clustering of temporal networks through a dynamic stochastic block model. Journal of the Royal Statistical Society: Series B (Statistical Methodology). · Zbl 1373.62312 |
| [68] | McPherson, M.; Smith-Lovin, L.; Cook, JM, Birds of a feather: Homophily in social networks, Annual Review of Sociology, 27, 415-444 (2001) |
| [69] | Mele, A., Hao, L., Cape, J., & Priebe, C. E. (2019). Spectral inference for large Stochastic Blockmodels with nodal covariates. arXiv preprint arXiv:1908.06438 |
| [70] | Mercken, L.; Snijders, TA; Steglich, C.; Vartiainen, E.; De Vries, H., Dynamics of adolescent friendship networks and smoking behavior, Social Networks, 32, 72-81 (2010) |
| [71] | Mislove, A., Marcon, M., Gummadi, K. P., Druschel, P., & Bhattacharjee, B. (2007). Measurement and analysis of online social networks. In Proceedings of the 7th ACM SIGCOMM conference on Internet measurement (pp. 29-42). |
| [72] | Murdoch, D.; Chow, E.; Murdoch, MD; Suggests, M., Package ‘ellipse’, American Statistician, 50, 178-180 (2020) |
| [73] | Palestro, JJ; Bahg, G.; Sederberg, PB; Lu, Z-L; Steyvers, M.; Turner, BM, A tutorial on joint models of neural and behavioral measures of cognition, Journal of Mathematical Psychology, 84, 20-48 (2018) · Zbl 1416.91329 |
| [74] | Paul, S.; Chen, Y., Consistent community detection in multi-relational data through restricted multi-layer stochastic blockmodel, Electronic Journal of Statistics, 10, 3807-3870 (2016) · Zbl 1357.62226 |
| [75] | Paul, S.; Chen, Y., Spectral and matrix factorization methods for consistent community detection in multi-layer networks, The Annals of Statistics, 48, 230-250 (2020) · Zbl 1440.62091 |
| [76] | Robins, G.; Pattison, P.; Elliott, P., Network models for social influence processes, Psychometrika, 66, 161-189 (2001) · Zbl 1293.62270 |
| [77] | Roy, S.; Atchadé, Y.; Michailidis, G., Likelihood inference for large scale stochastic blockmodels with covariates based on a divide-and-conquer parallelizable algorithm with communication, Journal of Computational and Graphical Statistics, 28, 609-619 (2019) · Zbl 07499080 |
| [78] | Salter-Townshend, M.; McCormick, TH, Latent space models for multiview network data, The Annals of Applied Statistics, 11, 1217 (2017) · Zbl 1380.62269 |
| [79] | Salter-Townshend, M.; Murphy, TB, Variational Bayesian inference for the latent position cluster model for network data, Computational Statistics and Data Analysis, 57, 661-671 (2013) · Zbl 1365.62246 |
| [80] | Sarkar, P., & Moore, A. W. (2006). Dynamic social network analysis using latent space models. In Advances in neural information processing systems (pp. 1145-1152). |
| [81] | Schmittmann, VD; Cramer, AO; Waldorp, LJ; Epskamp, S.; Kievit, RA; Borsboom, D., Deconstructing the construct: A network perspective on psychological phenomena, New Ideas in Psychology, 31, 43-53 (2013) |
| [82] | Sewell, DK; Chen, Y., Latent space models for dynamic networks, Journal of the American Statistical Association, 110, 1646-1657 (2015) · Zbl 1373.62580 |
| [83] | Sewell, DK; Chen, Y., Latent space models for dynamic networks with weighted edges, Social Networks, 44, 105-116 (2016) |
| [84] | Shalizi, CR; Thomas, AC, Homophily and contagion are generically confounded in observational social network studies, Sociological Methods and Research, 40, 211-239 (2011) |
| [85] | Smith, AL; Asta, DM; Calder, CA, The geometry of continuous latent space models for network data, Statistical Science: A Review Journal of the Institute of Mathematical Statistics, 34, 428 (2019) · Zbl 1429.62433 |
| [86] | Spearman, C. (1904). “General intelligence” objectively determined and measured. American Journal of Psychology,5, 201-293. |
| [87] | Sweet, TM, Incorporating covariates into stochastic blockmodels, Journal of Educational and Behavioral Statistics, 40, 635-664 (2015) |
| [88] | Sweet, TM, Social network methods for the educational and psychological sciences, Educational Psychologist, 51, 381-394 (2016) |
| [89] | Sweet, T., & Adhikari, S. (2020). A latent space network model for social influence. Psychometrika 1-24. · Zbl 1458.62278 |
| [90] | VanderWeele, TJ, Sensitivity analysis for contagion effects in social networks, Sociological Methods and Research, 40, 240-255 (2011) |
| [91] | VanderWeele, T. J., & An, W. (2013). Social networks and causal inference. In Handbook of causal analysis for social research (pp. 353-374). Springer. |
| [92] | Wang, S. (2019). Joint analysis of social and item response networks with latent space models, Master thesis, The Ohio State University. |
| [93] | Wang, S. (2021a). Recent integrations of latent variable network modeling with psychometric models. Frontiers in Psychology 12. |
| [94] | Wang, S. (2021b). JLSM: Joint latent space model for social networks and attributes. Joint latent space models for social networks and attributes using a fast inference approach. |
| [95] | Wang, S., & Edgerton, J. (2022). Resilience to stress in bipartite networks: Application to the Islamic State recruitment network. Journal of Complex Networks,10, cnac017. |
| [96] | Weng, H., & Feng, Y. (2016). Community detection with nodal information. arXiv preprint arXiv:1610.09735. |
| [97] | Xu, KS; Kliger, M.; Hero Iii, AO, Adaptive evolutionary clustering, Data Mining and Knowledge Discovery, 28, 304-336 (2014) · Zbl 1281.68200 |
| [98] | Yan, B., & Sarkar, P. (2020). Covariate regularized community detection in sparse graphs. Journal of the American Statistical Association 1-12. · Zbl 1464.62333 |
| [99] | Yang, X.; Guo, Y.; Liu, Y.; Steck, H., A survey of collaborative filtering based social recommender systems, Computer Communications, 41, 1-10 (2014) |
| [100] | Zhang, Y.; Levina, E.; Zhu, J., Community detection in networks with node features, Electronic Journal of Statistics, 10, 3153-3178 (2016) · Zbl 1359.62271 |
| [101] | Zhang, X., Xue, S., & Zhu, J. (2020). A flexible latent space model for multilayer networks. In International conference on machine learning (pp. 11288-11297). PMLR. |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
