×

A hybrid approach for the analysis of complex categorical data structures: assessment of latent distance learning perception in higher education. (English) Zbl 07847872

Summary: A long tradition of analysing ordinal response data deals with parametric models, which started with the seminal approach of cumulative models. When data are collected by means of Likert scale survey questions in which several scored items measure one or more latent traits, one of the sore topics is how to deal with the ordered categories. A stacked ensemble (or hybrid) model is introduced in the proposal to tackle the limitations of summing up the items. In particular, multiple items responses are synthesised into a single meta-item, defined via a joint data reduction approach; the meta-item is then modelled according to regression approaches for ordered polytomous variables accounting for potential scaling effects. Finally, a recursive partitioning method yielding trees provides automatic variable selection. The performance of the method is evaluated empirically by using a survey on Distance Learning perception.

MSC:

62-08 Computational methods for problems pertaining to statistics

Software:

catdata

References:

[1] Agresti A (2010) Analysis of ordinal categorical data, vol 656. Wiley · Zbl 1263.62007
[2] Amir, LR; Tanti, I.; Maharani, DA, Student perspective of classroom and distance learning during covid-19 pandemic in the undergraduate dental study program universitas indonesia, BMC Med Educ, 20, 1, 1-8 (2020) · doi:10.1186/s12909-020-02312-0
[3] Ananth, CV; Kleinbaum, DG, Regression models for ordinal responses: a review of methods and applications, Int J Epidemiol, 26, 6, 1323-1333 (1997) · doi:10.1093/ije/26.6.1323
[4] Aristovnik, A.; Keržič, D.; Ravšelj, D., Impacts of the covid-19 pandemic on life of higher education students: A global perspective, Sustainability, 12, 20, 8438 (2020) · doi:10.3390/su12208438
[5] Bacci S, Iannario M, Fabbricatore R (2022) Multilevel IRT models for the analysis of satisfaction for distance learning during the covid-19 pandemic. Submitted
[6] Bender, R.; Grouven, U., Using binary logistic regression models for ordinal data with non-proportional odds, J Clin Epidemiol, 51, 10, 809-816 (1998) · doi:10.1016/S0895-4356(98)00066-3
[7] Bork-Hüffer, T.; Kulcar, V.; Brielmair, F., University students’ perception, evaluation, and spaces of distance learning during the covid-19 pandemic in austria: What can we learn for post-pandemic educational futures?, Sustainability, 13, 14, 7595 (2021) · doi:10.3390/su13147595
[8] Brant, R., Assessing proportionality in the proportional odds model for ordinal logistic regression, Biometrics, 1, 1171-1178 (1990) · doi:10.2307/2532457
[9] Capone, V.; Caso, D.; Donizzetti, AR, University student mental well-being during COVID-19 outbreak: What are the relationships between information seeking, perceived risk and personal resources related to the academic context?, Sustainability, 12, 17, 7039 (2020) · doi:10.3390/su12177039
[10] Chyung, SYY, Age and gender differences in online behavior, self-efficacy, and academic performance, Q Rev Distance Educ, 8, 3, 213-222 (2007)
[11] Cox, C., Location-scale cumulative odds models for ordinal data: a generalized non-linear model approach, Stat Med, 14, 11, 1191-1203 (1995) · doi:10.1002/sim.4780141105
[12] Cox, EP III, The optimal number of response alternatives for a scale: a review, J Mark Res, 17, 4, 407-422 (1980) · doi:10.1177/002224378001700401
[13] De Soete GD, Carroll JD (1994) K-means clustering in a low-dimensional euclidean space. New approaches in classification and data analysis. Springer, Berlin, pp 212-219
[14] Dibiase, D.; Kidwai, K., Wasted on the young? comparing the performance and attitudes of younger and older us adults in an online class on geographic information: JGHE annual lecture, J Geogr High Educ, 34, 3, 299-326 (2010) · doi:10.1080/03098265.2010.490906
[15] Eckart, C.; Young, G., The approximation of one matrix by another of lower rank, Psychometrika, 1, 3, 211-218 (1936) · JFM 62.1075.02 · doi:10.1007/BF02288367
[16] Farcomeni A, Greco L (2016) Robust methods for data reduction. CRC Press
[17] Greenacre M (2007) Correspondence analysis in practice. Chapman and Hall/CRC · Zbl 1198.62061
[18] Hedeker, D.; Mermelstein, RJ; Demirtas, H., An application of a mixed-effects location scale model for analysis of ecological momentary assessment (EMA) data, Biometrics, 64, 2, 627-634 (2008) · Zbl 1137.62085 · doi:10.1111/j.1541-0420.2007.00924.x
[19] Hedeker, D.; Demirtas, H.; Mermelstein, RJ, A mixed ordinal location scale model for analysis of ecological momentary assessment (EMA) data, Stat Interface, 2, 4, 391-401 (2009) · Zbl 1245.62171 · doi:10.4310/SII.2009.v2.n4.a1
[20] Hedeker, D.; Mermelstein, RJ; Demirtas, H., Modeling between-subject and within-subject variances in ecological momentary assessment data using mixed-effects location scale models, Stat Med, 31, 27, 3328-3336 (2012) · doi:10.1002/sim.5338
[21] Hothorn, T.; Hornik, K.; Zeileis, A., Unbiased recursive partitioning: a conditional inference framework, J Comput Graph Stat, 15, 3, 651-674 (2006) · doi:10.1198/106186006X133933
[22] Hwang, H.; Dillon, WR; Takane, Y., An extension of multiple correspondence analysis for identifying heterogeneous subgroups of respondents, Psychometrika, 71, 1, 161-171 (2006) · Zbl 1306.62435 · doi:10.1007/s11336-004-1173-x
[23] Iannario M, Iodice D’Enza A, Romano R (2021) Antecedents of distance learning perception of the students during the Covid-19 pandemic. Submitted
[24] Iannario M, Iodice D’Enza A, Romano R (2022) Hybrid unfolding models to likert-scale data to assess distance learning perception in higher education. In: Book of Short papers 10th International Conference IES 2022 Innovation and Society 5.0: Statistical and Economic Methodologies for Quality Assessment. PKE - Professional Knowledge Empowerment, pp 398-403
[25] Iodice D’Enza A, Iannario M, Romano R (2021) Distance learning, stress and career-related anxiety during the covid-19 pandemic: a students perspective analysis. In: Book of Short papers SIS2021. Pearson, pp 177-182
[26] Ishwaran, H.; Gatsonis, CA, A general class of hierarchical ordinal regression models with applications to correlated ROC analysis, Canad J Stat, 28, 4, 731-750 (2000) · Zbl 0966.62046 · doi:10.2307/3315913
[27] Jolliffe IT (1986) Principal components in regression analysis. In: Principal component analysis. Springer, pp 129-155
[28] Jöreskog, KG, A general approach to confirmatory maximum likelihood factor analysis, Psychometrika, 34, 2, 183-202 (1969) · doi:10.1007/BF02289343
[29] Jöreskog, KG, On the estimation of polychoric correlations and their asymptotic covariance matrix, Psychometrika, 59, 3, 381-389 (1994) · Zbl 0830.62059 · doi:10.1007/BF02296131
[30] Kim, JH, Assessing practical significance of the proportional odds assumption, Stat Probab Lett, 65, 3, 233-239 (2003) · Zbl 1116.62302 · doi:10.1016/j.spl.2003.07.017
[31] Lebart L, Saporta G (2014) Historical elements of correspondence analysis and multiple correspondence analysis. In: Visualization and verbalization of data. CRC Press, Chapman & Hall, New York, pp 31-44
[32] Liddell, TM; Kruschke, JK, Analyzing ordinal data with metric models: What could possibly go wrong?, J Exp Soc Psychol, 79, 328-348 (2018) · doi:10.1016/j.jesp.2018.08.009
[33] Liu, I.; Mukherjee, B.; Suesse, T., Graphical diagnostics to check model misspecification for the proportional odds regression model, Stat Med, 28, 3, 412-429 (2009) · doi:10.1002/sim.3386
[34] MacQueen J (1967) Some methods for classification and analysis of multivariate observations. In: Proceedings of the fifth Berkeley symposium on mathematical statistics and probability, Oakland, CA, USA, pp 281-297 · Zbl 0214.46201
[35] Mahmud, MS; Talukder, MU; Rahman, SM, Does ‘fear of covid-19’ trigger future career anxiety? an empirical investigation considering depression from covid-19 as a mediator, Int J Soc Psychiatry, 67, 1, 35-45 (2021) · doi:10.1177/0020764020935488
[36] Markos, A.; Iodice D’Enza, A.; van de Velden, M., Beyond tandem analysis: joint dimension reduction and clustering in R, J Stat Softw (Online), 91, 10, 1-24 (2019)
[37] McCullagh, P., Regression models for ordinal data, J R Stat Soc: Ser B (Methodol), 42, 2, 109-127 (1980) · Zbl 0483.62056
[38] Muthén, B., A general structural equation model with dichotomous, ordered categorical, and continuous latent variable indicators, Psychometrika, 49, 1, 115-132 (1984) · doi:10.1007/BF02294210
[39] Muthén B, du Toit S, Spisic D (2009) Robust inference using weighted least squares and quadratic estimating equations in latent variable modeling with categorical and continuous outcomes. Unpublished technical report
[40] Peterson, B.; Harrell, FE Jr, Partial proportional odds models for ordinal response variables, J R Stat Soc: Ser C (Appl Stat), 39, 2, 205-217 (1990) · Zbl 0707.62154
[41] Peyhardi, J.; Trottier, C.; Guédon, Y., Partitioned conditional generalized linear models for categorical responses, Stat Model, 16, 4, 297-321 (2016) · Zbl 07289465 · doi:10.1177/1471082X16644874
[42] Preston, CC; Colman, AM, Optimal number of response categories in rating scales: reliability, validity, discriminating power, and respondent preferences, Acta Physiol (Oxf), 104, 1, 1-15 (2000)
[43] Raidal, S.; Volet, SE, Preclinical students’ predispositions towards social forms of instruction and self-directed learning: a challenge for the development of autonomous and collaborative learners, High Educ, 57, 5, 577-596 (2009) · doi:10.1007/s10734-008-9163-z
[44] Ramsay, JO, The effect of number of categories in rating scales on precision of estimation of scale values, Psychometrika, 38, 4, 513-532 (1973) · Zbl 0281.92024 · doi:10.1007/BF02291492
[45] Schwarz, G., Estimating the dimension of a model, Ann Stat, 1, 461-464 (1978) · Zbl 0379.62005
[46] Tutz G (2012) Regression for categorical data, vol 34. Cambridge University Press
[47] Tutz, G., Ordinal regression: a review and a taxonomy of models, Wiley Interdiscip Rev: Comput Stat, 4, 2 (2020) · Zbl 07910964 · doi:10.1002/wics.1545
[48] Tutz G (2020b) A taxonomy of polytomous item response models. arXiv preprint arXiv:2010.01382
[49] Tutz, G.; Berger, M., Separating location and dispersion in ordinal regression models, Econom Stat, 2, 131-148 (2017)
[50] Tutz, G.; Berger, M., Tree-structured scale effects in binary and ordinal regression, Stat Comput, 31, 2, 1-12 (2021) · Zbl 1475.62062 · doi:10.1007/s11222-020-09992-0
[51] Unger, S.; Meiran, WR, Student attitudes towards online education during the covid-19 viral outbreak of 2020: distance learning in a time of social distance, Int J Technol Educ Sci, 4, 4, 256-266 (2020) · doi:10.46328/ijtes.v4i4.107
[52] Veall, MR; Zimmermann, KF, Pseudo-r2 measures for some common limited dependent variable models, J Econ Surv, 10, 3, 241-259 (1996) · doi:10.1111/j.1467-6419.1996.tb00013.x
[53] van de Velden, M.; Iodice D’Enza, A.; Palumbo, F., Cluster correspondence analysis, Psychometrika, 82, 1, 158-185 (2017) · Zbl 1360.62539 · doi:10.1007/s11336-016-9514-0
[54] van de Velden, M.; Iodice D’Enza, A.; Markos, A., Distance-based clustering of mixed data, Wiley Interdiscip Rev: Comput Stat, 11, 3 (2019) · Zbl 07909155 · doi:10.1002/wics.1456
[55] Vermunt, JD; Vermetten, YJ, Patterns in student learning: relationships between learning strategies, conceptions of learning, and learning orientations, Educ Psychol Rev, 16, 4, 359-384 (2004) · doi:10.1007/s10648-004-0005-y
[56] Vichi, M.; Kiers, HA, Factorial k-means analysis for two-way data, Comput Stat Data Anal, 37, 1, 49-64 (2001) · Zbl 1051.62056 · doi:10.1016/S0167-9473(00)00064-5
[57] Zeileis, A.; Hothorn, T.; Hornik, K., Model-based recursive partitioning, J Comput Graph Stat, 17, 2, 492-514 (2008) · doi:10.1198/106186008X319331
[58] Zurlo, MC; Cattaneo Della Volta, MF; Vallone, F., Covid-19 student stress questionnaire: development and validation of a questionnaire to evaluate students’ stressors related to the coronavirus pandemic lockdown, Front Psychol, 11, 2892 (2020) · doi:10.3389/fpsyg.2020.576758
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.