Robust estimation in multivariate heteroscedastic regression models with autoregressive covariance structures using EM algorithm. (English) Zbl 1493.62307
Summary: In the analysis of repeated or clustered measurements, it is crucial to determine the dynamics that affect the mean, variance, and correlations of the data, which will be possible using appropriate models. One of these models is the joint mean-covariance model, which is a multivariate heteroscedastic regression model with autoregressive covariance structures. In these models, parameter estimation is usually carried on under normality assumption, but the resulting estimators will be very sensitive to the outliers or non-normality of data. In this study, we propose a robust alternative method and an EM algorithm for estimating the parameters of joint mean-covariance models. Robustification is achieved using a multivariate heavy-tailed distribution with the same number of parameters as the multivariate normal distribution. To simplify the estimation procedure, a modified Cholesky decomposition is adopted to factorize the dependence structure in terms of unconstrained autoregressive and scale innovation parameters. Also, the technique for the prediction of future responses is given. An intensive simulation study and a real data example are provided to demonstrate the performance of the proposed method.
MSC:
| 62H12 | Estimation in multivariate analysis |
| 62J05 | Linear regression; mixed models |
| 62M10 | Time series, auto-correlation, regression, etc. in statistics (GARCH) |
Keywords:
heteroscedastic regression models; joint mean and scale covariance model; Laplace distribution; modified decomposition; prediction; robustnessSoftware:
nlmeReferences:
| [1] | Anderson, D. N., A multivariate Linnik distribution, Statist. Probab. Lett., 14, 333-336 (1992) · Zbl 0754.60022 |
| [2] | Aroudi, A.; Veisi, H.; Sameti, H.; Mafakheri, Z., Speech signal modeling using multivariate distributions, EURASIP J. Audio Speech Music Process., 1, 35 (2015) |
| [3] | Arslan, O., Convergence behavior of an iterative reweighting algorithm to compute multivariate M-estimates for location and scatter, J. Statist. Plann. Inference, 118, 115-128 (2004) · Zbl 1031.62041 |
| [4] | Arslan, O., An alternative multivariate skew Laplace distribution: properties and estimation, Stat. Pap., 51, 865-887 (2010) · Zbl 1247.60015 |
| [5] | Croux, C.; Gijbels, I.; Prosdocomo, I., Robust estimation of mean and dispersion functions in extended generalized additive models, Biometrics, 68, 31-44 (2012) · Zbl 1241.62108 |
| [6] | Daniels, M. J.; Pourahmadi, M., Modeling covariance matrices via partial autocorrelations, J. Multivariate Anal., 100, 2352-2363 (2009) · Zbl 1175.62090 |
| [7] | Daniels, M.; Zhao, Y., Modelling the random effects covariance matrix in longitudinal data, Stat. Med., 22, 1631-1647 (2003) |
| [8] | Diggle, P. T.; Verbyla, A., Nonparametric estimation of covariance structure in longitudinal data, Biometrics, 54, 401-415 (1998) · Zbl 1058.62600 |
| [9] | Eltoft, T.; Kim, T.; Lee, T. W., On the multivariate Laplace distribution, IEEE Sign. Process. Lett., 13, 300-303 (2006) |
| [10] | Ernst, M. D., A multivariate generalized Laplace distribution, Comput. Statist., 13, 227-232 (2006) · Zbl 0922.62043 |
| [11] | Fan, Y. L.; Qin, G. Y.; Zhu, Z. Y., Variable selection in robust regression models for longitudinal data, J. Multivariate Anal., 109, 156-167 (2012) · Zbl 1241.62104 |
| [12] | Fang, K. T.; Kotz, S.; Ng, F. W., Symmetric Multivariate and Related Distributions (1990), Chapman and Hall: Chapman and Hall London · Zbl 0699.62048 |
| [13] | Fernandez, C.; Osiewalski, J.; Steel, M. F.J., Modeling and inference with v-distributions, J. Amer. Statist. Assoc., 90, 1331-1340 (1995) · Zbl 0868.62045 |
| [14] | Fragiadakis, K.; Meintanis, S. G., Goodness-of-fit tests for multivariate Laplace distributions, Math. Comput. Model., 53, 769-779 (2011) · Zbl 1217.62060 |
| [15] | Gómez, E.; Gomez-Viilegas, M. A.; Marín, J. M., A multivariate generalization of the power exponential family of distributions, Commun. Stat.-Theory Methods, 27, 589-600 (1998) · Zbl 0895.62053 |
| [16] | Gómez-Sanches-Manzano, E.; Gomez-Viilegas, M. A.; Marín, J. M., Sequences of elliptical distributions and mixtures of normal distributions, J. Multivariate Anal., 97, 2, 295-310 (1998) · Zbl 1085.62057 |
| [17] | Gómez-Sanches-Manzano, E.; Gomez-Viilegas, M. A.; Marín, J. M., Multivariate exponential power distributions as mixtures of normal distributions with Bayesian applications, Commun. Stat.-Theory Methods, 37, 6, 972-985 (2008) · Zbl 1135.62041 |
| [18] | Huang, J. Z.; Liu, N.; Pourahmadi, M.; Liu, L., Covariance matrix selection and estimation via penalised normal likelihood, Biometrika, 93, 1, 85-98 (2006) · Zbl 1152.62346 |
| [19] | Hurlimann, W., A moment method for the multivariate asymmetric Laplace distribution, Statist. Probab. Lett., 83, 4, 1247-1253 (2013) · Zbl 1463.62025 |
| [20] | Khodabina, M.; Ahmadabadib, A., Some properties of generalized gamma distribution, Math. Sci., 4, 1, 9-28 (2010) · Zbl 1209.60009 |
| [21] | Kotz, S.; Kozubowski, T.; Podgórski, K., The Laplace distribution and generalizations: A revisit with applications to communications, (Economics, Engineering, and Finance (2001), Birkhäuser: Birkhäuser Boston) · Zbl 0977.62003 |
| [22] | Kozubowski, T. J.; Podgórski, K., A multivariate and asymmetric generalization of Laplace distribution, Math. Sci., 15, 531-540 (2000) · Zbl 1035.60010 |
| [23] | Kozubowski, T. J.; Podgórski, K., Asymmetric Laplace laws and modeling financial data, Math. Comput. Model., 34, 1003-1021 (2001) · Zbl 1002.60012 |
| [24] | Lange, K.; Sinsheimer, J. S., Normal/independent distributions and their applications in robust regression, J. Comput. Graph. Stat., 2, 175-198 (1993) |
| [25] | Lin, T. I.; Wang, Y. J., A robust approach to joint modeling of mean and scale covariance for longitudinal data, J. Statist. Plann. Inference, 139, 9, 3013-3026 (2009) · Zbl 1168.62082 |
| [26] | Lindsey, J. K.; Lindsey, P. J., Multivariate distributions with correlation matrices for nonlinear repeated measurements, Comput. Statist. Data Anal., 50, 720-732 (2006) · Zbl 1431.62219 |
| [27] | Lv, J.; Guo, C.; Li, T.; Hao, Y.; Pan, X., Adaptive robust estimation in joint mean-covariance regression model for bivariate longitudinal data, Statistics, 52, 64-83 (2018) · Zbl 1390.62101 |
| [28] | Lv, J.; Yang, H.; Guo, C., An efficient and robust variable selection method for longitudinal generalized linear models, Comput. Statist. Data Anal., 82, 74-88 (2015) · Zbl 1507.62123 |
| [29] | Maadooliat, M.; Pourahmadi, M.; Huang, J. Z., Robust estimation of the correlation matrix of longitudinal data, Stat. Comput., 23, 1, 17-28 (2013) · Zbl 1322.62154 |
| [30] | Muirhead, R. J., Aspects of Multivariate Statistical Theory (2009), John Wiley & Sons: John Wiley & Sons New York |
| [31] | Nitithumbundit, T.; Chan, J. S., ECM algorithm for auto-regressive multivariate skewed variance gamma model with unbounded density, Methodol. Comput. Appl. Probab., 22, 1169-1191 (2020) · Zbl 1457.62171 |
| [32] | Pan, J. X.; MacKenzie, G., On modelling mean-covariance structures in longitudinal studies, Biometrika, 90, 239-244 (2003) · Zbl 1039.62068 |
| [33] | Pan, J. X.; MacKenzie, G., Regression models for covariance structures in longitudinal studies, Stat. Model., 6, 43-57 (2006) · Zbl 07257124 |
| [34] | Pinheiro, J.; Bates, D.; DebRoy, S.; Sarkar, D.; Core Team, R., Nlme: Linear and nonlinear mixed effects models, (R Package Version 3.1-142 (2019)), https://CRAN.R-project.org/package=nlme |
| [35] | Portilla, J.; Strela, V.; Wainwright, M. J.; Simoncelli, E. P., Image denoising using scale mixtures of Gaussians in the wavelet domain, IEEE Trans. Image Process., 12, 11, 1338-1351 (2003) · Zbl 1279.94028 |
| [36] | Potthoff, R. F.; Roy, S. N., A generalized multivariate analysis of variance model useful especially for growth curve problems, Biometrika, 51, 313-326 (1964) · Zbl 0138.14306 |
| [37] | Pourahmadi, M., Joint mean-covariance models with applications to longitudinal data: Unconstrained parameterisation, Biometrika, 86, 677-690 (1999) · Zbl 0949.62066 |
| [38] | Pourahmadi, M., Maximum likelihood estimation for generalised linear models for multivariate normal covariance matrix, Biometrika, 87, 425-435 (2000) · Zbl 0954.62091 |
| [39] | Pourahmadi, M., Cholesky decompositions and estimation of a covariance matrix: orthogonality of variance-correlation parameters, Biometrika, 94, 4, 1006-1013 (2007) · Zbl 1156.62043 |
| [40] | Pourahmadi, M., Covariance estimation: The GLM and regularization perspectives, Stat. Sci., 369-387 (2011) · Zbl 1246.62139 |
| [41] | Qin, G.; Zhu, Z., Robust estimation of mean and covariance for longitudinal data with dropouts, J. Appl. Stat., 42, 6, 1240-1254 (2015) · Zbl 1514.62810 |
| [42] | Rossi, E.; Spazzini, F., Model and distribution uncertainty in multivariate GARCH estimation: a Monte Carlo analysis, Comput. Statist. Data Anal., 54, 2786-2800 (2010) · Zbl 1284.91477 |
| [43] | Stacy, E. W., A generalization of the gamma distribution, Ann. Math. Stat., 33, 1187-1192 (1962) · Zbl 0121.36802 |
| [44] | Ulrich, G.; Chen, C. C., A bivariate double exponential distribution and its generalization, ASA Proc. Stat. Comput., 127-129 (1987) |
| [45] | Wang, Y. G.; Carey, V., Working correlation structure misspecification, estimation and covariate design: implications for generalised estimating equations performance, Biometrika, 90, 29-41 (2003) · Zbl 1035.62074 |
| [46] | Wang, X.; Jiang, Y.; Huang, M.; Zhang, H., Robust variable selection with exponential squared loss, J. Amer. Statist. Assoc., 108, 632-643 (2013) · Zbl 06195966 |
| [47] | Xu, L.; Xiang, S.; Yao, W., Robust maximum lq-likelihood estimation of joint mean-covariance models for longitudinal data, J. Multivariate Anal., 171, 397-411 (2019) · Zbl 1417.62146 |
| [48] | Yavuz, F. G.; Arslan, O., Linear mixed model with Laplace distribution (LLMM), Stat. Pap., 59, 271-289 (2018) · Zbl 1416.62401 |
| [49] | Ye, H.; Pan, J., Modelling covariance structures in generalized estimating equations for longitudinal data, Biometrika, 93, 927-941 (2006) · Zbl 1436.62348 |
| [50] | Zhang, W.; Leng, C., A moving average cholesky factor model in covariance modeling for longitudinal data, Biometrika, 99, 141-150 (2012) · Zbl 1234.62111 |
| [51] | Zhang, W.; Leng, C.; Tang, C. Y., A joint modelling approach for longitudinal studies, J. R. Stat. Soc. Ser. B-Stat. Methodol., 77, 1, 219-238 (2015) · Zbl 1414.62388 |
| [52] | Zheng, X.; Fung, W. K.; Zhu, Z., Robust estimation in joint mean-covariance regression model for longitudinal data, Ann. Inst. Stat. Math., 65, 617-638 (2013) · Zbl 1273.62095 |
| [53] | Zheng, X.; Fung, W. K.; Zhu, Z., Variable selection in robust joint mean and covariance model for longitudinal data analysis, Statist. Sinica, 515-531 (2014) · Zbl 1285.62112 |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
