×

Bayesian modeling of autoregressive partial linear models with scale mixture of normal errors. (English) Zbl 1514.62566

Summary: Normality and independence of error terms are typical assumptions for partial linear models. However, these assumptions may be unrealistic in many fields, such as economics, finance and biostatistics. In this paper, a Bayesian analysis for partial linear model with first-order autoregressive errors belonging to the class of the scale mixtures of normal distributions is studied in detail. The proposed model provides a useful generalization of the symmetrical linear regression model with independent errors, since the distribution of the error term covers both correlated and thick-tailed distributions, and has a convenient hierarchical representation allowing easy implementation of a Markov chain Monte Carlo scheme. In order to examine the robustness of the model against outlying and influential observations, a Bayesian case deletion influence diagnostics based on the Kullback-Leibler (K-L) divergence is presented. The proposed method is applied to monthly and daily returns of two Chilean companies.

MSC:

62-XX Statistics
Full Text: DOI

References:

[1] Andrews, D. and Mallows, C. 1974. Scale mixtures of normal distributions. J. R. Stat. Soc. Series B, 36: 99-102. · Zbl 0282.62017
[2] Brockwell, P. and Davis, R. 1991. Time Series Theory and Methods, New York: Springer. · Zbl 0709.62080 · doi:10.1007/978-1-4419-0320-4
[3] Brooks, S. P. Discussion on the paper by Spiegelhalter, Best, Carlin, and van de Linde (2002). J. R. Stat. Soc. Series B, 64(3)616-618.
[4] Chan, N. H. 2002. Time Series. Applications to Finance, Wiley Series in Probability and Statistics New York: Wiley. · Zbl 1006.62075
[5] Chen, M. H., Shao, Q. M. and Ibrahim, J. 2000. Monte Carlo Methods in Bayesian Computation, New York: Springer-Verlag. · Zbl 0949.65005 · doi:10.1007/978-1-4612-1276-8
[6] Chib, S. 1993. Bayes resgression with autoregressive errors: A Gibbs sampling approach. J. Econ., 58(3): 275-294. · Zbl 0775.62068
[7] Chib, S. and Greenberg, E. 1994. Bayes inference in regression models with ARMA \((\) p, q \()\) errors. J. Econ., : 183-206. · Zbl 0807.62065
[8] Cook, R. D. 1986. Assessment of local influence. J. R. Stat. Soc. Series B, 48: 133-169. · Zbl 0608.62041
[9] Cook, R. D. and Weisberg, S. 1982. Residuals and Influence in Regression, Boca Raton, FL: Chapman & Hall/CRC. · Zbl 0564.62054
[10] Cowles, M. and Carlin, B. 1996. Markov chain Monte Carlo convergence diagnostics: A comparative review. J. Am. Stat. Assoc., 91: 883-904. (doi:10.1080/01621459.1996.10476956) · Zbl 0869.62066
[11] Crainiceanu, C., Ruppert, D. and Wand, M. 2005. Bayesian analysis for penalized spline regression using WinBUGS. J. Stat. Softw., 14(14): 1-24. · doi:10.18637/jss.v014.i14
[12] Dominici, F., McDermott, A. and Hastie, T. 2004. Improved semiparametric time series models of air pollution and mortality. J. Am. Stat. Assoc., 9(468): 938-948. (doi:10.1198/016214504000000656) · Zbl 1055.62132
[13] Gelfand, A. E., Dey, D. K. and Chang, H. 1992. “Model determination using predictive distributions with implementation via sampling-based methods”. In Bayesian Statistics 4 (Peñíscola, 1991), 147-167. New York: Oxford University Press.
[14] Gurland, J. 1954. An example of autocorrelated disturbances in linear regression. Econometrica, 22: 218-227. (doi:10.2307/1907543) · Zbl 0055.37805 · doi:10.2307/1907543
[15] Green, P. and Silverman, B. 1994. Nonparametric Regression and Generalized Linear Models: A Rougthness Penalty Approach, Boca Raton, FL: Chapman & Hall. · Zbl 0832.62032
[16] He, X., Fung, W. and Zhu, Z. 2005. Robust estimation in generalized partial linear models for clustered data. J. Am. Stat. Assoc., 100(472): 1176-1184. (doi:10.1198/016214505000000277) · Zbl 1117.62351
[17] Hobert, J. and Casella, G. 1996. The effect of improper priors on Gibbs Sampling in hierarchical linear mixed models. J. Am. Stat. Assoc., 91(436): 1461-1473. (doi:10.1080/01621459.1996.10476714) · Zbl 0882.62020
[18] Ibacache-Pulgar, G. and Paula, G. 2011. Local influence for student-\(t\) partially linear models. Comput. Stat. Data Anal., 55): 1462-1478. (doi:10.1016/j.csda.2010.10.009) · Zbl 1328.62025 · doi:10.1016/j.csda.2010.10.009
[19] Ibacache-Pulgar, G., Paula, G. A. and Cysneiros, F. J.A. 2013. Semiparametric additive models under symmetric distributions. Test, 22(1): 103-121. (doi:10.1007/s11749-012-0309-z) · Zbl 1302.62094 · doi:10.1007/s11749-012-0309-z
[20] Kim, S., Chen, M. H. and Dey, D. 2008. Flexible generalized t-link models for binary response data. Biometrika, 95(1): 93-106. (doi:10.1093/biomet/asm079) · Zbl 1437.62513 · doi:10.1093/biomet/asm079
[21] Lachos, V. H., Bandyopadhyay, D. and Dipay, K. D. 2011. Linear and nonlinear mixed-effects models for censored HIV viral loads using normal/independent distributions. Biometrics, 67: 1594-1604. (doi:10.1111/j.1541-0420.2011.01586.x) · Zbl 1274.62806 · doi:10.1111/j.1541-0420.2011.01586.x
[22] Liu, C. 1996. Bayesian robust multivariate linear regression with incomplete data. J. Am. Stat. Assoc., 91: 1219-1227. (doi:10.1080/01621459.1996.10476991) · Zbl 0880.62028
[23] Marriott, J. and Newbold, P. 1998. Bayesian comparison of ARIMA and stationary ARMA models. Int. Stat. Rev., 66(3): 323-336. (doi:10.1111/j.1751-5823.1998.tb00376.x) · Zbl 0911.62082 · doi:10.1111/j.1751-5823.1998.tb00376.x
[24] McCulloch, R. and Tsay, R. 1994. Bayesian analysis of autoregressive time series via the Gibbs Sampler. J. Time Series Anal., 15(2): 235-250. (doi:10.1111/j.1467-9892.1994.tb00188.x) · Zbl 0800.62549 · doi:10.1111/j.1467-9892.1994.tb00188.x
[25] Mills, T. C. 1999. The Econometric Modelling of Financial Time Series, 2, Cambridge: Cambridge University Press. · Zbl 1145.62402 · doi:10.1017/CBO9780511754128
[26] Paula, G. A., Medeiros, M. and Vilca-Labra, E. 2009. Influence diagnostics for linear models with first-order autoregressive elliptical errors. Stat. Probab. Lett., 79: 339-346. (doi:10.1016/j.spl.2008.08.017) · Zbl 1155.62052 · doi:10.1016/j.spl.2008.08.017
[27] Rosa, G. J.M., Gianola, D. and Padovani, C. R. 2011. Bayesian longitudinal data analysis with mixed models and thick-tailed distributions using MCMC. J. Appl. Stat., 31: 855-873. (doi:10.1080/0266476042000214538) · Zbl 1121.62479
[28] Ruppert, D. 2002. Selecting the number of knots for penalized splines. J. Comput. Graph. Stat., : 735-757.
[29] Ruppert, D., Wand, M. and Carroll, R. 2003. Semiparametric Regression, Cambridge Series in Statistical and Probabilistic Mathematics No. 12 Cambridge University Press. · Zbl 1038.62042 · doi:10.1017/CBO9780511755453
[30] Sargan, J. D. 1964. “Wages and prices in the United Kingdom: A study in econometric methodology”. In Econometric Analysis for National Economic Planning, Edited by: Hart, P. E., Mills, G. and Whitaker, J. K. 25-54. London: Butterworth and Co. Ltd.
[31] Seber, G. A.F. and Wild, C. L. 1989. Nonlinear Regression, New York: Wiley. · Zbl 0721.62062 · doi:10.1002/0471725315
[32] Segal, M., Bacchetti, P. and Jewell, N. 1994. Variances for maximun penalized likelihood estimates obtained via the em algorithm. J. R. Stat. Soc. B, 56: 345-352. · Zbl 0800.62144
[33] Spiegelhalter, D. J., Best, N. G., Carlin, B. P. and van der Linde, A. 2002. Bayesian measures of model complexity and fit. J. R. Stat. Soc. Series B, 64(4): 583-639. (doi:10.1111/1467-9868.00353) · Zbl 1067.62010 · doi:10.1111/1467-9868.00353
[34] Sturtz, S., Ligges, U. and Gelman, A. 2005. R2WinBUGS: A package for running WinBUGS from R. J. Stat. Softw., 12(3): 1-16. · doi:10.18637/jss.v012.i03
[35] Tsay, R. S. 1984. Regression models with time series errors. J. Am. Stat. Assoc., 79: 118-124. (doi:10.1080/01621459.1984.10477073) · Zbl 0533.62082
[36] Wahba, G. 1982. “Constrained Regularization for Ill Posed Linear Operator Equations, with Applications in Meteorology and Medicine”. In Statistical Decision Theory and Related Topics III, Edited by: Gupta, S. S. and Berger, J. O. Vol. 2., 383-418. New York: Academic Press. · Zbl 0583.62066
[37] Zeger, S. and Diggle, P. 1994. Semiparametric models for longitudinal data with application to CD4 cell numbers in HIV seroconverters. Biometrics, 50(3): 689-699. (doi:10.2307/2532783) · Zbl 0821.62093 · doi:10.2307/2532783
[38] Zeller, C., Lachos, V. and Vilca-Labra, F. 2011. Local infuence analysis for regression models with scale mixtures of skew-normal distributions. J. Appl. Stat., 38: 343-368. (doi:10.1080/02664760903406504) · Zbl 1511.62164
[39] Zhao, Y., Staudenmayer, J., Coull, B. and Wand, M. 2006. General design Bayesian generalized linear mixed models. Stat. Sci., 21(1): 35-51. (doi:10.1214/088342306000000015) · Zbl 1129.62063 · doi:10.1214/088342306000000015
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.