×

Bayesian bootstrap multivariate regression. (English) Zbl 1026.62019

Summary: A Bayesian bootstrap multivariate regression (BBMR) procedure is presented that allows robust Bayesian analysis of multivariate regression models. BBMR does not require a parametric specification for the likelihood function and instead uses a bootstrapped likelihood based on the sampling distribution of location and scale estimators. A mixing algorithm for implementing the procedure automatically incorporates the scale invariant ignorance prior on the covariance matrix. BBMR can be implemented as a generic algorithm in standard statistical software independently of the actual choice of prior distributions. Monte Carlo evidence is provided showing accuracy and robustness of the approach in representing posterior distributions.

MSC:

62F15 Bayesian inference
62P20 Applications of statistics to economics
62H12 Estimation in multivariate analysis
62F35 Robustness and adaptive procedures (parametric inference)
62J05 Linear regression; mixed models
62F40 Bootstrap, jackknife and other resampling methods
Full Text: DOI

References:

[1] Boos, D. D.; Monahan, J. F., Bootstrap methods using prior information, Biometrika, 73, 77-83 (1986)
[2] Cambanis, S.; Huang, S.; Simons, G., On the theory of elliptically contoured distributions, Journal of Multivariate Analysis, 11, 368-385 (1981) · Zbl 0469.60019
[3] Davison, A. C.; Hinkley, D. V.; Worton, B. J., Bootstrap likelihoods, Biometrika, 79, 113-130 (1992) · Zbl 0753.62026
[4] Deemer, W. L.; Olkin, I., The jacobians of certain matrix transformations useful in multivariate analysis, Biometrika, 38, 345-367 (1951) · Zbl 0043.34204
[5] Doksum, K. A.; Lo, A. Y., Consistent and robust Bayes procedures for location based on partial information, Annals of Statistics, 18, 443-453 (1990) · Zbl 0701.62043
[6] Dufour, J.-M., Some impossibility theorems in econometrics with applications to structural and dynamic models, Econometrica, 65, 1365-1387 (1997) · Zbl 0886.62116
[7] Efron, B., Bootstrap methodsanother look at the jackknife, Annals of Statistics, 7, 1-26 (1979) · Zbl 0406.62024
[8] Geweke, J., Exact inference in the inequality constrained normal linear regression model, Journal of Applied Econometrics, 1, 127-141 (1986)
[9] Geweke, J., Bayesian inference in econometric models using Monte Carlo integration, Econometrica, 57, 1317-1339 (1989) · Zbl 0683.62068
[10] Geweke, J., Generic, algorithmic approaches to Monte Carlo integration in Bayesian inference, Contemporary Mathematics, 115, 117-134 (1991) · Zbl 0733.65110
[11] Graham, R. L.; Hinkley, D. V.; John, P. W.M.; Shi, S., Balanced design of bootstrap simulations, Journal of the Royal Statistical Society B, 52, 185-202 (1990) · Zbl 0731.62134
[12] Heckelei, Th., Mittelhammer, R.C., 1996. Bayesian bootstrap inference via regression structure likelihood. In: Fomby, T.B., Hill, R.C. (Eds.), Advances in Econometrics, Vol. 11A. TAI Press, Stanford, CT.; Heckelei, Th., Mittelhammer, R.C., 1996. Bayesian bootstrap inference via regression structure likelihood. In: Fomby, T.B., Hill, R.C. (Eds.), Advances in Econometrics, Vol. 11A. TAI Press, Stanford, CT.
[13] Johnson, M. E., Multivariate Statistical Simulation (1987), Wiley: Wiley New York · Zbl 0604.62056
[14] Johnson, N. L.; Kotz, S., Distributions in Statistics: Continuous Multivariate Distributions (1972), Wiley: Wiley New York · Zbl 0248.62021
[15] Klein, L., Economic Fluctuations in the United States, 1921-1941 (1950), Wiley: Wiley New York
[16] Kloek, T.; van Dijk, H. K., Bayesian estimates of equation system parametersan application of integration by Monte Carlo, Econometrica, 46, 1-19 (1978) · Zbl 0376.62014
[17] Mittelhammer, R. C.; Judge, G.; Miller, G., Econometric Foundations (2000), Cambridge University Press: Cambridge University Press Cambridge · Zbl 0961.62110
[18] Monahan, J. F.; Boos, D. B., Proper likelihoods for Bayesian analysis, Biometrika, 79, 271-278 (1992) · Zbl 0751.62012
[19] Pettit, A. N., Inference for the linear model using a likelihood based on ranks, Journal of the Royal Statistical Society B, 44, 234-243 (1982) · Zbl 0493.62044
[20] Pettit, A. N., Likelihood based inference using signed ranks for matched pairs, Journal of the Royal Statistical Society B, 45, 287-296 (1983) · Zbl 0529.62031
[21] Rubin, D. B., The Bayesian bootstrap, Annals of Statistics, 9, 130-134 (1981)
[22] Rubin, D.B., Shenkar, N., 1998. Imputation. In: Kotz, S., Read, C.B., Banks, D.L. (Eds.), Encyclopedia of Statistical Sciences, Update Vol. 2. Wiley, New York, pp. 336-342.; Rubin, D.B., Shenkar, N., 1998. Imputation. In: Kotz, S., Read, C.B., Banks, D.L. (Eds.), Encyclopedia of Statistical Sciences, Update Vol. 2. Wiley, New York, pp. 336-342.
[23] Ryu, H., Maximum entropy estimation of density and regression functions, Journal of Econometrics, 56, 397-440 (1993) · Zbl 0802.62100
[24] Shao, J.; Tu, D., The Jackknife and bootstrap (1995), Springer: Springer New York · Zbl 0947.62501
[25] Theil, H., Principles of Econometrics (1971), Wiley: Wiley New York · Zbl 0221.62002
[26] van Dijk, H.K., 1985. A note on simple algebraic relations between structural and reduced form parameters. Report no. 8549, Econometric Institute, Erasmus University, Rotterdam.; van Dijk, H.K., 1985. A note on simple algebraic relations between structural and reduced form parameters. Report no. 8549, Econometric Institute, Erasmus University, Rotterdam.
[27] van Dijk, H. K.; Kloek, T., Further experience in Bayesian analysis using Monte Carlo integration, Journal of Econometrics, 14, 307-328 (1980) · Zbl 0465.62106
[28] Zellner, A., An Introduction to Bayesian Inference in Econometrics (1971), Wiley: Wiley New York · Zbl 0246.62098
[29] Zellner, A., Bayesian method of moments/instrumental variable (BMOM/IV) analysis of mean and regression models, (Lee, J. C.; Johnson, W. O.; Zellner, A., Modeling and Prediction Honoring Seymour Geisser (1996), Springer: Springer New York)
[30] Zellner, A., 1998. The finite sample properties of simultaneous equations’ estimates and estimators. Bayesian and non-Bayesian approaches. Journal of Econometrics 83 (Annals issue in honor of Carl Christ), 185-212.; Zellner, A., 1998. The finite sample properties of simultaneous equations’ estimates and estimators. Bayesian and non-Bayesian approaches. Journal of Econometrics 83 (Annals issue in honor of Carl Christ), 185-212. · Zbl 0888.62119
[31] Zellner, A.; Highfield, R. A., Calculation of maximum entropy distributions and approximations of marginal posterior distributions, Journal of Econometrics, 37, 195-209 (1988)
[32] Zellner, A.; Bauwens, L.; van Dijk, H. K., Bayesian specification analysis and estimation of simultaneous equation models using Monte Carlo methods, Journal of Econometrics, 38, 39-72 (1988)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.