On the error in Laplace approximations of high-dimensional integrals. (English) Zbl 07851320
Summary: Laplace approximations are commonly used to approximate high-dimensional integrals in statistical applications, but the quality of such approximations as the dimension of the integral grows is not well understood. In this paper, we provide a new result on the size of the error in first- and higher-order Laplace approximations, in terms of the rate of growth of information about each of the integrated variables. By contrast with many existing results, we allow for variation in the rate of information growth among the different integrated variables. We apply our results to investigate the quality of Laplace approximations to the likelihood in some generalized linear mixed models.
{© 2021 The Author. Stat published by John Wiley & Sons Ltd.}
{© 2021 The Author. Stat published by John Wiley & Sons Ltd.}
MSC:
| 62-XX | Statistics |
Keywords:
Bayesian methods; computationally intensive methods; generalized linear models; large sample theorySoftware:
lme4References:
| [1] | Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015). Fitting linear mixed‐effects models using lme4. Journal of Statistical Software, 67(1), 1-48. |
| [2] | Butler, R. W. (2007). Saddlepoint approximations with applications: Cambridge University Press. https://doi.org/10.1017/CBO9780511619083 · Zbl 1183.62001 · doi:10.1017/CBO9780511619083 |
| [3] | Douc, R., Moulines, E., & Rydén, T. (2004). Asymptotic properties of the maximum likelihood estimator in autoregressive models with Markov regime. The Annals of Statistics, 32(5), 2254-2304. · Zbl 1056.62028 |
| [4] | Friel, N., & Wyse, J. (2012). Estimating the evidence—A review. Statistica Neerlandica, 66(3), 288-308. https://doi.org/10.1111/j.1467-9574.2011.00515.x · doi:10.1111/j.1467-9574.2011.00515.x |
| [5] | Goutis, C., & Casella, G. (1999). Explaining the saddlepoint approximation. The American Statistician, 53(3), 216-224. |
| [6] | McCullagh, P. (1987). Tensor methods in statistics. In (pp. 254‐256). Chapman and Hall. · Zbl 0732.62003 |
| [7] | Nie, L. (2007). Convergence rate of MLE in generalized linear and nonlinear mixed‐effects models: Theory and applications. Journal of Statistical Planning and Inference, 137(6), 1787-1804. · Zbl 1118.62073 |
| [8] | Ogden, H. E. (2017). On asymptotic validity of naive inference with an approximate likelihood. Biometrika, 104(1), 153-164. · Zbl 1506.62455 |
| [9] | Raudenbush, S. W., Yang, M.‐L., & Yosef, M. (2000). Maximum likelihood for generalized linear models with nested random effects via high‐order, multivariate Laplace approximation. Journal of Computational and Graphical Statistics, 9(1), 141-157. |
| [10] | Reid, N. (1988). Saddlepoint methods and statistical inference. Statistical Science, 3(2), 213-238. https://doi.org/10.1214/ss/1177012906 · Zbl 0955.62541 · doi:10.1214/ss/1177012906 |
| [11] | Rue, H., Martino, S., & Chopin, N. (2009). Approximate Bayesian inference for latent Gaussian models by using integrated nested Laplace approximations. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 71(2), 319-392. · Zbl 1248.62156 |
| [12] | Shun, Z., & McCullagh, P. (1995). Laplace approximation of high dimensional integrals. Journal of the Royal Statistical Society. Series B (Methodological), 57(4), 749-760. · Zbl 0826.41026 |
| [13] | Small, C. G. (2010). Expansions and asymptotics for statistics. In (chap. 6). Chapman and Hall/CRC. · Zbl 1196.62002 |
| [14] | Tierney, L., & Kadane, J. B. (1986). Accurate approximations for posterior moments and marginal densities. Journal of the American Statistical Association, 81(393), 82-86. · Zbl 0587.62067 |
| [15] | Zipunnikov, V., & Booth, J. G. (2011). Closed form GLM cumulants and GLMM fitting with a SQUAR‐EM‐LA 2 algorithm. |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
