×

An exposition of the false confidence theorem. (English) Zbl 07851087

Summary: A recent paper [M. S. Balch et al., Proc. R. Soc. Lond., A, Math. Phys. Eng. Sci. 475, No. 2227, Article ID 20180565, 20 p. (2019; Zbl 1472.62173)] presents the “false confidence theorem,” which has potentially broad implications for statistical inference using Bayesian posterior uncertainty. This theorem says that with an arbitrarily large (sampling/frequentist) probability, there exists a set that does contain the true parameter value but has an arbitrarily large posterior probability. As the use of Bayesian methods has become increasingly popular in applications of science, engineering and business, it is critically important to understand when Bayesian procedures lead to problematic statistical inferences or interpretations. In this paper, we consider a number of examples demonstrating the paradoxical nature of false confidence to begin to understand the contexts in which the false confidence theorem does (and does not) play a meaningful role in statistical inference. Our examples illustrate that models involving marginalization to non-linear, not one-to-one functions of multiple parameters play a key role in more extreme manifestations of false confidence.
{© 2018 John Wiley & Sons, Ltd.}

MSC:

62-XX Statistics

Citations:

Zbl 1472.62173

References:

[1] Balch, MS, Martin, R & Ferson, S (2017), ‘Satellite conjunction analysis and the false confidence theorem’, arXiv preprint arXiv:1706.08565.
[2] Berger, JO, Liseo, B, Wolpert, RL et al. (1999), ‘Integrated likelihood methods for eliminating nuisance parameters’, Statistical Science, 14(1), 1-28. · Zbl 1059.62521
[3] Fieller, EC (1954), ‘Some problems in interval estimation’, Journal of the Royal Statistical Society: Series B (Statistical Methodological), B16, 175-185. · Zbl 0057.35311
[4] Fraser, DAS, Reid, N & Lin, W (2018), ‘When should modes of inference disagree? Some simple but challenging examples’, Annals of Applied Statistics: Special section in memory of Stephen E. Fienberg. · Zbl 1405.62010
[5] Gleser, LJ & Hwang, JT (1987), ‘The nonexistence of 100 (1 − α) · Zbl 0638.62035
[6] Gong, R & Meng, X‐L (2017), ‘Judicious judgment meets unsettling updating: dilation, sure loss, and Simpson’s paradox’, arXiv preprint arXiv:1712.08946. · Zbl 07368228
[7] Hoff, PD (2009), A First Course in Bayesian Statistical Methods, Springer Science & Business Media, New York. · Zbl 1213.62044
[8] Kolmogoroff, A (1933), Grundbegriffe der wahrscheinlichkeitsrechnung. · Zbl 0007.21601
[9] Martin, R & Liu, C (2016), Validity and the foundations of statistical inference, arXiv preprint arXiv:1607.05051.
[10] Reid, N, Mukerjee, R & Fraser, D (2003), ‘Some aspects of matching priors’, Lecture Notes‐Monograph Series, 42, 31-43. Retrieved from http://www.jstor.org/stable/4356229
[11] Robert, C (2007), The Bayesian Choice: From Decision‐Theoretic Foundations to Computational Implementation, Springer Science & Business Media, New York. · Zbl 1129.62003
[12] Shafer, G (2008), Non‐additive probabilities in the work of Bernoulli and Lambert, Classic Works of the Dempster-Shafer Theory of Belief Functions, Springer, Berlin Heidelberg, 117-182.
[13] Weichselberger, K (2000), ‘The theory of interval‐probability as a unifying concept for uncertainty’, International Journal of Approximate Reasoning, 24(2‐3), 149-170. · Zbl 0995.68123
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.