Analytical derivation of the reference prior by sequential maximization of Shannon’s mutual information in the multi-group parameter case. (English) Zbl 1432.62051
Summary: We provide an analytical derivation of a non-informative prior by sequential maximization of Shannon’s mutual information in the multi-group parameter case assuming reasonable regularity conditions. We show that the derived prior coincides with the reference prior proposed by Berger and Bernardo, and that it can be considered as a useful alternative expression for the calculation of the reference prior. In using this expression we discuss the conditions under which an improper reference prior can be uniquely defined, i.e. when it does not depend on the particular choice of nested sequences of compact subsets of the parameter space needed for its construction. We also present the conditions under which the reference prior coincides with Jeffreys’ prior.
References:
| [1] | Berger, J.; Bernardo, J. M., Estimating a product of meansBayesian analysis with reference priors, J. Amer. Statist. Assoc., 84, 200-207 (1989) · Zbl 0682.62018 |
| [2] | Berger, J.; Bernardo, J. M., Ordered group reference priors with application to the multinomial problem, Biometrika, 79, 25-37 (1992) · Zbl 0763.62014 |
| [3] | Berger, J.; Bernardo, J. M., Reference priors in a variance components problem, (Goel, P., Proceedings of the Indo-USA Workshop on Bayesian Analysis in Statistics and Econometrics (1992), Springer: Springer New-York), 323-340 |
| [4] | Berger, J.; Bernardo, J. M., On the development of reference priors, (Bernardo, J. M.; Berger, J.; Dawid, A. P.; Smith, A. F.M., Bayesian Statistics, vol. 4 (1992), University Press: University Press Oxford), 35-60 |
| [5] | Berger, J.; Bernardo, J. M.; Sun, D., The formal definition of reference priors, Ann. Statist., 37, 5, 905-938 (2009) · Zbl 1162.62013 |
| [6] | Bernardo, J. M., Reference posterior distributions for Bayesian inference, J. Roy. Statist. Soc. B, 41, 113-147 (1979) · Zbl 0428.62004 |
| [7] | Clarke, B.; Yuan, A., Partial information reference priorsderivation and interpretations, J. Statist. Plann. Inference, 123, 2, 313-345 (2004) · Zbl 1053.62010 |
| [9] | Clarke, B. S.; Barron, A. R., Jeffreys’ prior is asymptotically least favorable under entropy risk, J. Statist. Plann. Inference, 41, 1, 37-60 (1994) · Zbl 0820.62006 |
| [10] | Datta, H. S.; Gosh, M., On the invariance of noninformative priors, Ann. Statist., 24, 1, 141-159 (1996) · Zbl 0906.62024 |
| [11] | Gosh, J. K.; Mukerjee, R., Non-informative priors, (Bernardo, J. M.; Berger, J.; Dawid, A. P.; Smith, A. F.M., Bayesian Statistics, vol. 4 (1992), University Press: University Press Oxford), 195-210 |
| [12] | Kass, R. E.; Wasserman, L., The selection of prior distributions by formal rules, J. Amer. Statist. Assoc., 91, 1343-1370 (1996) · Zbl 0884.62007 |
| [13] | Sun, D.; Berger, J., Reference priors with partial information, Biometrika, 85, 55-71 (1998) · Zbl 1067.62521 |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
