×

Shrinkage estimation with logarithmic penalties. (English) Zbl 07886838

Summary: In this paper, we have developed a novel approach for deriving shrinkage estimators of means without assuming normality. Our method is based on the equation of the first-order condition with a logarithmic penalty, and it introduces both one-step and two-step shrinkage estimators. The one-step estimator closely resembles the James-Stein estimator, while the differentiable two-step estimator exhibits similar performance to the positive-part Stein estimator. Although the latter does not satisfy Baranchik’s conditions, both estimators can be demonstrated to be minimax under normality assumptions. Furthermore, we have extended this method to handle cases involving an unknown scale. We have successfully applied this approach to the simultaneous estimation of Poisson means.

MSC:

62-XX Statistics

References:

[1] Banerjee, A.; Merugu, S.; Dhillon, IS; Ghosh, J., Clustering with Bregman divergences, Journal of Machine Learning Research, 6, 1705-1749, 2005 · Zbl 1190.62117
[2] Baranchik, AJ, A family of minimax estimators of the mean of a multivariate normal distribution, Annals of Mathematical Statistics, 41, 642-645, 1970 · Zbl 0204.52504 · doi:10.1214/aoms/1177697104
[3] Berger, JO, Statistical decision theory and Bayesian analysis, 1985, Springer Verlag · Zbl 0572.62008 · doi:10.1007/978-1-4757-4286-2
[4] Brandwein, AC; Strawderman, WE, Stein estimation: The spherically symmetric case, Statistical Science, 5, 356-369, 1990 · Zbl 0955.62611 · doi:10.1214/ss/1177012104
[5] Clevenson, ML; Zidek, JV, Simultaneous estimation of the means of independent Poisson laws, Journal of the American Statistical Association, 70, 698-705, 1975 · Zbl 0308.62018
[6] Doornik, JA, Object-oriented matrix programming using Ox, 2007, Timberlake Consultants Press and Oxford
[7] Efron, B.; Morris, C., Empirical Bayes on vector observations: An extension of Stein’s method, Biometrika, 59, 335-347, 1972 · Zbl 0238.62072 · doi:10.1093/biomet/59.2.335
[8] Efron, B.; Morris, C., Limiting the risk of Bayes and empirical Bayes estimators—Part II: The empirical Bayes case, Journal of the American Statistical Association, 67, 130-139, 1972 · Zbl 0231.62013
[9] Efron, B.; Morris, C., Families of minimax estimators of the mean of a multivariate normal distribution, Annals of Statistics, 4, 11-21, 1976 · Zbl 0322.62010 · doi:10.1214/aos/1176343344
[10] Efron, B.; Morris, C., Multivariate empirical Bayes and estimation of covariance matrices, Annals of Statistics, 4, 22-32, 1976 · Zbl 0322.62041 · doi:10.1214/aos/1176343345
[11] Fourdrinier, D.; Strawderman, WE; Wells, MT, Shrinkage estimation, 2018, Springer Nature · Zbl 1411.62011 · doi:10.1007/978-3-030-02185-6
[12] James, W., & Stein, C. (1961). Estimation with quadratic loss. In: Proceedings of the Fourth Berkeley Symposium on mathematical statistics and probability,1, 361-379. University of California Press, Berkeley. · Zbl 1281.62026
[13] Kubokawa, T., An approach to improving the James-Stein estimator, Journal of Multivariate Analysis, 36, 121-126, 1991 · Zbl 0733.62059 · doi:10.1016/0047-259X(91)90096-K
[14] Kubokawa, T., A unified approach to improving equivariant estimators, Annals of Statistics, 22, 290-299, 1994 · Zbl 0816.62021 · doi:10.1214/aos/1176325369
[15] Robert, CP, The Bayesian choice: From decision-theoretic foundations to computational implementation, 2007, Springer Verlag · Zbl 1129.62003
[16] Stein, C. (1956). Inadmissibility of the usual estimator for the mean of a multivariate normal distribution. In: Proceedings of the Third Berkeley Symposium on mathematical statistics and probability,1, 197-206. University of California Press, Berkeley. · Zbl 0073.35602
[17] Stein, C. (1973). Estimation of the mean of a multivariate normal distribution. In: Proceedings of the Prague Symposium on asymptotic statistics,II, 345-381. Charles University, Prague. · Zbl 0357.62020
[18] Stein, C., Estimation of the mean of a multivariate normal distribution, Annals of Statistics, 9, 1135-1151, 1981 · Zbl 0476.62035 · doi:10.1214/aos/1176345632
[19] Strawderman, WE, Proper Bayes minimax estimators of the multivariate normal mean, Annals of Mathematical Statistics, 42, 385-388, 1971 · Zbl 0222.62006 · doi:10.1214/aoms/1177693528
[20] Tsui, K-W, Robustness of Clevenson-Zidek-type estimators, Journal of the American Statistical Association, 79, 152-157, 1984 · Zbl 0553.62032 · doi:10.1080/01621459.1984.10477078
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.