Bandwidth selection in kernel density estimation: oracle inequalities and adaptive minimax optimality. (English) Zbl 1234.62035
Summary: We address the problem of density estimation with \(\mathbb L_s\)-loss by selection of kernel estimators. We develop a selection procedure and derive corresponding \(\mathbb L_s\)-risk oracle inequalities. It is shown that the proposed selection rule leads to the estimator being minimax adaptive over a scale of the anisotropic Nikol’skii classes. The main technical tools used in our derivations are uniform bounds on the \(\mathbb L_s\)-norms of empirical processes developed by Goldenshluger and Lepski [Ann. Probab. 39, No. 6, 2318–2384 (2011; Zbl 1238.60023)].
MSC:
| 62G07 | Density estimation |
| 62G20 | Asymptotic properties of nonparametric inference |
| 62G05 | Nonparametric estimation |
Citations:
Zbl 1238.60023References:
| [1] | Birgé, L. (2008). Model selection for density estimation with L 2 -loss. Available at . |
| [2] | Bretagnolle, J. and Huber, C. (1979). Estimation des densit��s: Risque minimax. Z. Wahrsch. Verw. Gebiete 47 119-137. · Zbl 0413.62024 · doi:10.1007/BF00535278 |
| [3] | Devroye, L. and Györfi, L. (1985). Nonparametric Density Estimation: The L 1 View . Wiley, New York. · Zbl 0546.62015 |
| [4] | Devroye, L. and Lugosi, G. (1996). A universally acceptable smoothing factor for kernel density estimates. Ann. Statist. 24 2499-2512. · Zbl 0867.62024 · doi:10.1214/aos/1032181164 |
| [5] | Devroye, L. and Lugosi, G. (1997). Nonasymptotic universal smoothing factors, kernel complexity and Yatracos classes. Ann. Statist. 25 2626-2637. · Zbl 0897.62035 · doi:10.1214/aos/1030741088 |
| [6] | Devroye, L. and Lugosi, G. (2001). Combinatorial Methods in Density Estimation . Springer, New York. · Zbl 0964.62025 |
| [7] | Donoho, D. L., Johnstone, I. M., Kerkyacharian, G. and Picard, D. (1996). Density estimation by wavelet thresholding. Ann. Statist. 24 508-539. · Zbl 0860.62032 · doi:10.1214/aos/1032894451 |
| [8] | Goldenshluger, A. and Lepski, O. (2008). Universal pointwise selection rule in multivariate function estimation. Bernoulli 14 1150-1190. · Zbl 1168.62323 · doi:10.3150/08-BEJ144 |
| [9] | Goldenshluger, A. and Lepski, O. (2009). Structural adaptation via L p -norm oracle inequalities. Probab. Theory Related Fields 143 41-71. · Zbl 1149.62020 · doi:10.1007/s00440-007-0119-5 |
| [10] | Goldenshluger, A. and Lepski, O. (2011). Uniform bounds for norms of sums of independent random functions. Ann. Probab. To appear. Available at . · Zbl 1238.60023 |
| [11] | Hasminskii, R. and Ibragimov, I. (1990). On density estimation in the view of Kolmogorov’s ideas in approximation theory. Ann. Statist. 18 999-1010. · Zbl 0705.62039 · doi:10.1214/aos/1176347736 |
| [12] | Ibragimov, I. A. and Has’minskiĭ, R. Z. (1980). An estimate of the density of a distribution. Zap. Nauchn. Sem. Leningrad. Otdel. Mat. Inst. Steklov. (LOMI) 98 61-85. |
| [13] | Ibragimov, I. A. and Khas’minskiĭ, R. Z. (1981). More on estimation of the density of a distribution. Zap. Nauchn. Sem. Leningrad. Otdel. Mat. Inst. Steklov. (LOMI) 108 72-88. · Zbl 0486.62039 |
| [14] | Jennrich, R. I. (1969). Asymptotic properties of non-linear least squares estimators. Ann. Math. Statist. 40 633-643. · Zbl 0193.47201 · doi:10.1214/aoms/1177697731 |
| [15] | Johnson, W. B., Schechtman, G. and Zinn, J. (1985). Best constants in moment inequalities for linear combinations of independent and exchangeable random variables. Ann. Probab. 13 234-253. · Zbl 0564.60020 · doi:10.1214/aop/1176993078 |
| [16] | Juditsky, A. and Lambert-Lacroix, S. (2004). On minimax density estimation on \Bbb R. Bernoulli 10 187-220. · Zbl 1076.62037 · doi:10.3150/bj/1082380217 |
| [17] | Kerkyacharian, G., Lepski, O. and Picard, D. (2001). Nonlinear estimation in anisotropic multi-index denoising. Probab. Theory Related Fields 121 137-170. · Zbl 1010.62029 · doi:10.1007/s004400100148 |
| [18] | Kerkyacharian, G., Picard, D. and Tribouley, K. (1996). L p adaptive density estimation. Bernoulli 2 229-247. · Zbl 0858.62031 |
| [19] | Mason, D. M. (2009). Risk bounds for kernel density estimators. Zap. Nauchn. Sem. Leningrad. Otdel. Mat. Inst. Steklov. (LOMI) 363 66-104. Available at . |
| [20] | Massart, P. (2007). Concentration Inequalities and Model Selection. Lecture Notes in Math. 1896 . Springer, Berlin. · Zbl 1170.60006 · doi:10.1007/978-3-540-48503-2 |
| [21] | Nikol’skiĭ, S. M. (1969). Priblizhenie Funktsii Mnogikh Peremennykh i Teoremy Vlozheniya . Nauka, Moscow. · Zbl 0185.37901 |
| [22] | Parzen, E. (1962). On estimation of a probability density function and mode. Ann. Math. Statist. 33 1065-1076. · Zbl 0116.11302 · doi:10.1214/aoms/1177704472 |
| [23] | Rigollet, P. and Tsybakov, A. B. (2007). Linear and convex aggregation of density estimators. Math. Methods Statist. 16 260-280. · Zbl 1231.62057 · doi:10.3103/S1066530707030052 |
| [24] | Rosenblatt, M. (1956). Remarks on some nonparametric estimates of a density function. Ann. Math. Statist. 27 832-837. · Zbl 0073.14602 · doi:10.1214/aoms/1177728190 |
| [25] | Samarov, A. and Tsybakov, A. (2007). Aggregation of density estimators and dimension reduction. In Advances in Statistical Modeling and Inference (V. Nair, ed.). Ser. Biostat. 3 233-251. World Scientific, Hackensack, NJ. |
| [26] | Silverman, B. W. (1986). Density Estimation for Statistics and Data Analysis . Chapman & Hall, London. · Zbl 0617.62042 |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
