A new information criterion-based bandwidth selection method for non-parametric regressions. (English) Zbl 07184808
Summary: Local linear estimator is a popularly used method to estimate the non-parametric regression functions, and many methods have been derived to estimate the smoothing parameter, or the bandwidth in this case. In this article, we propose an information criterion-based bandwidth selection method, with the degrees of freedom originally derived for non-parametric inferences. Unlike the plug-in method, the new method does not require preliminary parameters to be chosen in advance, and is computationally efficient compared to the cross-validation (CV) method. Numerical study shows that the new method performs better or comparable to existing plug-in method or CV method in terms of the estimation of the mean functions, and has lower variability than CV selectors. Real data applications are also provided to illustrate the effectiveness of the new method.
MSC:
| 62-XX | Statistics |
References:
| [1] | Fan J. Design-adaptive nonparametric regression. J Am Statist Assoc. 1992;87:998-1004. doi: 10.1080/01621459.1992.10476255[Taylor & Francis Online], [Web of Science ®], [Google Scholar] · Zbl 0850.62354 |
| [2] | Fan J. Local linear regression smoothers and their minimax efficiency. Ann Statist. 1993;21:196-216. doi: 10.1214/aos/1176349022[Crossref], [Web of Science ®], [Google Scholar] · Zbl 0773.62029 |
| [3] | Fan J, Gijbels I. Variable bandwidth and local linear regression smoothers. Ann Statist. 1992;20:2008-2036. doi: 10.1214/aos/1176348900[Crossref], [Web of Science ®], [Google Scholar] · Zbl 0765.62040 |
| [4] | Härdel W, Hall P, Marron JS. How far are automatically chosen regression smoothing parameters from their optimum? J Am Statist Assoc. 1988;83:86-99. [Web of Science ®], [Google Scholar] · Zbl 0644.62048 |
| [5] | Craven P, Wahba G. Smoothing noisy data with spline functions. Numer Math. 1979;31:377-403. doi: 10.1007/BF01404567[Crossref], [Web of Science ®], [Google Scholar] · Zbl 0377.65007 |
| [6] | Hurvich CM, Simonoff JS, Tsai C. Smoothing parameter selection in nonparametric regression using an improved Akaike information criterion. J R Stat Soc B. 1998;60(2):271-293. doi: 10.1111/1467-9868.00125[Crossref], [Google Scholar] · Zbl 0909.62039 |
| [7] | Ruppert D, Sheather SJ, Wand MP. An effective bandwidth selector for local linear squares regression. J Am Statist Assoc. 1995;90:1257-1270. doi: 10.1080/01621459.1995.10476630[Taylor & Francis Online], [Web of Science ®], [Google Scholar] · Zbl 0868.62034 |
| [8] | Grund B, Hall P, Marron JS. Loss and Risk in smoothing parameter selection. J Nonparametr Stat. 1994;4:107-132. doi: 10.1080/10485259408832605[Taylor & Francis Online], [Google Scholar] · Zbl 1380.62148 |
| [9] | Hall P, Marron JS. Lower bounds for bandwidth selection in density estimation. Probab Theory Related Fields. 1991;90:149-173. doi: 10.1007/BF01192160[Crossref], [Web of Science ®], [Google Scholar] · Zbl 0742.62041 |
| [10] | Jones MC, Kappenman RF. On a class of kernel density estimate bandwidth selectors. Scand J Statist. 1991;19:337-349. [Web of Science ®], [Google Scholar] · Zbl 0767.62035 |
| [11] | Hall P, Johnstone I. Empirical functionals and efficient smoothing parameter selection (with discussion). J R Stat Soc Ser B. 1992;54:475-530. [Google Scholar] · Zbl 0786.62050 |
| [12] | Shang HL. Bayestian bandwidth estimation for a nonparametric functional regression model with unknown error density. Comput Statist Data Anal. 2013;67:185-198. doi: 10.1016/j.csda.2013.05.006[Crossref], [Web of Science ®], [Google Scholar] · Zbl 1471.62182 |
| [13] | Levine M. Bandwidth selection for a class of difference-based variance estimators in the nonparametric regression: a possible approach. Comput Statist Data Anal. 2006;50:3405-3431. doi: 10.1016/j.csda.2005.08.001[Crossref], [Web of Science ®], [Google Scholar] · Zbl 1445.62082 |
| [14] | Sun Y, Li Q. Data-driven bandwidth selection for nonstationary semiparametric models. J Bus Econom Statist. 2011;29(4):541-551. doi: 10.1198/jbes.2011.09159[Taylor & Francis Online], [Web of Science ®], [Google Scholar] |
| [15] | Fan J, Zhang C, Zhang J. Generalized likelihood ratio statistics and Wilks phenomenon. Ann Statist. 2001;29:153-193. doi: 10.1214/aos/996986505[Crossref], [Web of Science ®], [Google Scholar] · Zbl 1029.62042 |
| [16] | Zhang C. Calibrating the degrees of freedom for automatic data smoothing and effective curve checking. J Am Statist Assoc. 2003;98:609-628. doi: 10.1198/016214503000000521[Taylor & Francis Online], [Web of Science ®], [Google Scholar] · Zbl 1040.62027 |
| [17] | Fox J, Weisberg S. An R companion to applied regression. 2nd ed. Thousand Oaks (CA): Sage; 2011. [Google Scholar] |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
