×

Wavelet regression in random design with heteroscedastic dependent errors. (English) Zbl 1369.62074

Summary: We investigate function estimation in nonparametric regression models with random design and heteroscedastic correlated noise. Adaptive properties of warped wavelet nonlinear approximations are studied over a wide range of Besov scales, \(f \in \mathcal B_{\pi ,r}^s\), and for a variety of \(L^p\) error measures. We consider error distributions with Long-Range-Dependence parameter \(\alpha\), \(0<\alpha \leq 1\); heteroscedasticity is modeled with a design dependent function \(\sigma \). We prescribe a tuning paradigm, under which warped wavelet estimation achieves partial or full adaptivity results with the rates that are shown to be the minimax rates of convergence. For \(p>2\), it is seen that there are three rate phases, namely the dense, sparse and long range dependence phase, depending on the relative values of \(s, p, \pi\) and \(\alpha\). Furthermore, we show that long range dependence does not come into play for shape estimation \(f - \int f\). The theory is illustrated with some numerical examples.

MSC:

62G08 Nonparametric regression and quantile regression
62G07 Density estimation
62G20 Asymptotic properties of nonparametric inference
62M10 Time series, auto-correlation, regression, etc. in statistics (GARCH)

References:

[1] Beran, J. and Feng, Y. (2001). Local polynomial estimation with a FARIMA-GARCH error process. Bernoulli 7 733-750. · Zbl 0985.62033 · doi:10.2307/3318539
[2] Beran, J. and Feng, Y. (2002). Local polynomial fitting with long-memory, short-memory and antipersistent errors. Ann. Inst. Statist. Math. 54 291-311. · Zbl 1012.62033 · doi:10.1023/A:1022469818068
[3] Cai, T. and Brown, L. D. (1999). Wavelet estimation for samples with random uniform design. Statist. Probab. Lett. 42 313-321. · Zbl 0940.62037 · doi:10.1016/S0167-7152(98)00223-5
[4] Cheng, B. and Robinson, P. M. (1991). Density estimation in strongly dependent nonlinear time series. Statist. Sinica 1 335-359. · Zbl 0823.62031
[5] Cheng, B. and Robinson, P. M. (1994). Semiparametric estimation from time series with long-range dependence. J. Econometrics 64 335-353. · Zbl 0808.62081 · doi:10.1016/0304-4076(94)90068-X
[6] Claeskens, G. and Hall, P. (2002). Effect of dependence on stochastic measures of accuracy of density estimators. Ann. Statist. 30 431-454. · Zbl 1012.62031 · doi:10.1214/aos/1021379860
[7] Cohen, A., Daubechies, I. and Vial, P. (1993). Wavelets on the interval and fast wavelet transforms. Appl. Comput. Harmon. Anal. 1 54-81. · Zbl 0795.42018 · doi:10.1006/acha.1993.1005
[8] Csörgő, S. and Mielniczuk, J. (1999). Random-design regression under long-range dependent errors. Bernoulli 5 209-224. · Zbl 0946.62084 · doi:10.2307/3318432
[9] Csörgő, S. and Mielniczuk, J. (2000). The smoothing dichotomy in random-design regression with long-memory errors based on moving averages. Statist. Sinica 10 771-787. · Zbl 1053.62553
[10] Donoho, D., Johnstone, I. M., Kerkyacharian, G. and Picard, D. (1996). Density estimation by wavelet thresholding. Ann. Statist. 24 508-539. · Zbl 0860.62032 · doi:10.1214/aos/1032894451
[11] Dzhaparidze, K. and van Zanten, J. H. (2001). On Bernstein-type inequalities for martingales. Stochastic Process. Appl. 93 109-117. · Zbl 1051.60022 · doi:10.1016/S0304-4149(00)00086-7
[12] Efromovich, S. (1999). How to overcome the curse of long-memory errors. IEEE Trans. Inform. Theory 45 1735-1741. · Zbl 0959.62038 · doi:10.1109/18.771257
[13] Guo, H. and Koul, H. L. (2008). Asymptotic inference in some hetereoscedastic regression models with long memory design and errors. Ann. Statist. 36 458-487. · Zbl 1132.62066 · doi:10.1214/009053607000000686
[14] Hall, P. and Heyde, C. C. (1980). Martingale Limit Theory and Its Application . Academic Press, New York. · Zbl 0462.60045
[15] Hall, P., Lahiri, S. N. and Truong, Y. K. (1995). On bandwidth choice for density estimation with dependent data. Ann. Statist. 23 2241-2263. · Zbl 0854.62039 · doi:10.1214/aos/1034713655
[16] Härdle, W., Kerkyacharian, G., Picard, D. and Tsybakov, A. (1997). Wavelets, Approximation, and Statistical Applications. Lecture Notes in Statistics 129 . Springer, New York. · Zbl 0899.62002
[17] Johnstone, I. M. (1999). Wavelet shrinkage for correlated data and inverse problems: Adaptivity results. Statist. Sinica 9 51-83. · Zbl 1065.62519
[18] Kerkyacharian, G. and Picard, D. (2000). Thresholding algorithms, maxisets and well-concentrated bases. Test 9 283-344. · Zbl 1107.62323 · doi:10.1007/BF02595738
[19] Kerkyacharian, G. and Picard, D. (2004). Regression in random design and warped wavelets. Bernoulli 10 1053-1105. · Zbl 1067.62039 · doi:10.3150/bj/1106314850
[20] Kulik, R. and Raimondo, M. (2009). L p wavelet regression with correlated errors. Statist. Sinica . · Zbl 1191.62072
[21] Mallat, S. (1998). A Wavelet Tour of Signal Processing , 2nd ed. Academic Press, San Diego, CA. · Zbl 0937.94001
[22] Masry, E. (2001). Local linear regression estimation under long-range dependence: Strong consistency and rates. IEEE Trans. Inform. Theory 47 2863-2875. · Zbl 1008.62579 · doi:10.1109/18.959266
[23] Masry, E. and Mielniczuk, J. (1999). Local linear regression estimation for time series with long-range dependence. Stochastic Process. Appl. 82 173-193. · Zbl 0991.62024 · doi:10.1016/S0304-4149(99)00015-0
[24] Mielniczuk, J. and Wu, W. B. (2004). On random-design model with dependent errors. Statist. Sinica 14 1105-1126. · Zbl 1060.62046
[25] Pensky, M. and Sapatinas, T. (2009). Functional deconvolution in a periodic setting: Uniform case. Ann. Statist. 37 73-104. · Zbl 1274.62253 · doi:10.1214/07-AOS552
[26] Robinson, P. M. and Hidalgo, F. J. (1997). Time series regression with long-range dependence. Ann. Statist. 25 77-104. · Zbl 0870.62072 · doi:10.1214/aos/1034276622
[27] Wang, Y. (1996). Function estimation via wavelet shrinkage for long-memory data. Ann. Statist. 24 466-484. · Zbl 0859.62042 · doi:10.1214/aos/1032894449
[28] Wu, W. B. and Mielniczuk, J. (2002). Kernel density estimation for linear processes. Ann. Statist. 30 1441-1459. · Zbl 1015.62034 · doi:10.1214/aos/1035844982
[29] Yang, Y. (2001). Nonparametric regression with dependent errors. Bernoulli 7 633-655. · Zbl 1006.62041 · doi:10.2307/3318730
[30] Yao, Q. and Tong, H. (1998). Cross-validatory bandwidth selections for regression estimation based on dependent data. J. Statist. Plann. Inference 68 387-415. · Zbl 0942.62046 · doi:10.1016/S0378-3758(97)00151-1
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.