×

Weak-convergence of empirical conditional processes and conditional \(U\)-processes involving functional mixing data. (English) Zbl 07672039

Summary: \(U\)-statistics represent a fundamental class of statistics arising from modeling quantities of interest defined by multi-subject responses. \(U\)-statistics generalize the empirical mean of a random variable \(X\) to sums over every \(m\)-tuple of distinct observations of \(X\). W. Stute [Ann. Probab. 19 (1991) 812-825] introduced a class of so-called conditional \(U\)-statistics, which may be viewed as a generalization of the Nadaraya-Watson estimates of a regression function. Stute proved their strong pointwise consistency to : \[ m(\mathbf{t}):=\mathbb{E}[\varphi (Y_1,\ldots,Y_m)|(X_1,\ldots, X_m) =\mathbf{t}], \; \text{ for }\mathbf{t}\in \mathcal{X}^m. \] In this paper we are mainly interested in establishing weak convergence of conditional \(U\)-processes in a functional mixing data framework. More precisely, we investigate the weak convergence of the conditional empirical process indexed by a suitable class of functions and of conditional \(U\)-processes when the explicative variable is functional. We treat the weak convergence in both cases when the class of functions is bounded or unbounded satisfying some moment conditions. These results are proved under some standard structural conditions on the Vapnik-Chervonenkis classes of functions and some mild conditions on the model. The theoretical results established in this paper are (or will be) key tools for many further developments in functional data analysis.

MSC:

62G05 Nonparametric estimation
62G08 Nonparametric regression and quantile regression
62G20 Asymptotic properties of nonparametric inference
62G35 Nonparametric robustness
62G07 Density estimation
62G32 Statistics of extreme values; tail inference
62G30 Order statistics; empirical distribution functions
62E20 Asymptotic distribution theory in statistics

Software:

fda (R); KernSmooth
Full Text: DOI

References:

[1] Abrevaya, J.; Jiang, W., A nonparametric approach to measuring and testing curvature, J. Bus. Econom. Statist., 23, 1, 1-19 (2005) · doi:10.1198/073500104000000316
[2] Akaike, H., An approximation to the density function, Ann. Inst. Statist. Math. Tokyo, 6, 127-132 (1954) · Zbl 0058.12302 · doi:10.1007/BF02900741
[3] Almanjahie, I.; Bouzebda, S.; Kaid, Z.; Ali, L., Nonparametric estimation of expectile regression in functional dependent data, J. Nonparametr. Stat., 34, 1, 1-3 (2022) · Zbl 07476221 · doi:10.1080/10485252.2022.2027412
[4] Almanjahie, IM; Bouzebda, S.; Chikr Elmezouar, Z.; Laksaci, A., The functional \(k\) NN estimator of the conditional expectile: Uniform consistency in number of neighbors, Stat. Risk Model., 38, 3-4, 47-63 (2022) · Zbl 1493.62151
[5] Aneiros, G.; Cao, R.; Fraiman, R.; Genest, C.; Vieu, P., Recent advances in functional data analysis and high-dimensional statistics, J. Multivariate Anal., 170, 3-9 (2019) · Zbl 1415.62043 · doi:10.1016/j.jmva.2018.11.007
[6] Araujo A, Giné E (1980) The central limit theorem for real and Banach valued random variables. John Wiley & Sons, New York-Chichester-Brisbane (Wiley Series in Probability and Mathematical Statistics) · Zbl 0457.60001
[7] Arcones, MA; Giné, E., Limit theorems for \(U\)-processes, Ann Probab, 21, 3, 1494-1542 (1993) · Zbl 0789.60031 · doi:10.1214/aop/1176989128
[8] Arcones, MA; Wang, Y., Some new tests for normality based on \(U\)-processes, Statist Probab Lett, 76, 1, 69-82 (2006) · Zbl 1085.62047 · doi:10.1016/j.spl.2005.07.003
[9] Arcones, MA; Yu, B., Central limit theorems for empirical and \(U\)-processes of stationary mixing sequences, J. Theoret. Probab., 7, 1, 47-71 (1994) · Zbl 0786.60028 · doi:10.1007/BF02213360
[10] Attouch, M.; Laksaci, A.; Rafaa, F., On the local linear estimate for functional regression: uniform in bandwidth consistency, Comm. Statist. Theory Methods, 48, 8, 1836-1853 (2019) · Zbl 07530852 · doi:10.1080/03610926.2018.1440308
[11] Basu AK, Kundu A (2002) Limit distribution for conditional \(U\)-statistics for dependent processes. In: Proceedings of the Fourth International Triennial Calcutta Symposium on Probability and Statistics (2000), pp 381-407. Edited by Arijit Chaudhuri, Malay Ghosh and Manisha Pal
[12] Blum, JR; Kiefer, J.; Rosenblatt, M., Distribution free tests of independence based on the sample distribution function, Ann. Math. Statist., 32, 485-498 (1961) · Zbl 0139.36301 · doi:10.1214/aoms/1177705055
[13] Borovkova, S.; Burton, R.; Dehling, H., Limit theorems for functionals of mixing processes with applications to \(U\)-statistics and dimension estimation, Trans. Amer. Math. Soc., 353, 11, 4261-4318 (2001) · Zbl 0980.60031 · doi:10.1090/S0002-9947-01-02819-7
[14] Borovskikh, YV, \(U\)-statistics in Banach spaces (1996), Utrecht: VSP, Utrecht · Zbl 0865.60004
[15] Bosq D (2000) Linear processes in function spaces, vol 149. Lecture Notes in Statistics. Springer-Verlag, New York, Theory and applications · Zbl 0962.60004
[16] Bouzebda, S. and Chaouch, M. (2022). Uniform limit theorems for a class of conditional Z-estimators when covariates are functions. Journal of Multivariate Analysis, page 104872 · Zbl 1520.62014
[17] Bouzebda, S.; Chaouch, M.; Laïb, N., Limiting law results for a class of conditional mode estimates for functional stationary ergodic data, Math Methods Statist, 25, 3, 168-195 (2016) · Zbl 1365.60014 · doi:10.3103/S1066530716030029
[18] Bouzebda, S.; Elhattab, I.; Nemouchi, B., On the uniform-in-bandwidth consistency of the general conditional \(U\)-statistics based on the copula representation, J. Nonparametr. Stat., 33, 2, 321-358 (2021) · Zbl 1472.62067 · doi:10.1080/10485252.2021.1937621
[19] Bouzebda, S., Mohammedi, M., and Laksaci, A. (2022a). The k-nearest neighbors method in single index regression model for functional quasi-associated time series data. Rev. Mat. Complut., pages 1-30
[20] Bouzebda, S.; Nemouchi, B., Central limit theorems for conditional empirical and conditional \(U\)-processes of stationary mixing sequences, Math Methods Statist, 28, 3, 169-207 (2019) · Zbl 1425.60024 · doi:10.3103/S1066530719030013
[21] Bouzebda, S.; Nemouchi, B., Uniform consistency and uniform in bandwidth consistency for nonparametric regression estimates and conditional \(U\)-statistics involving functional data, J. Nonparametr. Stat., 32, 2, 452-509 (2020) · Zbl 1476.62073 · doi:10.1080/10485252.2020.1759597
[22] Bouzebda, S.; Nezzal, A.; Stat, J., Uniform consistency and uniform in number of neighbors consistency for nonparametric regression estimates and conditional \(U\)-statistics involving functional data, Jpn, 1-85 (2022), To appear: Data, Sci, To appear
[23] Clémençcon, S.; Shawe-Taylor, J.; Zemel, R.; Bartlett, P.; Pereira, F.; Weinberger, KQ, On \(U\)-processes and clustering performance, Advances in Neural Information Processing Systems (2011), Newyork: Curran Associates Inc, Newyork
[24] de la Peña, VH, Decoupling and Khintchine’s inequalities for \(U\)-statistics, Ann Probab, 20, 4, 1877-1892 (1992) · Zbl 0761.60014
[25] de la Peña VH, Giné E (1999) Decoupling. Probability and its Applications. Springer-Verlag, New York (From dependence to independence, Randomly stopped processes. \(U\)-statistics and processes. Martingales and beyond)
[26] Deheuvels, P., One bootstrap suffices to generate sharp uniform bounds in functional estimation, Kybernetika (Prague), 47, 6, 855-865 (2011) · Zbl 1274.62234
[27] Deheuvels, P.; Mason, DM, General asymptotic confidence bands based on kernel-type function estimators, Stat. Inference Stoch. Process., 7, 3, 225-277 (2004) · Zbl 1125.62314 · doi:10.1023/B:SISP.0000049092.55534.af
[28] Denker, M.; Keller, G., On \(U\)-statistics and v Mises’ statistics for weakly dependent processes, Z. Wahrsch. Verw. Gebiete, 64, 4, 505-522 (1983) · Zbl 0519.60028 · doi:10.1007/BF00534953
[29] Devroye L, Lugosi G (2001) Combinatorial methods in density estimation. Springer-Verlag, New York (Springer Series in Statistics) · Zbl 0964.62025
[30] Dudley, RM, The sizes of compact subsets of Hilbert space and continuity of Gaussian processes, J. Functional Analysis, 1, 290-330 (1967) · Zbl 0188.20502 · doi:10.1016/0022-1236(67)90017-1
[31] Dudley, R. M. (1999). Uniform central limit theorems, volume 63 of Cambridge Studies in Advanced Mathematics. Cambridge University Press, Cambridge · Zbl 0951.60033
[32] Eberlein, E., Weak convergence of partial sums of absolutely regular sequences, Statist Probab Lett, 2, 5, 291-293 (1984) · Zbl 0564.60025 · doi:10.1016/0167-7152(84)90067-1
[33] Eggermont PPB, LaRiccia VN (2001) Maximum penalized likelihood estimation, vol I. Springer-Verlag, New York (Springer Series in Statistics.) · Zbl 0984.62026
[34] Faivishevsky, L.; Goldberger, J.; Koller, D.; Schuurmans, D.; Bengio, Y.; Bottou, L., Ica based on a smooth estimation of the differential entropy, Advances in Neural Information Processing Systems (2009), Newyork: Curran Associates Inc, Newyork
[35] Ferraty F Vieu P (2006). Nonparametric functional data analysis. Springer Series in Statistics. Springer, New York. Theory and practice · Zbl 1119.62046
[36] Ferraty, F.; Laksaci, A.; Tadj, A.; Vieu, P., Rate of uniform consistency for nonparametric estimates with functional variables, J. Statist. Plann. Inference, 140, 2, 335-352 (2010) · Zbl 1177.62044 · doi:10.1016/j.jspi.2009.07.019
[37] Frees, EW, Infinite order \(U\)-statistics, Scand. J. Statist., 16, 1, 29-45 (1989) · Zbl 0673.62032
[38] Fu, K-A, An application of \(U\)-statistics to nonparametric functional data analysis, Comm. Statist. Theory Methods, 41, 9, 1532-1542 (2012) · Zbl 1319.62088 · doi:10.1080/03610926.2010.526747
[39] Gasser T, Hall P, Presnell B (1998) Nonparametric estimation of the mode of a distribution of random curves. J. R. Stat. Soc. Ser. B Stat. Methodol., 60(4):681-691 · Zbl 0909.62030
[40] Ghosal, S.; Sen, A.; van der Vaart, AW, Testing monotonicity of regression, Ann. Statist., 28, 4, 1054-1082 (2000) · Zbl 1105.62337 · doi:10.1214/aos/1015956707
[41] Giné, E.; Mason, DM, Laws of the iterated logarithm for the local U-statistic process, J. Theoret. Probab., 20, 3, 457-485 (2007) · Zbl 1134.60022 · doi:10.1007/s10959-007-0067-0
[42] Giné, E.; Mason, DM, On local \(U\)-statistic processes and the estimation of densities of functions of several sample variables, Ann. Statist., 35, 3, 1105-1145 (2007) · Zbl 1175.60017 · doi:10.1214/009053607000000154
[43] Giné E, Zinn J (1984) Some limit theorems for empirical processes. Ann. Probab. 12(4):929-998 (With discussion) · Zbl 0553.60037
[44] Halmos, PR, The theory of unbiased estimation, Ann. Math. Statistics, 17, 34-43 (1946) · Zbl 0063.01891 · doi:10.1214/aoms/1177731020
[45] Härdle W (1990) Applied nonparametric regression, volume 19 of Econometric Society Monographs. Cambridge University Press, Cambridge · Zbl 0714.62030
[46] Harel, M.; Puri, ML, Conditional \(U\)-statistics for dependent random variables, J. Multivariate Anal., 57, 1, 84-100 (1996) · Zbl 0876.62041 · doi:10.1006/jmva.1996.0023
[47] Heilig, C.; Nolan, D., Limit theorems for the infinite-degree \(U\)-process, Statist. Sinica, 11, 1, 289-302 (2001) · Zbl 1057.62518
[48] Hoeffding, W., A class of statistics with asymptotically normal distribution, Ann. Math. Statistics, 19, 293-325 (1948) · Zbl 0032.04101 · doi:10.1214/aoms/1177730196
[49] Hoffmann-Jørgensen, J. (1984). Convergence of stochastic processes on polish spaces. Unpublished
[50] Horváth, L.; Kokoszka, P., Inference for functional data with applications (2012), Springer, New York: Springer Series in Statistics, Springer, New York · Zbl 1279.62017 · doi:10.1007/978-1-4614-3655-3
[51] Ibragimov, IA; Solev, VN, A condition for the regularity of a Gaussian stationary process, Dokl Akad Nauk SSSR, 185, 509-512 (1969) · Zbl 0188.23403
[52] Jadhav S and Ma S (2019). Kendall’s tau for functional data analysis
[53] Joly, E.; Lugosi, G., Robust estimation of \(U\)-statistics, Stochastic Process. Appl., 126, 12, 3760-3773 (2016) · Zbl 1386.60074 · doi:10.1016/j.spa.2016.04.021
[54] Kara-Zaitri, L.; Laksaci, A.; Rachdi, M.; Vieu, P., Uniform in bandwidth consistency for various kernel estimators involving functional data, J. Nonparametr. Stat., 29, 1, 85-107 (2017) · Zbl 1365.62163 · doi:10.1080/10485252.2016.1254780
[55] Kolmogorov AN, Tihomirov VM \((1959) \varepsilon \)-entropy and \(\varepsilon \)-capacity of sets in function spaces. Uspehi Mat. Nauk 14(2 (86)):3-86 · Zbl 0090.33503
[56] Koroljuk VS, Borovskich YV (1994) Theory of \(U\)-statistics, volume 273 of Mathematics and its Applications. Kluwer Academic Publishers Group, Dordrecht. Translated from the 1989 Russian original by P. V. Malyshev and D. V. Malyshev and revised by the authors · Zbl 0744.60024
[57] Kosorok, MR, Introduction to empirical processes and semiparametric inference (2008), Springer, New York: Springer Series in Statistics, Springer, New York · Zbl 1180.62137 · doi:10.1007/978-0-387-74978-5
[58] Le Cam L (1983) A remark on empirical measures. In A Festschrift for Erich L. Lehmann, Wadsworth Statist./Probab. Ser., pages 305-327. Wadsworth, Belmont, CA · Zbl 0525.60022
[59] Lee AJ \((1990) U\)-statistics, volume 110 of Statistics: Textbooks and Monographs. Marcel Dekker Inc., New York. Theory and practice · Zbl 0771.62001
[60] Lee, S.; Linton, O.; Whang, Y-J, Testing for stochastic monotonicity, Econometrica, 77, 2, 585-602 (2009) · Zbl 1161.62080 · doi:10.3982/ECTA7145
[61] Leucht, A., Degenerate \(U\)- and \(V\)-statistics under weak dependence: asymptotic theory and bootstrap consistency, Bernoulli, 18, 2, 552-585 (2012) · Zbl 1238.62059 · doi:10.3150/11-BEJ354
[62] Leucht, A.; Neumann, MH, Degenerate \(U\)- and \(V\)-statistics under ergodicity: asymptotics, bootstrap and applications in statistics, Ann Inst Statist Math, 65, 2, 349-386 (2013) · Zbl 1440.62070 · doi:10.1007/s10463-012-0374-9
[63] Ling, N.; Vieu, P., Nonparametric modelling for functional data: selected survey and tracks for future, Statistics, 52, 4, 934-949 (2018) · Zbl 1411.62084 · doi:10.1080/02331888.2018.1487120
[64] Ling, N.; Meng, S.; Vieu, P., Uniform consistency rate of \(k{\rm NN}\) regression estimation for functional time series data, J. Nonparametr. Stat., 31, 2, 451-468 (2019) · Zbl 1418.62160 · doi:10.1080/10485252.2019.1583338
[65] Liu Q, Lee J, Jordan M (2016) A kernelized stein discrepancy for goodness-of-fit tests. In: Balcan MF, Weinberger KQ (eds.) Proceedings of The 33rd International Conference on Machine Learning, volume 48 of Proceedings of Machine Learning Research, pages 276-284, New York, New York, USA. PMLR
[66] Masry, E., Nonparametric regression estimation for dependent functional data: asymptotic normality, Stochastic Process. Appl., 115, 1, 155-177 (2005) · Zbl 1101.62031 · doi:10.1016/j.spa.2004.07.006
[67] Mohammedi M, Bouzebda S, Laksaci A (2021) The consistency and asymptotic normality of the kernel type expectile regression estimator for functional data. J. Multivariate Anal., 181, Paper No. 104673, 24 · Zbl 1461.62239
[68] Nadaraya EA (1989) Nonparametric estimation of probability densities and regression curves, volume 20 of Mathematics and its Applications (Soviet Series). Kluwer Academic Publishers Group, Dordrecht · Zbl 0709.62039
[69] Nolan, D.; Pollard, D., \(U\)-processes: rates of convergence, Ann. Statist., 15, 2, 780-799 (1987) · Zbl 0624.60048 · doi:10.1214/aos/1176350374
[70] Parzen, E., On estimation of a probability density function and mode, Ann. Math. Statist., 33, 1065-1076 (1962) · Zbl 0116.11302 · doi:10.1214/aoms/1177704472
[71] Peng W, Coleman T, Mentch L (2019) Asymptotic distributions and rates of convergence for random forests via generalized u-statistics
[72] Pham, TD; Tran, LT, Some mixing properties of time series models, Stochastic Process. Appl., 19, 2, 297-303 (1985) · Zbl 0564.62068 · doi:10.1016/0304-4149(85)90031-6
[73] Prakasa Rao, BLS; Sen, A., Limit distributions of conditional \(U\)-statistics, J. Theoret. Probab., 8, 2, 261-301 (1995) · Zbl 0819.60034 · doi:10.1007/BF02212880
[74] Ramsay JO, Silverman BW (2002) Applied functional data analysis. Springer Series in Statistics. Springer-Verlag, New York. Methods and case studies · Zbl 1011.62002
[75] Ramsay JO, Silverman BW (2005) Functional data analysis, 2nd edn. Springer, New York (Springer Series in Statistics) · Zbl 1079.62006
[76] Rempala, G.; Gupta, A., Weak limits of \(U\)-statistics of infinite order, Random Oper. Stochastic Equations, 7, 1, 39-52 (1999) · Zbl 0942.60014 · doi:10.1515/rose.1999.7.1.39
[77] Rosenblatt, M., A central limit theorem and a strong mixing condition, Proc. Nat. Acad. Sci. U. S. A., 42, 43-47 (1956) · Zbl 0070.13804 · doi:10.1073/pnas.42.1.43
[78] Schick, A.; Wang, Y.; Wefelmeyer, W., Tests for normality based on density estimators of convolutions, Statist Probab Lett, 81, 2, 337-343 (2011) · Zbl 1205.62055 · doi:10.1016/j.spl.2010.10.022
[79] Sen, A., Uniform strong consistency rates for conditional \(U\)-statistics, Sankhyā Ser. A, 56, 2, 179-194 (1994) · Zbl 0847.62038
[80] Serfling RJ (1980) Approximation theorems of mathematical statistics. John Wiley & Sons Inc, New York (Wiley Series in Probability and Mathematical Statistics) · Zbl 0538.62002
[81] Sherman, RP, Maximal inequalities for degenerate \(U\)-processes with applications to optimization estimators, Ann. Statist., 22, 1, 439-459 (1994) · Zbl 0798.60021 · doi:10.1214/aos/1176325377
[82] Silverman, BW, Density estimation for statistics and data analysis (1986), London: Monographs on Statistics and Applied Probability. Chapman & Hall, London · Zbl 0617.62042
[83] Song Y, Chen X, Kato K (2019) Approximating high-dimensional infinite-order \(U\)-statistics: statistical and computational guarantees. arXiv e-prints, page arXiv:1901.01163
[84] Stute, W., Conditional empirical processes, Ann. Statist., 14, 2, 638-647 (1986) · Zbl 0594.62038 · doi:10.1214/aos/1176349943
[85] Stute, W., Conditional \(U\)-statistics, Ann Probab, 19, 2, 812-825 (1991) · Zbl 0770.60035 · doi:10.1214/aop/1176990452
[86] Stute, W., Almost sure representations of the product-limit estimator for truncated data, Ann. Statist., 21, 1, 146-156 (1993) · Zbl 0770.62027 · doi:10.1214/aos/1176349019
[87] Stute, W., \(L^p\)-convergence of conditional \(U\)-statistics, J. Multivariate Anal., 51, 1, 71-82 (1994) · Zbl 0807.62043 · doi:10.1006/jmva.1994.1050
[88] Stute, W., Universally consistent conditional \(U\)-statistics, Ann. Statist., 22, 1, 460-473 (1994) · Zbl 0818.62049 · doi:10.1214/aos/1176325378
[89] Stute, W., Symmetrized NN-conditional \(U\)-statistics, 231-237 (1996), Utrecht: Research developments in probability and statistics. VSP, Utrecht · Zbl 0872.62059
[90] van der Vaart AW, Wellner JA (1996) Weak convergence and empirical processes. Springer Series in Statistics. Springer-Verlag, New York. With applications to statistics · Zbl 0862.60002
[91] Volkonskiĭ, VA; Rozanov, YA, Some limit theorems for random functions, I. Teor. Veroyatnost. i Primenen, 4, 186-207 (1959)
[92] von Mises, R., On the asymptotic distribution of differentiable statistical functions, Ann. Math. Statistics, 18, 309-348 (1947) · Zbl 0037.08401 · doi:10.1214/aoms/1177730385
[93] Wand MP, Jones MC (1995) Kernel smoothing, volume 60 of Monographs on Statistics and Applied Probability. Chapman and Hall, Ltd., London · Zbl 0854.62043
[94] Yoshihara, K-I, Limiting behavior of \(U\)-statistics for stationary, absolutely regular processes, Z. Wahrscheinlichkeitstheorie und Verw. Gebiete, 35, 3, 237-252 (1976) · Zbl 0314.60028 · doi:10.1007/BF00532676
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.