-
Functional Sieve Bootstrap for the Partial Sum Process with Application to Change-Point Detection without Dimension Reduction
Authors:
Efstathios Paparoditis,
Lea Wegner,
Martin Wendler
Abstract:
Change-points in functional time series can be detected using the CUSUM-statistic, which is a non-linear functional of the partial sum process. Various methods have been proposed to obtain critical values for this statistic. In this paper we use the functional autoregressive sieve bootstrap to imitate the behavior of the partial sum process and we show that this procedure asymptotically correct es…
▽ More
Change-points in functional time series can be detected using the CUSUM-statistic, which is a non-linear functional of the partial sum process. Various methods have been proposed to obtain critical values for this statistic. In this paper we use the functional autoregressive sieve bootstrap to imitate the behavior of the partial sum process and we show that this procedure asymptotically correct estimates critical values under the null hypothesis. We also establish the consistency of the corresponding bootstrap based test under local alternatives. The finite sample performance of the procedure is studied via simulations under the null -hypothesis and under the alternative.
△ Less
Submitted 30 August, 2024; v1 submitted 9 August, 2024;
originally announced August 2024.
-
Power of Weighted Test Statistics for Structural Change in Time Series
Authors:
Herold Dehling,
Kata Vuk,
Martin Wendler
Abstract:
We investigate the power of some common change-point tests as a function of the location of the change-point. The test statistics are maxima of weighted U-statistics, with the CUSUM test and the Wilcoxon change-point test as special examples. We study the power under local alternatives, where we vary both the location of the change-point and the magnitude of the change. We quantify in which way we…
▽ More
We investigate the power of some common change-point tests as a function of the location of the change-point. The test statistics are maxima of weighted U-statistics, with the CUSUM test and the Wilcoxon change-point test as special examples. We study the power under local alternatives, where we vary both the location of the change-point and the magnitude of the change. We quantify in which way weighted versions of the tests are more powerful when the change occurs near the beginning or the end of the time interval, while losing power against changes in the center.
△ Less
Submitted 3 April, 2023; v1 submitted 17 February, 2023;
originally announced February 2023.
-
Robust Change-Point Detection for Functional Time Series Based on $U$-Statistics and Dependent Wild Bootstrap
Authors:
Lea Wegner,
Martin Wendler
Abstract:
The aim of this paper is to develop a change-point test for functional time series that uses the full functional information and is less sensitive to outliers compared to the classical CUSUM test. For this aim, the Wilcoxon two-sample test is generalized to functional data. To obtain the asymptotic distribution of the test statistic, we proof a limit theorem for a process of $U$-statistics with va…
▽ More
The aim of this paper is to develop a change-point test for functional time series that uses the full functional information and is less sensitive to outliers compared to the classical CUSUM test. For this aim, the Wilcoxon two-sample test is generalized to functional data. To obtain the asymptotic distribution of the test statistic, we proof a limit theorem for a process of $U$-statistics with values in a Hilbert space under weak dependence. Critical values can be obtained by a newly developed version of the dependent wild bootstrap for non-degenerate 2-sample $U$-statistics.
△ Less
Submitted 4 June, 2023; v1 submitted 3 June, 2022;
originally announced June 2022.
-
Block Length Choice for the Bootstrap of Dependent Panel Data -- a Comment on Choi and Shin (2020)
Authors:
Lea Wegner,
Martin Wendler
Abstract:
Choi and Shin (2020) have constructed a bootstrap-based test for change-points in panels with temporal and and/or cross-sectional dependence. They have compared their test to several other proposed tests. We demonstrate that by an appropriate, data-adaptive choice of the block length, the change-point test by Sharipov, Tewes, Wendler (2016) can at least cope with mild temporal dependence, the size…
▽ More
Choi and Shin (2020) have constructed a bootstrap-based test for change-points in panels with temporal and and/or cross-sectional dependence. They have compared their test to several other proposed tests. We demonstrate that by an appropriate, data-adaptive choice of the block length, the change-point test by Sharipov, Tewes, Wendler (2016) can at least cope with mild temporal dependence, the size distortion of this test is not as severe as claimed by Choi and Shin (2020).
△ Less
Submitted 22 March, 2021;
originally announced March 2021.
-
Karamardian Matrices: A Generalization of $Q$-Matrices
Authors:
K. C. Sivakumar,
P. Sushmitha,
Megan Wendler
Abstract:
A real square matrix $A$ is called a $Q$-matrix if the linear complementarity problem $LCP(A,q)$ has a solution for all $q \in \mathbb{R}^n$. This means that for every vector $q$ there exists a vector $x$ such that $x \geq 0, y=Ax+q\geq 0$ and $x^Ty=0$. A well known result of Karamardian states that if the problems $LCP(A,0)$ and $LCP(A,d)$ for some $d\in \mathbb{R}^n, d >0$ have only the zero sol…
▽ More
A real square matrix $A$ is called a $Q$-matrix if the linear complementarity problem $LCP(A,q)$ has a solution for all $q \in \mathbb{R}^n$. This means that for every vector $q$ there exists a vector $x$ such that $x \geq 0, y=Ax+q\geq 0$ and $x^Ty=0$. A well known result of Karamardian states that if the problems $LCP(A,0)$ and $LCP(A,d)$ for some $d\in \mathbb{R}^n, d >0$ have only the zero solution, then $A$ is a $Q$-matrix. By relaxing the condition on $d$ and imposing a condition on the solution vector $x$ in the two problems as above, the authors introduce a new class of matrices called Karamardian matrices, requiring that these two modified problems have only zero as a solution. In this article, a systematic treatment of Karamardian matrices is undertaken. Among other things, it is shown how Karamardian matrices have properties that are analogous to those of $Q$-matrices. A subclass of a recently introduced notion of $P_{\#}$-matrices is shown to possess the Karamardian property, and for this reason we undertake a thorough study of $P_{\#}$-matrices and make some fundamental contributions.
△ Less
Submitted 15 January, 2021; v1 submitted 17 May, 2020;
originally announced May 2020.
-
Rank-based change-point analysis for long-range dependent time series
Authors:
Annika Betken,
Martin Wendler
Abstract:
We consider change-point tests based on rank statistics to test for structural changes in long-range dependent observations. Under the hypothesis of stationary time series and under the assumption of a change with decreasing change-point height, the asymptotic distributions of corresponding test statistics are derived. For this, a uniform reduction principle for the sequential empirical process in…
▽ More
We consider change-point tests based on rank statistics to test for structural changes in long-range dependent observations. Under the hypothesis of stationary time series and under the assumption of a change with decreasing change-point height, the asymptotic distributions of corresponding test statistics are derived. For this, a uniform reduction principle for the sequential empirical process in a two-parameter Skorohod space equipped with a weighted supremum norm is proved. Moreover, we compare the efficiency of rank tests resulting from the consideration of different score functions. Under Gaussianity, the asymptotic relative efficiency of rank-based tests with respect to the CuSum test is 1, irrespective of the score function. Regarding the practical implementation of rank-based change-point tests, we suggest to combine self-normalized rank statistics with subsampling. The theoretical results are accompanied by simulation studies that, in particular, allow for a comparison of rank tests resulting from different score functions. With respect to the finite sample performance of rank-based change-point tests, the Van der Waerden rank test proves to be favorable in a broad range of situations. Finally, we analyze data sets from economy, hydrology, and network traffic monitoring in view of structural changes and compare our results to previous analysis of the data.
△ Less
Submitted 30 September, 2020; v1 submitted 14 April, 2020;
originally announced April 2020.
-
Change-point detection based on weighted two-sample U-statistics
Authors:
Herold Dehling,
Kata Vuk,
Martin Wendler
Abstract:
We investigate the large-sample behavior of change-point tests based on weighted two-sample U-statistics, in the case of short-range dependent data. Under some mild mixing conditions, we establish convergence of the test statistic to an extreme value distribution. A simulation study shows that the weighted tests are superior to the non-weighted versions when the change-point occurs near the bounda…
▽ More
We investigate the large-sample behavior of change-point tests based on weighted two-sample U-statistics, in the case of short-range dependent data. Under some mild mixing conditions, we establish convergence of the test statistic to an extreme value distribution. A simulation study shows that the weighted tests are superior to the non-weighted versions when the change-point occurs near the boundary of the time interval, while they loose power in the center.
△ Less
Submitted 9 February, 2022; v1 submitted 27 March, 2020;
originally announced March 2020.
-
Convergence of U-Processes in Hölder Spaces with Application to Robust Detection of a Changed Segment
Authors:
Alfredas Račkauskas,
Martin Wendler
Abstract:
To detect a changed segment (so called epidemic changes) in a time series, variants of the CUSUM statistic are frequently used. However, they are sensitive to outliers in the data and do not perform well for heavy tailed data, especially when short segments get a high weight in the test statistic. We will present a robust test statistic for epidemic changes based on the Wilcoxon statistic. To stud…
▽ More
To detect a changed segment (so called epidemic changes) in a time series, variants of the CUSUM statistic are frequently used. However, they are sensitive to outliers in the data and do not perform well for heavy tailed data, especially when short segments get a high weight in the test statistic. We will present a robust test statistic for epidemic changes based on the Wilcoxon statistic. To study their asymptotic behavior, we prove functional limit theorems for U-processes in Hölder spaces. We also study the finite sample behavior via simulations and apply the statistic to a real data example.
△ Less
Submitted 19 December, 2019; v1 submitted 27 August, 2019;
originally announced August 2019.
-
Bootstrapping Covariance Operators of Functional Time Series
Authors:
Olimjon Sh. Sharipov,
Martin Wendler
Abstract:
For testing hypothesis on the covariance operator of functional time series, we suggest to use the full functional information and to avoid dimension reduction techniques. The limit distribution follows from the central limit theorem of the weak convergence of the partial sum process in general Hilbert space applied to the product space. In order to obtain critical values for tests, we generalize…
▽ More
For testing hypothesis on the covariance operator of functional time series, we suggest to use the full functional information and to avoid dimension reduction techniques. The limit distribution follows from the central limit theorem of the weak convergence of the partial sum process in general Hilbert space applied to the product space. In order to obtain critical values for tests, we generalize bootstrap results from the independent to the dependent case. This results can be applied to covariance operators, autocovariance operators and cross covariance operators. We discuss one sample and changepoint tests and give some simulation results.
△ Less
Submitted 28 February, 2020; v1 submitted 14 April, 2019;
originally announced April 2019.
-
Nuisance Parameters Free Changepoint Detection in Non-stationary Series
Authors:
Michal Pešta,
Martin Wendler
Abstract:
Detecting abrupt changes in the mean of a time series, so-called changepoints, is important for many applications. However, many procedures rely on the estimation of nuisance parameters (like long-run variance). Under the alternative (a change in mean), estimators might be biased and data-adaptive rules for the choice of tuning parameters might not work as expected. If the data is not stationary,…
▽ More
Detecting abrupt changes in the mean of a time series, so-called changepoints, is important for many applications. However, many procedures rely on the estimation of nuisance parameters (like long-run variance). Under the alternative (a change in mean), estimators might be biased and data-adaptive rules for the choice of tuning parameters might not work as expected. If the data is not stationary, but heteroscedastic, this becomes more challenging. The aim of this paper is to present and investigate two changepoint tests, which involve neither nuisance nor tuning parameters. This is achieved by combing self-normalization and wild bootstrap. We study the asymptotic behavior and show the consistency of the bootstrap under the hypothesis as well as under the alternative, assuming mild conditions on the weak dependence of the time series and allowing the variance to change over time. As a by-product of the proposed tests, a changepoint estimator is introduced and its consistency is proved. The results are illustrated through a simulation study, which demonstrates computational efficiency of the developed methods. The new tests will also be applied to real data examples from finance and hydrology.
△ Less
Submitted 13 August, 2018; v1 submitted 6 August, 2018;
originally announced August 2018.
-
Empirical processes for recurrent and transient random walks in random scenery
Authors:
Nadine Guillotin-Plantard,
Francoise Pene,
Martin Wendler
Abstract:
In this paper, we are interested in the asymptotic behaviour of the sequence of processes $(W_n(s,t))_{s,t\in[0,1]}$ with \begin{equation*} W_n(s,t):=\sum_{k=1}^{\lfloor nt\rfloor}\big(1_{\{ξ_{S_k}\leq s\}}-s\big) \end{equation*} where $(ξ_x, x\in\mathbb{Z}^d)$ is a sequence of independent random variables uniformly distributed on $[0,1]$ and $(S_n)_{n\in\mathbb N}$ is a random walk evolving in…
▽ More
In this paper, we are interested in the asymptotic behaviour of the sequence of processes $(W_n(s,t))_{s,t\in[0,1]}$ with \begin{equation*} W_n(s,t):=\sum_{k=1}^{\lfloor nt\rfloor}\big(1_{\{ξ_{S_k}\leq s\}}-s\big) \end{equation*} where $(ξ_x, x\in\mathbb{Z}^d)$ is a sequence of independent random variables uniformly distributed on $[0,1]$ and $(S_n)_{n\in\mathbb N}$ is a random walk evolving in $\mathbb{Z}^d$, independent of the $ξ$'s. In Wendler (2016), the case where $(S_n)_{n\in\mathbb N}$ is a recurrent random walk in $\mathbb{Z}$ such that $(n^{-\frac 1α}S_n)_{n\geq 1}$ converges in distribution to a stable distribution of index $α$, with $α\in(1,2]$, has been investigated. Here, we consider the cases where $(S_n)_{n\in\mathbb N}$ is either: a) a transient random walk in $\mathbb{Z}^d$, b) a recurrent random walk in $\mathbb{Z}^d$ such that $(n^{-\frac 1d}S_n)_{n\geq 1}$ converges in distribution to a stable distribution of index $d\in\{1,2\}$.
△ Less
Submitted 16 December, 2019; v1 submitted 28 November, 2017;
originally announced November 2017.
-
Tests for scale changes based on pairwise differences
Authors:
Carina Gerstenberger,
Daniel Vogel,
Martin Wendler
Abstract:
In many applications it is important to know whether the amount of fluctuation in a series of observations changes over time. In this article, we investigate different tests for detecting change in the scale of mean-stationary time series. The classical approach based on the CUSUM test applied to the squared centered, is very vulnerable to outliers and impractical for heavy-tailed data, which lead…
▽ More
In many applications it is important to know whether the amount of fluctuation in a series of observations changes over time. In this article, we investigate different tests for detecting change in the scale of mean-stationary time series. The classical approach based on the CUSUM test applied to the squared centered, is very vulnerable to outliers and impractical for heavy-tailed data, which leads us to contemplate test statistics based on alternative, less outlier-sensitive scale estimators.
It turns out that the tests based on Gini's mean difference (the average of all pairwise distances) or generalized Qn estimators (sample quantiles of all pairwise distances) are very suitable candidates. They improve upon the classical test not only under heavy tails or in the presence of outliers, but also under normality. An explanation for this at first counterintuitive result is that the corresponding long-run variance estimates are less affected by a scale change than in the case of the sample-variance-based test.
We use recent results on the process convergence of U-statistics and U-quantiles for dependent sequences to derive the limiting distribution of the test statistics and propose estimators for the long-run variance. We perform a simulations study to investigate the finite sample behavior of the test and their power. Furthermore, we demonstrate the applicability of the new change-point detection methods at two real-life data examples from hydrology and finance.
△ Less
Submitted 13 November, 2016;
originally announced November 2016.
-
Change-Point Detection and Bootstrap for Hilbert Space Valued Random Fields
Authors:
Béatrice Bucchia,
Martin Wendler
Abstract:
The problem of testing for the presence of epidemic changes in random fields is investigated. In order to be able to deal with general changes in the marginal distribution, a Cramér-von Mises type test is introduced which is based on Hilbert space theory. A functional central limit theorem for $ρ$-mixing Hilbert space valued random fields is proven. In order to avoid the estimation of the long-run…
▽ More
The problem of testing for the presence of epidemic changes in random fields is investigated. In order to be able to deal with general changes in the marginal distribution, a Cramér-von Mises type test is introduced which is based on Hilbert space theory. A functional central limit theorem for $ρ$-mixing Hilbert space valued random fields is proven. In order to avoid the estimation of the long-run variance and obtain critical values, Shao's dependent wild bootstrap method is adapted to this context. For this, a joint functional central limit theorem for the original and the bootstrap sample is shown. Finally, the theoretic results are supplemented by a short simulation study.
△ Less
Submitted 20 October, 2016; v1 submitted 9 November, 2015;
originally announced November 2015.
-
Subsampling for General Statistics under Long Range Dependence with application to change point analysis
Authors:
Annika Betken,
Martin Wendler
Abstract:
In the statistical inference for long range dependent time series the shape of the limit distribution typically depends on unknown parameters. Therefore, we propose to use subsampling. We show the validity of subsampling for general statistics and long range dependent subordinated Gaussian processes which satisfy mild regularity conditions. We apply our method to a self-normalized change-point tes…
▽ More
In the statistical inference for long range dependent time series the shape of the limit distribution typically depends on unknown parameters. Therefore, we propose to use subsampling. We show the validity of subsampling for general statistics and long range dependent subordinated Gaussian processes which satisfy mild regularity conditions. We apply our method to a self-normalized change-point test statistic so that we can test for structural breaks in long range dependent time series without having to estimate any nuisance parameter. The finite sample properties are investigated in a simulation study. We analyze three data sets and compare our results to the conclusions of other authors.
△ Less
Submitted 19 October, 2016; v1 submitted 18 September, 2015;
originally announced September 2015.
-
A Robust Method for Shift Detection in Time Series
Authors:
Herold Dehling,
Roland Fried,
Martin Wendler
Abstract:
We present a robust test for change-points in time series which is based on the two-sample Hodges-Lehmann estimator. We develop new limit theory for a class of statistics based on the two-sample U-quantile processes, in the case of short range dependent observations. Using this theory we can derive the asymptotic distribution of our test statistic under the null hypothesis. We study the finite sam…
▽ More
We present a robust test for change-points in time series which is based on the two-sample Hodges-Lehmann estimator. We develop new limit theory for a class of statistics based on the two-sample U-quantile processes, in the case of short range dependent observations. Using this theory we can derive the asymptotic distribution of our test statistic under the null hypothesis. We study the finite sample properties of our test via a simulation study and compare the test with the classical CUSUM test and a test based on the Wilcoxon-Mann-Whitney statistic.
△ Less
Submitted 16 May, 2019; v1 submitted 10 June, 2015;
originally announced June 2015.
-
Bootstrap for U-Statistics: A new approach
Authors:
Olimjon Sh. Sharipov,
Johannes Tewes,
Martin Wendler
Abstract:
Bootstrap for nonlinear statistics like U-statistics of dependent data has been studied by several authors. This is typically done by producing a bootstrap version of the sample and plugging it into the statistic. We suggest an alternative approach of getting a bootstrap version of U-statistics, which can be described as a compromise between bootstrap and subsampling. We will show the consistency…
▽ More
Bootstrap for nonlinear statistics like U-statistics of dependent data has been studied by several authors. This is typically done by producing a bootstrap version of the sample and plugging it into the statistic. We suggest an alternative approach of getting a bootstrap version of U-statistics, which can be described as a compromise between bootstrap and subsampling. We will show the consistency of the new method and compare its finite sample properties in a simulation study.
△ Less
Submitted 27 May, 2015;
originally announced May 2015.
-
Studentized U-quantile processes under dependence with applications to change-point analysis
Authors:
Daniel Vogel,
Martin Wendler
Abstract:
Many popular robust estimators are $U$-quantiles, most notably the Hodges-Lehmann location estimator and the $Q_n$ scale estimator. We prove a functional central limit theorem for the sequential $U$-quantile process without any moment assumptions and under weak short-range dependence conditions. We further devise an estimator for the long-run variance and show its consistency, from which the conve…
▽ More
Many popular robust estimators are $U$-quantiles, most notably the Hodges-Lehmann location estimator and the $Q_n$ scale estimator. We prove a functional central limit theorem for the sequential $U$-quantile process without any moment assumptions and under weak short-range dependence conditions. We further devise an estimator for the long-run variance and show its consistency, from which the convergence of the studentized version of the sequential $U$-quantile process to a standard Brownian motion follows. This result can be used to construct CUSUM-type change-point tests based on $U$-quantiles, which do not rely on bootstrapping procedures. We demonstrate this approach in detail at the example of the Hodges-Lehmann estimator for robustly detecting changes in the central location. A simulation study confirms the very good robustness and efficiency properties of the test. Two real-life data sets are analyzed.
△ Less
Submitted 18 March, 2016; v1 submitted 13 March, 2015;
originally announced March 2015.
-
Sequential block bootstrap in a Hilbert space with application to change point analysis
Authors:
Olimjon Sharipov,
Johannes Tewes,
Martin Wendler
Abstract:
A new test for structural changes in functional data is investigated. It is based on Hilbert space theory and critical values are deduced from bootstrap iterations. Thus a new functional central limit theorem for the block bootstrap in a Hilbert space is required. The test can also be used to detect changes in the marginal distribution of random vectors, which is supplemented by a simulation study…
▽ More
A new test for structural changes in functional data is investigated. It is based on Hilbert space theory and critical values are deduced from bootstrap iterations. Thus a new functional central limit theorem for the block bootstrap in a Hilbert space is required. The test can also be used to detect changes in the marginal distribution of random vectors, which is supplemented by a simulation study. Our methods are applied to hydrological data from Germany.
△ Less
Submitted 15 September, 2015; v1 submitted 1 December, 2014;
originally announced December 2014.
-
Multivariate Generalized Linear-statistics of short range dependent data
Authors:
Svenja Fischer,
Roland Fried,
Martin Wendler
Abstract:
Generalized linear (GL-) statistics are defined as functionals of an U-quantile process and unify different classes of statistics such as U-statistics and L-statistics. We derive a central limit theorem for GL-statistics of strongly mixing sequences and arbitrary dimension of the underlying kernel. For this purpose we establish a limit theorem for U-statistics and an invariance principle for U-pro…
▽ More
Generalized linear (GL-) statistics are defined as functionals of an U-quantile process and unify different classes of statistics such as U-statistics and L-statistics. We derive a central limit theorem for GL-statistics of strongly mixing sequences and arbitrary dimension of the underlying kernel. For this purpose we establish a limit theorem for U-statistics and an invariance principle for U-processes together with a convergence rate for the remaining term of the Bahadur representation. An application is given by the generalized median estimator for the tail-parameter of the Pareto distribution, which is commonly used to model exceedances of high thresholds. We use subsampling to calculate confidence intervals and investigate its behaviour under independence and strong mixing in simulations.
△ Less
Submitted 1 December, 2014;
originally announced December 2014.
-
The Sequential Empirical Process of a Random Walk in Random Scenery
Authors:
Martin Wendler
Abstract:
A random walk in random scenery $(Y_n)_{n\in\mathbb{N}}$ is given by $Y_n=ξ_{S_n}$ for a random walk $(S_n)_{n\in\mathbb{N}}$ and iid random variables $(ξ_n)_{n\in\mathbb{Z}}$. In this paper, we will show the weak convergence of the sequential empirical process, i.e. the centered and rescaled empirical distribution function. The limit process shows a new type of behavior, combining properties of t…
▽ More
A random walk in random scenery $(Y_n)_{n\in\mathbb{N}}$ is given by $Y_n=ξ_{S_n}$ for a random walk $(S_n)_{n\in\mathbb{N}}$ and iid random variables $(ξ_n)_{n\in\mathbb{Z}}$. In this paper, we will show the weak convergence of the sequential empirical process, i.e. the centered and rescaled empirical distribution function. The limit process shows a new type of behavior, combining properties of the limit in the independent case (roughness of the paths) and in the long range dependent case (self-similarity).
△ Less
Submitted 19 November, 2015; v1 submitted 3 October, 2014;
originally announced October 2014.
-
Two-Sample U-Statistic Processes for Long-Range Dependent Data
Authors:
Herold Dehling,
Aeneas Rooch,
Martin Wendler
Abstract:
Motivated by some common-change point tests, we investigate the asymptotic distribution of the U-statistic process $U_n(t)=\sum_{i=1}^{[nt]}\sum_{j=[nt]+1}^n h(X_i,X_j)$, $0\leq t\leq 1$, when the underlying data are long-range dependent. We present two approaches, one based on an expansion of the kernel $h(x,y)$ into Hermite polynomials, the other based on an empirical process representation of t…
▽ More
Motivated by some common-change point tests, we investigate the asymptotic distribution of the U-statistic process $U_n(t)=\sum_{i=1}^{[nt]}\sum_{j=[nt]+1}^n h(X_i,X_j)$, $0\leq t\leq 1$, when the underlying data are long-range dependent. We present two approaches, one based on an expansion of the kernel $h(x,y)$ into Hermite polynomials, the other based on an empirical process representation of the U-statistic. Together, the two approaches cover a wide range of kernels, including all kernels commonly used in applications.
△ Less
Submitted 2 April, 2014;
originally announced April 2014.
-
Convergence of U-statistics indexed by a random walk to stochastic integrals of a Levy sheet
Authors:
Brice Franke,
Francoise Pene,
Martin Wendler
Abstract:
We establish limit theorems for U-statistics indexed by a random walk on Z^d and we express the limit in terms of some Levy sheet Z(s,t). Under some hypotheses, we prove that the limit process is Z(t,t) if the random walk is transient or null-recurrent ant that it is some stochastic integral with respect to Z when the walk is positive recurrent. We compare our results with results for random walks…
▽ More
We establish limit theorems for U-statistics indexed by a random walk on Z^d and we express the limit in terms of some Levy sheet Z(s,t). Under some hypotheses, we prove that the limit process is Z(t,t) if the random walk is transient or null-recurrent ant that it is some stochastic integral with respect to Z when the walk is positive recurrent. We compare our results with results for random walks in random scenery.
△ Less
Submitted 24 August, 2014; v1 submitted 30 January, 2014;
originally announced January 2014.
-
Block Sampling under Strong Dependence
Authors:
Ting Zhang,
Hwai-Chung Ho,
Martin Wendler,
Wei Biao Wu
Abstract:
The paper considers the block sampling method for long-range dependent processes. Our theory generalizes earlier ones by Hall, Jing and Lahiri (1998) on functionals of Gaussian processes and Nordman and Lahiri (2005) on linear processes. In particular, we allow nonlinear transforms of linear processes. Under suitable conditions on physical dependence measures, we prove the validity of the block sa…
▽ More
The paper considers the block sampling method for long-range dependent processes. Our theory generalizes earlier ones by Hall, Jing and Lahiri (1998) on functionals of Gaussian processes and Nordman and Lahiri (2005) on linear processes. In particular, we allow nonlinear transforms of linear processes. Under suitable conditions on physical dependence measures, we prove the validity of the block sampling method. The problem of estimating the self-similar index is also studied.
△ Less
Submitted 19 December, 2013;
originally announced December 2013.
-
Bootstrap for dependent Hilbert space-valued random variables with application to von Mises statistics
Authors:
H. Dehling,
O. Sh. Sharipov,
M. Wendler
Abstract:
Statistical methods for functional data are of interest for many applications. In this paper, we prove a central limit theorem for random variables taking their values in a Hilbert space. The random variables are assumed to be weakly dependent in the sense of near epoch dependence, where the underlying process fulfills some mixing conditions. As parametric inference in an infinite dimensional spac…
▽ More
Statistical methods for functional data are of interest for many applications. In this paper, we prove a central limit theorem for random variables taking their values in a Hilbert space. The random variables are assumed to be weakly dependent in the sense of near epoch dependence, where the underlying process fulfills some mixing conditions. As parametric inference in an infinite dimensional space is difficult, we show that the nonoverlapping block bootstrap is consistent. Furthermore, we show how these results can be used for degenerate von Mises-statistics.
△ Less
Submitted 15 July, 2014; v1 submitted 13 December, 2013;
originally announced December 2013.
-
Change-Point Detection under Dependence Based on Two-Sample U-Statistics
Authors:
Herold Dehling,
Roland Fried,
Isabel García,
Martin Wendler
Abstract:
We study the detection of change-points in time series. The classical CUSUM statistic for detection of jumps in the mean is known to be sensitive to outliers. We thus propose a robust test based on the Wilcoxon two-sample test statistic. The asymptotic distribution of this test can be derived from a functional central limit theorem for two-sample U-statistics. We extend a theorem of Csorgo and Hor…
▽ More
We study the detection of change-points in time series. The classical CUSUM statistic for detection of jumps in the mean is known to be sensitive to outliers. We thus propose a robust test based on the Wilcoxon two-sample test statistic. The asymptotic distribution of this test can be derived from a functional central limit theorem for two-sample U-statistics. We extend a theorem of Csorgo and Horvath to the case of dependent data.
△ Less
Submitted 9 April, 2013;
originally announced April 2013.
-
Stable Limit Theorem for U-Statistic Processes Indexed by a Random Walk
Authors:
Brice Franke,
Francoise Pene,
Martin Wendler
Abstract:
Let (S_n)_{n\in\N} be a Z-valued random walk with increments from the domain of attraction of some α-stable law and let (ξ(i))_{i\in\Z} be a sequence of iid random variables. We want to investigate U-statistics indexed by the random walk S_n, that is U_n:=\sum_{1\leq i<j\leq n}h(ξ(S_i),ξ(S_j)) for some symmetric bivariate function h. We will prove the weak convergence without assumption of finite…
▽ More
Let (S_n)_{n\in\N} be a Z-valued random walk with increments from the domain of attraction of some α-stable law and let (ξ(i))_{i\in\Z} be a sequence of iid random variables. We want to investigate U-statistics indexed by the random walk S_n, that is U_n:=\sum_{1\leq i<j\leq n}h(ξ(S_i),ξ(S_j)) for some symmetric bivariate function h. We will prove the weak convergence without assumption of finite variance. Additionally, under the assumption of finite moments of order greater than two, we will establish a law of the iterated logarithm for the U-statistic U_n.
△ Less
Submitted 3 March, 2015; v1 submitted 10 December, 2012;
originally announced December 2012.
-
Normal Limits, Nonnormal Limits, and the Bootstrap for Quantiles of Dependent Data
Authors:
O. Sh. Sharipov,
M. Wendler
Abstract:
We will show under very weak conditions on differentiability and dependence that the central limit theorem for quantiles holds and that the block bootstrap is weakly consistent. Under slightly stronger conditions, the bootstrap is strongly consistent. Without the differentiability condition, quantiles might have a non-normal asymptotic distribution and the bootstrap might fail.
We will show under very weak conditions on differentiability and dependence that the central limit theorem for quantiles holds and that the block bootstrap is weakly consistent. Under slightly stronger conditions, the bootstrap is strongly consistent. Without the differentiability condition, quantiles might have a non-normal asymptotic distribution and the bootstrap might fail.
△ Less
Submitted 14 December, 2012; v1 submitted 25 April, 2012;
originally announced April 2012.
-
Testing for Changes in Kendall's Tau
Authors:
Herold Dehling,
Daniel Vogel,
Martin Wendler,
Dominik Wied
Abstract:
For a bivariate time series $((X_i,Y_i))_{i=1,...,n}$ we want to detect whether the correlation between $X_i$ and $Y_i$ stays constant for all $i = 1,...,n$. We propose a nonparametric change-point test statistic based on Kendall's tau and derive its asymptotic distribution under the null hypothesis of no change by means a new U-statistic invariance principle for dependent processes. The asymptoti…
▽ More
For a bivariate time series $((X_i,Y_i))_{i=1,...,n}$ we want to detect whether the correlation between $X_i$ and $Y_i$ stays constant for all $i = 1,...,n$. We propose a nonparametric change-point test statistic based on Kendall's tau and derive its asymptotic distribution under the null hypothesis of no change by means a new U-statistic invariance principle for dependent processes. The asymptotic distribution depends on the long run variance of Kendall's tau, for which we propose an estimator and show its consistency. Furthermore, assuming a single change-point, we show that the location of the change-point is consistently estimated. Kendall's tau possesses a high efficiency at the normal distribution, as compared to the normal maximum likelihood estimator, Pearson's moment correlation coefficient. Contrary to Pearson's correlation coefficient, it has excellent robustness properties and shows no loss in efficiency at heavy-tailed distributions. We assume the data $((X_i,Y_i))_{i=1,...,n}$ to be stationary and P-near epoch dependent on an absolutely regular process. The P-near epoch dependence condition constitutes a generalization of the usually considered $L_p$-near epoch dependence, $p \ge 1$, that does not require the existence of any moments. It is therefore very well suited for our objective to efficiently detect changes in correlation for arbitrarily heavy-tailed data.
△ Less
Submitted 6 October, 2016; v1 submitted 21 March, 2012;
originally announced March 2012.
-
Unraveling Spurious Properties of Interaction Networks with Tailored Random Networks
Authors:
Stephan Bialonski,
Martin Wendler,
Klaus Lehnertz
Abstract:
We investigate interaction networks that we derive from multivariate time series with methods frequently employed in diverse scientific fields such as biology, quantitative finance, physics, earth and climate sciences, and the neurosciences. Mimicking experimental situations, we generate time series with finite length and varying frequency content but from independent stochastic processes. Using t…
▽ More
We investigate interaction networks that we derive from multivariate time series with methods frequently employed in diverse scientific fields such as biology, quantitative finance, physics, earth and climate sciences, and the neurosciences. Mimicking experimental situations, we generate time series with finite length and varying frequency content but from independent stochastic processes. Using the correlation coefficient and the maximum cross-correlation, we estimate interdependencies between these time series. With clustering coefficient and average shortest path length, we observe unweighted interaction networks, derived via thresholding the values of interdependence, to possess non-trivial topologies as compared to Erdős-Rényi networks, which would indicate small-world characteristics. These topologies reflect the mostly unavoidable finiteness of the data, which limits the reliability of typically used estimators of signal interdependence. We propose random networks that are tailored to the way interaction networks are derived from empirical data. Through an exemplary investigation of multichannel electroencephalographic recordings of epileptic seizures - known for their complex spatial and temporal dynamics - we show that such random networks help to distinguish network properties of interdependence structures related to seizure dynamics from those spuriously induced by the applied methods of analysis.
△ Less
Submitted 9 January, 2012;
originally announced January 2012.
-
U-Processes, U-Quantile Processes and Generalized Linear Statistics of Dependent Data
Authors:
Martin Wendler
Abstract:
Generalized linear statistics are an unifying class that contains U-statistics, U-quantiles, L-statistics as well as trimmed and winsorized U-statistics. For example, many commonly used estimators of scale fall into this class. GL-statistics only have been studied under independence; in this paper, we develop an asymptotic theory for GL-statistics of sequences which are strongly mixing or L^1 near…
▽ More
Generalized linear statistics are an unifying class that contains U-statistics, U-quantiles, L-statistics as well as trimmed and winsorized U-statistics. For example, many commonly used estimators of scale fall into this class. GL-statistics only have been studied under independence; in this paper, we develop an asymptotic theory for GL-statistics of sequences which are strongly mixing or L^1 near epoch dependent on an absolutely regular process. For this purpose, we prove an almost sure approximation of the empirical U-process by a Gaussian process. With the help of a generalized Bahadur representation, it follows that such a strong invariance principle also holds for the empirical U-quantile process and consequently for GL-statistics. We obtain central limit theorems and laws of the iterated logarithm for U-processes, U-quantile processes and GL-statistics as straightforward corollaries.
△ Less
Submitted 18 August, 2011; v1 submitted 27 September, 2010;
originally announced September 2010.
-
Bahadur Representation for U-Quantiles of Dependent Data
Authors:
Martin Wendler
Abstract:
U-quantiles are applied in robust statistics, like the Hodges-Lehmann estimator of location for example. They have been analyzed in the case of independent random variables with the help of a generalized Bahadur representation. Our main aim is to extend these results to U-quantiles of strongly mixing random variables and functionals of absolutely regular sequences. We obtain the central limit theo…
▽ More
U-quantiles are applied in robust statistics, like the Hodges-Lehmann estimator of location for example. They have been analyzed in the case of independent random variables with the help of a generalized Bahadur representation. Our main aim is to extend these results to U-quantiles of strongly mixing random variables and functionals of absolutely regular sequences. We obtain the central limit theorem and the law of the iterated logarithm for U-quantiles as straightforward corollaries. Furthermore, we improve the existing result for sample quantiles of mixing data.
△ Less
Submitted 14 March, 2011; v1 submitted 15 April, 2010;
originally announced April 2010.
-
Bootstrap for the Sample Mean and for U-Statistics of Mixing and Near Epoch Dependent Processes
Authors:
Olimjon Sh. Sharipov,
Martin Wendler
Abstract:
The validity of various bootstrapping methods has been proved for the sample mean of strongly mixing data. But in many applications, there appear nonlinear statistics of processes that are not strongly mixing. We investigate the nonoverlapping block bootstrap sequences which are near epoch dependent on strong mixing or absolutely regular processes. This includes ARMA and GARCH-processes as well as…
▽ More
The validity of various bootstrapping methods has been proved for the sample mean of strongly mixing data. But in many applications, there appear nonlinear statistics of processes that are not strongly mixing. We investigate the nonoverlapping block bootstrap sequences which are near epoch dependent on strong mixing or absolutely regular processes. This includes ARMA and GARCH-processes as well as data from chaotic dynamical systems. We establish the strong consistency of the bootstrap distribution estimator not only for the sample mean, but also for U-statistics, which include examples as Gini's mean difference or the chi^2-test statistic.
△ Less
Submitted 27 July, 2011; v1 submitted 16 November, 2009;
originally announced November 2009.
-
Law of the Iterated Logarithm for U-Statistics of Weakly Dependent Observations
Authors:
Herold Dehling,
Martin Wendler
Abstract:
The law of the iterated logarithm for partial sums of weakly dependent processes was intensively studied by Walter Philipp in the late 1960s and 1970s. In this paper, we aim to extend these results to nondegenerate U-statistics of data that are strongly mixing or functionals of an absolutely regular process.
The law of the iterated logarithm for partial sums of weakly dependent processes was intensively studied by Walter Philipp in the late 1960s and 1970s. In this paper, we aim to extend these results to nondegenerate U-statistics of data that are strongly mixing or functionals of an absolutely regular process.
△ Less
Submitted 24 February, 2010; v1 submitted 6 November, 2009;
originally announced November 2009.
-
Central Limit Theorem and the Bootstrap for U-Statistics of Strongly Mixing Data
Authors:
Herold Dehling,
Martin Wendler
Abstract:
The asymptotic normality of U-statistics has so far been proved for iid data and under various mixing conditions such as absolute regularity, but not for strong mixing. We use a coupling technique introduced in 1983 by Bradley to prove a new generalized covariance inequality similar to Yoshihara's. It follows from the Hoeffding-decomposition and this inequality that U-statistics of strongly mixi…
▽ More
The asymptotic normality of U-statistics has so far been proved for iid data and under various mixing conditions such as absolute regularity, but not for strong mixing. We use a coupling technique introduced in 1983 by Bradley to prove a new generalized covariance inequality similar to Yoshihara's. It follows from the Hoeffding-decomposition and this inequality that U-statistics of strongly mixing observations converge to a normal limit if the kernel of the U-statistic fulfills some moment and continuity conditions.
The validity of the bootstrap for U-statistics has until now only been established in the case of iid data (see Bickel and Freedman). For mixing data, Politis and Romano proposed the circular block bootstrap, which leads to a consistent estimation of the sample mean's distribution. We extend these results to U-statistics of weakly dependent data and prove a CLT for the circular block bootstrap version of U-statistics under absolute regularity and strong mixing. We also calculate a rate of convergence for the bootstrap variance estimator of a U-statistic and give some simulation results.
△ Less
Submitted 4 June, 2009; v1 submitted 12 November, 2008;
originally announced November 2008.