Showing 1–50 of 65 results for author: Wu, W B

Change point analysis with irregular signals

Authors: Tobias Kley, Yuhan Philip Liu, Hongyuan Cao, Wei Biao Wu

Abstract: This paper considers the problem of testing and estimation of change point where signals after the change point can be highly irregular, which departs from the existing literature that assumes signals after the change point to be piece-wise constant or vary smoothly. A two-step approach is proposed to effectively estimate the location of the change point. The first step consists of a preliminary e… ▽ More This paper considers the problem of testing and estimation of change point where signals after the change point can be highly irregular, which departs from the existing literature that assumes signals after the change point to be piece-wise constant or vary smoothly. A two-step approach is proposed to effectively estimate the location of the change point. The first step consists of a preliminary estimation of the change point that allows us to obtain unknown parameters for the second step. In the second step we use a new procedure to determine the position of the change point. We show that, under suitable conditions, the desirable $\mathcal{O}_P(1)$ rate of convergence of the estimated change point can be obtained. We apply our method to analyze the Baidu search index of COVID-19 related symptoms and find 8~December 2019 to be the starting date of the COVID-19 pandemic. △ Less

Submitted 13 September, 2024; originally announced September 2024.

Comments: 18 pages, 6 figures

MSC Class: 62M10; 62G20

Asymptotics of Stochastic Gradient Descent with Dropout Regularization in Linear Models

Authors: Jiaqi Li, Johannes Schmidt-Hieber, Wei Biao Wu

Abstract: This paper proposes an asymptotic theory for online inference of the stochastic gradient descent (SGD) iterates with dropout regularization in linear regression. Specifically, we establish the geometric-moment contraction (GMC) for constant step-size SGD dropout iterates to show the existence of a unique stationary distribution of the dropout recursive function. By the GMC property, we provide que… ▽ More This paper proposes an asymptotic theory for online inference of the stochastic gradient descent (SGD) iterates with dropout regularization in linear regression. Specifically, we establish the geometric-moment contraction (GMC) for constant step-size SGD dropout iterates to show the existence of a unique stationary distribution of the dropout recursive function. By the GMC property, we provide quenched central limit theorems (CLT) for the difference between dropout and $\ell^2$-regularized iterates, regardless of initialization. The CLT for the difference between the Ruppert-Polyak averaged SGD (ASGD) with dropout and $\ell^2$-regularized iterates is also presented. Based on these asymptotic normality results, we further introduce an online estimator for the long-run covariance matrix of ASGD dropout to facilitate inference in a recursive manner with efficiency in computational time and memory. The numerical experiments demonstrate that for sufficiently large samples, the proposed confidence intervals for ASGD with dropout nearly achieve the nominal coverage probability. △ Less

Submitted 11 September, 2024; originally announced September 2024.

Comments: 77 pages, 5 figures, 4 tables

MSC Class: 62E20; 62F12; 68W27

Gaussian Approximation For Non-stationary Time Series with Optimal Rate and Explicit Construction

Authors: Soham Bonnerjee, Sayar Karmakar, Wei Biao Wu

Abstract: Statistical inference for time series such as curve estimation for time-varying models or testing for existence of change-point have garnered significant attention. However, these works are generally restricted to the assumption of independence and/or stationarity at its best. The main obstacle is that the existing Gaussian approximation results for non-stationary processes only provide an existen… ▽ More Statistical inference for time series such as curve estimation for time-varying models or testing for existence of change-point have garnered significant attention. However, these works are generally restricted to the assumption of independence and/or stationarity at its best. The main obstacle is that the existing Gaussian approximation results for non-stationary processes only provide an existential proof and thus they are difficult to apply. In this paper, we provide two clear paths to construct such a Gaussian approximation for non-stationary series. While the first one is theoretically more natural, the second one is practically implementable. Our Gaussian approximation results are applicable for a very large class of non-stationary time series, obtain optimal rates and yet have good applicability. Building on such approximations, we also show theoretical results for change-point detection and simultaneous inference in presence of non-stationary errors. Finally we substantiate our theoretical results with simulation studies and real data analysis. △ Less

Submitted 6 August, 2024; v1 submitted 5 August, 2024; originally announced August 2024.

High Confidence Level Inference is Almost Free using Parallel Stochastic Optimization

Authors: Wanrong Zhu, Zhipeng Lou, Ziyang Wei, Wei Biao Wu

Abstract: Uncertainty quantification for estimation through stochastic optimization solutions in an online setting has gained popularity recently. This paper introduces a novel inference method focused on constructing confidence intervals with efficient computation and fast convergence to the nominal level. Specifically, we propose to use a small number of independent multi-runs to acquire distribution info… ▽ More Uncertainty quantification for estimation through stochastic optimization solutions in an online setting has gained popularity recently. This paper introduces a novel inference method focused on constructing confidence intervals with efficient computation and fast convergence to the nominal level. Specifically, we propose to use a small number of independent multi-runs to acquire distribution information and construct a t-based confidence interval. Our method requires minimal additional computation and memory beyond the standard updating of estimates, making the inference process almost cost-free. We provide a rigorous theoretical guarantee for the confidence interval, demonstrating that the coverage is approximately exact with an explicit convergence rate and allowing for high confidence level inference. In particular, a new Gaussian approximation result is developed for the online estimators to characterize the coverage properties of our confidence intervals in terms of relative errors. Additionally, our method also allows for leveraging parallel computing to further accelerate calculations using multiple cores. It is easy to implement and can be integrated with existing stochastic algorithms without the need for complicated modifications. △ Less

Submitted 17 January, 2024; originally announced January 2024.

Weighted Averaged Stochastic Gradient Descent: Asymptotic Normality and Optimality

Authors: Ziyang Wei, Wanrong Zhu, Wei Biao Wu

Abstract: Stochastic Gradient Descent (SGD) is one of the simplest and most popular algorithms in modern statistical and machine learning due to its computational and memory efficiency. Various averaging schemes have been proposed to accelerate the convergence of SGD in different settings. In this paper, we explore a general averaging scheme for SGD. Specifically, we establish the asymptotic normality of a… ▽ More Stochastic Gradient Descent (SGD) is one of the simplest and most popular algorithms in modern statistical and machine learning due to its computational and memory efficiency. Various averaging schemes have been proposed to accelerate the convergence of SGD in different settings. In this paper, we explore a general averaging scheme for SGD. Specifically, we establish the asymptotic normality of a broad range of weighted averaged SGD solutions and provide asymptotically valid online inference approaches. Furthermore, we propose an adaptive averaging scheme that exhibits both optimal statistical rate and favorable non-asymptotic convergence, drawing insights from the optimal weight for the linear model in terms of non-asymptotic mean squared error (MSE). △ Less

Submitted 18 July, 2023; v1 submitted 13 July, 2023; originally announced July 2023.

High Dimensional Analysis of Variance in Multivariate Linear Regression

Authors: Zhipeng Lou, Xianyang Zhang, Wei Biao Wu

Abstract: In this paper, we develop a systematic theory for high dimensional analysis of variance in multivariate linear regression, where the dimension and the number of coefficients can both grow with the sample size. We propose a new \emph{U}~type test statistic to test linear hypotheses and establish a high dimensional Gaussian approximation result under fairly mild moment assumptions. Our general frame… ▽ More In this paper, we develop a systematic theory for high dimensional analysis of variance in multivariate linear regression, where the dimension and the number of coefficients can both grow with the sample size. We propose a new \emph{U}~type test statistic to test linear hypotheses and establish a high dimensional Gaussian approximation result under fairly mild moment assumptions. Our general framework and theory can be applied to deal with the classical one-way multivariate ANOVA and the nonparametric one-way MANOVA in high dimensions. To implement the test procedure in practice, we introduce a sample-splitting based estimator of the second moment of the error covariance and discuss its properties. A simulation study shows that our proposed test outperforms some existing tests in various settings. △ Less

Submitted 10 January, 2023; originally announced January 2023.

Almost sure invariance principle of $β-$mixing time series in Hilbert space

Authors: Jianya Lu, Wei Biao Wu, Zhijie Xiao, Lihu Xu

Abstract: Inspired by \citet{Berkes14} and \citet{Wu07}, we prove an almost sure invariance principle for stationary $β-$mixing stochastic processes defined on Hilbert space. Our result can be applied to Markov chain satisfying Meyn-Tweedie type Lyapunov condition and thus generalises the contraction condition in \citet[Example 2.2]{Berkes14}. We prove our main theorem by the big and small blocks technique… ▽ More Inspired by \citet{Berkes14} and \citet{Wu07}, we prove an almost sure invariance principle for stationary $β-$mixing stochastic processes defined on Hilbert space. Our result can be applied to Markov chain satisfying Meyn-Tweedie type Lyapunov condition and thus generalises the contraction condition in \citet[Example 2.2]{Berkes14}. We prove our main theorem by the big and small blocks technique and an embedding result in \citet{gotze2011estimates}. Our result is further applied to the ergodic Markov chain and functional autoregressive processes. △ Less

Submitted 20 October, 2022; v1 submitted 26 September, 2022; originally announced September 2022.

$\ell^2$ Inference for Change Points in High-Dimensional Time Series via a Two-Way MOSUM

Authors: Jiaqi Li, Likai Chen, Weining Wang, Wei Biao Wu

Abstract: We propose an inference method for detecting multiple change points in high-dimensional time series, targeting dense or spatially clustered signals. Our method aggregates moving sum (MOSUM) statistics cross-sectionally by an $\ell^2$-norm and maximizes them over time. We further introduce a novel Two-Way MOSUM, which utilizes spatial-temporal moving regions to search for breaks, with the added adv… ▽ More We propose an inference method for detecting multiple change points in high-dimensional time series, targeting dense or spatially clustered signals. Our method aggregates moving sum (MOSUM) statistics cross-sectionally by an $\ell^2$-norm and maximizes them over time. We further introduce a novel Two-Way MOSUM, which utilizes spatial-temporal moving regions to search for breaks, with the added advantage of enhancing testing power when breaks occur in only a few groups. The limiting distribution of an $\ell^2$-aggregated statistic is established for testing break existence by extending a high-dimensional Gaussian approximation theorem to spatial-temporal non-stationary processes. Simulation studies exhibit promising performance of our test in detecting non-sparse weak signals. Two applications, analyzing equity returns and COVID-19 cases in the United States, showcase the real-world relevance of our proposed algorithms. △ Less

Submitted 3 July, 2023; v1 submitted 27 August, 2022; originally announced August 2022.

Comments: 111 pages, 10 figures

Sequential Detection of Common Change in High-dimensional Data Stream

Authors: Yanhong Wu, Wei Biao Wu

Abstract: After obtaining an accurate approximation for $ARL_0$, we first consider the optimal design of weight parameter for a multivariate EWMA chart that minimizes the stationary average delay detection time (SADDT). Comparisons with moving average (MA), CUSUM, generalized likelihood ratio test (GLRT), and Shiryayev-Roberts (S-R) charts after obtaining their $ARL_0$ and SADDT's are conducted numerically.… ▽ More After obtaining an accurate approximation for $ARL_0$, we first consider the optimal design of weight parameter for a multivariate EWMA chart that minimizes the stationary average delay detection time (SADDT). Comparisons with moving average (MA), CUSUM, generalized likelihood ratio test (GLRT), and Shiryayev-Roberts (S-R) charts after obtaining their $ARL_0$ and SADDT's are conducted numerically. To detect the change with sparse signals, hard-threshold and soft-threshold EWMA charts are proposed. Comparisons with other charts including adaptive techniques show that the EWMA procedure should be recommended for its robust performance and easy design. △ Less

Submitted 23 June, 2022; originally announced June 2022.

Time-Varying Multivariate Causal Processes

Authors: Jiti Gao, Bin Peng, Wei Biao Wu, Yayi Yan

Abstract: In this paper, we consider a wide class of time-varying multivariate causal processes which nests many classic and new examples as special cases. We first prove the existence of a weakly dependent stationary approximation for our model which is the foundation to initiate the theoretical development. Afterwards, we consider the QMLE estimation approach, and provide both point-wise and simultaneous… ▽ More In this paper, we consider a wide class of time-varying multivariate causal processes which nests many classic and new examples as special cases. We first prove the existence of a weakly dependent stationary approximation for our model which is the foundation to initiate the theoretical development. Afterwards, we consider the QMLE estimation approach, and provide both point-wise and simultaneous inferences on the coefficient functions. In addition, we demonstrate the theoretical findings through both simulated and real data examples. In particular, we show the empirical relevance of our study using an application to evaluate the conditional correlations between the stock markets of China and U.S. We find that the interdependence between the two stock markets is increasing over time. △ Less

Submitted 1 June, 2022; originally announced June 2022.

Testing and estimation of clustered signals

Authors: Hongyuan Cao, Wei Biao Wu

Abstract: We propose a change-point detection method for large scale multiple testing problems with data having clustered signals. Unlike the classic change-point setup, the signals can vary in size within a cluster. The clustering structure on the signals enables us to effectively delineate the boundaries between signal and non-signal segments. New test statistics are proposed for observations from one and… ▽ More We propose a change-point detection method for large scale multiple testing problems with data having clustered signals. Unlike the classic change-point setup, the signals can vary in size within a cluster. The clustering structure on the signals enables us to effectively delineate the boundaries between signal and non-signal segments. New test statistics are proposed for observations from one and/or multiple realizations. Their asymptotic distributions are derived. We also study the associated variance estimation problem. We allow the variances to be heteroscedastic in the multiple realization case, which substantially expands the applicability of the proposed method. Simulation studies demonstrate that the proposed approach has a favorable performance. Our procedure is applied to {an array based Comparative Genomic Hybridization (aCGH)} dataset. △ Less

Submitted 29 April, 2021; originally announced April 2021.

Report number: BEJ2007-047

Journal ref: Bernoulli, 2021

Long-term prediction intervals with many covariates

Authors: Sayar Karmakar, Marek Chudy, Wei Biao Wu

Abstract: Accurate forecasting is one of the fundamental focus in the literature of econometric time-series. Often practitioners and policy makers want to predict outcomes of an entire time horizon in the future instead of just a single $k$-step ahead prediction. These series, apart from their own possible non-linear dependence, are often also influenced by many external predictors. In this paper, we constr… ▽ More Accurate forecasting is one of the fundamental focus in the literature of econometric time-series. Often practitioners and policy makers want to predict outcomes of an entire time horizon in the future instead of just a single $k$-step ahead prediction. These series, apart from their own possible non-linear dependence, are often also influenced by many external predictors. In this paper, we construct prediction intervals of time-aggregated forecasts in a high-dimensional regression setting. Our approach is based on quantiles of residuals obtained by the popular LASSO routine. We allow for general heavy-tailed, long-memory, and nonlinear stationary error process and stochastic predictors. Through a series of systematically arranged consistency results we provide theoretical guarantees of our proposed quantile-based method in all of these scenarios. After validating our approach using simulations we also propose a novel bootstrap based method that can boost the coverage of the theoretical intervals. Finally analyzing the EPEX Spot data, we construct prediction intervals for hourly electricity prices over horizons spanning 17 weeks and contrast them to selected Bayesian and bootstrap interval forecasts. △ Less

Submitted 30 September, 2021; v1 submitted 15 December, 2020; originally announced December 2020.

Simultaneous inference for time-varying models

Authors: Sayar Karmakar, Stefan Richter, Wei Biao Wu

Abstract: A general class of time-varying regression models is considered in this paper. We estimate the regression coefficients by using local linear M-estimation. For these estimators, weak Bahadur representations are obtained and are used to construct simultaneous confidence bands. For practical implementation, we propose a bootstrap based method to circumvent the slow logarithmic convergence of the theo… ▽ More A general class of time-varying regression models is considered in this paper. We estimate the regression coefficients by using local linear M-estimation. For these estimators, weak Bahadur representations are obtained and are used to construct simultaneous confidence bands. For practical implementation, we propose a bootstrap based method to circumvent the slow logarithmic convergence of the theoretical simultaneous bands. Our results substantially generalize and unify the treatments for several time-varying regression and auto-regression models. The performance for ARCH and GARCH models is studied in simulations and a few real-life applications of our study are presented through analysis of some popular financial datasets. △ Less

Submitted 7 March, 2021; v1 submitted 26 November, 2020; originally announced November 2020.

Comments: To appear at Journal of Econometrics

Sharp connections between Berry-Esseen characteristics and Edgeworth expansions for stationary processes

Authors: Moritz Jirak, Wei Biao Wu, Ou Zhao

Abstract: Given a weakly dependent stationary process, we describe the transition between a Berry-Esseen bound and a second order Edgeworth expansion in terms of the Berry-Esseen characteristic. This characteristic is sharp: We show that Edgeworth expansions are valid if and only if the Berry-Esseen characteristic is of a certain magnitude. If this is not the case, we still get an optimal Berry-Esseen bound… ▽ More Given a weakly dependent stationary process, we describe the transition between a Berry-Esseen bound and a second order Edgeworth expansion in terms of the Berry-Esseen characteristic. This characteristic is sharp: We show that Edgeworth expansions are valid if and only if the Berry-Esseen characteristic is of a certain magnitude. If this is not the case, we still get an optimal Berry-Esseen bound, thus describing the exact transition. We also obtain (fractional) expansions given $3 < p \leq 4$ moments, where a similar transition occurs. Corresponding results also hold for the Wasserstein metric $W_1$, where a related, integrated characteristic turns out to be optimal. As an application, we establish novel weak Edgeworth expansion and CLTs in $L^p$ and $W_1$. As another application, we show that a large class of high dimensional linear statistics admit Edgeworth expansions without any smoothness constraints, that is, no non-lattice condition or related is necessary. In all results, the necessary weak-dependence assumptions are very mild. In particular, we show that many prominent dynamical systems and models from time series analysis are within our framework, giving rise to many new results in these areas. △ Less

Submitted 1 December, 2022; v1 submitted 11 July, 2020; originally announced July 2020.

Comments: Fixed some typos

Development of the Soft X-ray AGM-AGS RIXS Beamline at Taiwan Photon Source

Authors: A. Singh, H. Y. Huang, Y. Y. Chu, C. Y. Hua, S. W. Lin, H. S. Fung, H. W. Shiu, J. Chang, J. H. Li, J. Okamoto, C. C. Chiu, C. H. Chang, W. B. Wu, S. Y. Perng, S. C. Chung, K. Y. Kao, S. C. Yeh, H. Y. Chao, J. H. Chen, D. J. Huang, C. T. Chen

Abstract: We report on the development of a high-resolution and highly efficient beamline for soft-X-ray resonant inelastic X-ray scattering (RIXS) located at Taiwan Photon Source. This beamline adopts an optical design that uses an active grating monochromator (AGM) and an active grating spectrometer (AGS) to implement the energy compensation principle of grating dispersion. Active gratings are utilized to… ▽ More We report on the development of a high-resolution and highly efficient beamline for soft-X-ray resonant inelastic X-ray scattering (RIXS) located at Taiwan Photon Source. This beamline adopts an optical design that uses an active grating monochromator (AGM) and an active grating spectrometer (AGS) to implement the energy compensation principle of grating dispersion. Active gratings are utilized to diminish defocus, coma and higher-order aberrations as well as to decrease the slope errors caused by thermal deformation and optical polishing. The AGS is mounted on a rotatable granite platform to enable momentum-resolved RIXS measurements with scattering angle over a wide range. Several high-precision instruments developed in house for this beamline are briefly described. The best energy resolution obtained from this AGM-AGS beamline was 12.4 meV at 530 eV, achieving a resolving power 42,000, while the bandwidth of the incident soft X-rays was kept at 0.5 eV. To demonstrate the scientific impacts of high-resolution RIXS, we present an example of momentum-resolved RIXS measurements on a high-temperature superconducting cuprate, La$_{2-x}$Sr$_x$CuO$_4$. The measurements reveal the A$_{1g}$ apical oxygen phonons in superconducting cuprates, opening a new opportunity to investigate the coupling between these phonons and charge density waves. △ Less

Submitted 24 June, 2020; v1 submitted 23 June, 2020; originally announced June 2020.

Comments: 9 pages, p figures, submitted to J. of Synchrotron Radiation. Revise expression

Explainable AI for a No-Teardown Vehicle Component Cost Estimation: A Top-Down Approach

Authors: Ayman Moawad, Ehsan Islam, Namdoo Kim, Ram Vijayagopal, Aymeric Rousseau, Wei Biao Wu

Abstract: The broader ambition of this article is to popularize an approach for the fair distribution of the quantity of a system's output to its subsystems, while allowing for underlying complex subsystem level interactions. Particularly, we present a data-driven approach to vehicle price modeling and its component price estimation by leveraging a combination of concepts from machine learning and game theo… ▽ More The broader ambition of this article is to popularize an approach for the fair distribution of the quantity of a system's output to its subsystems, while allowing for underlying complex subsystem level interactions. Particularly, we present a data-driven approach to vehicle price modeling and its component price estimation by leveraging a combination of concepts from machine learning and game theory. We show an alternative to common teardown methodologies and surveying approaches for component and vehicle price estimation at the manufacturer's suggested retail price (MSRP) level that has the advantage of bypassing the uncertainties involved in 1) the gathering of teardown data, 2) the need to perform expensive and biased surveying, and 3) the need to perform retail price equivalent (RPE) or indirect cost multiplier (ICM) adjustments to mark up direct manufacturing costs to MSRP. This novel exercise not only provides accurate pricing of the technologies at the customer level, but also shows the, a priori known, large gaps in pricing strategies between manufacturers, vehicle sizes, classes, market segments, and other factors. There is also clear synergism or interaction between the price of certain technologies and other specifications present in the same vehicle. Those (unsurprising) results are indication that old methods of manufacturer-level component costing, aggregation, and the application of a flat and rigid RPE or ICM adjustment factor should be carefully examined. The findings are based on an extensive database, developed by Argonne National Laboratory, that includes more than 64,000 vehicles covering MY1990 to MY2020 over hundreds of vehicle specs. △ Less

Submitted 15 June, 2020; originally announced June 2020.

Comments: 17 pages, 18 figures

Journal ref: IEEE Transactions on Artificial Intelligence (Volume: 2, Issue: 2, April 2021, Page(s): 185 - 199)

Long-term prediction intervals of economic time series

Authors: Marek Chudy, Sayar Karmakar, Wei Biao Wu

Abstract: We construct long-term prediction intervals for time-aggregated future values of univariate economic time series. We propose computational adjustments of the existing methods to improve coverage probability under a small sample constraint. A pseudo-out-of-sample evaluation shows that our methods perform at least as well as selected alternative methods based on model-implied Bayesian approaches and… ▽ More We construct long-term prediction intervals for time-aggregated future values of univariate economic time series. We propose computational adjustments of the existing methods to improve coverage probability under a small sample constraint. A pseudo-out-of-sample evaluation shows that our methods perform at least as well as selected alternative methods based on model-implied Bayesian approaches and bootstrapping. Our most successful method yields prediction intervals for eight macroeconomic indicators over a horizon spanning several decades. △ Less

Submitted 13 February, 2020; originally announced February 2020.

Journal ref: Empirical Economics, 58, 2020, 191-222

Online Covariance Matrix Estimation in Stochastic Gradient Descent

Authors: Wanrong Zhu, Xi Chen, Wei Biao Wu

Abstract: The stochastic gradient descent (SGD) algorithm is widely used for parameter estimation, especially for huge data sets and online learning. While this recursive algorithm is popular for computation and memory efficiency, quantifying variability and randomness of the solutions has been rarely studied. This paper aims at conducting statistical inference of SGD-based estimates in an online setting. I… ▽ More The stochastic gradient descent (SGD) algorithm is widely used for parameter estimation, especially for huge data sets and online learning. While this recursive algorithm is popular for computation and memory efficiency, quantifying variability and randomness of the solutions has been rarely studied. This paper aims at conducting statistical inference of SGD-based estimates in an online setting. In particular, we propose a fully online estimator for the covariance matrix of averaged SGD iterates (ASGD) only using the iterates from SGD. We formally establish our online estimator's consistency and show that the convergence rate is comparable to offline counterparts. Based on the classic asymptotic normality results of ASGD, we construct asymptotically valid confidence intervals for model parameters. Upon receiving new observations, we can quickly update the covariance matrix estimate and the confidence intervals. This approach fits in an online setting and takes full advantage of SGD: efficiency in computation and memory. △ Less

Submitted 22 June, 2021; v1 submitted 10 February, 2020; originally announced February 2020.

Optimal Gaussian Approximation for Multiple Time Series

Authors: Sayar Karmakar, Wei Biao Wu

Abstract: We obtain an optimal bound for a Gaussian approximation of a large class of vector-valued random processes. Our results provide a substantial generalization of earlier results that assume independence and/or stationarity. Based on the decay rate of the functional dependence measure, we quantify the error bound of the Gaussian approximation using the sample size $n$ and the moment condition. Under… ▽ More We obtain an optimal bound for a Gaussian approximation of a large class of vector-valued random processes. Our results provide a substantial generalization of earlier results that assume independence and/or stationarity. Based on the decay rate of the functional dependence measure, we quantify the error bound of the Gaussian approximation using the sample size $n$ and the moment condition. Under the assumption of $p$th finite moment, with $p>2$, this can range from a worst case rate of $n^{1/2}$ to the best case rate of $n^{1/p}$. △ Less

Submitted 27 January, 2020; originally announced January 2020.

Comments: To appear in Statistica Sinica

Estimation of dynamic networks for high-dimensional nonstationary time series

Authors: Mengyu Xu, Xiaohui Chen, Wei Biao Wu

Abstract: This paper is concerned with the estimation of time-varying networks for high-dimensional nonstationary time series. Two types of dynamic behaviors are considered: structural breaks (i.e., abrupt change points) and smooth changes. To simultaneously handle these two types of time-varying features, a two-step approach is proposed: multiple change point locations are first identified based on compari… ▽ More This paper is concerned with the estimation of time-varying networks for high-dimensional nonstationary time series. Two types of dynamic behaviors are considered: structural breaks (i.e., abrupt change points) and smooth changes. To simultaneously handle these two types of time-varying features, a two-step approach is proposed: multiple change point locations are first identified based on comparing the difference between the localized averages on sample covariance matrices, and then graph supports are recovered based on a kernelized time-varying constrained $L_1$-minimization for inverse matrix estimation (CLIME) estimator on each segment. We derive the rates of convergence for estimating the change points and precision matrices under mild moment and dependence conditions. In particular, we show that this two-step approach is consistent in estimating the change points and the piecewise smooth precision matrix function, under certain high-dimensional scaling limit. The method is applied to the analysis of network structure of the S\&P 500 index between 2003 and 2008. △ Less

Submitted 30 December, 2019; v1 submitted 14 November, 2019; originally announced November 2019.

A supreme test for periodic explosive GARCH

Authors: Stefan Richter, Weining Wang, Wei Biao Wu

Abstract: We develop a uniform test for detecting and dating explosive behavior of a strictly stationary GARCH$(r,s)$ (generalized autoregressive conditional heteroskedasticity) process. Namely, we test the null hypothesis of a globally stable GARCH process with constant parameters against an alternative where there is an 'abnormal' period with changed parameter values. During this period, the change may le… ▽ More We develop a uniform test for detecting and dating explosive behavior of a strictly stationary GARCH$(r,s)$ (generalized autoregressive conditional heteroskedasticity) process. Namely, we test the null hypothesis of a globally stable GARCH process with constant parameters against an alternative where there is an 'abnormal' period with changed parameter values. During this period, the change may lead to an explosive behavior of the volatility process. It is assumed that both the magnitude and the timing of the breaks are unknown. We develop a double supreme test for the existence of a break, and then provide an algorithm to identify the period of change. Our theoretical results hold under mild moment assumptions on the innovations of the GARCH process. Technically, the existing properties for the QMLE in the GARCH model need to be reinvestigated to hold uniformly over all possible periods of change. The key results involve a uniform weak Bahadur representation for the estimated parameters, which leads to weak convergence of the test statistic to the supreme of a Gaussian Process. In simulations we show that the test has good size and power for reasonably large time series lengths. We apply the test to Apple asset returns and Bitcoin returns. △ Less

Submitted 9 December, 2018; originally announced December 2018.

Coulomb correlations intertwined with spin and orbital excitations in LaCoO$_3$

Authors: K. Tomiyasu, J. Okamoto, H. Y. Huang, Z. Y. Chen, E. P. Sinaga, W. B. Wu, Y. Y. Chu, A. Singh, R. -P. Wang, F. M. F. de Groot, A. Chainani, S. Ishihara, C. T. Chen, D. J. Huang

Abstract: We carried out temperature-dependent (20 - 550 K) measurements of resonant inelastic X-ray scattering on LaCoO$_3$ to investigate the evolution of its electronic structure across the spin-state crossover. In combination with charge-transfer multiplet calculations, we accurately quantized the renormalized crystal-field excitation energies and spin-state populations. We show that the screening of th… ▽ More We carried out temperature-dependent (20 - 550 K) measurements of resonant inelastic X-ray scattering on LaCoO$_3$ to investigate the evolution of its electronic structure across the spin-state crossover. In combination with charge-transfer multiplet calculations, we accurately quantized the renormalized crystal-field excitation energies and spin-state populations. We show that the screening of the on-site Coulomb interaction of 3d electrons is orbital selective and coupled to the spin-state crossover in LaCoO$_3$. The results establish that the gradual spin-state crossover is associated with a relative change of Coulomb energy versus bandwidth, leading to a Mott-type insulator-to-metal transition. △ Less

Submitted 15 August, 2017; originally announced August 2017.

Comments: 6 pages, 4 figures. Submitted to Phys. Rev. Lett

Journal ref: Phys. Rev. Lett. 119, 196402 (2017)

Simultaneous Inference for High Dimensional Mean Vectors

Authors: Zhipeng Lou, Wei Biao Wu

Abstract: Let $X_1, \ldots, X_n\in\mathbb{R}^p$ be i.i.d. random vectors. We aim to perform simultaneous inference for the mean vector $\mathbb{E} (X_i)$ with finite polynomial moments and an ultra high dimension. Our approach is based on the truncated sample mean vector. A Gaussian approximation result is derived for the latter under the very mild finite polynomial ($(2+θ)$-th) moment condition and the dim… ▽ More Let $X_1, \ldots, X_n\in\mathbb{R}^p$ be i.i.d. random vectors. We aim to perform simultaneous inference for the mean vector $\mathbb{E} (X_i)$ with finite polynomial moments and an ultra high dimension. Our approach is based on the truncated sample mean vector. A Gaussian approximation result is derived for the latter under the very mild finite polynomial ($(2+θ)$-th) moment condition and the dimension $p$ can be allowed to grow exponentially with the sample size $n$. Based on this result, we propose an innovative resampling method to construct simultaneous confidence intervals for mean vectors. △ Less

Submitted 16 April, 2017; originally announced April 2017.

Towards a general theory for non-linear locally stationary processes

Authors: Rainer Dahlhaus, Stefan Richter, Wei Biao Wu

Abstract: In this paper some general theory is presented for locally stationary processes based on the stationary approximation and the stationary derivative. Laws of large numbers, central limit theorems as well as deterministic and stochastic bias expansions are proved for processes obeying an expansion in terms of the stationary approximation and derivative. In addition it is shown that this applies to s… ▽ More In this paper some general theory is presented for locally stationary processes based on the stationary approximation and the stationary derivative. Laws of large numbers, central limit theorems as well as deterministic and stochastic bias expansions are proved for processes obeying an expansion in terms of the stationary approximation and derivative. In addition it is shown that this applies to some general nonlinear non-stationary Markov-models. In addition the results are applied to derive the asymptotic properties of maximum likelihood estimates of parameter curves in such models. △ Less

Submitted 19 November, 2017; v1 submitted 10 April, 2017; originally announced April 2017.

Comments: 50 pages, 1 figure

A Hypothesis on Upper Bound of Goldbach Counting Function

Authors: Willie B Wu

Abstract: I define Goldbach counting function with N > 0 and square-free P > 0. Decomposition of this function is discovered and deduction formula is found. I propose a hypothesis on upper bound of Goldbach counting function and prove that Goldbach conjecture is true under this hypothesis. Also, I propose a second hypothesis on upper bound of Goldbach counting function and prove that the twin prime conjectu… ▽ More I define Goldbach counting function with N > 0 and square-free P > 0. Decomposition of this function is discovered and deduction formula is found. I propose a hypothesis on upper bound of Goldbach counting function and prove that Goldbach conjecture is true under this hypothesis. Also, I propose a second hypothesis on upper bound of Goldbach counting function and prove that the twin prime conjecture is true under this hypothesis △ Less

Submitted 21 July, 2016; originally announced July 2016.

Orbital engineering in nickelate heterostructures driven by anisotropic oxygen hybridization rather than orbital energy levels

Authors: G. Fabbris, D. Meyers, J. Okamoto, J. Pelliciari, A. S. Disa, Y. Huang, Z. -Y. Chen, W. B. Wu, C. T. Chen, S. Ismail-Beigi, C. H. Ahn, F. J. Walker, D. J. Huang, T. Schmitt, M. P. M. Dean

Abstract: Resonant inelastic x-ray scattering is used to investigate the electronic origin of orbital polarization in nickelate heterostructures taking $\mathrm{LaTiO_3-LaNiO_3-3x(LaAlO_3)}$, a system with exceptionally large polarization, as a model system. We find that heterostructuring generates only minor changes in the Ni $3d$ orbital energy levels, contradicting the often-invoked picture in which chan… ▽ More Resonant inelastic x-ray scattering is used to investigate the electronic origin of orbital polarization in nickelate heterostructures taking $\mathrm{LaTiO_3-LaNiO_3-3x(LaAlO_3)}$, a system with exceptionally large polarization, as a model system. We find that heterostructuring generates only minor changes in the Ni $3d$ orbital energy levels, contradicting the often-invoked picture in which changes in orbital energy levels generate orbital polarization. Instead, O $K$-edge x-ray absorption spectroscopy demonstrates that orbital polarization is caused by an anisotropic reconstruction of the oxygen ligand hole states. This provides an explanation for the limited success of theoretical predictions based on tuning orbital energy levels and implies that future theories should focus on anisotropic hybridization as the most effective means to drive large changes in electronic structure and realize novel emergent phenomena. △ Less

Submitted 8 September, 2016; v1 submitted 29 March, 2016; originally announced March 2016.

Comments: Accepted for publication in Physical Review Letters. 6 pages, 4 figures

Journal ref: Phys. Rev. Lett. 117, 147401 (2016)

Jahn-Teller distortion driven magnetic polarons in magnetite

Authors: H. Y. Huang, Z. Y. Chen, R. -P. Wang, F. M. F. de Groot, W. B. Wu, J. Okamoto, A. Chainani, J. -S. Zhou, H. -T. Jeng, G. Y. Guo, Je-Geun Park, L. H. Tjeng, C. T. Chen, D. J. Huang

Abstract: The first known magnetic mineral, magnetite (Fe$_3$O$_4$), has unusual properties which have fascinated mankind for centuries; it undergoes the Verwey transition at $T_{\rm V}$ $\sim$120 K with an abrupt change in structure and electrical conductivity. The mechanism of the Verwey transition however remains contentious. Here we use resonant inelastic X-ray scattering (RIXS) over a wide temperature… ▽ More The first known magnetic mineral, magnetite (Fe$_3$O$_4$), has unusual properties which have fascinated mankind for centuries; it undergoes the Verwey transition at $T_{\rm V}$ $\sim$120 K with an abrupt change in structure and electrical conductivity. The mechanism of the Verwey transition however remains contentious. Here we use resonant inelastic X-ray scattering (RIXS) over a wide temperature range across the Verwey transition to identify and separate out the magnetic excitations derived from nominal Fe$^{2+}$ and Fe$^{3+}$ states. Comparison of the RIXS results with crystal-field multiplet calculations shows that the spin-orbital $dd$ excitons of the Fe$^{2+}$ sites arise from a tetragonal Jahn-Teller active polaronic distortion of the Fe$^{2+}$O$_6$ octahedra. These low-energy excitations, which get weakened for temperatures above 350 K but persist at least up to 550 K, are distinct from optical excitations and best explained as magnetic polarons. △ Less

Submitted 13 August, 2016; v1 submitted 25 December, 2015; originally announced December 2015.

Journal ref: Nature Communications 8, 15929 (2017)

Raman and fluorescence characteristics of resonant inelastic X-ray scattering from doped superconducting cuprates

Authors: H. Y. Huang, C. J. Jia, Z. Y. Chen, K. Wohlfeld, B. Moritz, T. P. Devereaux, W. B. Wu, J. Okamoto, W. S. Lee, M. Hashimoto, Y. He, Z. X. Shen, Y. Yoshida, H. Eisaki, C. Y. Mou, C. T. Chen, D. J. Huang

Abstract: Measurements of spin excitations are essential for an understanding of spin-mediated pairing for superconductivity; and resonant inelastic X-ray scattering (RIXS) provides a considerable opportunity to probe high-energy spin excitations. However, whether RIXS correctly measures the collective spin excitations of doped superconducting cuprates remains under debate. Here we demonstrate distinct Rama… ▽ More Measurements of spin excitations are essential for an understanding of spin-mediated pairing for superconductivity; and resonant inelastic X-ray scattering (RIXS) provides a considerable opportunity to probe high-energy spin excitations. However, whether RIXS correctly measures the collective spin excitations of doped superconducting cuprates remains under debate. Here we demonstrate distinct Raman- and fluorescence-like RIXS excitations of Bi$_{1.5}$Pb$_{0.6}$Sr$_{1.54}$CaCu$_{2}$O$_{8+δ}$ in the mid-infrared energy region. Combining photon-energy and momentum dependent RIXS measurements with theoretical calculations using exact diagonalization provides conclusive evidence that the Raman-like RIXS excitations correspond to collective spin excitations, which are magnons in the undoped Mott insulators and evolve into paramagnons in doped superconducting compounds. In contrast, the fluorescence-like shifts are due primarily to the continuum of particle-hole excitations in the charge channel. Our results show that under the proper experimental conditions RIXS indeed can be used to probe paramagnons in doped high-$T_c$ cuprate superconductors. △ Less

Submitted 28 October, 2015; originally announced October 2015.

Journal ref: Scientific Reports 6, 19657 (2016)

Gaussian Approximation for High Dimensional Time Series

Authors: Danna Zhang, Wei Biao Wu

Abstract: We consider the problem of approximating sums of high-dimensional stationary time series by Gaussian vectors, using the framework of functional dependence measure. The validity of the Gaussian approximation depends on the sample size $n$, the dimension $p$, the moment condition and the dependence of the underlying processes. We also consider an estimator for long-run covariance matrices and study… ▽ More We consider the problem of approximating sums of high-dimensional stationary time series by Gaussian vectors, using the framework of functional dependence measure. The validity of the Gaussian approximation depends on the sample size $n$, the dimension $p$, the moment condition and the dependence of the underlying processes. We also consider an estimator for long-run covariance matrices and study its convergence properties. Our results allow constructing simultaneous confidence intervals for mean vectors of high-dimensional time series with asymptotically correct coverage probabilities. A Gaussian multiplier bootstrap method is proposed. A simulation study indicates the quality of Gaussian approximation with different $n$, $p$ under different moment and dependence conditions. △ Less

Submitted 27 August, 2015; originally announced August 2015.

Regularized estimation of linear functionals of precision matrices for high-dimensional time series

Authors: Xiaohui Chen, Mengyu Xu, Wei Biao Wu

Abstract: This paper studies a Dantzig-selector type regularized estimator for linear functionals of high-dimensional linear processes. Explicit rates of convergence of the proposed estimator are obtained and they cover the broad regime from i.i.d. samples to long-range dependent time series and from sub-Gaussian innovations to those with mild polynomial moments. It is shown that the convergence rates depen… ▽ More This paper studies a Dantzig-selector type regularized estimator for linear functionals of high-dimensional linear processes. Explicit rates of convergence of the proposed estimator are obtained and they cover the broad regime from i.i.d. samples to long-range dependent time series and from sub-Gaussian innovations to those with mild polynomial moments. It is shown that the convergence rates depend on the degree of temporal dependence and the moment conditions of the underlying linear processes. The Dantzig-selector estimator is applied to the sparse Markowitz portfolio allocation and the optimal linear prediction for time series, in which the ratio consistency when compared with an oracle estimator is established. The effect of dependence and innovation moment conditions is further illustrated in the simulation study. Finally, the regularized estimator is applied to classify the cognitive states on a real fMRI dataset and to portfolio optimization on a financial dataset. △ Less

Submitted 19 August, 2016; v1 submitted 11 June, 2015; originally announced June 2015.

Comments: 44 pages, 4 figures

MSC Class: 62H12; 62M10

Uniform Convergence of Multivariate Spectral Density Estimates

Authors: Wei Biao Wu, Paolo Zaffaroni

Abstract: We consider uniform moment convergence of lag-window spectral density estimates for univariate and multivariate stationary processes. Optimal rates of convergence are obtained under mild and easily verifiable conditions. Our theory complements earlier results which primarily concern weak or in-probability convergence. We consider uniform moment convergence of lag-window spectral density estimates for univariate and multivariate stationary processes. Optimal rates of convergence are obtained under mild and easily verifiable conditions. Our theory complements earlier results which primarily concern weak or in-probability convergence. △ Less

Submitted 14 May, 2015; originally announced May 2015.

Time-varying nonlinear regression models: Nonparametric estimation and model selection

Authors: Ting Zhang, Wei Biao Wu

Abstract: This paper considers a general class of nonparametric time series regression models where the regression function can be time-dependent. We establish an asymptotic theory for estimates of the time-varying regression functions. For this general class of models, an important issue in practice is to address the necessity of modeling the regression function as nonlinear and time-varying. To tackle thi… ▽ More This paper considers a general class of nonparametric time series regression models where the regression function can be time-dependent. We establish an asymptotic theory for estimates of the time-varying regression functions. For this general class of models, an important issue in practice is to address the necessity of modeling the regression function as nonlinear and time-varying. To tackle this, we propose an information criterion and prove its selection consistency property. The results are applied to the U.S. Treasury interest rate data. △ Less

Submitted 18 March, 2015; originally announced March 2015.

Comments: Published in at http://dx.doi.org/10.1214/14-AOS1299 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AOS-AOS1299

Journal ref: Annals of Statistics 2015, Vol. 43, 741-768

Self-normalized Cramér Type Moderate Deviations under Dependence

Authors: Xiaohong Chen, Qi-Man Shao, Wei Biao Wu

Abstract: We establish a Cramér-type moderate deviation result for self-normalized sums of weakly dependent random variables, where the moment requirement is much weaker than the non-self-normalized counterpart. The range of the moderate deviation is shown to depend on the moment condition and the degree of dependence of the underlying processes. We consider two types of self-normalization: the big-block-sm… ▽ More We establish a Cramér-type moderate deviation result for self-normalized sums of weakly dependent random variables, where the moment requirement is much weaker than the non-self-normalized counterpart. The range of the moderate deviation is shown to depend on the moment condition and the degree of dependence of the underlying processes. We consider two types of self-normalization: the big-block-small-block scheme and the interlacing or equal-block scheme. Simulation study shows that the latter can have a better finite-sample performance. Our result is applied to multiple testing and construction of simultaneous confidence intervals for high-dimensional time series mean vectors. △ Less

Submitted 11 September, 2014; originally announced September 2014.

MSC Class: 62E20; 60F10

$L^2$ Asymptotics for High-Dimensional Data

Authors: Mengyu Xu, Danna Zhang, Wei Biao Wu

Abstract: We develop an asymptotic theory for $L^2$ norms of sample mean vectors of high-dimensional data. An invariance principle for the $L^2$ norms is derived under conditions that involve a delicate interplay between the dimension $p$, the sample size $n$ and the moment condition. Under proper normalization, central and non-central limit theorems are obtained. To facilitate the related statistical infer… ▽ More We develop an asymptotic theory for $L^2$ norms of sample mean vectors of high-dimensional data. An invariance principle for the $L^2$ norms is derived under conditions that involve a delicate interplay between the dimension $p$, the sample size $n$ and the moment condition. Under proper normalization, central and non-central limit theorems are obtained. To facilitate the related statistical inference, we propose a plug-in calibration method and a re-sampling procedure to approximate the distributions of the $L^2$ norms. Our results are applied to multiple tests and inference of covariance matrix structures. △ Less

Submitted 11 March, 2015; v1 submitted 28 May, 2014; originally announced May 2014.

Comments: 37

MSC Class: 62G20; 62H15; 62G10

Komlós-Major-Tusnády approximation under dependence

Authors: István Berkes, Weidong Liu, Wei Biao Wu

Abstract: The celebrated results of Komlós, Major and Tusnády [Z. Wahrsch. Verw. Gebiete 32 (1975) 111-131; Z. Wahrsch. Verw. Gebiete 34 (1976) 33-58] give optimal Wiener approximation for the partial sums of i.i.d. random variables and provide a powerful tool in probability and statistics. In this paper we extend KMT approximation for a large class of dependent stationary processes, solving a long standing… ▽ More The celebrated results of Komlós, Major and Tusnády [Z. Wahrsch. Verw. Gebiete 32 (1975) 111-131; Z. Wahrsch. Verw. Gebiete 34 (1976) 33-58] give optimal Wiener approximation for the partial sums of i.i.d. random variables and provide a powerful tool in probability and statistics. In this paper we extend KMT approximation for a large class of dependent stationary processes, solving a long standing open problem in probability theory. Under the framework of stationary causal processes and functional dependence measures of Wu [Proc. Natl. Acad. Sci. USA 102 (2005) 14150-14154], we show that, under natural moment conditions, the partial sum processes can be approximated by Wiener process with an optimal rate. Our dependence conditions are mild and easily verifiable. The results are applied to ergodic sums, as well as to nonlinear time series and Volterra processes, an important class of nonlinear processes. △ Less

Submitted 26 February, 2014; originally announced February 2014.

Comments: Published in at http://dx.doi.org/10.1214/13-AOP850 the Annals of Probability (http://www.imstat.org/aop/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AOP-AOP850

Journal ref: Annals of Probability 2014, Vol. 42, No. 2, 794-817

Covariance and precision matrix estimation for high-dimensional time series

Authors: Xiaohui Chen, Mengyu Xu, Wei Biao Wu

Abstract: We consider estimation of covariance matrices and their inverses (a.k.a. precision matrices) for high-dimensional stationary and locally stationary time series. In the latter case the covariance matrices evolve smoothly in time, thus forming a covariance matrix function. Using the functional dependence measure of Wu [Proc. Natl. Acad. Sci. USA 102 (2005) 14150-14154 (electronic)], we obtain the ra… ▽ More We consider estimation of covariance matrices and their inverses (a.k.a. precision matrices) for high-dimensional stationary and locally stationary time series. In the latter case the covariance matrices evolve smoothly in time, thus forming a covariance matrix function. Using the functional dependence measure of Wu [Proc. Natl. Acad. Sci. USA 102 (2005) 14150-14154 (electronic)], we obtain the rate of convergence for the thresholded estimate and illustrate how the dependence affects the rate of convergence. Asymptotic properties are also obtained for the precision matrix estimate which is based on the graphical Lasso principle. Our theory substantially generalizes earlier ones by allowing dependence, by allowing nonstationarity and by relaxing the associated moment conditions. △ Less

Submitted 6 January, 2014; originally announced January 2014.

Comments: Published in at http://dx.doi.org/10.1214/13-AOS1182 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AOS-AOS1182

Journal ref: Annals of Statistics 2013, Vol. 41, No. 6, 2994-3021

Signatures of electronic phase separation in the Hall effect of anisotropically strained La0.67Ca0.33MnO3 films

Authors: Liuqi Yu, Lingfei Wang, Xiaohang Zhang, W. B. Wu, S. von Molnár, Z. Fisk, P. Xiong

Abstract: Systematic transport measurements have been performed on a series of La0.67Ca0.33MnO3 (LCMO) thin films with varying degrees of anisotropic strain. The strain is induced via epitaxial growth on NdGaO3(001) substrates and varied by controlling the thermal annealing time. An antiferromagnetic insulating (AFI) state, possibly associated with charge ordering, emerges upon thermal annealing. The Hall e… ▽ More Systematic transport measurements have been performed on a series of La0.67Ca0.33MnO3 (LCMO) thin films with varying degrees of anisotropic strain. The strain is induced via epitaxial growth on NdGaO3(001) substrates and varied by controlling the thermal annealing time. An antiferromagnetic insulating (AFI) state, possibly associated with charge ordering, emerges upon thermal annealing. The Hall effect in these materials exhibits features that are indicative of a percolative phase transition and correlate closely with the emergence of the AFI state. In the paramagnetic phase, the Hall resistivity takes on two slopes in all samples: a decreasing negative slope with increasing temperature at low fields, which is attributed to the carrier hopping motion, and an almost temperature independent positive slope at high fields due to diffusive transport of holes. Significantly, the crossover fields of the Hall resistivity slope at different temperatures correspond to the same magnetization, which is interpreted as the critical point of a magnetic field-driven percolative phase transition. At lower temperatures near the zero-field metal-insulator transition, pronounced enhancement of the Hall coefficient with the development of the AFI state is observed. The enhancement peaks near the magnetic field-driven percolation; its magnitude correlates with the strength of the AFI state and is suppressed with the melting of the AFI state by an in-plane magnetic field. The observations resemble many features of the enhancement of the Hall coefficient in granular metal films near the composition-driven percolation. △ Less

Submitted 23 December, 2013; originally announced December 2013.

Journal ref: Liuqi Yu et al 2013 New J. Phys. 15 113057

Block Sampling under Strong Dependence

Authors: Ting Zhang, Hwai-Chung Ho, Martin Wendler, Wei Biao Wu

Abstract: The paper considers the block sampling method for long-range dependent processes. Our theory generalizes earlier ones by Hall, Jing and Lahiri (1998) on functionals of Gaussian processes and Nordman and Lahiri (2005) on linear processes. In particular, we allow nonlinear transforms of linear processes. Under suitable conditions on physical dependence measures, we prove the validity of the block sa… ▽ More The paper considers the block sampling method for long-range dependent processes. Our theory generalizes earlier ones by Hall, Jing and Lahiri (1998) on functionals of Gaussian processes and Nordman and Lahiri (2005) on linear processes. In particular, we allow nonlinear transforms of linear processes. Under suitable conditions on physical dependence measures, we prove the validity of the block sampling method. The problem of estimating the self-similar index is also studied. △ Less

Submitted 19 December, 2013; originally announced December 2013.

Heteroepitaxial Growth and Multiferroic Properties of Mn-doped BiFeO3 films on SrTiO3 buffered III-V Semiconductor GaAs

Authors: G. Y. Gao, Z. B. Yang, W. Huang, H. Z. Zeng, Y. Wang, H. L. W. Chan, W. B. Wu, J. H. Hao

Abstract: Epitaxial Mn-doped BiFeO3 (MBFO) thin films were grown on GaAs (001) substrate with SrTiO3 (STO) buffer layer by pulsed laser deposition. X-ray diffraction results demonstrate that the films show pure (00l) orientation, and MBFO(100)//STO(100), whereas STO (100)//GaAs (110). Piezoresponse force microscopy images and polarization versus electric field loops indicate that the MBFO films grown on GaA… ▽ More Epitaxial Mn-doped BiFeO3 (MBFO) thin films were grown on GaAs (001) substrate with SrTiO3 (STO) buffer layer by pulsed laser deposition. X-ray diffraction results demonstrate that the films show pure (00l) orientation, and MBFO(100)//STO(100), whereas STO (100)//GaAs (110). Piezoresponse force microscopy images and polarization versus electric field loops indicate that the MBFO films grown on GaAs have an effective ferroelectric switching. The MBFO films exhibit good ferroelectric behavior (2Pr ~ 92 μC/cm2 and 2EC ~ 372 kV/cm). Ferromagnetic property with saturated magnetization of 6.5 emu/cm3 and coercive field of about 123 Oe is also found in the heterostructure at room temperature. △ Less

Submitted 17 September, 2013; originally announced September 2013.

Comments: 19 pages, 4 figures

Journal ref: J. Appl. Phys. 114, 094106 (2013)

Inference of time-varying regression models

Authors: Ting Zhang, Wei Biao Wu

Abstract: We consider parameter estimation, hypothesis testing and variable selection for partially time-varying coefficient models. Our asymptotic theory has the useful feature that it can allow dependent, nonstationary error and covariate processes. With a two-stage method, the parametric component can be estimated with a $n^{1/2}$-convergence rate. A simulation-assisted hypothesis testing procedure is pr… ▽ More We consider parameter estimation, hypothesis testing and variable selection for partially time-varying coefficient models. Our asymptotic theory has the useful feature that it can allow dependent, nonstationary error and covariate processes. With a two-stage method, the parametric component can be estimated with a $n^{1/2}$-convergence rate. A simulation-assisted hypothesis testing procedure is proposed for testing significance and parameter constancy. We further propose an information criterion that can consistently select the true set of significant predictors. Our method is applied to autoregressive models with time-varying coefficients. Simulation results and a real data application are provided. △ Less

Submitted 17 August, 2012; originally announced August 2012.

Comments: Published in at http://dx.doi.org/10.1214/12-AOS1010 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AOS-AOS1010

Journal ref: Annals of Statistics 2012, Vol. 40, No. 3, 1376-1402

Exact Moderate and Large Deviations for Linear Processes

Authors: Magda Peligrad, Hailin Sang, Yunda Zhong, Wei Biao Wu

Abstract: Large and moderate deviation probabilities play an important role in many applied areas, such as insurance and risk analysis. This paper studies the exact moderate and large deviation asymptotics in non-logarithmic form for linear processes with independent innovations. The linear processes we analyze are general and therefore they include the long memory case. We give an asymptotic representation… ▽ More Large and moderate deviation probabilities play an important role in many applied areas, such as insurance and risk analysis. This paper studies the exact moderate and large deviation asymptotics in non-logarithmic form for linear processes with independent innovations. The linear processes we analyze are general and therefore they include the long memory case. We give an asymptotic representation for probability of the tail of the normalized sums and specify the zones in which it can be approximated either by a standard normal distribution or by the marginal distribution of the innovation process. The results are then applied to regression estimates, moving averages, fractionally integrated processes, linear processes with regularly varying exponents and functions of linear processes. We also consider the computation of value at risk and expected shortfall, fundamental quantities in risk theory and finance. △ Less

Submitted 5 May, 2013; v1 submitted 2 November, 2011; originally announced November 2011.

Comments: to appear in Statistica Sinica, 28 pages, 1 figure

MSC Class: 60F10; 62E20

A central limit theorem for stationary random fields

Authors: Mohamed El Machkouri, Dalibor Volny, Wei Biao Wu

Abstract: This paper establishes a central limit theorem and an invariance principle for a wide class of stationary random fields under natural and easily verifiable conditions. More precisely, we deal with random fields of the form $X_k = g(\varepsilon_{k-s}, s \in \Z^d)$, $k\in\Z^d$, where $(\varepsilon_i)_{i\in\Z^d}$ are i.i.d random variables and $g$ is a measurable function. Such kind of spatial proces… ▽ More This paper establishes a central limit theorem and an invariance principle for a wide class of stationary random fields under natural and easily verifiable conditions. More precisely, we deal with random fields of the form $X_k = g(\varepsilon_{k-s}, s \in \Z^d)$, $k\in\Z^d$, where $(\varepsilon_i)_{i\in\Z^d}$ are i.i.d random variables and $g$ is a measurable function. Such kind of spatial processes provides a general framework for stationary ergodic random fields. Under a short-range dependence condition, we show that the central limit theorem holds without any assumption on the underlying domain on which the process is observed. A limit theorem for the sample auto-covariance function is also established. △ Less

Submitted 11 July, 2012; v1 submitted 5 September, 2011; originally announced September 2011.

Comments: 22 pages

Simultaneous Inference of Covariances

Authors: Han Xiao, Wei Biao Wu

Abstract: We consider asymptotic distributions of maximum deviations of sample covariance matrices, a fundamental problem in high-dimensional inference of covariances. Under mild dependence conditions on the entries of the data matrices, we establish the Gumbel convergence of the maximum deviations. Our result substantially generalizes earlier ones where the entries are assumed to be independent and identic… ▽ More We consider asymptotic distributions of maximum deviations of sample covariance matrices, a fundamental problem in high-dimensional inference of covariances. Under mild dependence conditions on the entries of the data matrices, we establish the Gumbel convergence of the maximum deviations. Our result substantially generalizes earlier ones where the entries are assumed to be independent and identically distributed, and it provides a theoretical foundation for high-dimensional simultaneous inference of covariances. △ Less

Submitted 2 September, 2011; originally announced September 2011.

Comments: 21 pages, one supplementary file

MSC Class: Primary 62H15; 62H10; secondary 62E20

Covariance matrix estimation for stationary time series

Authors: Han Xiao, Wei Biao Wu

Abstract: We obtain a sharp convergence rate for banded covariance matrix estimates of stationary processes. A precise order of magnitude is derived for spectral radius of sample covariance matrices. We also consider a thresholded covariance matrix estimator that can better characterize sparsity if the true covariance matrix is sparse. As our main tool, we implement Toeplitz [Math. Ann. 70 (1911) 351-376] i… ▽ More We obtain a sharp convergence rate for banded covariance matrix estimates of stationary processes. A precise order of magnitude is derived for spectral radius of sample covariance matrices. We also consider a thresholded covariance matrix estimator that can better characterize sparsity if the true covariance matrix is sparse. As our main tool, we implement Toeplitz [Math. Ann. 70 (1911) 351-376] idea and relate eigenvalues of covariance matrices to the spectral densities or Fourier transforms of the covariances. We develop a large deviation result for quadratic forms of stationary processes using m-dependence approximation, under the framework of causal representation and physical dependence measures. △ Less

Submitted 30 May, 2012; v1 submitted 23 May, 2011; originally announced May 2011.

Comments: Published in at http://dx.doi.org/10.1214/11-AOS967 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AOS-AOS967

Journal ref: Annals of Statistics 2012, Vol. 40, No. 1, 466-493

Asymptotic Inference of Autocovariances of Stationary Processes

Authors: Han Xiao, Wei Biao Wu

Abstract: The paper presents a systematic theory for asymptotic inference of autocovariances of stationary processes. We consider nonparametric tests for serial correlations based on the maximum (or ${\cal L}^\infty$) and the quadratic (or ${\cal L}^2$) deviations. For these two cases, with proper centering and rescaling, the asymptotic distributions of the deviations are Gumbel and Gaussian, respectively.… ▽ More The paper presents a systematic theory for asymptotic inference of autocovariances of stationary processes. We consider nonparametric tests for serial correlations based on the maximum (or ${\cal L}^\infty$) and the quadratic (or ${\cal L}^2$) deviations. For these two cases, with proper centering and rescaling, the asymptotic distributions of the deviations are Gumbel and Gaussian, respectively. To establish such an asymptotic theory, as byproducts, we develop a normal comparison principle and propose a sufficient condition for summability of joint cumulants of stationary processes. We adopt a simulation-based block of blocks bootstrapping procedure that improves the finite-sample performance. △ Less

Submitted 17 May, 2011; originally announced May 2011.

Comments: 46 pages, 1 figure

MSC Class: Primary 60F05; 62M10; secondary 62E20

Simultaneous nonparametric inference of time series

Authors: Weidong Liu, Wei Biao Wu

Abstract: We consider kernel estimation of marginal densities and regression functions of stationary processes. It is shown that for a wide class of time series, with proper centering and scaling, the maximum deviations of kernel density and regression estimates are asymptotically Gumbel. Our results substantially generalize earlier ones which were obtained under independence or beta mixing assumptions. The… ▽ More We consider kernel estimation of marginal densities and regression functions of stationary processes. It is shown that for a wide class of time series, with proper centering and scaling, the maximum deviations of kernel density and regression estimates are asymptotically Gumbel. Our results substantially generalize earlier ones which were obtained under independence or beta mixing assumptions. The asymptotic results can be applied to assess patterns of marginal densities or regression functions via the construction of simultaneous confidence bands for which one can perform goodness-of-fit tests. As an application, we construct simultaneous confidence bands for drift and volatility functions in a dynamic short-term rate model for the U.S. Treasury yield curve rates data. △ Less

Submitted 20 October, 2010; originally announced October 2010.

Comments: Published in at http://dx.doi.org/10.1214/09-AOS789 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AOS-AOS789

Journal ref: Annals of Statistics 2010, Vol. 38, No. 4, 2388-2421

Testing for Parallelism Between Trends in Multiple Time Series

Authors: David Degras, Zhiwei Xu, Ting Zhang, Wei Biao Wu

Abstract: This paper considers the inference of trends in multiple, nonstationary time series. To test whether trends are parallel to each other, we use a parallelism index based on the L2-distances between nonparametric trend estimators and their average. A central limit theorem is obtained for the test statistic and the test's consistency is established. We propose a simulation-based approximation to the… ▽ More This paper considers the inference of trends in multiple, nonstationary time series. To test whether trends are parallel to each other, we use a parallelism index based on the L2-distances between nonparametric trend estimators and their average. A central limit theorem is obtained for the test statistic and the test's consistency is established. We propose a simulation-based approximation to the distribution of the test statistic, which significantly improves upon the normal approximation. The test is also applied to devise a clustering algorithm. Finally, the finite-sample properties of the test are assessed through simulations and the test methodology is illustrated with time series from Motorola cell phone activity in the United States. △ Less

Submitted 24 May, 2011; v1 submitted 10 October, 2010; originally announced October 2010.

Comments: Submitted to IEEE Transactions on Signal Processing

Central limit theorem for Fourier transforms of stationary processes

Authors: Magda Peligrad, Wei Biao Wu

Abstract: We consider asymptotic behavior of Fourier transforms of stationary ergodic sequences with finite second moments. We establish a central limit theorem (CLT) for almost all frequencies and also an annealed CLT. The theorems hold for all regular sequences. Our results shed new light on the foundation of spectral analysis and on the asymptotic distribution of periodogram, and it provides a nice blend… ▽ More We consider asymptotic behavior of Fourier transforms of stationary ergodic sequences with finite second moments. We establish a central limit theorem (CLT) for almost all frequencies and also an annealed CLT. The theorems hold for all regular sequences. Our results shed new light on the foundation of spectral analysis and on the asymptotic distribution of periodogram, and it provides a nice blend of harmonic analysis, theory of stationary processes and theory of martingales. △ Less

Submitted 5 November, 2010; v1 submitted 19 October, 2009; originally announced October 2009.

Comments: Published in at http://dx.doi.org/10.1214/10-AOP530 the Annals of Probability (http://www.imstat.org/aop/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AOP-AOP530

Journal ref: Annals of Probability 2010, Vol. 38, No. 5, 2009-2022

Recursive estimation of time-average variance constants

Authors: Wei Biao Wu

Abstract: For statistical inference of means of stationary processes, one needs to estimate their time-average variance constants (TAVC) or long-run variances. For a stationary process, its TAVC is the sum of all its covariances and it is a multiple of the spectral density at zero. The classical TAVC estimate which is based on batched means does not allow recursive updates and the required memory complexi… ▽ More For statistical inference of means of stationary processes, one needs to estimate their time-average variance constants (TAVC) or long-run variances. For a stationary process, its TAVC is the sum of all its covariances and it is a multiple of the spectral density at zero. The classical TAVC estimate which is based on batched means does not allow recursive updates and the required memory complexity is O(n). We propose a faster algorithm which recursively computes the TAVC, thus having memory complexity of order O(1) and the computational complexity scales linearly in $n$. Under short-range dependence conditions, we establish moment and almost sure convergence of the recursive TAVC estimate. Convergence rates are also obtained. △ Less

Submitted 31 August, 2009; originally announced August 2009.

Comments: Published in at http://dx.doi.org/10.1214/08-AAP587 the Annals of Applied Probability (http://www.imstat.org/aap/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AAP-AAP587 MSC Class: 60F05 (Primary); 60F17 (Secondary)

Journal ref: Annals of Applied Probability 2009, Vol. 19, No. 4, 1529-1552

Local linear quantile estimation for nonstationary time series

Authors: Zhou Zhou, Wei Biao Wu

Abstract: We consider estimation of quantile curves for a general class of nonstationary processes. Consistency and central limit results are obtained for local linear quantile estimates under a mild short-range dependence condition. Our results are applied to environmental data sets. In particular, our results can be used to address the problem of whether climate variability has changed, an important pro… ▽ More We consider estimation of quantile curves for a general class of nonstationary processes. Consistency and central limit results are obtained for local linear quantile estimates under a mild short-range dependence condition. Our results are applied to environmental data sets. In particular, our results can be used to address the problem of whether climate variability has changed, an important problem raised by IPCC (Intergovernmental Panel on Climate Change) in 2001. △ Less

Submitted 25 August, 2009; originally announced August 2009.

Comments: Published in at http://dx.doi.org/10.1214/08-AOS636 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AOS-AOS636 MSC Class: 62G05 (Primary); 60F05 (Secondary)

Journal ref: Annals of Statistics 2009, Vol. 37, No. 5B, 2696-2729