×

Uniform post-selection inference for least absolute deviation regression and other Z-estimation problems. (English) Zbl 1345.62049

Summary: We develop uniformly valid confidence regions for regression coefficients in a high-dimensional sparse median regression model with homoscedastic errors. Our methods are based on a moment equation that is immunized against nonregular estimation of the nuisance part of the median regression function by using Neyman’s orthogonalization. We establish that the resulting instrumental median regression estimator of a target regression coefficient is asymptotically normally distributed uniformly with respect to the underlying sparse model and is semiparametrically efficient. We also generalize our method to a general nonsmooth Z-estimation framework where the number of target parameters is possibly much larger than the sample size. We extend Huber’s results on asymptotic normality to this setting, demonstrating uniform asymptotic normality of the proposed estimators over rectangles, constructing simultaneous confidence bands on all of the target parameters, and establishing asymptotic validity of the bands uniformly over underlying approximately sparse models.

MSC:

62F12 Asymptotic properties of parametric estimators
62J05 Linear regression; mixed models
62H05 Characterization and structure theory for multivariate probability distributions; copulas
62H12 Estimation in multivariate analysis