×

Penalized LAD regression for single-index models. (English) Zbl 1345.62105

Summary: In this article, we consider the penalized LAD regression which deals with variable selection and estimation simultaneously for single-index models. The proposed estimator is robust and efficient with respect to heavy tailed errors or outliers in the response. Then, we introduce a practical algorithm where the unknown link function is estimated by local linear smoothing combined with LAD regression and the parametric index is estimated through linear LAD regression. Furthermore, we show that, under certain appropriate conditions, the penalized LAD estimator has desired large sample properties including \(\sqrt{n}\)-consistency, and oracle property. Simulation studies and a real data application are carried to illustrate the performances of the proposed method for finite-sample cases. Finally, based on the idea of sure independence screening procedure and the distance correlation (DC-SIS) proposed by R. Li et al. [J. Am. Stat. Assoc. 107, No. 499, 1129–1139 (2012; Zbl 1443.62184)], a robust two-step estimator is introduced to deal with ultra-high dimensional data.

MSC:

62J07 Ridge regression; shrinkage estimators (Lasso)

Citations:

Zbl 1443.62184
Full Text: DOI

References:

[1] DOI: 10.1016/j.csda.2011.11.022 · Zbl 1243.62029 · doi:10.1016/j.csda.2011.11.022
[2] DOI: 10.1198/016214501753382273 · Zbl 1073.62547 · doi:10.1198/016214501753382273
[3] DOI: 10.1111/j.1467-9868.2008.00674.x · doi:10.1111/j.1467-9868.2008.00674.x
[4] DOI: 10.1214/aos/1176325768 · Zbl 0829.62029 · doi:10.1214/aos/1176325768
[5] Härdle W., Journal of the American Statistical Association 84 pp 986– (1989)
[6] DOI: 10.1016/0304-4076(93)90114-K · Zbl 0816.62079 · doi:10.1016/0304-4076(93)90114-K
[7] DOI: 10.1002/1099-131X(200103)20:2<111::AID-FOR786>3.0.CO;2-N · doi:10.1002/1099-131X(200103)20:2<111::AID-FOR786>3.0.CO;2-N
[8] DOI: 10.1080/01621459.1991.10475035 · doi:10.1080/01621459.1991.10475035
[9] DOI: 10.1080/01621459.2012.695654 · Zbl 1443.62184 · doi:10.1080/01621459.2012.695654
[10] DOI: 10.1016/j.jspi.2010.10.003 · Zbl 1204.62070 · doi:10.1016/j.jspi.2010.10.003
[11] DOI: 10.1017/S0266466600004394 · doi:10.1017/S0266466600004394
[12] DOI: 10.1016/j.jspi.2010.01.043 · Zbl 1184.62172 · doi:10.1016/j.jspi.2010.01.043
[13] DOI: 10.1007/978-1-4899-3324-9 · doi:10.1007/978-1-4899-3324-9
[14] Tibshirani R., Journal of the Royal Statistical Society: Series B 58 pp 267– (1996)
[15] DOI: 10.1198/073500106000000251 · doi:10.1198/073500106000000251
[16] DOI: 10.1198/jasa.2009.0138 · Zbl 1388.62213 · doi:10.1198/jasa.2009.0138
[17] DOI: 10.1016/j.csda.2008.03.003 · Zbl 1452.62136 · doi:10.1016/j.csda.2008.03.003
[18] DOI: 10.1214/07-AOAS147 · doi:10.1214/07-AOAS147
[19] DOI: 10.1016/j.jmva.2010.02.003 · Zbl 1189.62075 · doi:10.1016/j.jmva.2010.02.003
[20] DOI: 10.1111/1467-9868.03411 · Zbl 1091.62028 · doi:10.1111/1467-9868.03411
[21] DOI: 10.1007/s10463-008-0184-2 · Zbl 1440.62280 · doi:10.1007/s10463-008-0184-2
[22] DOI: 10.1080/01621459.1998.10474104 · doi:10.1080/01621459.1998.10474104
[23] DOI: 10.1111/j.1467-9469.2004.03_035.x · Zbl 1063.62060 · doi:10.1111/j.1467-9469.2004.03_035.x
[24] DOI: 10.1198/jcgs.2011.09156 · doi:10.1198/jcgs.2011.09156
[25] DOI: 10.1198/jasa.2011.tm10563 · Zbl 1233.62195 · doi:10.1198/jasa.2011.tm10563
[26] DOI: 10.1214/009053607000000802 · Zbl 1142.62027 · doi:10.1214/009053607000000802
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.