×

Approximate penalization path for smoothly clipped absolute deviation. (English) Zbl 1318.62208

Summary: Feature selection often constitutes one of the central aspects of many scientific investigations. Among the methodologies for feature selection in penalized regression, the smoothly clipped and absolute deviation seems to be very useful because it satisfies the oracle property. However, its estimation algorithms such as the local quadratic approximation and the concave-convex procedure are not computationally efficient. In this paper, we propose an efficient penalization path algorithm. Through numerical examples on real and simulated data, we illustrate that our path algorithm can be useful for feature selection in regression problems.

MSC:

62H30 Classification and discrimination; cluster analysis (statistical aspects)
62J07 Ridge regression; shrinkage estimators (Lasso)

Software:

ElemStatLearn
Full Text: DOI

References:

[1] Tibshirani R., J. R. Statist. Soc. Ser. B 58 pp 267– (1996)
[2] DOI: 10.1198/016214501753382273 · Zbl 1073.62547 · doi:10.1198/016214501753382273
[3] DOI: 10.1198/016214506000000735 · Zbl 1171.62326 · doi:10.1198/016214506000000735
[4] DOI: 10.1198/016214508000001066 · Zbl 1286.62062 · doi:10.1198/016214508000001066
[5] DOI: 10.1162/08997660360581958 · Zbl 1022.68112 · doi:10.1162/08997660360581958
[6] DOI: 10.1023/A:1008288411710 · Zbl 0905.90131 · doi:10.1023/A:1008288411710
[7] Lange K., Optimization (2004) · Zbl 1140.90004 · doi:10.1007/978-1-4757-4182-7
[8] DOI: 10.1214/009053606000001370 · Zbl 1194.62094 · doi:10.1214/009053606000001370
[9] DOI: 10.1214/009053604000000067 · Zbl 1091.62054 · doi:10.1214/009053604000000067
[10] Zhu J., Advances in Neural Information Processing Systems 16 pp 49– (2004)
[11] Hastie T., J. Mach. Learn. Res. 5 pp 1391– (2004)
[12] DOI: 10.1162/neco.2007.19.6.1633 · Zbl 1119.68150 · doi:10.1162/neco.2007.19.6.1633
[13] DOI: 10.1111/j.1467-9868.2007.00607.x · doi:10.1111/j.1467-9868.2007.00607.x
[14] Stamey T. A., J. Urol. 16 pp 1076– (1989)
[15] Hastie T., The Element of Statistical Learning: Data Mining, Inference, and Prediction (2009) · Zbl 1273.62005
[16] DOI: 10.1126/science.286.5439.531 · doi:10.1126/science.286.5439.531
[17] Zou H., J. R. Statist. Soc. Ser. B 67 pp 301– · Zbl 1069.62054 · doi:10.1111/j.1467-9868.2005.00503.x
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.