×

Ridge regression and the Lasso: how do they do as finders of significant regressors and their multipliers? (English) Zbl 07603841

MSC:

62-XX Statistics
Full Text: DOI

References:

[1] Austin, P. C.; Steyerberg, E. W., The number of subjects per variable required in linear regression analyses, Journal of Clinical Epidemiology, 68, 6, 627-36 (2015) · doi:10.1016/j.jclinepi.2014.12.014
[2] Bendel, R. B.; Afifi, A. A., Comparison of stopping rules in forward stepwise regression, Journal of the American Statistical Association, 72, 357, 46-53 (1977) · Zbl 0346.62050 · doi:10.2307/2286904
[3] Breiman, L., Statistical modeling, Statistical Science, 16, 3, 199-231 (2001) · Zbl 1059.62505 · doi:10.1214/ss/1009213726
[4] Breiman, L., Random forests, Machine Learning, 45, 1, 5-32 (2001) · Zbl 1007.68152 · doi:10.1023/A:1010933404324
[5] Brook, R. J.; Moore, T., On the expected length of the least squares coefficient vector, Journal of Econometrics, 12, 2, 245-46 (1980) · doi:10.1016/0304-4076(80)90010-X
[6] Efron, B.; Tibshirani, R., An introduction to the bootstrap (1993), Boca Raton, FL: Chapman and Hall, Boca Raton, FL · Zbl 0835.62038
[7] Efron, B.; Hastie, T.; Johnstone, I.; Tibshirani, R., Least angle regression, The Annals of Statistics, 32, 2, 407-99 (2004) · Zbl 1091.62054 · doi:10.1214/009053604000000067
[8] Efroymson, M. A., Mathematical methods for digital computers, Multiple regression analysis (1960), New York: Wiley, New York · Zbl 0089.12602
[9] Frank, I. E.; Friedman, J. H., A statistical view of some chemometrics regression tools, Technometrics, 35, 2, 109-35 (1993) · Zbl 0775.62288 · doi:10.1080/00401706.1993.10485033
[10] Gana, R., Ridge regression estimation of the linear probability model, Journal of Applied Statistics, 22, 4, 537-39 (1995) · doi:10.1080/757584790
[11] Gana, R. (2018) · doi:10.2139/ssrn.3247320
[12] Gana, R.; Vasudevan, S., Ridge regression estimated linear probability model predictions of O-glycosylation in proteins with structural and sequence data, BMC Molecular and Cell Biology, 20, 1, 21 (2019) · doi:10.1186/s12860-019-0200-9
[13] Goldberger, A. S., Econometric theory (1964), New York: Wiley, New York · Zbl 0124.12102
[14] Golub, G. H.; Heath, M.; Wahba, G., Generalized cross-validation as a method for choosing a good ridge parameter, Technometrics, 21, 2, 215-23 (1979) · Zbl 0461.62059 · doi:10.1080/00401706.1979.10489751
[15] Greenberg, E.; Parks, R. P., A predictive approach to model selection and multicollinearity, Journal of Applied Econometrics, 12, 1, 67-75 (1997) · doi:10.1002/(SICI)1099-1255(199701)12:1<67::AID-JAE427>3.0.CO;2-W
[16] Gruber, M. H. J., Regression estimators - A comparative study (2014), Boston, MA: Academic Press, Boston, MA
[17] Gruber, M. H. J., Improving efficiency by shrinkage - The James-Stein and Ridge Regression estimators (2017), New York: Marcel Dekker Inc, New York
[18] Hocking, R. R., The analysis and selection of variables in linear regression, Biometrics, 32, 1, 1-49 (1976) · Zbl 0328.62042 · doi:10.2307/2529336
[19] Hoerl, A. E.; Kannard, R. W.; Baldwin, K. F., Ridge regression: some simulations, Communications in Statistics - Simulation and Computation, 4, 2, 105-23 (1975) · Zbl 0296.62062 · doi:10.1080/03610917508548342
[20] Hoerl, A. E.; Kennard, R. W., Ridge regression: biased estimation of nonorthogonal problems, Technometrics, 12, 1, 55-67 (1970) · Zbl 0202.17205 · doi:10.1080/00401706.1970.10488634
[21] Hoerl, A. E.; Kennard, R. W., Ridge regression iterative estimation of the biasing parameter, Communications in Statistics - Theory and Methods, 5, 1, 77-88 (1976) · Zbl 0326.62047 · doi:10.1080/03610927608827333
[22] Hoerl, R. W.; Schuenemeyer, J. H.; Hoerl, A. E., A simulation of biased estimation and subset selection regression techniques, Technometrics, 28, 4, 369-80 (1986) · Zbl 0649.62064 · doi:10.2307/1268986
[23] Keynes, J. M.1938. The Collected Writings of John Maynard Keynes, volume 14, pp. 299-300.
[24] Lawless, J. F.; Wang, P., A simulation study of ridge and other regression estimators, Communications in Statistics - Theory and Methods, 5, 4, 307-23 (1976) · Zbl 0336.62056 · doi:10.1080/03610927608827353
[25] Mallows, C. L., Some comments on Cp, Technometrics, 15, 4, 661-75 (1973) · Zbl 0269.62061 · doi:10.1080/00401706.1973.10489103
[26] Matsumoto, M.; Nishimura, T., Mersenne twister: a 623-dimensionally equidistributed uniform pseudo-random number generator, ACM Transactions on Modeling and Computer Simulation, 8, 1, 3-30 (1998) · Zbl 0917.65005 · doi:10.1145/272991.272995
[27] Monyak, J. T.1998. Mean squared error properties of the ridge regression estimated linear probability model, unpublished PhD dissertation, University of Delaware.
[28] Myers, R. H., Classical and modern regression with applications, Technometrics, 29, 377-378 (1990)
[29] Obenchain, R. L., Classical F-tests and confidence regions for ridge regression, Technometrics, 19, 4, 429-39 (1977) · Zbl 0375.62066 · doi:10.1080/00401706.1977.10489582
[30] Osborne, M.; Presnell, B.; Turlach, B., A new approach to variable selection in least squares problems, IMA Journal of Numerical Analysis, 20, 3, 389-404 (2000) · Zbl 0962.65036 · doi:10.1093/imanum/20.3.389
[31] Piegorsch, W. W.; Casella, G., The early use of matrix diagonal increments in statistical problems, SIAM Review, 31, 3, 428-34 (1989) · Zbl 0686.65013 · doi:10.1137/1031089
[32] Taylor, H. L.; Banks, S. C.; McCoy, J. F., Deconvolution with the Ɩ1 norm, Geophysics, 44, 1, 39-52 (1979) · doi:10.1190/1.1440921
[33] Santosa, F.; Symes, W. W., Linear inversion of band-limited reflection seismograms, SIAM Journal on Scientific and Statistical Computing, 7, 4, 1307-30 (1986) · Zbl 0602.73113 · doi:10.1137/0907087
[34] Tibshirani, R., Regression shrinkage and selection via the lasso, Journal of the Royal Statistical Society Series B (Methodological), 58, 1, 267-88 (1996) · Zbl 0850.62538 · doi:10.1111/j.2517-6161.1996.tb02080.x
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.