Implementing the Bianco and Yohai estimator for logistic regression. (English) Zbl 1429.62317
Summary: A fast and stable algorithm to compute a highly robust estimator for the logistic regression model is proposed. A criterium for the existence of this estimator at finite samples is derived and the problem of the selection of an appropriate loss function is discussed. It is shown that the loss function can be chosen such that the robust estimator exists if and only if the maximum likelihood estimator exists. The advantages of using a weighted version of this estimator are also considered. Simulations and an example give further support for the good performance of the implemented estimators.
MSC:
| 62J12 | Generalized linear models (logistic models) |
| 62F35 | Robustness and adaptive procedures (parametric inference) |
| 62F10 | Point estimation |
Software:
BRENTReferences:
| [1] | Albert, A.; Anderson, J. A., On the existence of maximum likelihood estimates in logistic regression models, Biometrika, 71, 1-10 (1984) · Zbl 0543.62020 |
| [2] | Atkinson, A.; Riani, M., Robust Diagnostic Regression Analysis (2000), Springer: Springer New York · Zbl 0964.62063 |
| [3] | Bianco, A. M.; Yohai, V. J., Robust estimation in the logistic regression model, (Rieder, H., Robust Statistics, Data Analysis, and Computer Intensive Methods. Robust Statistics, Data Analysis, and Computer Intensive Methods, Lecture Notes in Statistics, Vol. 109 (1996), Springer: Springer New York), 17-34 · Zbl 0839.62030 |
| [4] | Brent, R., Algorithms for Minimization without Derivatives (1973), Prentice-Hall: Prentice-Hall Englewood Cliffs, NJ, USA · Zbl 0245.65032 |
| [5] | Cantoni, E.; Ronchetti, E., Robust inference for generalized linear models, J. Amer. Statist. Assoc., 96, 1022-1030 (2001) · Zbl 1072.62610 |
| [6] | Carroll, R. J.; Pederson, S., On robust estimation in the logistic regression model, J. Roy. Statist. Soc. B, 55, 693-706 (1993) · Zbl 0794.62021 |
| [7] | Christmann, A.; Rousseeuw, P. J., Measuring overlap in binary regression, Comp. Statist. Data Anal., 37, 65-75 (2001) · Zbl 1051.62065 |
| [8] | Croux, C.; Haesbroeck, G., Influence function and efficiency of the minimum covariance determinant scatter matrix estimator, J. Multivariate Anal., 71, 161-190 (1999) · Zbl 0946.62055 |
| [9] | Croux, C.; Flandre, C.; Haesbroeck, G., The breakdown behavior of the maximum likelihood estimator in the logistic regression model, Statist. Probab. Lett., 60, 377-386 (2002) · Zbl 1045.62014 |
| [10] | Finney, D. J., The estimation from individual records of the relationship between dose and quantal response, Biometrika, 34, 320-334 (1947) · Zbl 0036.09701 |
| [11] | Hampel, F. R.; Ronchetti, E. M.; Rousseeuw, P. J.; Stahel, W. A., Robust Statistics: The Approach based on Influence Functions (1986), Wiley: Wiley New York · Zbl 0593.62027 |
| [12] | Kordzakhia, N.; Mishra, G. D.; Reiersølmoen, L., Robust estimation in the logistic regression model, J. Statist. Planning Inference, 98, 211-223 (2001) · Zbl 0977.62080 |
| [13] | Künsch, H. R.; Stefanski, L. A.; Carroll, R. J., Conditionally unbiased bounded influence estimation in general regression models, with applications to generalized linear models, J. Amer. Statist. Assoc., 84, 460-466 (1989) · Zbl 0679.62024 |
| [14] | Pregibon, D., Resistant fits for some commonly used logistic models with medical applications, Biometrics, 38, 485-498 (1982) |
| [15] | Rousseeuw, P.J., 1985. Multivariate estimation with high breakdown point. In: Grossmann, W., Pflug, G., Vincze, I., Wertz, W. (Ed.), Mathematical Statistics and Applications, Vol. B. Reidel, Dordrecht, pp. 283-297.; Rousseeuw, P.J., 1985. Multivariate estimation with high breakdown point. In: Grossmann, W., Pflug, G., Vincze, I., Wertz, W. (Ed.), Mathematical Statistics and Applications, Vol. B. Reidel, Dordrecht, pp. 283-297. · Zbl 0609.62054 |
| [16] | Rousseeuw, P.J., Christmann, A., 2002. Robustness against separation and outliers in logistic regression. Comput. Statist. Data Anal. to appear.; Rousseeuw, P.J., Christmann, A., 2002. Robustness against separation and outliers in logistic regression. Comput. Statist. Data Anal. to appear. · Zbl 1429.62325 |
| [17] | Rousseeuw, P. J.; Van Driessen, K., A fast algorithm for the minimum covariance determinant estimator, Technometrics, 41, 212-223 (1999) |
| [18] | Rousseeuw, P. J.; van Zomeren, B. C., Unmasking multivariate outliers and leverage points, J. Amer. Statist. Assoc., 85, 633-639 (1990) |
| [19] | Santner, T. J.; Duffy, D. E., A note on A. Albert and J.A. Anderson’s conditions for the existence of maximum likelihood estimates in logistic regression, Biometrika, 73, 755-758 (1986) · Zbl 0655.62022 |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
