×

Robust estimation in structured linear regression. (English) Zbl 0867.62040

Summary: A structured linear regression model is one in which there are permanent dependencies among some \(p\) row vectors of the \(n\times p\) design matrix. To study structured linear regression, we introduce a new class of robust estimators, called \(D\)-estimators, which can be regarded as a generalization of the least median of squares and least trimmed squares estimators. They minimize a dispersion function of the ordered absolute residuals up to the rank \(h\).
We investigate their breakdown point and exact fit point as a function of \(h\) in structured linear regression. It is found that the \(D\)- and \(S\)-estimators can achieve the highest possible breakdown point for \(h\) appropriately chosen. It is shown that both the maximum breakdown point and the corresponding optimal value of \(h\), \(h_{\text{op}}\), are sample dependent. They hinge on the design but not on the response. The relationship between the breakdown point and the design vanishes when \(h\) is strictly larger than \(h_{\text{op}}\). However, when \(h\) is smaller than \(h_{\text{op}}\), the breakdown point depends in a complicated way on the design as well as on the response.

MSC:

62G35 Nonparametric robustness
62J05 Linear regression; mixed models
62K99 Design of statistical experiments
62N99 Survival analysis and censored data
Full Text: DOI

References:

[1] BASSETT, G. W., JR. 1991. Equivariant, monotonic, 50
[2] COAKLEY, C. W. 1991. Advances in the study of breakdown and resistance. Ph.D. dissertation, Dept. Statistics, Pennsy lvania State Univ. Z.
[3] COAKLEY, C. W. and HETTMANSPERGER, T. P. 1993. A bounded influence, high breakdown, efficient regression estimator. J. Amer. Statist. Assoc. 88 872 880. Z. JSTOR: · Zbl 0783.62024 · doi:10.2307/2290776
[4] COAKLEY, C. W. and MILI, L. 1993. Exact fit points under simple regression with replication. Statist. Probab. Lett. 17 265 271. Z. · Zbl 0779.62052 · doi:10.1016/0167-7152(93)90201-S
[5] COAKLEY, C. W., MILI, L. and CHENIAE, M. G. 1994. Effect of leverage on the finite sample efficiencies of high breakdown estimators. Statist. Probab. Lett. 19 399 408. Z. · Zbl 0800.62192 · doi:10.1016/0167-7152(94)90008-6
[6] CROUX, C., ROUSSEEUW, P. J. and HOSSJER, O. 1994. Generalized S-estimators. J. Amer. \" Statist. Assoc. 89 1271 1281. Z. · Zbl 0812.62073
[7] DAVIES, P. L. 1993. Aspects of robust linear regression. Ann. Statist. 21 1843 1899. Z. · Zbl 0797.62026 · doi:10.1214/aos/1176349401
[8] DONOHO, D. L. and HUBER, P. J. 1983. The notion of breakdown point. In A Festschrift for Z. Erich L. Lehman P. J. Bickel, K. A. Doksum and J. L. Hodges, Jr., eds. 157 184. Wadsworth, Belmont, CA. Z. · Zbl 0523.62032
[9] DONOHO, D. L., JOHNSTONE, I., ROUSSEEUW, P. J. and STAHEL, W. 1985. Comment on “Projection pursuit” by P. J. Huber. Ann. Statist. 13 496 500. Z.
[10] ELLIS, S. P. and MORGENTHALER, S. 1992. Leverage and breakdown in L regression. J. Amer. 1 Statist. Assoc. 87 143 148. Z. JSTOR: · Zbl 0781.62101 · doi:10.2307/2290462
[11] HAMPEL, F. R. 1971. A general qualitative definition of robustness. Ann. Math. Statist. 42 1887 1896. · Zbl 0229.62041 · doi:10.1214/aoms/1177693054
[12] HAMPEL, F. R., RONCHETTI, E. M., ROUSSEEUW, P. J. and STAHEL, W. A. 1986. Robust Statistics: The Approach Based on Influence Functions. Wiley, New York. Z. · Zbl 0593.62027
[13] HODGES, J. L., JR. 1967. Efficiency in normal samples and tolerance of extreme values for some estimates of location. Proc. Fifth Berkeley Sy mp. Math. Statist. Probab. 1 163 168. Univ. California Press, Berkeley. Z. · Zbl 0211.50205
[14] MARTIN, R. D., YOHAI, V. J. and ZAMAR, R. H. 1989. Min-max bias robust regression. Ann. Statist. 17 1608 1630. Z. · Zbl 0713.62068 · doi:10.1214/aos/1176347384
[15] MILI, L., CHENIAE, M. G. and ROUSSEEUW, P. J. 1994. Robust state estimation of electric power sy stems. IEEE Trans. Circuits and Sy stems 41 349 358. Z. · Zbl 0799.62106 · doi:10.1109/81.296336
[16] MILI, L. and COAKLEY, C. W. 1993. Robust estimation in structured linear regression. Technical Report 93-13, Dept. Statistics, Virginia Poly technic Institute and State Univ., Blacksburg. Z.
[17] MILI, L., PHANIRAJ, V. and ROUSSEEUW, P. J. 1990. Robust estimation theory for bad data diagnostics in electric power sy stems. In Control and Dy namic Sy stems: Advances in Z. Theory and Applications C. T. Leondes, ed.. Advances in Industrial Sy stems 37 271 325. Academic Press, New York. Z. · Zbl 0753.93020
[18] MILI, L., PHANIRAJ, V. and ROUSSEEUW, P. J. 1991. Least median of squares estimation in power sy stems. IEEE Trans. Power Sy stems 6 511 523. Z.
[19] MULLER, CH. H. 1995. Breakdown points for designed experiments. J. Statist. Plann. Inference \" 45 413 427. Z. · Zbl 0827.62066 · doi:10.1016/0378-3758(94)00086-B
[20] My ERS, R. H. and MONTGOMERY, D. C. 1995. Response Surface Methodology: Process and Product Optimization Using Designed Experiments. Wiley, New York. Z. · Zbl 1161.62392
[21] NETER, J., WASSERMAN, W. and KUTNER, M. H. 1985. Applied Linear Statistical Models, 2nd ed. Irwin, Homewood, IL. Z.
[22] ROUSSEEUW, P. J. 1984. Least median of squares regression. J. Amer. Statist. Assoc. 79 871 880. Z. JSTOR: · Zbl 0547.62046 · doi:10.2307/2288718
[23] ROUSSEEUW, P. J. and LEROY, A. M. 1987. Robust Regression and Outlier Detection. Wiley, New York. Z. · Zbl 0711.62030
[24] ROUSSEEUW, P. J. and YOHAI, V. 1984. Robust regression by means of S-estimators. In Robust and Nonlinear Time Series Analy sis. Lecture Notes in Statist. 26 256 272. Springer, New York. Z. · Zbl 0567.62027
[25] RUCKSTUHL, A. F. 1995. Analy sis of the T emission spectrum by robust estimation techniques. 2 Ph.D. thesis, Seminar fur Statistik, Swiss Federal Institute of Technology, Zurich. \" \" Z.
[26] RUCKSTUHL, A. F., STAHEL, W. A. and DRESSLER, K. 1993. Robust estimation of term values in high-resolution spectroscopy: application to the e3 a3 spectrum of T. Jouru g 2 nal of Molecular Spectroscopy 160 434 445. Z.
[27] SIMPSON, D. G., RUPPERT, D. and CARROLL, R. J. 1992. On one-step GM estimates and stability of inferences in linear regression. J. Amer. Statist. Assoc. 87 439 450. Z. JSTOR: · Zbl 0781.62104 · doi:10.2307/2290275
[28] STROMBERG, A. J. 1992. Personal communication. Z. Z.
[29] TABLEMAN, M. 1994. The asy mptotics of the least trimmed absolute deviations LTAD estimator. Statist. Probab. Lett. 17 387 398. Z. · Zbl 0797.62029 · doi:10.1016/0167-7152(94)90007-8
[30] YOHAI, V. J. 1987. High breakdown point and high efficiency robust estimates for regression. Ann. Statist. 15 642 656. Z. · Zbl 0624.62037 · doi:10.1214/aos/1176350366
[31] YOHAI, V. J. and ZAMAR, R. 1988. High breakdown-point estimates of regression by means of the minimization of an efficient scale. J. Amer. Statist. Assoc. 83 406 413. JSTOR: · Zbl 0648.62036 · doi:10.2307/2288856
[32] BLACKSBURG, VIRGINIA 24061-0111 BLACKSBURG, VIRGINIA 24061-0439 E-MAIL: lmili@vt.edu E-MAIL: coakley@vt.edu
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.