Robust estimation in multiple linear regression model with non-Gaussian noise. (English) Zbl 1283.93263
Summary: The traditional least squares estimators used in multiple linear regression model are very sensitive to design anomalies. To rectify the situation we propose a reparametrization of the model. We derive modified maximum likelihood estimators and show that they are robust and considerably more efficient than the least squares estimators besides being insensitive to moderate design anomalies.
MSC:
| 93E10 | Estimation and detection in stochastic control theory |
| 62J05 | Linear regression; mixed models |
References:
| [1] | Abromowitz, M.; Stegun, I. A., Handbook of mathematical functions (1985), Dover: Dover New York |
| [2] | Akkaya, A. D.; Tiku, M. L., Robust estimation and hypothesis testing under short-tailedness and inliers, Test, 14, 129-150 (2005) · Zbl 1069.62015 |
| [3] | Aström, K. J., Maximum likelihood and prediction error methods, Automatica, 16, 551-574 (1980) · Zbl 0441.93036 |
| [4] | Atkinson, A.; Riani, M., Robust diagnostic regression analysis (2000), Springer: Springer New York · Zbl 0964.62063 |
| [5] | Bhattacharyya, G. K., The asymptotics of maximum likelihood and related estimators based on type II censored data, Journal of the American Statistical Association, 80, 398-404 (1985) · Zbl 0576.62042 |
| [6] | Carr, N. L., Kinetics of catalytic isomerization of \(n\)-Pentane, Industrial and Engineering Chemistry, 52, 391-396 (1960) |
| [7] | Dedieu, H.; Ogorzalek, M. J., Identifiability and identification of chaotic systems based on adaptive synchronization, IEEE Transactions on Circuits and Systems-I: Fundamental Theory and Applications, 44, 10, 948-962 (1997) |
| [8] | Draper, N.; Smith, H., Applied regression analysis (1981), Wiley: Wiley New York · Zbl 0548.62046 |
| [9] | Hamilton, L. C., Regression with Graphics (1992), Brooks/Cole Publishing Company: Brooks/Cole Publishing Company California |
| [10] | Hoeffding, W., On the distribution of the expected value of order statistics, Annals of Mathematical Statistics, 24, 93-100 (1953) · Zbl 0050.13603 |
| [11] | Hosmer, D. W.; Lemeshow, S., Applied logistic regression (1989), Wiley: Wiley New York · Zbl 0715.62125 |
| [12] | Huber, P. J., Robust statistics (1981), Wiley: Wiley New York · Zbl 0536.62025 |
| [13] | Islam, M. Q.; Tiku, M. L., Multiple linear regression model under non-normality, Communications in Statistics-Theory and Methods, 33, 2443-2467 (2004) · Zbl 1217.62096 |
| [14] | Kailath, T.; Sayed, A. H.; Hassibi, B., Linear estimation (2000), Prentice-Hall: Prentice-Hall New Jersey |
| [15] | Oral, E., Binary regression with stochastic covariates, Communications in Statistics-Theory and Methods, 35, 1429-1447 (2006) · Zbl 1120.62053 |
| [16] | Puthenpura, S.; Sinha, N. K., Modified maximum likelihood method for the robust estimation of system parameters from very noisy data, Automatica, 22, 231-235 (1986) · Zbl 0589.93067 |
| [17] | Roy, J.; Tiku, M. L., A Leguerre series approximation to the sampling distribution of the variance, Sankhya, 24, 181-184 (1962) · Zbl 0105.12501 |
| [18] | Sayed, A. H.; Nascimento, V. H.; Capparrone, A. M., A regularized robust design criterion for uncertain data, SIAM Journal on Matrix Analysis and Its Applications, 23, 1120-1142 (2002) · Zbl 1058.15002 |
| [19] | Schneider, H., Truncated and censored samples from normal populations (1986), Marcel Dekker: Marcel Dekker New York · Zbl 0601.62052 |
| [20] | Sinha, N. K.; Kuszta, B., Modelling and identification of dynamic systems (1983), Van-Nostrand Reinhold: Van-Nostrand Reinhold California · Zbl 0365.93011 |
| [21] | Subramanian, A.; Sayed, A. H., A regularized robust filters for time-varying uncertain discrete-time systems, IEEE Transactions on Automatic Control, 49, 970-976 (2004) · Zbl 1365.93514 |
| [22] | Tan, W. Y.; Tabatabai, M. A., A modified Winsorized regression procedure for linear models, Journal of Statistical Computation and Simulation, 30, 299-313 (1988) · Zbl 0726.62106 |
| [23] | Tiku, M. L., Estimating the mean and standard deviation from a censored normal sample, Biometrika, 54, 155-165 (1967) |
| [24] | Tiku, M. L., Rejoinder: Comment on “A new statistic for testing suspected outliers”, Communications in Statistics, A6, 1417-1422 (1977) · Zbl 0376.62016 |
| [25] | Tiku, M. L., Linear regression model with censored observations, Communications in Statistics-Theory and Methods, 7, 1219-1232 (1978) · Zbl 0415.62047 |
| [26] | Tiku, M. L., Robustness of MML estimators based on censored samples and robust test statistics, Journal of Statistical Planning and Inference, 4, 123-143 (1980) · Zbl 0441.62035 |
| [27] | Tiku, M. L. (1989). Modified maximum likelihood estimation. Encyclopedia of statistical sciences. New York: Wiley. (supplement volume).; Tiku, M. L. (1989). Modified maximum likelihood estimation. Encyclopedia of statistical sciences. New York: Wiley. (supplement volume). |
| [28] | Tiku, M. L., & Akkaya, A. D. (2004). Robust estimation and hypothesis testing. New Delhi: New Age International (formerly Wiley Eastern).; Tiku, M. L., & Akkaya, A. D. (2004). Robust estimation and hypothesis testing. New Delhi: New Age International (formerly Wiley Eastern). · Zbl 1069.62015 |
| [29] | Tiku, M. L.; Suresh, R. P., A new method of estimation for location and scale parameters, Journal of Statistical Planning and Inference, 30, 281-292 (1992) · Zbl 0850.62270 |
| [30] | Tiku, M. L.; Tan, W. Y.; Balakrishnan, N., Robust inference (1986), Marcel Dekker: Marcel Dekker New York · Zbl 0597.62017 |
| [31] | Tiku, M. L.; Vaughan, D. C., Logistic and nonlogistic density functions in binary regression with nonstochastic covariates, Biometrical Journal, 39, 883-898 (1997) · Zbl 0932.62079 |
| [32] | Tiku, M. L.; Wong, W. K.; Bian, G., Time series models with asymmetric innovations, Communications in Statistics-Theory and Methods, 28, 1331-1360 (1999) · Zbl 0958.62087 |
| [33] | Tiku, M. L.; Wong, W. K.; Vaughan, D. C.; Bian, G., Time series models in non-normal situations: Symmetric innovations, Journal of Time Series Analysis, 21, 571-596 (2000) · Zbl 0972.62084 |
| [34] | Vaughan, D. C., The Generalized Secant Hyperbolic Distribution and its properties, Communications in Statistics-Theory and Methods, 31, 219-238 (2002) · Zbl 0991.62004 |
| [35] | Vaughan, D. C.; Tiku, M. L., Estimation and hypothesis testing for a non-normal bivariate distribution with applications, Journal of Mathematical and Computer Modelling, 32, 53-67 (2000) · Zbl 0970.62036 |
| [36] | Voss, H. U.; Timmer, J.; Kurths, J., Nonlinear dynamical system identification from uncertain and indirect measurements, International Journal of Bifurcation and Chaos, 14, 6, 1905-1933 (2004) · Zbl 1129.93545 |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
