Abstract
Many researchers have studied restricted estimation in the context of exact and stochastic restrictions in linear regression. Some ideas in linear regression, where the ridge and restricted estimations are the well known, were carried to the generalized linear models which provide a wide range of models, including logistic regression, Poisson regression, etc. This study considers the estimation of generalized linear models under stochastic restrictions on the parameters. Furthermore, the sampling distribution of the estimators under the stochastic restriction, the compatibility test and choice of the biasing parameter are given. A real data set is analyzed and simulation studies concerning Binomial and Poisson distributions are conducted. The results show that when stochastic restrictions and ridge idea are simultaneously applied to the estimation methods, the new estimator gains efficiency in terms of having smaller variance and mean square error.
Similar content being viewed by others
Notes
Here, 2 refers to the table value corresponding to \(95\%\).
If for example we choose \(Var(\phi )=\sigma ^{2}=0.2\), then the probability approximately equals \(P(\left| \beta _{4}-\beta _{5}\right| \le 0.8944)=0.95\).
Same result is also valid for the ridge estimator when we use a biasing parameter that does not depend on \(\sigma ^{2}\) (\(k_{m}\) and \(k_{h}\) depend on \(\sigma ^{2}\) through \({\hat{\beta }}_{c}\)) However, to save space we did not report those results.
Same result is also valid for the ridge estimator when we use a biasing parameter that does not depend on \(\sigma ^{2}\).
This result is true for the ridge estimator when we use a biasing parameter that does not depend on \(\sigma ^{2}\). However, when a biasing parameter that depends on \(\sigma ^{2}\) is used, this result is valid for large sample sizes and \(\gamma ^{2}=0.85,0.90.\)
References
Asar Y, Arashi M, Wu J (2017) Restricted ridge estimator in the logistic regression model. Commun Stat Simul Comput 46(8):6538–6544
Bayhan GM, Bayhan M (1998) Forecasting using autocorrelated errors and multicollinear predictor variables. Comput Ind Eng 34:413–421
Bakli M, Fraisier C, Almeras L (2014) From culex exposure to west nile virus infection: screening of specific biomarkers. Open J Vet Med 4:145–161
Chalton DO, Troskie CG (1993) On the compatibility of sample and prior information in the mixed regression model. Commun Stat Theory Methods 22(3):921–928
Eidson M (2001) “Neon needles” in a haystack: the advantages of passive surveillance for West Nile Virus. Ann N Y Acad Sci 951:38–53
Fallah R, Arashi M, Tabatabaey SMM (2017) On the ridge regression estimator with sub-space restriction. Commun Stat Theory Methods 46(23):11854–11865
Fahrmeir L, Tutz G (2001) Multivariate statistical modelling based on generalized linear models, 2nd edn. Springer, New York
Groß J (2003) Restricted ridge estimation. Stat Probab Lett 65:57–64
Hoerl AE, Kennard RW (1976) Ridge estimation: iterative estimation of the biasing parameter. Commun Stat A5:77–88
Hoerl AE, Kennard RW, Baldwin KF (1975) Ridge regression: some simualtions. Commun Stat 4:105–123
Kaçıranlar S, Sakallıoğlu S, Özkale MR, Güler H (2011) More on the restricted ridge regression estimation. J Stat Comput Simul 81(11):1433–1448
Kuran Ö, Özkale MR (2016) Gilmour’s approach to mixed and stochastic restricted ridge predictions in linear mixed models. Linear Algebra Appl 508:22–47
Kurtoğlu F, Özkale MR (2016) Liu estimation in generalized linear models: application on Gamma distributed response variable. Stat Pap 57(4):911–928
Kurtoğlu F, Özkale MR (2019a) Restricted ridge estimator in generalized linear models: Monte Carlo simulation studies on Poisson and binomial distributed responses. Commun Stat Simul Comput 48(4):1191–1218
Kurtoğlu F, Özkale MR (2019b) Restricted Liu estimator in generalized linear models: Monte Carlo simulation studies on Gamma and Poisson distributed responses. Hacet J Math Stat 48(4):1250–1276
Li Y, Yang H (2011) A new ridge-type estimator in stochastic restricted linear regression. Stat J Theor Appl Stat 45(2):123–130
McDonald GC, Galarneau DI (1975) A Monte Carlo evaluation of ridge-type estimators. J Am Stat Assoc 70:407–416
Nelder JA, Wedderburn RWM (1972) Generalized linear models. J R Stat Soc A135:370–384
Nyquist H (1991) Restricted estimation of generalized linear models. Appl Stat 40(1):133–141
Özkale MR (2009) A stochastic restricted ridge regression estimator. J Multivar Anal 100:1706–1716
Özkale MR (2016) Iterative algorithms of biased estimation methods in binary logistic regression. Stat Pap 57(4):991–1016
Özkale MR (2019) The r-d class estimator in generalized linear models: application on Gamma, Poisson and Binomial distributed responses. J Stat Comput Simul 89(4):615–640
Rao CR, Toutenburg H (1995) Linear models-least squares and alternatives. Springer, New York
Roberts RS, Foppa IM (2006) Prediction of equine risk of West Nile Virus infection based on dead bird surveillance. Vector-B Zoonotic Dis 6(1):1–6
Roozbeh M, Arashi M, Niroumand HA (2011) Ridge regression methodology in partial linear models with correlated errors. J Stat Comput Simul 81(4):517–528
Roozbeh M, Arashi M (2014) Feasible ridge estimator in seemingly unrelated semiparametric models. Commun Stat Simul Comput 43:2593–2613
Segerstedt B (1992) On ordinary ridge regression in generalized linear models. Commun Stat Theory Methods 21(8):2227–2246
Siray GU, Toker S, Kaçıranlar S (2015) On the restricted Liu estimator in logistic regression model. Commun Stat Simul Comput 44:217–232
Theil H (1963) On the use of incomplete prior information in regression analysis. J Am Stat Assoc 58:401–414
Theil H, Golberger AS (1961) On pure and mixed statistical estimation in economics. Int Econ Rev 2:65–78
Toutenburg H (1982) Prior information in linear models. Wiley, Chichester
Varathan N, Wijekoon P (2015) Stochastic restricted maximum likelihood estimator in logistic regression model. Open J Stat 5:837–851
Varathan N, Wijekoon P (2016) Ridge estimator in logistic regression under stochastic linear restrictions. Br J Math Comput Sci 15(3):1–14
Varathan N, Wijekoon P (2018) Liu-Type logistic estimator under stochastic linear restrictions. Ceylon J Sci 47(1):21–34
Acknowledgements
This work was supported by Research Fund of Çukurova University under Project Number FBI-2017-9024 to M. Revan Özkale, a visiting scholar for one month at Stockholm University, Department of Statistics.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
On behalf of all authors, the corresponding author states that there is no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Özkale, M.R., Nyquist, H. The stochastic restricted ridge estimator in generalized linear models. Stat Papers 62, 1421–1460 (2021). https://doi.org/10.1007/s00362-019-01142-7
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00362-019-01142-7
Keywords
- Generalized linear models
- Stochastic restrictions
- Restricted estimation
- Ridge regression
- Sampling distribution