Skip to main content
Log in

Maximum likelihood estimation and parameter interpretation in elliptical mixed logistic regression

  • Original Paper
  • Published:
TEST Aims and scope Submit manuscript

Abstract

We introduce the class of elliptical mixed logistic model with focus on the normal/independent subclass. Parameter interpretation in mixed logistic model is not straightforward since the odds ratio is random. For the proposed models, we obtain the odds ratio distribution and its summaries used to interpret the fixed effects and to measure the heterogeneity among the clusters thus extending previous results. Fisher information is also obtained. A Monte Carlo expectation-maximization algorithm is considered to obtain the maximum likelihood estimates. A simulation study is performed comparing normal and heavy-tailed models. It also address the effect of the misspecification of the random effect distribution and other model aspects in the parameter interpretation. A data analysis is performed showing the utility of heavy-tailed mixed logistic model. Among the main conclusions, we note that the misspecification of the random effect distribution influences the fixed effects interpretation and the quantification of the among clusters heterogeneity.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  • Bates D, Maechler M, Bolker BM, Walker S (2015) Fitting linear mixed-effects models using lme4. J Stat Softw. arXiv:1406.5823

  • Booth JG, Hobert JP (1999) Maximizing generalized linear mixed model likelihoods with an automated Monte Carlo em algorithm. J R Stat Soc B 61(1):265–285

    Article  MATH  Google Scholar 

  • Celeux G, Diebolt J (1985) The SEM algorithm: a probabilistic theacher algorithm derived from EM algorithm for the mixture problem. Comput Stat Q 2:73–82

    Google Scholar 

  • Dempster AP, Laird NM, Rubin DB (1977) Maximum likelihood from incomplete data via the EM algorithm. J R Stat Soc B 39:1–38

    MathSciNet  MATH  Google Scholar 

  • Doornik JA (2007) Ox 5—an object-oriented matrix programming language. Timberlake Consultands Ltd

  • Fang KT, Kotz S, Ng KW (1990) Symmetric multivariate and related distributions. Chapman & Hall, London/New York

    Book  MATH  Google Scholar 

  • Fonseca TCO, Ferreira MAR, Migon HS (2008) Objective bayesian analysis for the student-t regression model. Biometrika 95(2):325–333

    Article  MathSciNet  MATH  Google Scholar 

  • Have TR, Localio AR (1999) Empirical Bayes estimation of random effects parameters in mixed effects logistic regression models. Biometrics 55:1022–1029

    Article  MATH  Google Scholar 

  • Jank W (2005) Stochastic variants of EM: Monte Carlo. Quasi-Monte Carlo and more. P. Am. Stat. Assoc, Mineapolis, Minnesota, pp 1–6

    Google Scholar 

  • Lange K, Sinsheimer JS (1993) Normal/independent distributions and their applications in robust regression. J Comput Graph Stat 2(2):175–198

    MathSciNet  Google Scholar 

  • Larsen K, Petersen JH, Budtz-Jørgensen E, Endahl L (2000) Interpreting parameters in the logistic regression model with random effects. Biometrics 56:909–914

    Article  MATH  Google Scholar 

  • Levine RA, Casella G (2001) Implementations of the Monte Carlo EM algorithm. J Comput Graph Stat 10(3):422–439

    Article  MathSciNet  Google Scholar 

  • Liu J, Dey DK (2008) Skew random effects in multilevel binomial models: an alternative to nonparametric approach. Stat Model 8:221–241

    Article  MathSciNet  Google Scholar 

  • Liu L, Yu Z (2008) A likelihood reformulation method in non-normal random effects models. Stat Med 27:3105–3124

    Article  MathSciNet  Google Scholar 

  • McCulloch CE (1997) Maximum likelihood algorithms for generalized linear mixed models. J Am Stat Assoc 92:162–170

    Article  MathSciNet  MATH  Google Scholar 

  • McCulloch C, Searle SR (2001) Generalized, linear, and mixed models. Wiley, New York

    MATH  Google Scholar 

  • Meza C, Jaffrézic F, Joulley JL (2007) Estimation in the probit normal model for binary outcomes using the SAEM algorithm. Comput Stat Data Anal 53:31350–1360

    MathSciNet  Google Scholar 

  • Nelson KP, Lipsitz SR, Fitzmaurice GM, Ibrahim J, Parzen M, Strawderman R (2006) Use of the probability integral transformation to fit nonlinear mixed-effects models with non-normal random effects. J Comput Graph Stat 15:39–57

    Article  Google Scholar 

  • Philippe A (1997) Simulation of right and left truncated gamma distributions by mixtures. Stat Comput 7(3):173–181

    Article  Google Scholar 

  • R Development Core Team (2015) R: a language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. ISBN 3-900051-07-0

  • Santos CC, Loschi RH, Arellano-Valle RB (2013) Parameters interpretation in skewed logistic regression with random intercept. Bayesian Anal 8:381–410

    Article  MathSciNet  MATH  Google Scholar 

  • Santos CC, Loschi RH (2016) EM-Type algorithms for heavy-tailed Logistic mixed models (Manuscript submitted to publication)

  • Souza ADP, Migon HS (2010) Bayesian outlier analysis in binary regression. J Appl Stat 37:1355–1368

    Article  MathSciNet  Google Scholar 

  • Wagler AE (2014) Confidence intervals for assessing heterogeneity in generalized linear mixed models. J Educ Behav Stat 39(3):167–179

    Article  Google Scholar 

  • We GC, Tanner MA (1990) A Monte Carlo implementation of the EM algorithm and the poor man’s data augmentation algorithms. J Am Stat Assoc 85(411):699–704

    Article  Google Scholar 

Download references

Acknowledgments

The authors would like to thank the editors and the referees whose comments and suggestions led to an improved article. The authors thank CAPES and CNPq of the Ministry for Science and Technology of Brazil, and FAPEMIG for a partial allowance to their researches.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Rosangela H. Loschi.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (pdf 142 KB)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Santos, C.C., Loschi, R.H. Maximum likelihood estimation and parameter interpretation in elliptical mixed logistic regression. TEST 26, 209–230 (2017). https://doi.org/10.1007/s11749-016-0507-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11749-016-0507-1

Keywords

Mathematics Subject Classification

Navigation