×

Multiple comparisons of treatment against control under unequal variances using parametric bootstrap. (English) Zbl 07912612

Summary: In one-way analysis of variance models, performing simultaneous multiple comparisons of treatment groups with a control group may be of interest. Dunnett’s test is used to test such differences and assumes equal variances of the response variable for each group. This assumption is not always met even after transformation. A parametric bootstrap (PB) method is developed here for comparing multiple treatment group means against the control group with unequal variances and unbalanced data. In simulation studies, the proposed method outperformed Dunnett’s test in controlling the type I error under various settings, particularly when data have heteroscedastic variance and unbalanced design. Simulations show that power is often lower for the PB method than for Dunnett’s test under equal variance, balanced data, or smaller sample size, but similar to or higher than for Dunnett’s test with unequal variance, unbalanced data and larger sample size. The method is applied to a dataset concerning isotope levels found in elephant tusks from various geographical areas. These data have very unbalanced group sizes and unequal variances. This example illustrates that the PB method is easy to implement and avoids the need for transforming data to meet the equal variance assumption, simplifying interpretation of results.

MSC:

62-XX Statistics

Software:

DescTools; pbANOVA; R; carData
Full Text: DOI

References:

[1] Alver, S. and Zhang, G., pbANOVA: Parametric Bootstrap for ANOVA Models, 2022. https://CRAN.R-project.org/package=pbANOVA. R package version 0.1.0.
[2] Bickel, P.J. and Freedman, D.A., Some asymptotic theory for the bootstrap, Ann. Stat.9 (1981), pp. 1196-1217. · Zbl 0449.62034
[3] Casella, G. and Berger, R.L., Statistical Inference, 2nd ed., Duxbury, Pacific Grove, CA, 2002.
[4] Cheng, W.S.C., Murphy, T.L., Smith, M.T., Cooksley, W.G.E., Halliday, J.W., and Powell, L.W., Dose-dependent pharmacokinetics of caffeine in humans: Relevance as a test of quantitative liver function, Clin. Pharmacol. Ther.47 (1990), pp. 516-524. .
[5] Christensen, R., Analysis of Variance, Design, and Regression: Applied Statistical Methods, Chapman and Hall/CRC, Boca Raton, FL, 1996. · Zbl 0868.62055
[6] Christensen, R., Analysis of Variance, Design, and Regression: Linear Modeling for Unbalanced Data, 2nd ed., CRC Press, Boca Raton, FL, 2016. · Zbl 1388.62001
[7] Dunnett, C.W., A multiple comparison procedure for comparing several treatments with a control, J. Am. Stat. Assoc.50 (1955), pp. 1096-1121. http://www.jstor.org/stable/2281208. · Zbl 0066.12603
[8] Dunnett, C.W., New tables for multiple comparisons with a control, Biometrics20 (1964), pp. 482-491. · Zbl 0121.35703
[9] Efron, B., Bootstrap methods: Another look at the jackknife, Ann. Stat.7 (1979), pp. 1-26. · Zbl 0406.62024
[10] Efron, B. and Tibshirani, R., Bootstrap methods for standard errors, confidence intervals, and other measures of statistical accuracy, Stat. Sci.1 (1986), pp. 54-75. · Zbl 0587.62082
[11] Efron, B. and Tibshirani, R.J., An Introduction to the Bootstrap, Chapman & Hall, New York, NY, 1993. · Zbl 0835.62038
[12] Ferguson, T.S., A Course in Large Sample Theory, Chapman & Hall, London, UK, 1996. · Zbl 0871.62002
[13] Fox, J. and Weisberg, S., An R Companion to Applied Regression, 3rd ed., Sage, Thousand Oaks, CA, 2019. Available at https://socialsciences.mcmaster.ca/jfox/Books/Companion/.
[14] Games, P.A. and Howell, J.F., Pairwise multiple comparison procedures with unequal N’s and/or variances: A monte carlo study, J. Educ. Stat.1 (1976), pp. 113-125.
[15] Hall, P., The Bootstrap and Edgeworth Expansion, Springer-Verlag, New York, NY, 1992. · Zbl 0829.62021
[16] Kramer, C.Y., Extension of multiple range tests to group means with unequal numbers of replications, Biometrics12 (1956), pp. 307-310.
[17] Krishnamoorthy, K. and Lu, F., A parametric bootstrap approach for ANOVA with unequal variances: Fixed and random models, Comput. Stat. Data Anal.51 (2007), pp. 5731-5742. . · Zbl 1445.62187
[18] Kutuk, Z.B., Ergin, E., Cakir, F.Y., and Gurgan, S., Effects of in-office bleaching agent combined with different desensitizing agents on enamel, J. Appl. Oral. Sci.27 (2019). Available at http://www.scielo.br/scielo.php?script=sci_arttext&pid=S1678-77572019000100406&nrm=iso.
[19] Miller Jr, R.G., Simultaneous Statistical Inference, 2nd ed., Springer-Verlag, New York; Heidelberg; Berlin, 1981. · Zbl 0463.62002
[20] R Core Team, R: A Language and Environment for Statistical Computing, R Foundation for Statistical Computing, Vienna, Austria, 2020. Available at https://www.R-project.org/.
[21] Shao, J. and Tu, D., The Jackknife and Bootstrap, Springer, New York, NY, 1995. · Zbl 0947.62501
[22] Signorell, A., Aho, K., Alfons, A., Anderegg, N., Aragon, T., Arachchige, C., Arppe, A., Baddeley, A., Barton, K., Bolker, B., Borchers, H.W., Caeiro, F., Champely, S., Chessel, D., Chhay, L., Cooper, N., Cummins, C., Dewey, M., Doran, H.C., Dray, S., Dupont, C., Eddelbuettel, D., Ekstrom, C., Elff, M., Enos, J., Farebrother, R.W., Fox, J., Francois, R., Friendly, M., Galili, T., Gamer, M., Gastwirth, J.L., Gegzna, V., Gel, Y.R., Graber, S., Gross, J., Grothendieck, G., Harrell Jr, F.E., Heiberger, R., Hoehle, M., Hoffmann, C.W., Hojsgaard, S., Hothorn, T., Huerzeler, M., Hui, W.W., Hurd, P., Hyndman, R.J., Jackson, C., Kohl, M., Korpela, M., Kuhn, M., Labes, D., Leisch, F., Lemon, J., Li, D., Maechler, M., Magnusson, A., Mainwaring, B., Malter, D., Marsaglia, G., Marsaglia, J., Matei, A., Meyer, D., Miao, W., Millo, G., Min, Y., Mitchell, D., Mueller, F., Naepflin, M., Navarro, D., Nilsson, H., Nordhausen, K., Ogle, D., Ooi, H., Parsons, N., Pavoine, S., Plate, T., Prendergast, L., Rapold, R., Revelle, W., Rinker, T., Ripley, B.D., Rodriguez, C., Russell, N., Sabbe, N., Scherer, R., Seshan, V.E., Smithson, M., Snow, G., Soetaert, K., Stahel, W.A., Stephenson, A., Stevenson, M., Stubner, R., Templ, M., Lang, D.T., Therneau, T., Tille, Y., Torgo, L., Trapletti, A., Ulrich, J., Ushey, K., VanDerWal, J., Venables, B., Verzani, J., Iglesias, P.J.V., Warnes, G.R., Wellek, S., Wickham, H., Wilcox, R.R., Wolf, P., Wollschlaeger, D., Wood, J., Wu, Y., Yee, T., and Zeileis, A., DescTools: Tools for Descriptive Statistics, 2020. https://cran.r-project.org/package=DescTools. R package version 0.99.38
[23] Sprenger, J., Science without (parametric) models: The case of bootstrap resampling, Synthese180 (2011), pp. 65-76.
[24] Strojek, K., Yoon, K.H., Hruba, V., Elze, M., Langkilde, A.M., and Parikh, S., Effect of dapagliflozin in patients with type 2 diabetes who have inadequate glycaemic control with glimepiride: A randomized, 24-week, double-blind, placebo-controlled trial, Diabetes Obes Metab13 (2011), pp. 928-938. .
[25] Tallarida, R. and Murray, R., Dunnett’s test (comparison with a control), in Manual of Pharmacologic Calculations, Springer, New York, NY, 1987.
[26] Xu, L.-W., Yang, F.-Q., Abula, A., and Qin, S., A parametric bootstrap approach for two-way ANOVA in presence of possible interactions with unequal variances, J. Multivar. Anal.115 (2013), pp. 172-180. · Zbl 1258.62034
[27] Yigit, E. and Gökpınar, F., A simulation study on tests for one-way anova under the unequal variance assumption, Commun. Fac. Sci. Univ. Ank. Ser.59 (2010), pp. 15-34. · Zbl 1260.62061
[28] Zeileis, A. and Hothorn, T., Diagnostic checking in regression relationships, R News2 (2002), pp. 7-10. Available at https://CRAN.R-project.org/doc/Rnews/.
[29] Zhang, G., A parametric bootstrap approach for one-way ANOVA under unequal variances with unbalanced data, Commun. Stat. Simul. Comput.44 (2015), pp. 827-832. . · Zbl 1325.62146
[30] Zhang, G., Simultaneous confidence intervals for pairwise multiple comparisons in a two-way unbalanced design with unequal variances, J. Stat. Comput. Simul.85 (2015), pp. 2727-2735. . · Zbl 1457.62231
[31] Ziegler, S., Merker, S., Streit, B., Boner, M., and Jacob, D.E., Towards understanding isotope variability in elephant ivory to establish isotopic profiling and source-area determination, Biol. Conserv.197 (2016), pp. 154-163.
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.