×

Credible ecological inference for medical decisions with personalized risk assessment. (English) Zbl 1396.62259

Summary: This paper studies an identification problem that arises when clinicians seek to personalize patient care by predicting health outcomes conditional on observed patient covariates. Let \(y\) be an outcome of interest and let \((x=k,\,w=j)\) be observed patient covariates. Suppose a clinician wants to choose a care option that maximizes a patient’s expected utility conditional on the observed covariates. To accomplish this, the clinician needs to know the conditional probability distribution \(P(y\mid x=k,\,w=j)\). It is common to have a trustworthy evidence-based risk assessment that predicts \(y\) conditional on a subset of the observed covariates, say \(x\), but not conditional on \((x,\,w)\). Then the clinician knows \(P(y\mid x=k)\) but not \(P(y\mid x=k,\,w=j)\). Research on the ecological inference problem studies partial identification of \(P(y\mid x,\,w)\) given knowledge of \(P(y\mid x)\) and \(P(w\mid x)\). Combining this knowledge with structural assumptions yields tighter conclusions. A psychological literature comparing actuarial predictions and clinical judgments has concluded that clinicians should not attempt to subjectively predict patient outcomes conditional on covariates that are not utilized in evidence-based risk assessments. I argue that formalizing clinical judgment through analysis of the identification problem can improve risk assessments and care decisions.

MSC:

62P10 Applications of statistics to biology and medical sciences; meta analysis
Full Text: DOI

References:

[1] Arias, E. (2015), United States Life Tables, 2011, National Vital Statistics Reports, Vol. 64. Centers for Disease Control and Prevention. www.cdc.gov/nchs/data/nvsr/nvsr64/nvsr64_11.pdf, accessed May 2, 2017.
[2] Berger, J. (1985), Statistical Decision Theory and Bayesian Analysis. Springer‐Verlag, New York. 10.1007/978-1-4757-4286-2 · Zbl 0572.62008
[3] Cho, W. (1998), “If the assumption fits...: A comment on the king ecological inference solution.” Political Analysis, 7, 143-163.
[4] Cho, W. and B.Gaines (2004), “The limits of ecological inference: The case of split‐ticket voting.” American Journal of Political Science, 48, 52-71.
[5] Claus, E., N.Risch, and W.Thompson (1994), “Autosomal dominant inheritance of early‐onset breast cancer. implications for risk prediction.” Cancer, 73, 643-651.
[6] Cross, P. and C.Manski (2002), “Regressions, short and long.” Econometrica, 70, 357-368. 10.1111/1468-0262.00279 · Zbl 1104.62314
[7] Dawes, R., R.Faust, and P.Meehl (1989), “Clinical versus actuarial judgment.” Science, 243, 1668-1674.
[8] Dominitz, J. and C.Manski (2017), “More data or better data? A statistical decision problem.” Review of Economic Studies, 84, 1583-1605. 10.1093/restud/rdx005 · Zbl 1409.62023
[9] Duncan, O. and B.Davis (1953), “An alternative to ecological correlation.” American Sociological Review, 18, 665-666.
[10] Ellsberg, D. (1961), “Risk, ambiguity, and the Savage axioms.” Quarterly Journal of Economics, 75, 643-669. · Zbl 1280.91045
[11] Freedman, D., S.Klein, M.Ostland, and M.Roberts (1998), “Review of a solution to the ecological inference problem, by G. King.” Journal of the American Statistical Association, 93, 1518-1522.
[12] Freedman, D., S.Klein, M.Ostland, and M.Roberts (1999), “Response to King”s comment.” Journal of the American Statistical Association, 94, 355-357.
[13] Gail, M., L.Brinton, D.Byar, D.Corle, S.Green, C.Shairer, and J.Mulvihill (1989), “Projecting individualized probabilities of developing breast cancer for white females who are being examined annually.” Journal of the National Cancer Institute, 81, 1879-1886.
[14] Go, A., D.Mozaffarian, V.Roger, E.Benjamin, J.Berry, W.Borden, D.Bravata, S.Dai, E.Ford, C.Fox, S.Franco, H.Fullerton, C.Gillespie, S.Hailpern, J.Heit, V.Howard, M.Huffman, B.Kissela, S.Kittner, D.Lackland, J.Lichtman, L.Lisabeth, D.Magid, G.Marcus, A.Marelli, D.Matchar, D.McGuire, E.Mohler, C.Moy, M.Mussolino, G.Nichol, N.Paynter, P.Schreiner, P.Sorlie, J.Stein, T.Turan, S.Virani, N.Wong, D.Woo, and M.Turner; on behalf of the American Heart Association Statistics Committee and Stroke Statistics Subcommittee (2013), “Heart disease and stroke statistics—2013 update: A report from the American Heart Association.” Circulation, 127, e6-e245.
[15] Good, I. (1967), “On the principle of total evidence.” The British Journal for the Philosophy of Science, 17, 319-321.
[16] Goodman, L. (1953), “Ecological regressions and behavior of individuals.” American Sociological Review, 18, 663-664.
[17] Groves, W., D.Zald, B.Lebow, B.Snitz, and C.Nelson (2000), “Clinical versus mechanical prediction: A meta‐analysis.” Psychological Assessment, 12, 19-30.
[18] Grünwald, P. and J.Halpern (2004), “When ignorance is bliss.” In Proceedings of the Twentieth Conference on Uncertainty in Artificial Intelligence, 226-234.
[19] Herron, T., T.Seidenfeld, and L.Wasserman (1997), “Divisive conditioning: Further results on dilation.” Philosophy of Science, 64, 411-444. 10.1086/392559
[20] Horowitz, J. and C.Manski (1995), “Identification and robustness with contaminated and corrupted data.” Econometrica, 63, 281-302. 10.2307/2951627 · Zbl 0820.62030
[21] Kadane, J., M.Shervish, and T.Seidenfeld (2008), “Is ignorance bliss?” Journal of Philosophy, 105, 5-36.
[22] King, G. (1997), A Solution to the Ecological Inference Problem: Reconstructing Individual Behavior From Aggregate Data. Princeton University Press, Princeton.
[23] King, G. (1999), “The future of ecological inference research: A comment on Freedman et al.”. Journal of the American Statistical Association, 94, 352-355.
[24] Komen, S. G. (2016), Estimating Breast Cancer Risk, ww5.komen.org/BreastCancer/GailAssessmentModel.html, accessed May 2, 2017.
[25] Mandelblatt, J., K.Cronin, S.Bailey et al. , and Breast Cancer Working Group of the Cancer Intervention and Surveillance Modeling Network (2009), “Effects of mammography screening under different screening schedules: Model estimates of potential benefits and harms.” Annals of Internal Medicine, 151, 738-747.
[26] Manski, C. (2000), “Identification problems and decisions under ambiguity: Empirical analysis of treatment response and normative analysis of treatment choice.” Journal of Econometrics, 95, 415-442. · Zbl 0971.62079
[27] Manski, C. (2007a), Identification for Prediction and Decision. Harvard University Press, Cambridge.
[28] Manski, C. (2007b), “Minimax‐regret treatment choice with missing outcome data.” Journal of Econometrics, 139, 105-115. 10.1016/j.jeconom.2006.06.006 · Zbl 1418.62512
[29] Manski, C. (2009), “Diversified treatment under ambiguity.” International Economic Review, 50, 1013-1041. 10.1111/j.1468-2354.2009.00558.x
[30] Manski, C. (2010), “Vaccination with partial knowledge of external effectiveness.” Proceedings of the National Academy of Sciences, 107, 3953-3960.
[31] Manski, C. (2013), “Diagnostic testing and treatment under ambiguity: Using decision analysis to inform clinical practice.” Proceedings of the National Academy of Sciences, 110, 2064-2069.
[32] Manski, C. (2017), “Mandating vaccination with unknown indirect effects.” Journal of Public Economic Theory, 19, 603-619. 10.1111/jpet.12234
[33] Manski, C. and J.Pepper (2000), “Monotone instrumental variables: With an application to the returns to schooling.” Econometrica, 68, 997-1010. 10.1111/1468-0262.00144 · Zbl 1016.62133
[34] Manski, C. and J.Pepper (2013), “Deterrence and the death penalty: Partial identification analysis using repeated cross sections.” Journal of Quantitative Criminology, 29, 123-141.
[35] Manski, C. and J.Pepper (2017), “How do right‐to‐carry laws affect crime rates? Coping with ambiguity using bounded‐variation assumptions.” Review of Economics and Statistics. Forthcoming. 10.1162/REST_a_00689
[36] Meltzer, D. (2001), “Addressing uncertainty in medical cost‐effectiveness: Implications of expected utility maximization for methods to perform sensitivity analysis and the use of cost‐effectiveness analysis to set priorities for medical research.” Journal of Health Economics, 20, 109-129.
[37] Myers, E., P.Moorman, J.Gierisch, L.Havrilesky, L.Grimm, S.Ghate, B.Davidson, R.Mongtomery, M.Crowley, D. A.McCrory, and G.Sanders (2015), “Benefits and harms of breast cancer screening: A systematic review.” Journal of the American Medical Association, 314, 1615-1634.
[38] National Cancer Institute (2016), Breast Cancer Risk Assessment Tool, http://www.cancer.gov/bcrisktool/, accessed May 2, 2017.
[39] National Comprehensive Cancer Network (2016), Breast Cancer Screening and Diagnosis, Version 1.2016, www.nccn.org/professionals/physician_gls/pdf/breast‐screening.pdf, accessed May 2, 2017.
[40] Phelps, C. and A.Mushlin (1988), “Focusing technology assessment using medical decision theory.” Medical Decision Making, 8, 279-289.
[41] Savage, L. (1951), “The theory of statistical decision.” Journal of the American Statistical Association, 46, 55-67. · Zbl 0042.14302
[42] Savage, L. (1954), The Foundations of Statistics. Wiley, New York. · Zbl 0055.12604
[43] Shlonsky, A. and D.Wagner (2005), “The next step: Integrating actuarial risk assessment and clinical judgment into an evidence‐based practice framework in CPS case management.” Children and Youth Services Review, 27, 409-427.
[44] Singletary, K. and S.Gapstur (2001), “Alcohol and breast cancer: Review of epidemiologic and experimental evidence and potential mechanisms.” Journal of the American Medical Association, 286, 2143-2151.
[45] Stoye, J. (2012), “Minimax regret treatment choice with covariates or with limited validity of experiments.” Journal of Econometrics, 166, 157-165. 10.1016/j.jeconom.2011.06.012 · Zbl 1441.62876
[46] Substance Abuse and Mental Health Services Administration (2014), 2014 National Survey on Drug Use and Health (NSDU). Table 2.46B—Alcohol use, binge alcohol use, and heavy alcohol use in the past month among persons aged 18 or older, by demographic characteristics: Percentages, 2013 and 2014, www.samhsa.gov/data/sites/default/files/NSDUH‐DetTabs2014/NSDUH‐DetTabs2014.htm#tab2‐46b, accessed May 2, 2017.
[47] Tetenov, A. (2012), Measuring Precision of Statistical Inference on Partially Identified Parameters. Collegio Carlo Alberto, Moncalieri (Torino), Italy.
[48] Von Neumann, J. and O.Morgenstern (1944), Theory of Games and Economic Behavior. Princeton University Press, Princeton. · Zbl 0063.05930
[49] Wakefield, J. (2008), “Ecological studies revisited.” Annual Review of Public Health, 29, 75-90.
[50] Wald, A. (1950), Statistical Decision Functions. Wiley, New York. · Zbl 0040.36402
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.