Chimeric Forecasting: Blending Human Judgment and Computational Methods for Improved, Real-time Forecasts of Influenza Hospitalizations
Authors:
Thomas McAndrew,
Mark Lechmanik,
ErinN. Hulland,
Shaun Truelove,
Mark Ilodigwe,
Maimuna Majumder
Abstract:
Infectious disease forecasts can reduce mortality and morbidity by supporting evidence-based public health decision making. Most epidemic models train on surveillance and structured data (e.g. weather, mobility, media), missing contextual information about the epidemic. Human judgment forecasts are novel data, asking humans to generate forecasts based on surveillance data and contextual informatio…
▽ More
Infectious disease forecasts can reduce mortality and morbidity by supporting evidence-based public health decision making. Most epidemic models train on surveillance and structured data (e.g. weather, mobility, media), missing contextual information about the epidemic. Human judgment forecasts are novel data, asking humans to generate forecasts based on surveillance data and contextual information. Our primary hypothesis is that an epidemic model trained on surveillance plus human judgment forecasts (a chimeric model) can produce more accurate long-term forecasts of incident hospitalizations compared to a control model trained only on surveillance. Humans have a finite amount of cognitive energy to forecast, limiting them to forecast a small number of states. Our secondary hypothesis is that a model can map human judgment forecasts from a small number of states to all states with similar performance. For the 2023/24 season, we collected weekly incident influenza hospitalizations for all US states, and 696 human judgment forecasts of peak epidemic week and the maximum number of hospitalizations (peak intensity) for ten of the most populous states. We found a chimeric model outperformed a control model on long-term forecasts. Compared to human judgment, a chimeric model produced forecasts of peak epidemic week and peak intensity with similar or improved performance. Forecasts of peak epidemic week and peak intensity for the ten states where humans input forecasts vs a model that extended these forecasts to all states showed similar performance to one another. Our results suggest human judgment forecasts are a viable data source that can improve infectious disease forecasts and support public health decisions.
△ Less
Submitted 5 October, 2024;
originally announced October 2024.
Infectious disease surveillance needs for the United States: lessons from COVID-19
Authors:
Marc Lipsitch,
Mary T. Bassett,
John S. Brownstein,
Paul Elliott,
David Eyre,
M. Kate Grabowski,
James A. Hay,
Michael Johansson,
Stephen M. Kissler,
Daniel B. Larremore,
Jennifer Layden,
Justin Lessler,
Ruth Lynfield,
Duncan MacCannell,
Lawrence C. Madoff,
C. Jessica E. Metcalf,
Lauren A. Meyers,
Sylvia K. Ofori,
Celia Quinn,
Ana I. Ramos Bento,
Nick Reich,
Steven Riley,
Roni Rosenfeld,
Matthew H. Samore,
Rangarajan Sampath
, et al. (5 additional authors not shown)
Abstract:
The COVID-19 pandemic has highlighted the need to upgrade systems for infectious disease surveillance and forecasting and modeling of the spread of infection, both of which inform evidence-based public health guidance and policies. Here, we discuss requirements for an effective surveillance system to support decision making during a pandemic, drawing on the lessons of COVID-19 in the U.S., while l…
▽ More
The COVID-19 pandemic has highlighted the need to upgrade systems for infectious disease surveillance and forecasting and modeling of the spread of infection, both of which inform evidence-based public health guidance and policies. Here, we discuss requirements for an effective surveillance system to support decision making during a pandemic, drawing on the lessons of COVID-19 in the U.S., while looking to jurisdictions in the U.S. and beyond to learn lessons about the value of specific data types. In this report, we define the range of decisions for which surveillance data are required, the data elements needed to inform these decisions and to calibrate inputs and outputs of transmission-dynamic models, and the types of data needed to inform decisions by state, territorial, local, and tribal health authorities. We define actions needed to ensure that such data will be available and consider the contribution of such efforts to improving health equity.
△ Less
Submitted 22 November, 2023;
originally announced November 2023.
