Evidence map›Paper›PMID 30647115›Full record

ArticleProceedings of the National Academy of Sciences of the United States of America2019

A collaborative multiyear, multimodel assessment of seasonal influenza forecasting in the United States.

Nicholas G Reich, Logan C Brooks, Spencer J Fox, Sasikiran Kandula, Craig J McGowan, Evan Moore, Dave Osthus, Evan L Ray, Abhinav Tushar, Teresa K Yamana and 4 more

Abstract read
In one paragraph

Article in Proceedings of the National Academy of Sciences of the United States of America, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 155 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
155citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

155 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Review
  10. Article
  11. Article
  12. Local Influenza Forecasts Outperform State-Level Forecasts in the United States.medRxiv : the preprint server for health sciences · 2026
    Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Leveraging probabilistic forecasts for dengue preparedness and control: The 2024 Dengue Forecasting Sprint in Brazil.Proceedings of the National Academy of Sciences of the United States of America · 2026
    Article
  20. Article

95 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

14 authors.

Nicholas G ReichDepartment of Biostatistics and Epidemiology, University of Massachusetts-Amherst, Amherst, MA 01003; nick@schoolph.umass.edu.ORCID 0000-0003-3503-9899
Logan C BrooksComputer Science Department, Carnegie Mellon University, Pittsburgh, PA, 15213.
Spencer J FoxDepartment of Integrative Biology, University of Texas at Austin, Austin, TX 78712.ORCID 0000-0003-1969-3778
Sasikiran KandulaDepartment of Environmental Health Sciences, Columbia University, New York, NY 10032.
Craig J McGowanInfluenza Division, Centers for Disease Control and Prevention, Atlanta, GA 30333.ORCID 0000-0002-6298-0185
Evan MooreDepartment of Biostatistics and Epidemiology, University of Massachusetts-Amherst, Amherst, MA 01003.
Dave OsthusStatistical Sciences Group, Los Alamos National Laboratory, Los Alamos, NM 87545.
Evan L RayDepartment of Mathematics and Statistics, Mount Holyoke College, South Hadley, MA 01075.
Abhinav TusharDepartment of Biostatistics and Epidemiology, University of Massachusetts-Amherst, Amherst, MA 01003.
Teresa K YamanaDepartment of Environmental Health Sciences, Columbia University, New York, NY 10032.
Matthew BiggerstaffInfluenza Division, Centers for Disease Control and Prevention, Atlanta, GA 30333.
Michael A JohanssonDivision of Vector-Borne Diseases, Centers for Disease Control and Prevention, San Juan, PR 00920.ORCID 0000-0002-5090-7722
Roni RosenfeldMachine Learning Department, Carnegie Mellon University, Pittsburgh, PA 15213.
Jeffrey ShamanDepartment of Environmental Health Sciences, Columbia University, New York, NY 10032.

Funding

Training, Outreach & Diversity ComponentU54GM088491 · NIGMS · UNIVERSITY OF PITTSBURGH AT PITTSBURGH · PI ROBERTS, MARK STENIUS · 2009 to 2018
$16.7M
Statistical methods for real-time forecasts of infectious disease: expanding dynamic time-series and machine learning approaches for pandemic scenariosR35GM119582 · NIGMS · UNIVERSITY OF MASSACHUSETTS AMHERST · PI Nicholas G Reich · 2016 to 2026
$4.8M
Development and Dissemination of Operational Real-Time Respiratory Virus ForecastU01GM110748 · NIGMS · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI SHAMAN, JEFFREY L · 2014 to 2018
$2.6M
Influenza Outbreak Prediction: Applying Data Assimilation Methodology to Make...R01GM100467 · NIGMS · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI SHAMAN, JEFFREY L · 2011 to 2015
$1.4M
CLC NIH HHS C0000008NIGMS NIH HHS R01 GM100467NIGMS NIH HHS R35 GM119582NIGMS NIH HHS U01 GM110748NIGMS NIH HHS U54 GM088491
6 · The paper itself

Abstract

Influenza infects an estimated 9-35 million individuals each year in the United States and is a contributing cause for between 12,000 and 56,000 deaths annually. Seasonal outbreaks of influenza are common in temperate regions of the world, with highest incidence typically occurring in colder and drier months of the year. Real-time forecasts of influenza transmission can inform public health response to outbreaks. We present the results of a multiinstitution collaborative effort to standardize the collection and evaluation of forecasting models for influenza in the United States for the 2010/2011 through 2016/2017 influenza seasons. For these seven seasons, we assembled weekly real-time forecasts of seven targets of public health interest from 22 different models. We compared forecast accuracy of each model relative to a historical baseline seasonal average. Across all regions of the United States, over half of the models showed consistently better performance than the historical baseline when forecasting incidence of influenza-like illness 1 wk, 2 wk, and 3 wk ahead of available data and when forecasting the timing and magnitude of the seasonal peak. In some regions, delays in data reporting were strongly and negatively associated with forecast accuracy. More timely reporting and an improved overall accessibility to novel and traditional data sources are needed to improve forecasting accuracy and its integration with real-time public health decision making.

Indexed as

ForecastingModels, StatisticalComputer SimulationDisease OutbreaksHumansInfluenza, HumanPublic HealthSeasonsUnited Statesforecastinginfectious diseaseinfluenzapublic healthstatistics

Identifiers

PMID30647115
PMCPMC6386665

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.