Evidence map›Paper›PMID 27449080›Full record

ArticleBMC infectious diseases2016

Results from the centers for disease control and prevention's predict the 2013-2014 Influenza Season Challenge.

Matthew Biggerstaff, David Alper, Mark Dredze, Spencer Fox, Isaac Chun-Hai Fung, Kyle S Hickmann, Bryan Lewis, Roni Rosenfeld, Jeffrey Shaman, Ming-Hsiang Tsou and 4 more

Abstract read
In one paragraph

Article in BMC infectious diseases, 2016. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 99 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
99citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

99 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. [Re-transmission risk prediction of imported Chikungunya fever in Guangdong Province using the SEIR-SEI model].Nan fang yi ke da xue xue bao = Journal of Southern Medical University · 2026
    Article
  4. Article
  5. Article
  6. Local Influenza Forecasts Outperform State-Level Forecasts in the United States.medRxiv : the preprint server for health sciences · 2026
    Article
  7. Article
  8. Article
  9. Article
  10. Leveraging probabilistic forecasts for dengue preparedness and control: The 2024 Dengue Forecasting Sprint in Brazil.Proceedings of the National Academy of Sciences of the United States of America · 2026
    Article
  11. Article
  12. Improving outbreak forecasts through model augmentation.Proceedings of the National Academy of Sciences of the United States of America · 2025
    Article
  13. Article
  14. Article
  15. Optimizing Disease Outbreak Forecast Ensembles.Emerging infectious diseases · 2024
    Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. When the role of uncertainty is…uncertain.Proceedings of the National Academy of Sciences of the United States of America · 2023
    Article

39 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

14 authors.

Matthew BiggerstaffEpidemiology and Prevention Branch, Influenza Division, Centers for Disease Control and Prevention, Atlanta, Georgia, USA. mbiggerstaff@cdc.gov.
David AlperEveryday Health, New York, New York, USA.
Mark DredzeJohns Hopkins University, Baltimore, Maryland, USA.
Spencer FoxUniversity of Texas at Austin, Austin, Texas, USA.
Isaac Chun-Hai FungGeorgia Southern University, Statesboro, Georgia, USA.
Kyle S HickmannLos Alamos National Laboratory, Los Alamos, New Mexico, USA.
Bryan LewisVirginia Tech, Blacksburg, Virginia, USA.
Roni RosenfeldCarnegie Mellon University, Pittsburgh, Pennsylvania, USA.
Jeffrey ShamanColumbia University, New York, New York, USA.
Ming-Hsiang TsouSan Diego State University, San Diego, California, USA.
Paola VelardiSapienza University of Roma, Rome, Italy.
Alessandro VespignaniNortheastern University, Boston, Massachusetts, USA.
Lyn FinelliEpidemiology and Prevention Branch, Influenza Division, Centers for Disease Control and Prevention, Atlanta, Georgia, USA.
Influenza Forecasting Contest Working Group

Funding

True Metal fac coreP30ES009089 · NIEHS · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI MATTHEW S PERZANOWSKI · 1998 to 2026
$44.7M
Understanding and controlling antibiotic resistanceU54GM088558 · NIGMS · HARVARD SCHOOL OF PUBLIC HEALTH · PI HANAGE, WILLIAM · 2009 to 2018
$26.4M
Training, Outreach & Diversity ComponentU54GM088491 · NIGMS · UNIVERSITY OF PITTSBURGH AT PITTSBURGH · PI VAN PANHUIS, WILLEM GIJSBERT · 2009 to 2018
$16.7M
Synthetic Information Systems for Better Informing Public Health PolicymakersU01GM070694 · NIGMS · VIRGINIA POLYTECHNIC INST AND ST UNIV · PI EUBANK, STEPHEN G, MARATHE, MADHAV VISHNU · 2004 to 2016
$8.6M
Impacts of Individual and Social Behavior on Influenza Dynamics and ControlU01GM087719 · NIGMS · YALE UNIVERSITY · PI GALVANI, ALISON P, MEYERS, LAUREN ANCEL · 2009 to 2018
$6.3M
Systems Analysis of Social Pathways of Epidemics to Reduce Health DisparitiesR01GM109718 · NIGMS · VIRGINIA POLYTECHNIC INST AND ST UNIV · PI MARATHE, ACHLA, VULLIKANTI, ANIL · 2014 to 2022
$3.6M
Development and Dissemination of Operational Real-Time Respiratory Virus ForecastU01GM110748 · NIGMS · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI SHAMAN, JEFFREY L · 2014 to 2018
$2.6M
Influenza Outbreak Prediction: Applying Data Assimilation Methodology to Make...R01GM100467 · NIGMS · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI SHAMAN, JEFFREY L · 2011 to 2015
$1.4M
NIGMS NIH HHS R01 GM100467NIGMS NIH HHS U01 GM070694NIGMS NIH HHS U01 GM087719NIGMS NIH HHS U01 GM110748NIGMS NIH HHS U54 GM088558
6 · The paper itself

Abstract

backgroundEarly insights into the timing of the start, peak, and intensity of the influenza season could be useful in planning influenza prevention and control activities. To encourage development and innovation in influenza forecasting, the Centers for Disease Control and Prevention (CDC) organized a challenge to predict the 2013-14 Unites States influenza season.

methodsChallenge contestants were asked to forecast the start, peak, and intensity of the 2013-2014 influenza season at the national level and at any or all Health and Human Services (HHS) region level(s). The challenge ran from December 1, 2013-March 27, 2014; contestants were required to submit 9 biweekly forecasts at the national level to be eligible. The selection of the winner was based on expert evaluation of the methodology used to make the prediction and the accuracy of the prediction as judged against the U.S. Outpatient Influenza-like Illness Surveillance Network (ILINet).

resultsNine teams submitted 13 forecasts for all required milestones. The first forecast was due on December 2, 2013; 3/13 forecasts received correctly predicted the start of the influenza season within one week, 1/13 predicted the peak within 1 week, 3/13 predicted the peak ILINet percentage within 1 %, and 4/13 predicted the season duration within 1 week. For the prediction due on December 19, 2013, the number of forecasts that correctly forecasted the peak week increased to 2/13, the peak percentage to 6/13, and the duration of the season to 6/13. As the season progressed, the forecasts became more stable and were closer to the season milestones.

conclusionForecasting has become technically feasible, but further efforts are needed to improve forecast accuracy so that policy makers can reliably use these predictions. CDC and challenge contestants plan to build upon the methods developed during this contest to improve the accuracy of influenza forecasts.

Indexed as

Centers for Disease Control and Prevention, U.S.Models, BiologicalSeasonsForecastingHumansInfluenza, HumanModels, StatisticalPublic Health SurveillanceUnited StatesForecastingInfluenzaModelingPrediction

Identifiers

PMID27449080
PMCPMC4957319

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.