Evidence map›Paper›PMID 30045889›Full record

ArticleJournal of the Royal Society, Interface2018

Evaluation of mechanistic and statistical methods in forecasting influenza-like illness.

Sasikiran Kandula, Teresa Yamana, Sen Pei, Wan Yang, Haruka Morita, Jeffrey Shaman

Abstract read
In one paragraph

Article in Journal of the Royal Society, Interface, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 35 papers.

0numbers the graph read from it
0cells of the map it votes in
35citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

35 citing papers in PubMed.

  1. Article
  2. Improving outbreak forecasts through model augmentation.Proceedings of the National Academy of Sciences of the United States of America · 2025
    Article
  3. Article
  4. Article
  5. Article
  6. Review
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Multiscale influenza forecasting.Nature communications · 2021
    Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Sasikiran KandulaDepartment of Environmental Health Sciences, Columbia University, New York, NY, USA sk3542@cumc.columbia.edu.ORCID 0000-0002-6248-9097
Teresa YamanaDepartment of Environmental Health Sciences, Columbia University, New York, NY, USA.ORCID 0000-0001-8349-3151
Sen PeiDepartment of Environmental Health Sciences, Columbia University, New York, NY, USA.ORCID 0000-0002-7072-2995
Wan YangDepartment of Environmental Health Sciences, Columbia University, New York, NY, USA.ORCID 0000-0002-7555-9728
Haruka MoritaDepartment of Environmental Health Sciences, Columbia University, New York, NY, USA.
Jeffrey ShamanDepartment of Environmental Health Sciences, Columbia University, New York, NY, USA.ORCID 0000-0002-7216-7809

Funding

True Metal fac coreP30ES009089 · NIEHS · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI MATTHEW S PERZANOWSKI · 1998 to 2026
$44.7M
Development and Dissemination of Operational Real-Time Respiratory Virus ForecastU01GM110748 · NIGMS · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI SHAMAN, JEFFREY L · 2014 to 2018
$2.6M
Influenza Outbreak Prediction: Applying Data Assimilation Methodology to Make...R01GM100467 · NIGMS · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI SHAMAN, JEFFREY L · 2011 to 2015
$1.4M
NIEHS NIH HHS P30 ES009089NIGMS NIH HHS R01 GM100467NIGMS NIH HHS U01 GM110748
6 · The paper itself

Abstract

A variety of mechanistic and statistical methods to forecast seasonal influenza have been proposed and are in use; however, the effects of various data issues and design choices (statistical versus mechanistic methods, for example) on the accuracy of these approaches have not been thoroughly assessed. Here, we compare the accuracy of three forecasting approaches-a mechanistic method, a weighted average of two statistical methods and a super-ensemble of eight statistical and mechanistic models-in predicting seven outbreak characteristics of seasonal influenza during the 2016-2017 season at the national and 10 regional levels in the USA. For each of these approaches, we report the effects of real time under- and over-reporting in surveillance systems, use of non-surveillance proxies of influenza activity and manual override of model predictions on forecast quality. Our results suggest that a meta-ensemble of statistical and mechanistic methods has better overall accuracy than the individual methods. Supplementing surveillance data with proxy estimates generally improves the quality of forecasts and transient reporting errors degrade the performance of all three approaches considerably. The improvement in quality from ad hoc and post-forecast changes suggests that domain experts continue to possess information that is not being sufficiently captured by current forecasting approaches.

Indexed as

Computer SimulationDisease OutbreaksModels, BiologicalSeasonsForecastingHumansInfluenza, Humanforecastsinfluenzamechanistic modelsmeta-ensemblenowcast

Identifiers

PMID30045889
PMCPMC6073642

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.