Evidence map›Paper›PMID 27665707›Full record

ArticleScientific reports2016

Evaluating the performance of infectious disease forecasts: A comparison of climate-driven and seasonal dengue forecasts for Mexico.

Michael A Johansson, Nicholas G Reich, Aditi Hota, John S Brownstein, Mauricio Santillana

Abstract read
In one paragraph

Article in Scientific reports, 2016. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 57 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
57citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

57 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Review
  6. Article
  7. Ensemble approaches for short-term dengue fever forecasts: A global evaluation study.Proceedings of the National Academy of Sciences of the United States of America · 2025
    Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Evaluating infectious disease forecasts with allocation scoring rules.Journal of the Royal Statistical Society. Series A, (Statistics in Society) · 2024
    Article
  14. Article
  15. Article
  16. Article
  17. Modeling COVID-19 incidence with Google Trends.Frontiers in research metrics and analytics · 2022
    Article
  18. Article
  19. Impact of environmental factors on the spread of dengue fever in Sri Lanka.International journal of environmental science and technology : IJEST · 2022
    Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Michael A JohanssonDengue Branch, Division of Vector-Borne Diseases, Centers for Disease Control and Prevention, San Juan, Puerto Rico.
Nicholas G ReichDepartment of Biostatistics and Epidemiology, University of Massachusetts, Amherst, Massachusetts, USA.
Aditi HotaComputational Health Informatics Program, Boston Children's Hospital, Boston, Massachusetts, USA.
John S BrownsteinComputational Health Informatics Program, Boston Children's Hospital, Boston, Massachusetts, USA.
Mauricio SantillanaComputational Health Informatics Program, Boston Children's Hospital, Boston, Massachusetts, USA.

Funding

Understanding and controlling antibiotic resistanceU54GM088558 · NIGMS · HARVARD SCHOOL OF PUBLIC HEALTH · PI LIPSITCH, MARC · 2009 to 2018
$26.4M
Methods for Reducing Spatial Uncertainty and Bias in Disease SurveillanceR01AI102939 · NIAID · JOHNS HOPKINS UNIVERSITY · PI LESSLER, JUSTIN · 2013 to 2017
$4.6M
A Platform for Modeling the Global Impact of Climate Change on Infectious DiseaseR01LM010812 · NLM · BOSTON CHILDREN'S HOSPITAL · PI BROWNSTEIN, JOHN S. · 2010 to 2015
$2.5M
Inference for interacting pathogens with mechanistic and phenomenological modelsR21AI115173 · NIAID · UNIVERSITY OF MASSACHUSETTS AMHERST · PI REICH, NICHOLAS G · 2015 to 2016
$454k
NIAID NIH HHS R01 AI102939NIAID NIH HHS R21 AI115173NIGMS NIH HHS U54 GM088558NLM NIH HHS R01 LM010812
6 · The paper itself

Abstract

Dengue viruses, which infect millions of people per year worldwide, cause large epidemics that strain healthcare systems. Despite diverse efforts to develop forecasting tools including autoregressive time series, climate-driven statistical, and mechanistic biological models, little work has been done to understand the contribution of different components to improved prediction. We developed a framework to assess and compare dengue forecasts produced from different types of models and evaluated the performance of seasonal autoregressive models with and without climate variables for forecasting dengue incidence in Mexico. Climate data did not significantly improve the predictive power of seasonal autoregressive models. Short-term and seasonal autocorrelation were key to improving short-term and long-term forecasts, respectively. Seasonal autoregressive models captured a substantial amount of dengue variability, but better models are needed to improve dengue forecasting. This framework contributes to the sparse literature of infectious disease prediction model evaluation, using state-of-the-art validation techniques such as out-of-sample testing and comparison to an appropriate reference model.

Identifiers

PMID27665707
PMCPMC5036038

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.