Evidence map›Paper›PMID 30946017›Full record

ArticleJMIR public health and surveillance2019

Improved Real-Time Influenza Surveillance: Using Internet Search Data in Eight Latin American Countries.

Leonardo Clemente, Fred Lu, Mauricio Santillana

Abstract read
In one paragraph

Article in JMIR public health and surveillance, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 13 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
13citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

13 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Real-Time Detection of Flu Season Onset: A Novel Approach to Flu Surveillance.International journal of environmental research and public health · 2022
    Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Computational Forecasting Methodology for Acute Respiratory Infectious Disease Dynamics.International journal of environmental research and public health · 2020
    Article
  11. Review
  12. Article
  13. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Leonardo Clemente *School of Engineering and Sciences, Tecnologico de Monterrey, Monterrey, Mexico.ORCID http://orcid.org/0000-0001-8939-8841
Fred Lu *Computational Health Informatics Program, Boston Children's Hospital, Boston, MA, United States.ORCID http://orcid.org/0000-0003-1026-5734
Mauricio SantillanaComputational Health Informatics Program, Boston Children's Hospital, Boston, MA, United States.ORCID http://orcid.org/0000-0002-4206-418X

Funding

Development of an Open-Source and Data-Driven Modeling Platform to Monitor and Forecast Disease ActivityR01GM130668 · NIGMS · NORTHEASTERN UNIVERSITY · PI SANTILLANA, MAURICIO · 2018 to 2022
$1.9M
NIGMS NIH HHS R01 GM130668
6 · The paper itself

Abstract

backgroundNovel influenza surveillance systems that leverage Internet-based real-time data sources including Internet search frequencies, social-network information, and crowd-sourced flu surveillance tools have shown improved accuracy over the past few years in data-rich countries like the United States. These systems not only track flu activity accurately, but they also report flu estimates a week or more ahead of the publication of reports produced by healthcare-based systems, such as those implemented and managed by the Centers for Disease Control and Prevention. Previous work has shown that the predictive capabilities of novel flu surveillance systems, like Google Flu Trends (GFT), in developing countries in Latin America have not yet delivered acceptable flu estimates.

objectiveThe aim of this study was to show that recent methodological improvements on the use of Internet search engine information to track diseases can lead to improved retrospective flu estimates in multiple countries in Latin America.

methodsA machine learning-based methodology that uses flu-related Internet search activity and historical information to monitor flu activity, named ARGO (AutoRegression with Google search), was extended to generate flu predictions for 8 Latin American countries (Argentina, Bolivia, Brazil, Chile, Mexico, Paraguay, Peru, and Uruguay) for the time period: January 2012 to December of 2016. These retrospective (out-of-sample) Influenza activity predictions were compared with historically observed flu suspected cases in each country, as reported by Flunet, an influenza surveillance database maintained by the World Health Organization. For a baseline comparison, retrospective (out-of-sample) flu estimates were produced for the same time period using autoregressive models that only leverage historical flu activity information.

resultsOur results show that ARGO-like models' predictive power outperform autoregressive models in 6 out of 8 countries in the 2012-2016 time period. Moreover, ARGO significantly improves on historical flu estimates produced by the now discontinued GFT for the time period of 2012-2015, where GFT information is publicly available.

conclusionsWe demonstrate here that a self-correcting machine learning method, leveraging Internet-based disease-related search activity and historical flu trends, has the potential to produce reliable and timely flu estimates in multiple Latin American countries. This methodology may prove helpful to local public health officials who design and implement interventions aimed at mitigating the effects of influenza outbreaks. Our methodology generally outperforms both the now-discontinued tool GFT, and autoregressive methodologies that exploit only historical flu activity to produce future disease estimates.

Indexed as

developing countriesdigital epidemiologygoogle flu trendsinfluenza, humaninfluenza monitoringmachine learningreal-time disease surveillance

Identifiers

PMID30946017
PMCPMC6470460

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.