Evidence map›Paper›PMID 33674304›Full record

ArticleScience advances2021

An early warning approach to monitor COVID-19 activity with multiple digital traces in near real time.

Nicole E Kogan, Leonardo Clemente, Parker Liautaud, Justin Kaashoek, Nicholas B Link, Andre T Nguyen, Fred S Lu, Peter Huybers, Bernd Resch, Clemens Havas and 7 more

Abstract read
In one paragraph

Article in Science advances, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 92 papers, 3 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
92citing papers in PubMed, 3 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

92 citing papers in PubMed, 3 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Characterizing population-level changes in human behavior during the COVID-19 pandemic in the United States.Proceedings of the National Academy of Sciences of the United States of America · 2025
    Article
  11. Early Warning of Infectious Disease Outbreaks Using Social Media and Digital Data: A Scoping Review.International journal of environmental research and public health · 2025
    Article
  12. Review
  13. Article
  14. Article
  15. Observational
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article

32 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

17 authors.

Nicole E KoganComputational Health Informatics Program, Boston Children's Hospital, Boston, MA, USA. msantill@fas.harvard.edu nkogan@g.harvard.edu leonardo.clemente@childrens.harvard.edu parker_liautaud@g.harvard.edu.ORCID 0000-0003-1622-0537
Leonardo ClementeComputational Health Informatics Program, Boston Children's Hospital, Boston, MA, USA. msantill@fas.harvard.edu nkogan@g.harvard.edu leonardo.clemente@childrens.harvard.edu parker_liautaud@g.harvard.edu.ORCID 0000-0001-8939-8841
Parker LiautaudDepartment of Earth and Planetary Sciences, Harvard University, Cambridge, MA, USA. msantill@fas.harvard.edu nkogan@g.harvard.edu leonardo.clemente@childrens.harvard.edu parker_liautaud@g.harvard.edu.ORCID 0000-0001-5227-0844
Justin KaashoekComputational Health Informatics Program, Boston Children's Hospital, Boston, MA, USA.ORCID 0000-0002-9049-9698
Nicholas B LinkComputational Health Informatics Program, Boston Children's Hospital, Boston, MA, USA.ORCID 0000-0003-4078-4842
Andre T NguyenComputational Health Informatics Program, Boston Children's Hospital, Boston, MA, USA.ORCID 0000-0001-7131-6879
Fred S LuComputational Health Informatics Program, Boston Children's Hospital, Boston, MA, USA.ORCID 0000-0003-1026-5734
Peter HuybersDepartment of Earth and Planetary Sciences, Harvard University, Cambridge, MA, USA.ORCID 0000-0002-3734-8145
Bernd ReschDepartment of Geoinformatics - Z_GIS, University of Salzburg, Salzburg, Austria.ORCID 0000-0002-2233-6926
Clemens HavasDepartment of Geoinformatics - Z_GIS, University of Salzburg, Salzburg, Austria.ORCID 0000-0003-0390-5094
Andreas PetutschnigDepartment of Geoinformatics - Z_GIS, University of Salzburg, Salzburg, Austria.ORCID 0000-0001-5029-2425
Jessica DavisNortheastern University, Boston, MA, USA.ORCID 0000-0003-0726-1855
Matteo ChinazziNortheastern University, Boston, MA, USA.ORCID 0000-0002-5955-1929
Backtosch MustafaComputational Health Informatics Program, Boston Children's Hospital, Boston, MA, USA.
William P HanageDepartment of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, MA, USA.ORCID 0000-0002-6319-7336
Alessandro VespignaniNortheastern University, Boston, MA, USA.ORCID 0000-0003-3419-4205
Mauricio SantillanaComputational Health Informatics Program, Boston Children's Hospital, Boston, MA, USA. msantill@fas.harvard.edu nkogan@g.harvard.edu leonardo.clemente@childrens.harvard.edu parker_liautaud@g.harvard.edu.ORCID 0000-0002-4206-418X

Funding

Development of an Open-Source and Data-Driven Modeling Platform to Monitor and Forecast Disease ActivityR01GM130668 · NIGMS · NORTHEASTERN UNIVERSITY · PI SANTILLANA, MAURICIO · 2018 to 2022
$1.9M
NIGMS NIH HHS R01 GM130668
6 · The paper itself

Abstract

Given still-high levels of coronavirus disease 2019 (COVID-19) susceptibility and inconsistent transmission-containing strategies, outbreaks have continued to emerge across the United States. Until effective vaccines are widely deployed, curbing COVID-19 will require carefully timed nonpharmaceutical interventions (NPIs). A COVID-19 early warning system is vital for this. Here, we evaluate digital data streams as early indicators of state-level COVID-19 activity from 1 March to 30 September 2020. We observe that increases in digital data stream activity anticipate increases in confirmed cases and deaths by 2 to 3 weeks. Confirmed cases and deaths also decrease 2 to 4 weeks after NPI implementation, as measured by anonymized, phone-derived human mobility data. We propose a means of harmonizing these data streams to identify future COVID-19 outbreaks. Our results suggest that combining disparate health and behavioral data may help identify disease activity changes weeks before observation using traditional epidemiological monitoring.

Indexed as

Epidemiological MonitoringCOVID-19Disease OutbreaksHumansProbabilitySARS-CoV-2Time FactorsUnited States

Identifiers

PMID33674304
PMCPMC7935356

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.