Evidence map›Paper›PMID 34903654›Full record

ArticleProceedings of the National Academy of Sciences of the United States of America2021

An open repository of real-time COVID-19 indicators.

Alex Reinhart, Logan Brooks, Maria Jahja, Aaron Rumack, Jingjing Tang, Sumit Agrawal, Wael Al Saeed, Taylor Arnold, Amartya Basu, Jacob Bien and 57 more

Erratum issuedAbstract read
In one paragraph

Article in Proceedings of the National Academy of Sciences of the United States of America, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. An erratum has been issued. Cited by 34 papers.

0numbers the graph read from it
0cells of the map it votes in
34citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

34 citing papers in PubMed.

  1. Review
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Review
  9. Article
  10. Predictive Modeling for Pandemic Forecasting: A COVID-19 Study in New Zealand and Partner Countries.International journal of environmental research and public health · 2025
    Article
  11. Graph-Based Prediction of Spatio-Temporal Vaccine Hesitancy From Insurance Claims Data.IEEE access : practical innovations, open solutions · 2025
    Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Review
  19. Smooth multi-period forecasting with application to prediction of COVID-19 cases.Journal of computational and graphical statistics : a joint publication of American Statistical Association, Institute of Mathematical Statistics, Interface Foundation of North America · 2024
    Article
  20. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

67 authors.

Alex ReinhartDepartment of Statistics & Data Science, Carnegie Mellon University, Pittsburgh, PA 15213; areinhar@stat.cmu.edu.ORCID 0000-0002-6658-514X
Logan BrooksMachine Learning Department, Carnegie Mellon University, Pittsburgh, PA 15213.
Maria JahjaDepartment of Statistics & Data Science, Carnegie Mellon University, Pittsburgh, PA 15213.
Aaron RumackMachine Learning Department, Carnegie Mellon University, Pittsburgh, PA 15213.ORCID 0000-0002-9181-1794
Jingjing TangComputational Biology Department, Carnegie Mellon University, Pittsburgh, PA 15213.ORCID 0000-0003-1447-5018
Sumit AgrawalGoogle.org Fellows, Google LLC, Mountain View, CA 94043.
Wael Al SaeedComputer Science Department, Carnegie Mellon University, Pittsburgh, PA 15213.
Taylor ArnoldLinguistics Program, University of Richmond, Richmond, VA 23173.
Amartya BasuInformation Networking Institute, Carnegie Mellon University, Pittsburgh, PA 15213.
Jacob BienDepartment of Data Sciences and Operations, University of Southern California, Los Angeles, CA 90089.
Ángel A CabreraHuman-Computer Interaction Institute, Carnegie Mellon University, Pittsburgh, PA 15213.ORCID 0000-0003-0348-3362
Andrew ChinMachine Learning Department, Carnegie Mellon University, Pittsburgh, PA 15213.
Eu Jing ChuaMachine Learning Department, Carnegie Mellon University, Pittsburgh, PA 15213.
Brian ClarkMachine Learning Department, Carnegie Mellon University, Pittsburgh, PA 15213.
Sarah ColquhounGoogle.org Fellows, Google LLC, Mountain View, CA 94043.
Nat DeFriesMachine Learning Department, Carnegie Mellon University, Pittsburgh, PA 15213.
David C FarrowGoogle.org Fellows, Google LLC, Mountain View, CA 94043.
Jodi ForlizziHuman-Computer Interaction Institute, Carnegie Mellon University, Pittsburgh, PA 15213.
Jed GrabmanGoogle.org Fellows, Google LLC, Mountain View, CA 94043.
Samuel GratzlMachine Learning Department, Carnegie Mellon University, Pittsburgh, PA 15213.
Alden GreenDepartment of Statistics & Data Science, Carnegie Mellon University, Pittsburgh, PA 15213.
George HaffMachine Learning Department, Carnegie Mellon University, Pittsburgh, PA 15213.
Robin HanHuman-Computer Interaction Institute, Carnegie Mellon University, Pittsburgh, PA 15213.
Kate HarwoodGoogle.org Fellows, Google LLC, Mountain View, CA 94043.
Addison J HuDepartment of Statistics & Data Science, Carnegie Mellon University, Pittsburgh, PA 15213.ORCID 0000-0002-9339-7291
Raphael HydeGoogle.org Fellows, Google LLC, Mountain View, CA 94043.
Sangwon HyunDepartment of Data Sciences and Operations, University of Southern California, Los Angeles, CA 90089.
Ananya JoshiComputer Science Department, Carnegie Mellon University, Pittsburgh, PA 15213.
Jimi KimSchool of Natural Sciences and Mathematics, University of Texas at Dallas, Richardson, TX 75080.
Andrew KuznetsovHuman-Computer Interaction Institute, Carnegie Mellon University, Pittsburgh, PA 15213.
Wichada La Motte-KerrMachine Learning Department, Carnegie Mellon University, Pittsburgh, PA 15213.
Yeon Jin LeeCollege of Fine Arts, Carnegie Mellon University, Pittsburgh, PA 15213.
Kenneth LeeDepartment of Statistics, University of California, Davis, CA 95616.
Zachary C LiptonMachine Learning Department, Carnegie Mellon University, Pittsburgh, PA 15213.
Michael X LiuHuman-Computer Interaction Institute, Carnegie Mellon University, Pittsburgh, PA 15213.
Lester MackeyMicrosoft Research New England, Cambridge, MA 02142.
Kathryn MazaitisMachine Learning Department, Carnegie Mellon University, Pittsburgh, PA 15213.
Daniel J McDonaldDepartment of Statistics, University of British Columbia, Vancouver, BC V6T 1Z4, Canada.ORCID 0000-0002-0443-4282
Phillip McGuinnessGoogle.org Fellows, Google LLC, Mountain View, CA 94043.ORCID 0000-0002-9510-2370
Balasubramanian NarasimhanDepartment of Statistics, Stanford University, Stanford, CA 94305.
Michael P O'BrienGoogle.org Fellows, Google LLC, Mountain View, CA 94043.ORCID 0000-0002-5942-791X
Natalia L OliveiraDepartment of Statistics & Data Science, Carnegie Mellon University, Pittsburgh, PA 15213.ORCID 0000-0003-1410-0371
Pratik PatilDepartment of Statistics & Data Science, Carnegie Mellon University, Pittsburgh, PA 15213.
Adam PererHuman-Computer Interaction Institute, Carnegie Mellon University, Pittsburgh, PA 15213.ORCID 0000-0002-8369-3847
Collin A PolitschMachine Learning Department, Carnegie Mellon University, Pittsburgh, PA 15213.ORCID 0000-0003-3727-9167
Samyak RajanalaDepartment of Statistics, Stanford University, Stanford, CA 94305.ORCID 0000-0002-5791-3789
Dawn RuckerComputer Science Department, Carnegie Mellon University, Pittsburgh, PA 15213.
Chris ScottGoogle.org Fellows, Google LLC, Mountain View, CA 94043.
Nigam H ShahDepartment of Medicine, Stanford University, Stanford, CA 94305.
Vishnu ShankarProgram in Immunology, Stanford University School of Medicine, Stanford, CA 94305.
James SharpnackDepartment of Statistics, University of California, Davis, CA 95616.
Dmitry ShemetovMachine Learning Department, Carnegie Mellon University, Pittsburgh, PA 15213.
Noah SimonDepartment of Biostatistics, University of Washington, Seattle, WA 98195.
Benjamin Y SmithGoogle.org Fellows, Google LLC, Mountain View, CA 94043.
Vishakha SrivastavaMachine Learning Department, Carnegie Mellon University, Pittsburgh, PA 15213.
Shuyi TanDepartment of Statistics, University of British Columbia, Vancouver, BC V6T 1Z4, Canada.
Robert TibshiraniDepartment of Statistics, Stanford University, Stanford, CA 94305.
Elena TuzhilinaDepartment of Statistics, Stanford University, Stanford, CA 94305.
Ana Karina Van NortwickMachine Learning Department, Carnegie Mellon University, Pittsburgh, PA 15213.
Valérie VenturaDepartment of Statistics & Data Science, Carnegie Mellon University, Pittsburgh, PA 15213.
Larry WassermanDepartment of Statistics & Data Science, Carnegie Mellon University, Pittsburgh, PA 15213.
Benjamin WeaverGoogle.org Fellows, Google LLC, Mountain View, CA 94043.
Jeremy C WeissHeinz College of Information Systems and Public Policy, Carnegie Mellon University, Pittsburgh, PA 15213.
Spencer WhitmanGoogle.org Fellows, Google LLC, Mountain View, CA 94043.
Kristin WilliamsHuman-Computer Interaction Institute, Carnegie Mellon University, Pittsburgh, PA 15213.ORCID 0000-0002-6469-1969
Roni RosenfeldMachine Learning Department, Carnegie Mellon University, Pittsburgh, PA 15213.ORCID 0000-0002-3274-5862
Ryan J TibshiraniDepartment of Statistics & Data Science, Carnegie Mellon University, Pittsburgh, PA 15213.ORCID 0000-0002-2158-8304

Funding

Delphi Influenza Forecasting Center of ExcellenceU01IP001121 · IP · CARNEGIE-MELLON UNIVERSITY · PI ROSENFELD, RONALD · 2019 to 2023
$4.8M
ACL HHS U01IP001121NCIRD CDC HHS U01 IP001121
6 · The paper itself

Abstract

The COVID-19 pandemic presented enormous data challenges in the United States. Policy makers, epidemiological modelers, and health researchers all require up-to-date data on the pandemic and relevant public behavior, ideally at fine spatial and temporal resolution. The COVIDcast API is our attempt to fill this need: Operational since April 2020, it provides open access to both traditional public health surveillance signals (cases, deaths, and hospitalizations) and many auxiliary indicators of COVID-19 activity, such as signals extracted from deidentified medical claims data, massive online surveys, cell phone mobility data, and internet search trends. These are available at a fine geographic resolution (mostly at the county level) and are updated daily. The COVIDcast API also tracks all revisions to historical data, allowing modelers to account for the frequent revisions and backfill that are common for many public health data sources. All of the data are available in a common format through the API and accompanying R and Python software packages. This paper describes the data sources and signals, and provides examples demonstrating that the auxiliary signals in the COVIDcast API present information relevant to tracking COVID activity, augmenting traditional public health reporting and empowering research and decision-making.

Indexed as

Databases, FactualHealth Status IndicatorsAmbulatory CareCOVID-19Epidemiologic MethodsHumansInternetPhysical DistancingSurveys and QuestionnairesTravelUnited Statesdigital surveillanceinternet surveysmedical insurance claimsopen data

Identifiers

PMID34903654
PMCPMC8713778

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.