Evidence map›Paper›PMID 37490532›Full record

ArticleProceedings of the National Academy of Sciences of the United States of America2023

Separating signal from noise in wastewater data: An algorithm to identify community-level COVID-19 surges in real time.

Aparna Keshaviah, Ian Huff, Xindi C Hu, Virginia Guidry, Ariel Christensen, Steven Berkowitz, Stacie Reckling, Rachel T Noble, Thomas Clerkin, Denene Blackwood and 3 more

Abstract read
In one paragraph

Article in Proceedings of the National Academy of Sciences of the United States of America, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 11 papers.

0numbers the graph read from it
0cells of the map it votes in
11citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

11 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

13 authors.

Aparna KeshaviahMathematica, Inc., Princeton, NJ 08543.ORCID 0000-0002-4324-6807
Ian HuffMathematica, Inc., Princeton, NJ 08543.
Xindi C HuMathematica, Inc., Princeton, NJ 08543.ORCID 0000-0002-4299-3931
Virginia GuidryNorth Carolina Department of Health and Human Services, Division of Public Health, Raleigh, NC 27609.
Ariel ChristensenNorth Carolina Department of Health and Human Services, Division of Public Health, Raleigh, NC 27609.
Steven BerkowitzNorth Carolina Department of Health and Human Services, Division of Public Health, Raleigh, NC 27609.
Stacie RecklingNorth Carolina Department of Health and Human Services, Division of Public Health, Raleigh, NC 27609.ORCID 0009-0008-7809-9422
Rachel T NobleInstitute of Marine Sciences, University of North Carolina-Chapel Hill, Morehead City, NC 28557.
Thomas ClerkinInstitute of Marine Sciences, University of North Carolina-Chapel Hill, Morehead City, NC 28557.
Denene BlackwoodInstitute of Marine Sciences, University of North Carolina-Chapel Hill, Morehead City, NC 28557.
Sandra L McLellanSchool of Freshwater Sciences, University of Wisconsin-Milwaukee, Milwaukee, WI 53204.
Adélaïde RoguetSchool of Freshwater Sciences, University of Wisconsin-Milwaukee, Milwaukee, WI 53204.ORCID 0000-0003-3688-4525
Isabel MusseMathematica, Inc., Princeton, NJ 08543.ORCID 0000-0003-4755-2366

Funding

Improved scalability, sensitivity, and interpretability of pathogen detection, including SARS-CoV-2, in wastewater using high-throughput, highly multiplexed digital array PCR technologyU01DA053899 · NIDA · UNIV OF NORTH CAROLINA CHAPEL HILL · PI NOBLE, RACHEL TODD · 2021 to 2022
$1.7M
NIDA NIH HHS U01 DA053899
6 · The paper itself

Abstract

Wastewater monitoring has provided health officials with early warnings for new COVID-19 outbreaks, but to date, no approach has been validated to distinguish signal (sustained surges) from noise (background variability) in wastewater data to alert officials to the need for heightened public health response. We analyzed 62 wk of data from 19 sites participating in the North Carolina Wastewater Monitoring Network to characterize wastewater metrics around the Delta and Omicron surges. We found that wastewater data identified outbreaks 4 to 5 d before case data (reported on the earlier of the symptom start date or test collection date), on average. At most sites, correlations between wastewater and case data were similar regardless of how wastewater concentrations were normalized and whether calculated with county-level or sewershed-level cases, suggesting that officials may not need to geospatially align case data with sewershed boundaries to gain insights into disease transmission. Although wastewater trend lines captured clear differences in the Delta versus Omicron surge trajectories, no single wastewater metric (detectability, percent change, or flow-population normalized viral concentrations) reliably signaled when these surges started. After iteratively examining different combinations of these three metrics, we developed the Covid-SURGE (Signaling Unprecedented Rises in Groupwide Exposure) algorithm, which identifies unprecedented signals in the wastewater data. With a true positive rate of 82%, a false positive rate of 7%, and strong performance during both surges and in small and large sites, our algorithm provides public health officials with an automated way to flag community-level COVID-19 surges in real time.

Indexed as

COVID-19AlgorithmsBenchmarkingDisease OutbreaksHumansRNA, ViralWastewaterRNA, ViralWastewateralert algorithmCOVID-19 surgeearly warningSARS-CoV-2wastewater monitoring

Identifiers

PMID37490532
PMCPMC10401018

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.