Evidence map›Paper›PMID 38573752›Full record

ArticleJournal of medical Internet research2024

Moving Biosurveillance Beyond Coded Data Using AI for Symptom Detection From Physician Notes: Retrospective Cohort Study.

Andrew J McMurry, Amy R Zipursky, Alon Geva, Karen L Olson, James R Jones, Vladimir Ignatov, Timothy A Miller, Kenneth D Mandl

Abstract read
In one paragraph

Article in Journal of medical Internet research, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 11 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
11citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

11 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Observational
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Cumulus: A federated EHR-based learning system powered by FHIR and AI.medRxiv : the preprint server for health sciences · 2024
    Article
  11. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Andrew J McMurryComputational Health Informatics Program, Boston Children's Hospital, Boston, MA, United States.ORCID 0000-0001-5604-0704
Amy R ZipurskyComputational Health Informatics Program, Boston Children's Hospital, Boston, MA, United States.ORCID 0000-0002-3003-2818
Alon GevaComputational Health Informatics Program, Boston Children's Hospital, Boston, MA, United States.ORCID 0000-0002-8574-0133
Karen L OlsonComputational Health Informatics Program, Boston Children's Hospital, Boston, MA, United States.ORCID 0000-0002-5124-6129
James R JonesComputational Health Informatics Program, Boston Children's Hospital, Boston, MA, United States.ORCID 0009-0001-2940-3634
Vladimir IgnatovComputational Health Informatics Program, Boston Children's Hospital, Boston, MA, United States.ORCID 0009-0009-5743-1825
Timothy A MillerComputational Health Informatics Program, Boston Children's Hospital, Boston, MA, United States.ORCID 0000-0003-4513-403X
Kenneth D MandlComputational Health Informatics Program, Boston Children's Hospital, Boston, MA, United States.ORCID 0000-0002-9781-0477

Funding

Instrumenting the Delivery System for a Genomics Research Information CommonsU01TR002623 · NCATS · BOSTON CHILDREN'S HOSPITAL · PI MANDL, KENNETH D. · 2019 to 2024
$8.6M
RESEARCH TRAINING IN PEDIATRIC EMERGENCY MEDICINET32HD040128 · NICHD · CHILDREN'S HOSPITAL BOSTON · PI Kenneth D. Mandl · 2001 to 2026
$5.0M
NCATS NIH HHS U01 TR002623NICHD NIH HHS T32 HD040128
6 · The paper itself

Abstract

backgroundReal-time surveillance of emerging infectious diseases necessitates a dynamically evolving, computable case definition, which frequently incorporates symptom-related criteria. For symptom detection, both population health monitoring platforms and research initiatives primarily depend on structured data extracted from electronic health records.

objectiveThis study sought to validate and test an artificial intelligence (AI)-based natural language processing (NLP) pipeline for detecting COVID-19 symptoms from physician notes in pediatric patients. We specifically study patients presenting to the emergency department (ED) who can be sentinel cases in an outbreak.

methodsSubjects in this retrospective cohort study are patients who are 21 years of age and younger, who presented to a pediatric ED at a large academic children's hospital between March 1, 2020, and May 31, 2022. The ED notes for all patients were processed with an NLP pipeline tuned to detect the mention of 11 COVID-19 symptoms based on Centers for Disease Control and Prevention (CDC) criteria. For a gold standard, 3 subject matter experts labeled 226 ED notes and had strong agreement (F

resultsThere were 85,678 ED encounters during the study period, including 4% (n=3420) with patients with COVID-19. NLP was more accurate at identifying encounters with patients that had any of the COVID-19 symptoms (F

conclusionsThis study establishes the value of AI-based NLP as a highly effective tool for real-time COVID-19 symptom detection in pediatric patients, outperforming traditional ICD-10 methods. It also reveals the evolving nature of symptom prevalence across different virus variants, underscoring the need for dynamic, technology-driven approaches in infectious disease surveillance.

Indexed as

BiosurveillanceCOVID-19PhysiciansSARS-CoV-2Artificial IntelligenceChildHumansRetrospective StudiesUnited StatesadolescentadolescentsAIartificial intelligencechildchildrenclinical noteclinical notesCOVID-19detectdetectiondiagnosediagnosisdiagnosticdiagnosticsdocumentationemergencyinfectiousnatural language processingpaediatricpaediatricspediatricpediatricspipelinepipelinespublic health, biosurveillancepulmonaryrespiratorySARS-CoV-2surveillancesymptomsymptomsteenteenagerteenagersteensurgentyouth

Identifiers

PMID38573752
PMCPMC11027052

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.