Evidence map›Paper›PMID 35504534›Full record

ArticleJournal of hospital medicine2022

Derivation of a natural language processing algorithm to identify febrile infants.

Jeffrey P Yaeger, Jiahao Lu, Jeremiah Jones, Ashkan Ertefaie, Kevin Fiscella, Daniel Gildea

Abstract read
In one paragraph

Article in Journal of hospital medicine, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 6 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
6citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

6 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Using natural language processing in emergency medicine health service research: A systematic review and meta-analysis.Academic emergency medicine : official journal of the Society for Academic Emergency Medicine · 2024
    Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Jeffrey P YaegerDepartment of Pediatrics, University of Rochester Medical Center, Rochester, New York, USA.ORCID 0000-0001-6206-6222
Jiahao LuDepartment of Pediatrics, University of Rochester Medical Center, Rochester, New York, USA.
Jeremiah JonesDepartment of Biostatistics and Computational Biology, University of Rochester Medical Center, Rochester, New York, USA.
Ashkan ErtefaieDepartment of Biostatistics and Computational Biology, University of Rochester Medical Center, Rochester, New York, USA.
Kevin FiscellaDepartment of Family Medicine, University of Rochester Medical Center, Rochester, New York, USA.
Daniel GildeaDepartment of Computer Science, University of Rochester, Rochester, New York, USA.

Funding

Institutional Career Development CoreKL2TR001999 · NCATS · UNIVERSITY OF ROCHESTER · PI XIAO, JIN · 2016 to 2024
$5.2M
NCATS NIH HHS KL2 TR001999
6 · The paper itself

Abstract

backgroundDiagnostic codes can retrospectively identify samples of febrile infants, but sensitivity is low, resulting in many febrile infants eluding detection. To ensure study samples are representative, an improved approach is needed.

objectiveTo derive and internally validate a natural language processing algorithm to identify febrile infants and compare its performance to diagnostic codes.

methodsThis cross-sectional study consisted of infants aged 0-90 days brought to one pediatric emergency department from January 2016 to December 2017. We aimed to identify infants with fever, defined as a documented temperature ≥38°C. We used 2017 clinical notes to develop two rule-based algorithms to identify infants with fever and tested them on data from 2016. Using manual abstraction as the gold standard, we compared performance of the two rule-based algorithms (Models 1, 2) to four previously published diagnostic code groups (Models 5-8) using area under the receiver-operating characteristics curve (AUC), sensitivity, and specificity.

resultsFor the test set (n = 1190 infants), 184 infants were febrile (15.5%). The AUCs (0.92-0.95) and sensitivities (86%-92%) of Models 1 and 2 were significantly greater than Models 5-8 (0.67-0.74; 20%-74%) with similar specificities (93%-99%). In contrast to Models 5-8, samples from Models 1 and 2 demonstrated similar characteristics to the gold standard, including fever prevalence, median age, and rates of bacterial infections, hospitalizations, and severe outcomes.

conclusionsFindings suggest rule-based algorithms can accurately identify febrile infants with greater sensitivity while preserving specificity compared to diagnostic codes. If externally validated, rule-based algorithms may be important tools to create representative study samples, thereby improving generalizability of findings.

Indexed as

FeverNatural Language ProcessingAlgorithmsChildCross-Sectional StudiesHumansInfantRetrospective Studies

Identifiers

PMID35504534
PMCPMC13067292

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.