Evidence map›Paper›PMID 39392375›Full record

ArticleCritical care explorations2024

Development and Validation of a Machine Learning Model for Early Detection of Untreated Infection.

Kevin G Buell, Kyle A Carey, Nicole Dussault, William F Parker, Jay Dumanian, Sivasubramanium V Bhavani, Emily R Gilbert, Christopher J Winslow, Nirav S Shah, Majid Afshar and 2 more

Abstract readValidation Study
In one paragraph

Article in Critical care explorations, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

12 authors.

Kevin G BuellDepartment of Medicine, University of Chicago Medical Center, Chicago, IL.ORCID 0000-0001-5718-3328
Kyle A CareyDepartment of Medicine, University of Chicago Medical Center, Chicago, IL.
Nicole DussaultDepartment of Medicine, Duke University, Raleigh-Durham, NC.
William F ParkerDepartment of Medicine, University of Chicago Medical Center, Chicago, IL.
Jay DumanianDepartment of Medicine, Duke University, Raleigh-Durham, NC.
Sivasubramanium V BhavaniDepartment of Medicine, Emory University, Atlanta, GA.
Emily R GilbertDepartment of Medicine, Loyola University, Chicago, IL.
Christopher J WinslowDepartment of Medicine, Endeavor Health, Evanston, IL.
Nirav S ShahDepartment of Medicine, University of Chicago Medical Center, Chicago, IL.
Majid AfsharDepartment of Medicine, University of Wisconsin-Madison, Madison, WI.
Dana P EdelsonDepartment of Medicine, University of Chicago Medical Center, Chicago, IL.
Matthew M ChurpekDepartment of Medicine, University of Wisconsin-Madison, Madison, WI.

Funding

RESEARCH TRAINING IN RESPIRATORY BIOLOGYT32HL007605 · NHLBI · UNIVERSITY OF CHICAGO · PI Yun Fang, Gokhan M. Mutlu · 1985 to 2026
$18.1M
Improving the efficiency and equity of critical care allocation during a crisis with place-based disadvantage indicesR01LM014263 · NLM · UNIVERSITY OF CHICAGO · PI William F Parker · 2023 to 2026
$2.0M
Sepsis Early Prediction and Subphenotype Illumination Study (SEPSIS)R35GM145330 · NIGMS · UNIVERSITY OF WISCONSIN-MADISON · PI Matthew Michael Churpek · 2022 to 2026
$1.9M
Identification of Precision Sepsis Subphenotypes Using Vital Sign TrajectoriesK23GM144867 · NIGMS · EMORY UNIVERSITY · PI BHAVANI, SIVASUBRAMANIUM · 2021 to 2025
$890k
Mending a Broken Heart Allocation System with Machine LearningK08HL150291 · NHLBI · UNIVERSITY OF CHICAGO · PI PARKER, WILLIAM F · 2020 to 2024
$713k
NHLBI NIH HHS K08 HL150291NHLBI NIH HHS T32 HL007605NIGMS NIH HHS K23 GM144867NIGMS NIH HHS R35 GM145330NLM NIH HHS R01 LM014263
6 · The paper itself

Abstract

backgroundEarly diagnostic uncertainty for infection causes delays in antibiotic administration in infected patients and unnecessary antibiotic administration in noninfected patients.

objectiveTo develop a machine learning model for the early detection of untreated infection (eDENTIFI), with the presence of infection determined by clinician chart review. DERIVATION COHORT: Three thousand three hundred fifty-seven adult patients hospitalized between 2006 and 2018 at two health systems in Illinois, United States. VALIDATION COHORT: We validated in 1632 patients in a third Illinois health system using area under the receiver operating characteristic curve (AUC). PREDICTION MODEL: Using a longitudinal discrete-time format, we trained a gradient boosted machine model to predict untreated infection in the next 6 hours using routinely available patient demographics, vital signs, and laboratory results.

resultseDENTIFI had an AUC of 0.80 (95% CI, 0.79-0.81) in the validation cohort and outperformed the systemic inflammatory response syndrome criteria with an AUC of 0.64 (95% CI, 0.64-0.65; p < 0.001). The most important features were body mass index, age, temperature, and heart rate. Using a threshold with a 47.6% sensitivity, eDENTIFI detected infection a median 2.0 hours (interquartile range, 0.9-5.2 hr) before antimicrobial administration, with a negative predictive value of 93.6%. Antibiotic administration guided by eDENTIFI could have decreased unnecessary IV antibiotic administration in noninfected patients by 10.8% absolute or 46.4% relative percentage points compared with clinicians.

conclusioneDENTIFI could both decrease the time to antimicrobial administration in infected patients and unnecessary antibiotic administration in noninfected patients. Further prospective validation is needed.

Indexed as

Early DiagnosisMachine LearningAdultAgedAnti-Bacterial AgentsArea Under CurveCohort StudiesFemaleHumansIllinoisInfectionsMaleMiddle AgedROC CurveAnti-Bacterial Agents

Identifiers

PMID39392375
PMCPMC11473064

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.