Evidence map›Paper›PMID 41572724›Full record

ArticleInfection control and hospital epidemiology2026

Leveraging a large language model to support expansion of surveillance activities to include cardiovascular implantable device infections in a large, integrated national healthcare system.

Dipandita Basnet, Hillary J Mull, Daniel J Morgan, Samuel W Golenbock, Rebecca P Lamkin, Judith M Strymish, Kimberly Harvey, Kaeli Yuen, Marin L Schweizer, Dimitri Drekonja and 2 more

Registry-linked trialAbstract read
In one paragraph

Article in Infection control and hospital epidemiology, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT05020418 (Promoting De-Implementation of Inappropriate Antimicrobial Use in Cardiac Device Procedures By Expanding Audit and Feedback), which is not on this map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT05020418 nacompletednot on this map

Promoting De-Implementation of Inappropriate Antimicrobial Use in Cardiac Device Procedures By Expanding Audit and Feedback

TypeinterventionalSponsorVA Office of Research and DevelopmentRan2023 to 2025Enrolled5,469ConditionsAntibiotics Causing Adverse Effects in Therapeutic UseArmsChart Review
3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

12 authors.

Dipandita BasnetCenter for Health Optimization and Implementation Research (CHOIR), VA Boston Healthcare System, Boston, MA, USA.ORCID https://orcid.org/0009-0002-9222-2710
Hillary J MullCenter for Health Optimization and Implementation Research (CHOIR), VA Boston Healthcare System, Boston, MA, USA.ORCID https://orcid.org/0000-0002-4484-0445
Daniel J MorganVA Maryland Healthcare System, Baltimore, MD, USA.
Samuel W GolenbockCenter for Health Optimization and Implementation Research (CHOIR), VA Boston Healthcare System, Boston, MA, USA.ORCID https://orcid.org/0000-0001-7270-3643
Rebecca P LamkinCenter for Health Optimization and Implementation Research (CHOIR), VA Boston Healthcare System, Boston, MA, USA.
Judith M StrymishSection of Infectious Disease, VA Boston Healthcare System, Boston, MA, USA.ORCID https://orcid.org/0000-0002-3711-0639
Kimberly HarveyCenter for Health Optimization and Implementation Research (CHOIR), VA Boston Healthcare System, Boston, MA, USA.
Kaeli YuenDepartment of Veterans Affairs, Office of the Chief AI Officer, Washington, DC, USA.
Marin L SchweizerWilliam S. Middleton VA Hospital, Madison, WI, USA.ORCID https://orcid.org/0000-0002-3604-0093
Dimitri DrekonjaSection of Infectious Diseases, Minneapolis VA Healthcare System, MN, USA.
Maria C Rodriguez-BarradasSection of Infectious Diseases, Michael E. DeBakey VA Medical Center, Houston, TX, USA.ORCID https://orcid.org/0000-0003-2446-2667
Westyn Branch-EllimanSection of Infectious Diseases, VA Greater Los Angeles Healthcare Systemhttps://ror.org/05xcarb80, Los Angeles, CA, USA.ORCID https://orcid.org/0000-0002-9658-5124

Funding

HSRD VA I01 HX003234
6 · The paper itself

Abstract

backgroundSurveillance activities are emerging as exemplar use cases for large language models (LLMs) in health care. The aim of this study was to evaluate the potential for LLMs to support the expansion of surveillance activities to include cardiovascular implantable electronic device (CIED) procedures.

methodsA validated machine learning-based infection flagging tool was applied to a cohort of VA CIED procedures from 7/1/2021 to 9/30/2023; cases with ≥10% probability of CIED infection underwent manual review. Then, a weighted random sample of 50 infected and 50 uninfected cases was reviewed with generative artificial intelligence (GenAI) assistance. GenAI prompts were iteratively refined to extract and classify all components of infection-related variables from clinical notes. Data extracted by GenAI were compared with manual chart reviews to assess infection status and extraction consistency.

resultsAmong 12,927 CIED procedures, 334 (2.58%) had ≥10% probability of CIED infection. Among 100 sampled cases, 50 of 50 uninfected cases were correctly categorized. Among 50 infection cases, GenAI identified all CIED infections, but the timing of events and the attribution to a preceding procedure were incorrect in 7 of 50 cases. The overall specificity of the GenAI-assisted process was 100% and the sensitivity for accurately classifying timing and attribution of CIED infection events was 82%. Errors in timing improved with iterative prompt updates. Manual chart reviews averaged 25 minutes per chart; the GenAI-assisted process averaged 5-7 minutes per chart.

conclusionsLLMs can help streamline the review process for healthcare-associated infection surveillance, but manual adjudication of output is needed to ensure the correct timeline of events and attribution.

Identifiers

PMID41572724
PMCPMC13216803

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.