Evidence map›Paper›PMID 38287897›Full record

ArticleHospital pediatrics2024

An Algorithm to Assess Guideline Concordance of Antibiotic Choice in Community-Acquired Pneumonia.

Julia K W Yarahuan, Susannah Kisvarday, Eugene Kim, Adam P Yan, Mari M Nakamura, Sarah B Jones, Jonathan D Hron

Abstract read
In one paragraph

Article in Hospital pediatrics, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 5 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
5citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

5 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Artificial intelligence in antimicrobial stewardship: a systematic review and meta-analysis of predictive performance and diagnostic accuracy.European journal of clinical microbiology & infectious diseases : official publication of the European Society of Clinical Microbiology · 2025
    Pooled it
  2. Impact of Clinician Feedback Reports on Antibiotic Use in Children Hospitalized With Community-acquired Pneumonia.Clinical infectious diseases : an official publication of the Infectious Diseases Society of America · 2025
    Article
  3. Article
  4. Article
  5. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Julia K W YarahuanDepartment of Pediatrics, Divisions of aGeneral Pediatrics.
Susannah KisvardayDepartment of Pediatrics, Divisions of aGeneral Pediatrics.
Eugene KimDepartment of Anesthesia.
Adam P YanHematology and Oncology.
Mari M NakamuraInfectious Diseases.
Sarah B JonesAntimicrobial Stewardship Program.
Jonathan D HronDepartment of Pediatrics, Divisions of aGeneral Pediatrics.

Funding

RESEARCH TRAINING-MEDICAL INFORMATICS 90T15LM007092 · NLM · HARVARD UNIVERSITY (SCH OF PUBLIC HLTH) · PI Nils Gehlenborg · 1992 to 2026
$32.8M
NLM NIH HHS T15 LM007092
6 · The paper itself

Abstract

BACKGROUND AND

objectiveThis study aimed to develop and evaluate an algorithm to reduce the chart review burden of improvement efforts by automatically labeling antibiotic selection as either guideline-concordant or -discordant based on electronic health record data for patients with community-acquired pneumonia (CAP).

methodsWe developed a 3-part algorithm using structured and unstructured data to assess adherence to an institutional CAP clinical practice guideline. The algorithm was applied to retrospective data for patients seen with CAP from 2017 to 2019 at a tertiary children's hospital. Performance metrics included positive predictive value (precision), sensitivity (recall), and F1 score (harmonized mean), with macro-weighted averages. Two physician reviewers independently assigned "actual" labels based on manual chart review.

resultsOf 1345 patients with CAP, 893 were included in the training cohort and 452 in the validation cohort. Overall, the model correctly labeled 435 of 452 (96%) patients. Of the 286 patients who met guideline inclusion criteria, 193 (68%) were labeled as having received guideline-concordant antibiotics, 48 (17%) were labeled as likely in a scenario in which deviation from the clinical practice guideline was appropriate, and 45 (16%) were given the final label of "possibly discordant, needs review." The sensitivity was 0.96, the positive predictive value was 0.97, and the F1 was 0.96.

conclusionsAn automated algorithm that uses structured and unstructured electronic health record data can accurately assess the guideline concordance of antibiotic selection for CAP. This tool has the potential to improve the efficiency of improvement efforts by reducing the manual chart review needed for quality measurement.

Indexed as

Community-Acquired InfectionsPneumoniaAnti-Bacterial AgentsChildGuideline AdherenceHumansRetrospective StudiesAnti-Bacterial Agents

Identifiers

PMID38287897
PMCPMC10823186

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.