Evidence map›Paper›PMID 29668648›Full record

ArticleMedical care2018

In Data We Trust? Comparison of Electronic Versus Manual Abstraction of Antimicrobial Prescribing Quality Metrics for Hospitalized Veterans With Pneumonia.

Barbara E Jones, Candace Haroldsen, Karl Madaras-Kelly, Matthew B Goetz, Jian Ying, Brian Sauer, Makoto M Jones, Molly Leecaster, Tom Greene, Scott K Fridkin and 2 more

Abstract readComparative Study
In one paragraph

Article in Medical care, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 9 papers.

0numbers the graph read from it
0cells of the map it votes in
9citing papers in PubMed
1.3field-weighted citation impact, top 20% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

9 citing papers in PubMed, 13 citations in OpenAlex.

  1. Article
  2. Ultra-Short-Course Antibiotics for Suspected Pneumonia With Preserved Oxygenation.Clinical infectious diseases : an official publication of the Infectious Diseases Society of America · 2023
    Article
  3. Comparison of electronic versus manual abstraction for 2 standardized perinatal care measures.Journal of the American Medical Informatics Association : JAMIA · 2022
    Article
  4. Review
  5. Article
  6. Article
  7. Review
  8. Article
  9. Antimicrobials in acute and long-term care: a point in time along the way to improved use.Euro surveillance : bulletin Europeen sur les maladies transmissibles = European communicable disease bulletin · 2018
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

12 authors at 6 institutions in 1 country.

Barbara E JonesInformatics, Decision-Enhancement, and Analytic Sciences (IDEAS 2.0) Center of Innovation, VA SLC Health System.
Candace HaroldsenInformatics, Decision-Enhancement, and Analytic Sciences (IDEAS 2.0) Center of Innovation, VA SLC Health System.
Karl Madaras-KellyBoise VA Medical Center and Idaho State University College of Pharmacy, Pocatello, ID.
Matthew B GoetzVA Greater Los Angeles Healthcare System and David Geffen School of Medicine at UCLA, Los Angeles, CA.
Jian YingDivision of Epidemiology, University of Utah, Salt Lake City, UT.
Brian SauerInformatics, Decision-Enhancement, and Analytic Sciences (IDEAS 2.0) Center of Innovation, VA SLC Health System.
Makoto M JonesInformatics, Decision-Enhancement, and Analytic Sciences (IDEAS 2.0) Center of Innovation, VA SLC Health System.
Molly LeecasterInformatics, Decision-Enhancement, and Analytic Sciences (IDEAS 2.0) Center of Innovation, VA SLC Health System.
Tom GreeneInformatics, Decision-Enhancement, and Analytic Sciences (IDEAS 2.0) Center of Innovation, VA SLC Health System.
Scott K FridkinEmory University School of Medicine, Department of Medicine, Atlanta, GA.
Melinda M NeuhauserDepartment of Veterans Affairs, VA Center for Medication Safety (MedSAFE), Pharmacy Benefits Management Services, Hines, IL.
Matthew H SamoreInformatics, Decision-Enhancement, and Analytic Sciences (IDEAS 2.0) Center of Innovation, VA SLC Health System.
University of Utah · USEmory University · USIdaho State University · USMedication Management (United States) · USPulmonary and Critical Care Associates · USVA Greater Los Angeles Healthcare System · US

Funding

Informatics, Decision-Enhancement and Analytic Sciences CenterI50HX001240 · VA · VA SALT LAKE CITY HEALTHCARE SYSTEM · PI SAMORE, MATTHEW H · 2015 to 2015
–
Actionable Knowledge to Guide Antibiotic StewardshipIK2HX001165 · VA · VA SALT LAKE CITY HEALTHCARE SYSTEM · PI JONES, MAKOTO · 2015 to 2020
–
HSRD VA I50 HX001240HSRD VA IK2 HX001165HSRD VA IK2 HX001908
6 · The paper itself

Abstract

backgroundElectronic health records provide the opportunity to assess system-wide quality measures. Veterans Affairs Pharmacy Benefits Management Center for Medication Safety uses medication use evaluation (MUE) through manual review of the electronic health records.

objectiveTo compare an electronic MUE approach versus human/manual review for extraction of antibiotic use (choice and duration) and severity metrics. RESEARCH

designRetrospective. SUBJECTS: Hospitalizations for uncomplicated pneumonia occurring during 2013 at 30 Veterans Affairs facilities. MEASURES: We compared summary statistics, individual hospitalization-level agreement, facility-level consistency, and patterns of variation between electronic and manual MUE for initial severity, antibiotic choice, daily clinical stability, and antibiotic duration.

resultsAmong 2004 hospitalizations, electronic and manual abstraction methods showed high individual hospitalization-level agreement for initial severity measures (agreement=86%-98%, κ=0.5-0.82), antibiotic choice (agreement=89%-100%, κ=0.70-0.94), and facility-level consistency for empiric antibiotic choice (anti-MRSA r=0.97, P<0.001; antipseudomonal r=0.95, P<0.001) and therapy duration (r=0.77, P<0.001) but lower facility-level consistency for days to clinical stability (r=0.52, P=0.006) or excessive duration of therapy (r=0.55, P=0.005). Both methods identified widespread facility-level variation in antibiotic choice, but we found additional variation in manual estimation of excessive antibiotic duration and initial illness severity.

conclusionsElectronic and manual MUE agreed well for illness severity, antibiotic choice, and duration of therapy in pneumonia at both the individual and facility levels. Manual MUE showed additional reviewer-level variation in estimation of initial illness severity and excessive antibiotic use. Electronic MUE allows for reliable, scalable tracking of national patterns of antimicrobial use, enabling the examination of system-wide interventions to improve quality.

Indexed as

Practice Patterns, Physicians'Anti-Infective AgentsAntimicrobial StewardshipElectronic Health RecordsFemaleGuideline AdherenceHospitals, VeteransHumansMalePneumoniaQuality of Health CareRetrospective StudiesSeverity of Illness IndexTime FactorsUnited StatesVeteransAnti-Infective Agents

Identifiers

PMID29668648
PMCPMC6002916
OpenAlexW2801011459

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.