Evidence map›Paper›PMID 32000780›Full record

ArticleBMC medical informatics and decision making2020

Novel methodology to measure pre-procedure antimicrobial prophylaxis: integrating text searches with structured data from the Veterans Health Administration's electronic medical record.

Hillary J Mull, Kelly Stolzmann, Emily Kalver, Marlena H Shin, Marin L Schweizer, Archana Asundi, Payal Mehta, Maggie Stanislawski, Westyn Branch-Elliman

Open access · goldAbstract read
In one paragraph

Article in BMC medical informatics and decision making, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
1.1field-weighted citation impact, top 26% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed, 10 citations in OpenAlex.

  1. Trial
  2. Article
  3. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors at 4 institutions in 1 country.

Hillary J MullVA Boston Healthcare System, Center for Healthcare Organization and Implementation Research (CHOIR), 150 S. Huntington Ave, Boston, MA, 02130, USA. Hillary.mull@va.gov.ORCID 0000-0002-4484-0445
Kelly StolzmannVA Boston Healthcare System, Center for Healthcare Organization and Implementation Research (CHOIR), 150 S. Huntington Ave, Boston, MA, 02130, USA.
Emily KalverVA Boston Healthcare System, Center for Healthcare Organization and Implementation Research (CHOIR), 150 S. Huntington Ave, Boston, MA, 02130, USA.
Marlena H ShinVA Boston Healthcare System, Center for Healthcare Organization and Implementation Research (CHOIR), 150 S. Huntington Ave, Boston, MA, 02130, USA.
Marin L SchweizerCenter for Access and Delivery Research and Evaluation (CADRE), Iowa City VA Health Care System, Iowa City, Iowa, USA.
Archana AsundiDepartment of Medicine, Boston University School of Medicine, Boston, MA, USA.
Payal MehtaVA Boston Healthcare System, Department of Medicine, Sections of Infectious Diseases and Cardiology, Boston, MA, USA.
Maggie StanislawskiSeattle-Denver Center of Innovation for Veteran-Centered and Value-Driven Care, Seattle, Washington and Denver, Colorado, USA.
Westyn Branch-EllimanVA Boston Healthcare System, Center for Healthcare Organization and Implementation Research (CHOIR), 150 S. Huntington Ave, Boston, MA, 02130, USA.
Boston University · USVA Boston Healthcare System · USCenter for Innovation · USUniversity of Iowa · US

Funding

K12 Cardiopulmonary Implementation Science Scholars ProgramK12HL138049 · NHLBI · UNIV OF MASSACHUSETTS MED SCH WORCESTER · PI LEMON, STEPHENIE C., LINDENAUER, PETER KYLE · 2017 to 2021
$2.7M
Validation of a Semi-Automated Infection Surveillance Algorithm for Electrophysiology ProceduresI21HX002710 · VA · VA BOSTON HEALTH CARE SYSTEM · PI BRANCH-ELLIMAN, WESTYN · 2019 to 2019
–
HSRD VA I21 HX002710NHLBI NIH HHS K12 HL138049
6 · The paper itself

Abstract

backgroundAntimicrobial prophylaxis is an evidence-proven strategy for reducing procedure-related infections; however, measuring this key quality metric typically requires manual review, due to the way antimicrobial prophylaxis is documented in the electronic medical record (EMR). Our objective was to electronically measure compliance with antimicrobial prophylaxis using both structured and unstructured data from the Veterans Health Administration (VA) EMR. We developed this methodology for cardiac device implantation procedures.

methodsWith clinician input and review of clinical guidelines, we developed a list of antimicrobial names recommended for the prevention of cardiac device infection. We trained the algorithm using existing fiscal year (FY) 2008-15 data from the VA Clinical Assessment Reporting and Tracking-Electrophysiology (CART-EP), which contains manually determined information about antimicrobial prophylaxis. We merged CART-EP data with EMR data and programmed statistical software to flag an antimicrobial orders or drug fills from structured data fields in the EMR and hits on text string searches of antimicrobial names documented in clinician's notes. We iteratively tested combinations of these data elements to optimize an algorithm to accurately classify antimicrobial use. The final algorithm was validated in a national cohort of VA cardiac device procedures from FY2016-2017. Discordant cases underwent expert manual review to identify reasons for algorithm misclassification.

resultsThe CART-EP dataset included 2102 procedures at 38 VA facilities with manually identified antimicrobial prophylaxis in 2056 cases (97.8%). The final algorithm combining structured EMR fields and text note search results correctly classified 2048 of the CART-EP cases (97.4%). In the validation sample, the algorithm measured compliance with antimicrobial prophylaxis in 16,606 of 18,903 cardiac device procedures (87.8%). Misclassification was due to EMR documentation issues, such as antimicrobial prophylaxis documented only in hand-written clinician notes in a format that cannot be electronically searched.

conclusionsWe developed a methodology with high accuracy to measure guideline concordant use of antimicrobial prophylaxis before cardiac device procedures using data fields present in modern EMRs. This method can replace manual review in quality measurement in the VA and other healthcare systems with EMRs; further, this method could be adapted to measure compliance in other procedural areas where antimicrobial prophylaxis is recommended.

Indexed as

Electronic Health RecordsAlgorithmsAntibiotic ProphylaxisAnti-Infective AgentsCohort StudiesData CollectionDocumentationHumansUnited StatesUnited States Department of Veterans AffairsVeterans Health ServicesAnti-Infective AgentsAlgorithmAntibiotic prophylaxisCardiac device procedureQuality measurementVeterans health administration

Identifiers

PMID32000780
PMCPMC6993312
OpenAlexW3004926474

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.