Evidence map›Paper›PMID 29507122›Full record

ArticleBMJ quality & safety2019

Impact of a national QI programme on reducing electronic health record notifications to clinicians.

Tina Shah, Shilpa Patel-Teague, Laura Kroupa, Ashley N D Meyer, Hardeep Singh

Abstract read
In one paragraph

Article in BMJ quality & safety, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 17 papers.

0numbers the graph read from it
0cells of the map it votes in
17citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

17 citing papers in PubMed.

  1. Article
  2. Article
  3. Review
  4. Article
  5. Article
  6. Article
  7. Article
  8. Review
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Review
  16. Review
  17. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

5 authors.

Tina ShahTNT Health Enterprises, Atlanta, GA (previously Department of Veterans Affairs, Washington, District of Columbia), USA.
Shilpa Patel-TeagueVA Sunshine Network, Department of Veterans Affairs, St Petersburg, Florida, USA.
Laura KroupaVA Heartland Network, Department of Veterans Affairs, Kansas City, Missouri and Saint Louis University School of Medicine, St. Louis, Missouri, USA.
Ashley N D MeyerCenter for Innovations in Quality, Effectiveness and Safety, Michael E DeBakey Veterans Affairs Medical Center and Baylor College of Medicine, Houston, Texas, USA.
Hardeep SinghCenter for Innovations in Quality, Effectiveness and Safety, Michael E DeBakey Veterans Affairs Medical Center and Baylor College of Medicine, Houston, Texas, USA.

Funding

Decision Making and Clinical Work of Test Result Follow-up in Health IT SettingsR01HS022087 · AHRQ · BAYLOR COLLEGE OF MEDICINE · PI SINGH, HARDEEP · 2013 to 2016
$2.0M
AHRQ HHS R01 HS022087HSRD VA IK2 HX002586
6 · The paper itself

Abstract

backgroundEmerging evidence suggests electronic health record (EHR)-related information overload is a risk to patient safety. In the US Department of Veterans Affairs (VA), EHR-based 'inbox' notifications originally intended for communicating important clinical information are now cited by 70% of primary care practitioners (PCPs) to be of unmanageable volume. We evaluated the impact of a national, multicomponent, quality improvement (QI) programme to reduce low-value EHR notifications.

methodsThe programme involved three steps: (1) accessing daily PCP notification load data at all 148 facilities operated nationally by the VA; (2) standardising and restricting mandatory notification types at all facilities to a recommended list; and (3) hands-on training for all PCPs on customising and processing notifications more effectively. Designated leaders at each of VA's 18 regional networks led programme implementation using a nationally developed toolkit. Each network supervised technical requirements and data collection, ensuring consistency. Coaching calls and emails allowed the national team to address implementation challenges and monitor effects. We analysed notification load and mandatory notifications preintervention (March 2017) and immediately postintervention (June-July 2017) to assess programme impact.

resultsMedian number of mandatory notification types at each facility decreased significantly from 15 (IQR: 13-19) to 10 (IQR: 10-11) preintervention to postintervention, respectively (P<0.001). Mean daily notifications per PCP decreased significantly from 128 (SEM=4) to 116 (SEM=4; P<0.001). Heterogeneity in implementation across sites led to differences in observed programme impact, including potentially beneficial carryover effects.

conclusionsBased on prior estimates on time to process notifications, a national QI programme potentially saved 1.5 hours per week per PCP to enable higher value work. The number of daily notifications remained high, suggesting the need for additional multifaceted interventions and protected clinical time to help manage them. Nevertheless, our project suggests feasibility of using large-scale 'de-implementation' interventions to reduce unintended safety or efficiency consequences of well-intended electronic communication systems.

Indexed as

Program DevelopmentProgram EvaluationElectronic Health RecordsEquipment FailureHumansPhysicians, Primary CareQuality Improvementburnoutcommunicationelectronic health recordsmeasurementpatient safetyquality improvement

Identifiers

PMID29507122
PMCPMC6365918

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.