Evidence map›Paper›PMID 31790566›Full record

ArticleJAMA network open2019

Assessment of Unintentional Duplicate Orders by Emergency Department Clinicians Before and After Implementation of a Visual Aid in the Electronic Health Record Ordering System.

Steven Horng, Joshua W Joseph, Shelley Calder, Jennifer P Stevens, Ashley L O'Donoghue, Charles Safran, Larry A Nathanson, Evan L Leventhal

Abstract read
In one paragraph

Article in JAMA network open, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 7 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
7citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

7 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. The role of information systems in emergency department decision-making-a literature review.Journal of the American Medical Informatics Association : JAMIA · 2024
    Pooled it
  2. Observational
  3. Article
  4. Article
  5. New EHR certification requirements and their association with duplicate tests and images.Journal of the American Medical Informatics Association : JAMIA · 2022
    Article
  6. Article
  7. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Steven HorngDepartment of Emergency Medicine, Beth Israel Deaconess Medical Center, Boston, Massachusetts.
Joshua W JosephDepartment of Emergency Medicine, Beth Israel Deaconess Medical Center, Boston, Massachusetts.
Shelley CalderDepartment of Emergency Medicine, Beth Israel Deaconess Medical Center, Boston, Massachusetts.
Jennifer P StevensCenter for Healthcare Delivery Science, Beth Israel Deaconess Medical Center, Boston, Massachusetts.
Ashley L O'DonoghueCenter for Healthcare Delivery Science, Beth Israel Deaconess Medical Center, Boston, Massachusetts.
Charles SafranDivision of Clinical Informatics, Beth Israel Deaconess Medical Center, Boston, Massachusetts.
Larry A NathansonDepartment of Emergency Medicine, Beth Israel Deaconess Medical Center, Boston, Massachusetts.
Evan L LeventhalDepartment of Emergency Medicine, Beth Israel Deaconess Medical Center, Boston, Massachusetts.

Funding

A multistakeholder examination of the drivers and value of inpatient consultationK08HS024288 · AHRQ · BETH ISRAEL DEACONESS MEDICAL CENTER · PI STEVENS, JENNIFER P · 2016 to 2020
$752k
AHRQ HHS K08 HS024288
6 · The paper itself

Abstract

Importance: Electronic health records allow teams of clinicians to simultaneously care for patients, but an unintended consequence is the potential for duplicate orders of tests and medications. Objective: To determine whether a simple visual aid is associated with a reduction in duplicate ordering of tests and medications. Design, Setting, and Participants: This cohort study used an interrupted time series model to analyze 184 694 consecutive patients who visited the emergency department (ED) of an academic hospital with 55 000 ED visits annually. Patient visits occurred 1 year before and after each intervention, as follows: for laboratory orders, from August 13, 2012, to August 13, 2014; for medication orders, from February 3, 2013, to February 3, 2015; and for radiology orders, from December 12, 2013, to December 12, 2015. Data were analyzed from April to September 2019. Exposure: If an order had previously been placed during the ED visit, a red highlight appeared around the checkbox of that order in the computerized provider order entry system. Main Outcomes and Measures: Number of unintentional duplicate laboratory, medication, and radiology orders. Results: A total of 184 694 patients (mean [SD] age, 51.6 [20.8] years; age range, 0-113.0 years; 99 735 [54.0%] women) who visited the ED were analyzed over the 3 overlapping study periods. After deployment of a noninterruptive nudge in electronic health records, there was an associated 49% decrease in the rate of unintentional duplicate orders for laboratory tests (incidence rate ratio, 0.51; 95% CI, 0.45-0.59), from 4485 to 2731 orders, and an associated 40% decrease in unintentional duplicate orders of radiology tests (incidence rate ratio, 0.60; 95% CI, 0.44-0.82), from 956 to 782 orders. There was not a statistically significant change in unintentional duplicate orders of medications (incidence rate ratio, 1.17; 95% CI, 0.52-2.61), which increased from 225 to 287 orders. The nudge eliminated an estimated 17 936 clicks in our electronic health record. Conclusions and Relevance: In this interrupted time series cohort study, passive visual cues that provided just-in-time decision support were associated with reductions in unintentional duplicate orders for laboratory and radiology tests but not in unintentional duplicate medication orders.

Indexed as

AdolescentAdultAgedAged, 80 and overAudiovisual AidsChildChild, PreschoolElectronic Health RecordsEmergency Service, HospitalFemaleHealth Plan ImplementationHealth Services MisuseHumansInfantInfant, NewbornInterrupted Time Series Analysis

Identifiers

PMID31790566
PMCPMC6902748

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.