Evidence map›Paper›PMID 32977564›Full record

ArticleJournal of personalized medicine2020

A Closer Look at the "Right" Format for Clinical Decision Support: Methods for Evaluating a Storyboard BestPractice Advisory.

Brian J Douthit, R Clayton Musser, Kay S Lytle, Rachel L Richesson

Abstract read
In one paragraph

Article in Journal of personalized medicine, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 10 papers.

0numbers the graph read from it
0cells of the map it votes in
10citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

10 citing papers in PubMed.

  1. Point-of-care tools to support optometric care provision to people with age-related macular degeneration: A randomised, placebo-controlled trial.Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians (Optometrists) · 2022
    Trial
  2. Article
  3. Article
  4. Review
  5. Article
  6. Leveraging artificial intelligence to reduce diagnostic errors in emergency medicine: Challenges, opportunities, and future directions.Academic emergency medicine : official journal of the Society for Academic Emergency Medicine · 2025
    Review
  7. Article
  8. Best Practice Alert to Promote Screening for Primary Aldosteronism Among People With Apparent Treatment-Resistant Hypertension.Endocrine practice : official journal of the American College of Endocrinology and the American Association of Clinical Endocrinologists · 2024
    Article
  9. Article
  10. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Brian J DouthitSchool of Nursing, Duke University, Durham, NC 27710, USA.ORCID 0000-0001-6634-8171
R Clayton MusserSchool of Medicine, Duke University, Durham, NC 27710, USA.
Kay S LytleDuke Health, Duke School of Medicine, Durham, NC 27710 USA.ORCID 0000-0001-9845-1501
Rachel L RichessonSchool of Nursing, Duke University, Durham, NC 27710, USA.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

(1) Background: The five rights of clinical decision support (CDS) are a well-known framework for planning the nuances of CDS, but recent advancements have given us more options to modify the format of the alert. One-size-fits-all assessments fail to capture the nuance of different BestPractice Advisory (BPA) formats. To demonstrate a tailored evaluation methodology, we assessed a BPA after implementation of Storyboard for changes in alert fatigue, behavior influence, and task completion; (2) Methods: Data from 19 weeks before and after implementation were used to evaluate differences in each domain. Individual clinics were evaluated for task completion and compared for changes pre- and post-redesign; (3) Results: The change in format was correlated with an increase in alert fatigue, a decrease in erroneous free text answers, and worsened task completion at a system level. At a local level, however, 14% of clinics had improved task completion; (4) Conclusions: While the change in BPA format was correlated with decreased performance, the changes may have been driven primarily by the COVID-19 pandemic. The framework and metrics proposed can be used in future studies to assess the impact of new CDS formats. Although the changes in this study seemed undesirable in aggregate, some positive changes were observed at the level of individual clinics. Personalized implementations of CDS tools based on local need should be considered.

Indexed as

alert fatigueclinical decision supportsystems evaluation

Identifiers

PMID32977564
PMCPMC7712422

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.