Evidence map›Paper›PMID 33749610›Full record

ArticleJMIR medical informatics2021

Applying Clinical Decision Support Design Best Practices With the Practical Robust Implementation and Sustainability Model Versus Reliance on Commercially Available Clinical Decision Support Tools: Randomized Controlled Trial.

Katy E Trinkley, Miranda E Kroehl, Michael G Kahn, Larry A Allen, Tellen D Bennett, Gary Hale, Heather Haugen, Simeon Heckman, David P Kao, Janet Kim and 7 more

Registry-linked trialOpen access · goldAbstract read
In one paragraph

Article in JMIR medical informatics, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT04028557 (Development and Validation of an Integrated Implementation Model for Clinical Decision Support for Heart Failure Prescribing), which is not on this map. Cited by 20 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
20citing papers in PubMed, 1 pooled it
7.3field-weighted citation impact, top 3% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT04028557 nacompletednot on this map

Development and Validation of an Integrated Implementation Model for Clinical Decision Support for Heart Failure Prescribing

TypeinterventionalSponsorUniversity of Colorado, DenverRan2019 to 2019Enrolled118ConditionsDecision Support Systems, Clinical, Heart FailureArmsDecision Support Systems, Clinical
3 · Its place in the literature

Who cites it

20 citing papers in PubMed, 1 synthesis or guideline pooled it, 38 citations in OpenAlex.

  1. Pooled it
  2. Trial
  3. Trial
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Observational
  12. Article
  13. Article
  14. Review
  15. Article
  16. Article
  17. Article
  18. Article
  19. Research and Scholarly Methods: Implementation Science Studies.Journal of the American College of Clinical Pharmacy : JACCP · 2022
    Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

17 authors at 6 institutions in 1 country.

Katy E TrinkleyDepartment of Clinical Pharmacy, Skaggs School of Pharmacy and Pharmaceutical Sciences, University of Colorado Anschutz Medical Campus, Aurora, CO, United States.ORCID https://orcid.org/0000-0003-2041-7404
Miranda E KroehlCharter Communications Corporation, Greenwood Village, CO, United States.ORCID https://orcid.org/0000-0002-3840-3660
Michael G KahnSection of Informatics and Data Science, Department of Pediatrics, School of Medicine, University of Colorado Anschutz Medical Campus, Aurora, CO, United States.ORCID https://orcid.org/0000-0003-4786-6875
Larry A AllenAdult and Child Consortium for Outcomes Research and Delivery Science, University of Colorado, Aurora, CO, United States.ORCID https://orcid.org/0000-0003-2540-3095
Tellen D BennettAdult and Child Consortium for Outcomes Research and Delivery Science, University of Colorado, Aurora, CO, United States.ORCID https://orcid.org/0000-0003-1483-4236
Gary HaleDepartment of Clinical Informatics, University of Colorado Health, Aurora, CO, United States.ORCID https://orcid.org/0000-0002-1224-1309
Heather HaugenUniversity of Colorado Clinical and Translational Sciences Institute, Aurora, CO, United States.ORCID https://orcid.org/0000-0002-0214-9656
Simeon HeckmanDepartment of Clinical Informatics, University of Colorado Health, Aurora, CO, United States.ORCID https://orcid.org/0000-0002-4736-1423
David P KaoDepartment of Clinical Informatics, University of Colorado Health, Aurora, CO, United States.ORCID https://orcid.org/0000-0002-2832-9348
Janet KimDepartment of Clinical Pharmacy, Skaggs School of Pharmacy and Pharmaceutical Sciences, University of Colorado Anschutz Medical Campus, Aurora, CO, United States.ORCID https://orcid.org/0000-0001-9589-4489
Daniel M MatlockAdult and Child Consortium for Outcomes Research and Delivery Science, University of Colorado, Aurora, CO, United States.ORCID https://orcid.org/0000-0001-9597-9642
Daniel C MaloneDepartment of Pharmacotherapy, Skaggs College of Pharmacy, University of Utah, Salt Lake City, UT, United States.ORCID https://orcid.org/0000-0002-5006-9394
Robert L Page NdDepartment of Clinical Pharmacy, Skaggs School of Pharmacy and Pharmaceutical Sciences, University of Colorado Anschutz Medical Campus, Aurora, CO, United States.ORCID https://orcid.org/0000-0003-2390-2392
Jessica StineDepartment of Clinical Pharmacy, Skaggs School of Pharmacy and Pharmaceutical Sciences, University of Colorado Anschutz Medical Campus, Aurora, CO, United States.ORCID https://orcid.org/0000-0002-9258-5602
Krithika SureshAdult and Child Consortium for Outcomes Research and Delivery Science, University of Colorado, Aurora, CO, United States.ORCID https://orcid.org/0000-0001-7785-3536
Lauren WellsDepartment of Clinical Pharmacy, Skaggs School of Pharmacy and Pharmaceutical Sciences, University of Colorado Anschutz Medical Campus, Aurora, CO, United States.ORCID https://orcid.org/0000-0002-8404-1007
Chen-Tan LinDepartment of Clinical Informatics, University of Colorado Health, Aurora, CO, United States.ORCID https://orcid.org/0000-0002-8678-7945
Outcomes Research Consortium · USUniversity of Colorado Anschutz Medical Campus · USUniversity of Colorado Health · USCharter Communications (United States)Colorado Clinical and Translational Sciences InstituteUniversity of Utah · US

Funding

NIH Prior Approval Process ProfessionalUL1TR002535 · NCATS · UNIVERSITY OF COLORADO DENVER · PI SOKOL, RONALD J. · 2018 to 2022
$51.1M
IMPlementation to Achieve Clinical Transformation (IMPACT): The Colorado Training ProgramK12HL137862 · NHLBI · UNIVERSITY OF COLORADO DENVER · PI GLASGOW, RUSSELL E, HAVRANEK, EDWARD PAUL · 2017 to 2021
$2.9M
NCATS NIH HHS UL1 TR002535NHLBI NIH HHS K12 HL137862
6 · The paper itself

Abstract

backgroundLimited consideration of clinical decision support (CDS) design best practices, such as a user-centered design, is often cited as a key barrier to CDS adoption and effectiveness. The application of CDS best practices is resource intensive; thus, institutions often rely on commercially available CDS tools that are created to meet the generalized needs of many institutions and are not user centered. Beyond resource availability, insufficient guidance on how to address key aspects of implementation, such as contextual factors, may also limit the application of CDS best practices. An implementation science (IS) framework could provide needed guidance and increase the reproducibility of CDS implementations.

objectiveThis study aims to compare the effectiveness of an enhanced CDS tool informed by CDS best practices and an IS framework with a generic, commercially available CDS tool.

methodsWe conducted an explanatory sequential mixed methods study. An IS-enhanced and commercial CDS alert were compared in a cluster randomized trial across 28 primary care clinics. Both alerts aimed to improve beta-blocker prescribing for heart failure. The enhanced alert was informed by CDS best practices and the Practical, Robust, Implementation, and Sustainability Model (PRISM) IS framework, whereas the commercial alert followed vendor-supplied specifications. Following PRISM, the enhanced alert was informed by iterative, multilevel stakeholder input and the dynamic interactions of the internal and external environment. Outcomes aligned with PRISM's evaluation measures, including patient reach, clinician adoption, and changes in prescribing behavior. Clinicians exposed to each alert were interviewed to identify design features that might influence adoption. The interviews were analyzed using a thematic approach.

resultsBetween March 15 and August 23, 2019, the enhanced alert fired for 61 patients (106 alerts, 87 clinicians) and the commercial alert fired for 26 patients (59 alerts, 31 clinicians). The adoption and effectiveness of the enhanced alert were significantly higher than those of the commercial alert (62% vs 29% alerts adopted, P<.001; 14% vs 0% changed prescribing, P=.006). Of the 21 clinicians interviewed, most stated that they preferred the enhanced alert.

conclusionsThe results of this study suggest that applying CDS best practices with an IS framework to create CDS tools improves implementation success compared with a commercially available tool.

trial registrationClinicalTrials.gov NCT04028557; http://clinicaltrials.gov/ct2/show/NCT04028557.

Indexed as

clinical decision support systemscongestive heart failureimplementation sciencePRISMRE-AIM

Identifiers

PMID33749610
PMCPMC8077777
OpenAlexW3138878086

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.