Evidence map›Paper›PMID 35641136›Full record

Trial reportJournal of the American Medical Informatics Association : JAMIA2022

Using CDS Hooks to increase SMART on FHIR app utilization: a cluster-randomized trial.

Keaton L Morgan, Polina V Kukhareva, Phillip B Warner, Jonah Wilkof, Meir Snyder, Devin Horton, Troy Madsen, Joseph Habboushe, Kensaku Kawamoto

Open access · bronzeAbstract readRandomized Controlled Trial
In one paragraph

Trial report in Journal of the American Medical Informatics Association : JAMIA, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 14 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
14citing papers in PubMed, 2 pooled it
5.4field-weighted citation impact, top 4% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

14 citing papers in PubMed, 2 syntheses or guidelines pooled it, 20 citations in OpenAlex.

  1. Pooled it
  2. The role of information systems in emergency department decision-making-a literature review.Journal of the American Medical Informatics Association : JAMIA · 2024
    Pooled it
  3. Article
  4. Review
  5. Article
  6. Article
  7. Review
  8. Article
  9. Prompt Engineering in Clinical Practice: Tutorial for Clinicians.Journal of medical Internet research · 2025
    Article
  10. Article
  11. Article
  12. Article
  13. Current challenges for evaluating mobile health applications.Journal of the American Medical Informatics Association : JAMIA · 2023
    Article
  14. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors at 2 institutions in 1 country.

Keaton L MorganDepartment of Biomedical Informatics, University of Utah, Salt Lake City, Utah, USA.ORCID 0000-0001-9140-4454
Polina V KukharevaDepartment of Biomedical Informatics, University of Utah, Salt Lake City, Utah, USA.ORCID 0000-0002-5576-1486
Phillip B WarnerDepartment of Biomedical Informatics, University of Utah, Salt Lake City, Utah, USA.
Jonah WilkofMDCalc (MD Aware, LLC), New York, New York, USA.
Meir SnyderMDCalc (MD Aware, LLC), New York, New York, USA.
Devin HortonDepartment of Internal Medicine, University of Utah, Salt Lake City, Utah, USA.ORCID 0000-0002-0422-7937
Troy MadsenDepartment of Emergency Medicine, University of Utah, Salt Lake City, Utah, USA.ORCID 0000-0001-9446-4743
Joseph HabbousheMDCalc (MD Aware, LLC), New York, New York, USA.
Kensaku KawamotoDepartment of Biomedical Informatics, University of Utah, Salt Lake City, Utah, USA.ORCID 0000-0003-4282-9338
University of Utah · USManpower Demonstration Research Corporation · US

Funding

UNIVERSITY OF UTAH MEDICAL INFORMATICS TRAININGT15LM007124 · NLM · UTAH STATE HIGHER EDUCATION SYSTEM--UNIVERSITY OF UTAH · PI Karen Louise Eilbeck · 1997 to 2026
$22.0M
National Library of Medicine or the National Institutes of HealthNIH HHSNLM NIH HHSNLM NIH HHS T15 LM007124
6 · The paper itself

Abstract

objectiveHL7 SMART on FHIR apps have the potential to improve healthcare delivery and EHR usability, but providers must be aware of the apps and use them for these potential benefits to be realized. The HL7 CDS Hooks standard was developed in part for this purpose. The objective of this study was to determine if contextually relevant CDS Hooks prompts can increase utilization of a SMART on FHIR medical reference app (MDCalc for EHR). MATERIALS AND

methodsWe conducted a 7-month, provider-randomized trial with 70 providers in a single emergency department. The intervention was a collection of CDS Hooks prompts suggesting the use of 6 medical calculators in a SMART on FHIR medical reference app. The primary outcome was the percentage of provider-patient interactions in which the app was used to view a recommended calculator. Secondary outcomes were app usage stratified by individual calculators.

resultsIntervention group providers viewed a study calculator in the app in 6.0% of interactions compared to 2.6% in the control group (odds ratio = 2.45, 95% CI, 1.2-5.2, P value .02), an increase of 130%. App use was significantly greater for 2 of 6 calculators. DISCUSSION AND

conclusionContextually relevant CDS Hooks prompts led to a significant increase in SMART on FHIR app utilization. This demonstrates the potential of using CDS Hooks to guide appropriate use of SMART on FHIR apps and was a primary motivation for the development of the standard. Future research may evaluate potential impacts on clinical care decisions and outcomes.

Indexed as

Health Level SevenMobile ApplicationsDelivery of Health CareElectronic Health RecordsHumansCDS Hooksclinical decision supportelectronic health recordsSMART on FHIRstandards

Identifiers

PMID35641136
PMCPMC9382378
OpenAlexW4282918604

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.