Evidence map›Paper›PMID 24668841›Full record

ArticleJournal of the American Medical Informatics Association : JAMIA2014

Applying human factors principles to alert design increases efficiency and reduces prescribing errors in a scenario-based simulation.

Alissa L Russ, Alan J Zillich, Brittany L Melton, Scott A Russell, Siying Chen, Jeffrey R Spina, Michael Weiner, Elizabette G Johnson, Joanne K Daggy, M Sue McManus and 4 more

Open access · bronzeAbstract read
In one paragraph

Article in Journal of the American Medical Informatics Association : JAMIA, 2014. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 52 papers, 4 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
52citing papers in PubMed, 4 pooled it
37.1field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

52 citing papers in PubMed, 4 syntheses or guidelines pooled it, 140 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Trial
  6. Trial
  7. Trial
  8. Trial
  9. Article
  10. Article
  11. The value of simulation testing for the evaluation of ambient digital scribes: a case report.Journal of the American Medical Informatics Association : JAMIA · 2025
    Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

14 authors at 7 institutions in 1 country.

Alissa L RussCenter for Health Information and Communication, Health Services Research and Development Service CIN 13-416, Department of Veterans Affairs, Veterans Health Administration, Richard L. Roudebush VA Medical Center, Indianapolis, Indiana, USA Indiana University Center for Health Services and Outcomes Research and Regenstrief Institute, Inc., Indianapolis, Indiana, USA College of Pharmacy, Purdue University, West Lafayette, Indiana, USA.
Alan J ZillichCenter for Health Information and Communication, Health Services Research and Development Service CIN 13-416, Department of Veterans Affairs, Veterans Health Administration, Richard L. Roudebush VA Medical Center, Indianapolis, Indiana, USA Indiana University Center for Health Services and Outcomes Research and Regenstrief Institute, Inc., Indianapolis, Indiana, USA College of Pharmacy, Purdue University, West Lafayette, Indiana, USA.
Brittany L MeltonSchool of Pharmacy, University of Kansas, Lawrence, Kansas, USA.
Scott A RussellCenter for Health Information and Communication, Health Services Research and Development Service CIN 13-416, Department of Veterans Affairs, Veterans Health Administration, Richard L. Roudebush VA Medical Center, Indianapolis, Indiana, USA.
Siying ChenCenter for Health Information and Communication, Health Services Research and Development Service CIN 13-416, Department of Veterans Affairs, Veterans Health Administration, Richard L. Roudebush VA Medical Center, Indianapolis, Indiana, USA.
Jeffrey R SpinaDepartment of Veterans Affairs, VA Greater Los Angeles Healthcare System, Los Angeles, California, USA David Geffen School of Medicine, University of California, Los Angeles, California, USA.
Michael WeinerCenter for Health Information and Communication, Health Services Research and Development Service CIN 13-416, Department of Veterans Affairs, Veterans Health Administration, Richard L. Roudebush VA Medical Center, Indianapolis, Indiana, USA Indiana University Center for Health Services and Outcomes Research and Regenstrief Institute, Inc., Indianapolis, Indiana, USA Department of Medicine, Indiana University School of Medicine, Indianapolis, Indiana, USA.
Elizabette G JohnsonDepartment of Psychology, Purdue University, West Lafayette, Indiana, USA.
Joanne K DaggyCenter for Health Information and Communication, Health Services Research and Development Service CIN 13-416, Department of Veterans Affairs, Veterans Health Administration, Richard L. Roudebush VA Medical Center, Indianapolis, Indiana, USA Department of Biostatistics, Indiana University School of Medicine, Indianapolis, Indiana, USA.
M Sue McManusDepartment of Nephrology Services, Department of Veterans Affairs, Temple, Texas, USA.
Jason M HawseyDepartment of Veterans Affairs, Office of Information, Bay Pines, Florida, USA.
Anthony G PuleoDepartment of Veterans Affairs, Office of Information, Salt Lake City, Utah, USA.
Bradley N DoebbelingCenter for Health Information and Communication, Health Services Research and Development Service CIN 13-416, Department of Veterans Affairs, Veterans Health Administration, Richard L. Roudebush VA Medical Center, Indianapolis, Indiana, USA Indiana University Center for Health Services and Outcomes Research and Regenstrief Institute, Inc., Indianapolis, Indiana, USA Department of BioHealth Informatics, School of Informatics and Computing, Indiana University-Purdue University, Indianapolis, Indiana, USA.
Jason J SaleemHuman Factors Engineering, Office of Informatics and Analytics, Veterans Health Administration, Louisville, Kentucky, USA.
Purdue University West Lafayette · USIndiana University – Purdue University Indianapolis · USRichard L. Roudebush VA Medical Center · USCentral Texas Veterans Health Care System · USHealth Services Research & Development · USUniversity of California, Los Angeles · USUniversity of Kansas · US

Funding

Quality Assurance and Quality Control Project Management: Improving Submissions and Study Conduct in the Human Subjects Research Prior Approval ProcessUL1TR002529 · NCATS · INDIANA UNIVERSITY INDIANAPOLIS · PI MOE, SHARON M, WIEHE, SARAH ELIZABETH · 2018 to 2022
$27.2M
Indiana Clinical and Translational Sciences InstituteUL1TR001108 · NCATS · INDIANA UNIVERSITY INDIANAPOLIS · PI DENNE, SCOTT C., SHEKHAR, ANANTHA · 2013 to 2017
$23.3M
NCATS NIH HHS UL1 TR001108
6 · The paper itself

Abstract

objectiveTo apply human factors engineering principles to improve alert interface design. We hypothesized that incorporating human factors principles into alerts would improve usability, reduce workload for prescribers, and reduce prescribing errors. MATERIALS AND

methodsWe performed a scenario-based simulation study using a counterbalanced, crossover design with 20 Veterans Affairs prescribers to compare original versus redesigned alerts. We redesigned drug-allergy, drug-drug interaction, and drug-disease alerts based upon human factors principles. We assessed usability (learnability of redesign, efficiency, satisfaction, and usability errors), perceived workload, and prescribing errors.

resultsAlthough prescribers received no training on the design changes, prescribers were able to resolve redesigned alerts more efficiently (median (IQR): 56 (47) s) compared to the original alerts (85 (71) s; p=0.015). In addition, prescribers rated redesigned alerts significantly higher than original alerts across several dimensions of satisfaction. Redesigned alerts led to a modest but significant reduction in workload (p=0.042) and significantly reduced the number of prescribing errors per prescriber (median (range): 2 (1-5) compared to original alerts: 4 (1-7); p=0.024). DISCUSSION: Aspects of the redesigned alerts that likely contributed to better prescribing include design modifications that reduced usability-related errors, providing clinical data closer to the point of decision, and displaying alert text in a tabular format. Displaying alert text in a tabular format may help prescribers extract information quickly and thereby increase responsiveness to alerts.

conclusionsThis simulation study provides evidence that applying human factors design principles to medication alerts can improve usability and prescribing outcomes.

Indexed as

Drug Therapy, Computer-AssistedErgonomicsMedical Order Entry SystemsUser-Computer InterfaceDecision Support Systems, ClinicalHumansMedication ErrorsPrescriptionsReminder Systems

Identifiers

PMID24668841
PMCPMC4173163
OpenAlexW2148527190

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.