ArticleJournal of medical systems2017
Systematic Heuristic Evaluation of Computerized Consultation Order Templates: Clinicians' and Human Factors Engineers' Perspectives.
Article in Journal of medical systems, 2017. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 11 papers, 1 of them a synthesis that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
11 citing papers in PubMed, 1 synthesis or guideline pooled it.
- Systematic review of applied usability metrics within usability evaluation methods for hospital electronic healthcare record systems: Metrics and Evaluation Methods for eHealth Systems.Journal of evaluation in clinical practice · 2021Pooled it
- A heuristic evaluation of a pharmacy surveillance information system.BMC medical informatics and decision making · 2024Article
- Medical and nursing clinician perspectives on the usability of the hospital electronic medical record: A qualitative analysis.Health information management : journal of the Health Information Management Association of Australia · 2024Article
- Accuracy, thoroughness, and quality of outpatient primary care documentation in the U.S. Department of Veterans Affairs.BMC primary care · 2024Observational
- Characterizing barriers to closing cross-institutional referral loops: Workflow and information flow analysis.Applied ergonomics · 2024Article
- Cerner Millennium's Care Pathways for Specialty Care Referrals: Provider and Nurse Experiences, Perceptions, and Recommendations for Improvements.Journal of general internal medicine · 2023Article
- Human factors and ergonomics methods for pharmacy research and clinical practice.Research in social & administrative pharmacy : RSAP · 2021Review
- Developing Infographics to Facilitate HIV-Related Patient-Provider Communication in a Limited-Resource Setting.Applied clinical informatics · 2019Article
- Alerts for community pharmacist-provided medication therapy management: recommendations from a heuristic evaluation.BMC medical informatics and decision making · 2019Article
- Integrity of clinical information in computerized order requisitions for diagnostic imaging.Journal of the American Medical Informatics Association : JAMIA · 2018Article
- Expanding Human Computer Interaction Methods to Understand User Needs in the Design Process of Personal Health Systems.Yearbook of medical informatics · 2018Review
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
5 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
We assessed the usability of consultation order templates and identified problems to prioritize in design efforts for improving referral communication. With a sample of 26 consultation order templates, three evaluators performed a usability heuristic evaluation. The evaluation used 14 domain-independent heuristics and the following three supplemental references: 1 new domain-specific heuristic, 6 usability goals, and coded clinicians' statements regarding ease of use for 10 sampled templates. Evaluators found 201 violations, a mean of 7.7 violations per template. Minor violations outnumbered major violations almost twofold, 115 (57%) to 62 (31%). Approximately 68% of violations were linked to 5 heuristics: aesthetic and minimalist design (17%), error prevention (16%), consistency and standards (14%), recognition rather than recall (11%), and meet referrers' information needs (10%). Severe violations were attributed mostly to meet referrers' information needs and recognition rather than recall. Recorded violations yielded potential negative consequences for efficiency, effectiveness, safety, learnability, and utility. Evaluators and clinicians demonstrated 80% agreement in usability assessment. Based on frequency and severity of usability heuristic violations, the consultation order templates reviewed may impede clinical efficiency and risk patient safety. Results support the following design considerations: communicate consultants' requirements, facilitate information seeking, and support communication. While the most frequent heuristic violations involved interaction design and presentation, the most severe violations lacked information desired by referring clinicians. Violations related to templates' inability to support referring clinicians' information needs had the greatest potential negative impact on efficiency and safety usability goals. Heuristics should be prioritized in future design efforts.
Indexed as
Identifiers
28735373What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.