ArticleApplied clinical informatics2020
Usability Testing a Potentially Inappropriate Medication Dashboard: A Core Component of the Dashboard Development Process.
Article in Applied clinical informatics, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 17 papers, 3 of them syntheses that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
17 citing papers in PubMed, 3 syntheses or guidelines pooled it, 30 citations in OpenAlex.
- Usability evaluation methods for hospital information systems: a systematic review.BMC health services research · 2025Pooled it
- Usability Evaluation of Dashboards: A Systematic Literature Review of Tools.BioMed research international · 2023Pooled it
- Agile, Easily Applicable, and Useful eHealth Usability Evaluations: Systematic Review and Expert-Validation.Applied clinical informatics · 2022Pooled it
- From Data to Decision: Design and Evaluation of a Patient Safety Dashboard.Medical journal of the Islamic Republic of Iran · 2025Article
- Towards a Novel Patient Experience Survey System: Incorporating Physician Perspectives into Performance Feedback Dashboard Design.Journal of patient experience · 2025Article
- Evaluation of usability and user feedback to guide telepharmacy application development in Indonesia: a mixed-methods study.BMC medical informatics and decision making · 2024Article
- A Web-Based Tool to Report Adverse Drug Reactions by Community Pharmacists in Australia: Usability Testing Study.JMIR formative research · 2023Article
- Use of a Medication Safety Audit and Feedback Tool in the Emergency Department Is Affected by Prescribing Characteristics.Applied clinical informatics · 2023Article
- Novel Note Templates to Enhance Signal and Reduce Noise in Medical Documentation: Prospective Improvement Study.JMIR formative research · 2023Article
- Linking Activity Theory Within User-Centered Design: Novel Framework to Inform Design and Evaluation of Adverse Drug Reaction Reporting Systems in Pharmacy.JMIR human factors · 2023Article
- Developing the VA Geriatric Scholars Programs' Clinical Dashboards Using the PDSA Framework for Quality Improvement.Applied clinical informatics · 2022Article
- Dashboard Design to Identify and Balance Competing Risk of Multiple Hospital-Acquired Conditions.Applied clinical informatics · 2022Article
- Developing Dashboards to Address Children's Health Disparities in Ohio.Applied clinical informatics · 2022Article
- Potentially inappropriate medications in older Chinese outpatients based on the Beers criteria and Chinese criteria.Frontiers in pharmacology · 2022Article
- Analysis of a Web-Based Dashboard to Support the Use of National Audit Data in Quality Improvement: Realist Evaluation.Journal of medical Internet research · 2021Article
- Participatory Design of an Electronic Medical Record for Paediatric Palliative Care: A Think-Aloud Study with Nurses and Physicians.Children (Basel, Switzerland) · 2021Article
- Human Factors and Organizational Issues in Health Informatics: Innovations and Opportunities.Yearbook of medical informatics · 2021Review
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
9 authors at 4 institutions in 1 country.
Funding
No grant is acknowledged in the PubMed record.
Abstract
backgroundWith the increased usage of dashboard reporting systems to monitor and track patient panels by clinical users, developers must ensure that the information displays they produce are accurate and intuitive. When evaluating usability of a clinical dashboard among potential end users, developers oftentimes rely on methods such as questionnaires as opposed to other, more time-intensive strategies that incorporate direct observation.
objectivesPrior to release of the potentially inappropriate medication (PIM) clinical dashboard, designed to facilitate completion of a quality improvement project by clinician scholars enrolled in the Veterans Affairs (VA) workforce development Geriatric Scholars Program (GSP), we evaluated the usability of the system. This article describes the process of usability testing a dashboard reporting system with clinicians using direct observation and think-aloud moderating techniques.
methodsWe developed a structured interview protocol that combines virtual observation, think-aloud moderating techniques, and retrospective questioning of the overall user experience, including use of the System Usability Scale (SUS). Thematic analysis was used to analyze field notes from the interviews of three GSP alumni.
resultsOur structured approach to usability testing identified specific functional problems with the dashboard reporting system that were missed by results from the SUS. Usability testing lead to overall improvements in the intuitive use of the system, increased data transparency, and clarification of the dashboard's purpose.
conclusionReliance solely on questionnaires and surveys at the end stages of dashboard development can mask potential functional problems that will impede proper usage and lead to misinterpretation of results. A structured approach to usability testing in the developmental phase is an important tool for developers of clinician friendly systems for displaying easily digested information and tracking outcomes for the purpose of quality improvement.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.