Observational studyJournal of biomedical informatics2019
A mixed-methods evaluation framework for electronic health records usability studies.
Observational study in Journal of biomedical informatics, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 29 papers, 2 of them syntheses that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
29 citing papers in PubMed, 2 syntheses or guidelines pooled it.
- Systematic review of applied usability metrics within usability evaluation methods for hospital electronic healthcare record systems: Metrics and Evaluation Methods for eHealth Systems.Journal of evaluation in clinical practice · 2021Pooled it
- A systematic review of contributing factors of and solutions to electronic health record-related impacts on physician well-being.Journal of the American Medical Informatics Association : JAMIA · 2021Pooled it
- Predicting Electronic Health Record Usability: Scoping Review of Adoption Models, Metrics, and Future Directions.JMIR human factors · 2026Article
- Factors Associated With the Usability and Adoption of Continuous Monitoring Devices With Deterioration Alerting Systems in Acute Hospital Non-ICU Settings: A Mixed Methods Study.Journal of nursing management · 2026Article
- Providers' Perspective on the Feasibility of Digital Self-Management of Blood Pressure in Refugees: Mixed Methods Study.JMIR human factors · 2025Article
- Investigating Information Visualization to Combat Information Overload in Electronic Health Records: Protocol for a Randomized Controlled Trial.JMIR research protocols · 2025Article
- Facilitators and Barriers to ICU Providers' Usability of Electronic Health Records Screens.Studies in health technology and informatics · 2025Article
- Evaluating the Usability, Acceptability, User Experience, and Design of an Interactive Responsive Platform to Improve Perinatal Nurses' Stigmatizing Attitudes Toward Substance Use in Pregnancy: Mixed Methods Study.JMIR human factors · 2025Article
- Harnessing an Artificial Intelligence-Based Large Language Model With Personal Health Record Capability for Personalized Information Support in Postsurgery Myocardial Infarction: Descriptive Qualitative Study.Journal of medical Internet research · 2025Article
- Human factors and systems simulation methods to optimize peri-operative EHR design and implementation.Advances in simulation (London, England) · 2025Article
- Afraid of the dentist? There's an app for that: Development and usability testing of a cognitive behavior therapy-based mobile app.PLOS digital health · 2024Article
- The Intensive Care Unit Bundle Board: A Novel Real-Time Data Visualization Tool to Improve Maintenance Care for Invasive Catheters.Applied clinical informatics · 2023Article
- Usability of a mobile application for health professionals in home care services: a user-centered approach.Scientific reports · 2023Article
- Clinician use of data elements from cardiovascular implantable electronic devices in clinical practice.Cardiovascular digital health journal · 2023Article
- Improving usability of Electronic Health Records in a UK Mental Health setting: a feasibility study.Journal of medical systems · 2022Article
- Comparing International Experiences With Electronic Health Records Among Emergency Medicine Physicians in the United States and Norway: Semistructured Interview Study.JMIR human factors · 2022Article
- Evaluation of Physicians' Electronic Health Records Experience Using Actual and Perceived Measures.Perspectives in health information managemen · 2022Article
- Evaluating Electronic Health Record Limitations and Time Expenditure in a German Medical Center.Applied clinical informatics · 2021Article
- Analysing EHR navigation patterns and digital workflows among physicians during ICU pre-rounds.Health information management : journal of the Health Information Management Association of Australia · 2021Observational
- Barriers to the Digitization of Health Information: A Qualitative and Quantitative Study in Kenya and Lao PDR Using a Cloud-Based Maternal and Child Registration System.International journal of environmental research and public health · 2021Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
7 authors.
Funding
Abstract
backgroundPoor EHR design adds further challenges, especially in the areas of order entry and information visualization, with a net effect of increased rates of incidents, accidents, and mortality in ICU settings.
objectiveThe purpose of this study was to propose a novel, mixed-methods framework to understand EHR-related information overload by identifying and characterizing areas of suboptimal usability and clinician frustration within a vendor-based, provider-facing EHR interface.
methodsA mixed-methods, live observational usability study was conducted at a single, large, tertiary academic medical center in the Southeastern US utilizing a commercial, vendor based EHR. Physicians were asked to complete usability patient cases, provide responses to three surveys, and participant in a semi-structured interview.
resultsOf the 25 enrolled ICU physician participants, there were 5(20%) attending physicians, 9 (36%) fellows, and 11 (44%) residents; 52% of participants were females. On average, residents were the quickest in completing the tasks while attending physician took the longest to complete the same task. Poor usability, complex interface screens, and difficulty to navigate the EHR significantly correlated with high frustration levels. Significant association were found between the occurrence of error messages and temporal demand such that more error messages resulted in longer completion time (p = .03). DISCUSSION: Physicians remain frustrated with the EHR due to difficulty in finding patient information. EHR usability remains a critical challenge in healthcare, with implications for medical errors, patient safety, and clinician burnout. There is a need for scientific findings on current information needs and ways to improve EHR-related information overload.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.