SynthesisJournal of the American Medical Informatics Association : JAMIA2019
Evaluating visual analytics for health informatics applications: a systematic review from the American Medical Informatics Association Visual Analytics Working Group Task Force on Evaluation.
Synthesis in Journal of the American Medical Informatics Association : JAMIA, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 21 papers, 2 of them syntheses that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
21 citing papers in PubMed, 2 syntheses or guidelines pooled it.
- Systematic review and narrative synthesis of computerized audit and feedback systems in healthcare.Journal of the American Medical Informatics Association : JAMIA · 2022Pooled it
- A Systematic Review of Patient-Facing Visualizations of Personal Health Data.Applied clinical informatics · 2019Pooled it
- KRAS Clinical Trial Finder: A Patient-Centered Platform for Improving Access to Clinical Trial Information.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2026Article
- Lessons Learned From Developing Dashboards to Support Decision-Making for Community Opioid Response by Community Stakeholders: Mixed Methods and Multisite Study.JMIR human factors · 2024Article
- Deploying an asthma dashboard to support quality improvement across a nationally representative sentinel network of 7.6 million people in England.NPJ primary care respiratory medicine · 2024Article
- Health Tracking via Mobile Apps for Depression Self-management: Qualitative Content Analysis of User Reviews.JMIR human factors · 2022Article
- Using set visualisation to find and explain patterns of missing values: a case study with NHS hospital episode statistics data.BMJ open · 2022Article
- QDS-COVID: A visual analytics system for interactive exploration of millions of COVID-19 healthcare records in Brazil.Applied soft computing · 2022Article
- Food and Nutrition Systems Dashboards: A Systematic Review.Advances in nutrition (Bethesda, Md.) · 2022Article
- An Open-Access Data Platform: Global Nutrition and Health Atlas (GNHA).Current developments in nutrition · 2022Article
- Interactive Visualization Applications in Population Health and Health Services Research: Systematic Scoping Review.Journal of medical Internet research · 2022Article
- U.S. COVID-19 State Government Public Dashboards: An Expert Review.Applied clinical informatics · 2021Review
- A rapidly deployed, interactive, online visualization system to support fatality management during the coronavirus disease 2019 (COVID-19) pandemic.Journal of the American Medical Informatics Association : JAMIA · 2020Article
- Visual Analytic Tools and Techniques in Population Health and Health Services Research: Scoping Review.Journal of medical Internet research · 2020Article
- Interactive Exploration of Longitudinal Cancer Patient Histories Extracted From Clinical Text.JCO clinical cancer informatics · 2020Article
- Best practices for data visualization: creating and evaluating a report for an evidence-based fall prevention program.Journal of the American Medical Informatics Association : JAMIA · 2020Article
- Visual Analytic Tools and Techniques in Population Health and Health Services Research: Protocol for a Scoping Review.JMIR research protocols · 2019Article
- Usability Testing of an Interactive Dashboard for Surgical Quality Improvement in a Large Congenital Heart Center.Applied clinical informatics · 2019Article
- Data, capacity-building, and training needs to address rural health inequities in the Northwest United States: a qualitative study.Journal of the American Medical Informatics Association : JAMIA · 2019Article
- Advancing biomedical and health informatics knowledge through reviews of existing research.Journal of the American Medical Informatics Association : JAMIA · 2019Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
15 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
objectiveThis article reports results from a systematic literature review related to the evaluation of data visualizations and visual analytics technologies within the health informatics domain. The review aims to (1) characterize the variety of evaluation methods used within the health informatics community and (2) identify best practices.
methodsA systematic literature review was conducted following PRISMA guidelines. PubMed searches were conducted in February 2017 using search terms representing key concepts of interest: health care settings, visualization, and evaluation. References were also screened for eligibility. Data were extracted from included studies and analyzed using a PICOS framework: Participants, Interventions, Comparators, Outcomes, and Study Design.
resultsAfter screening, 76 publications met the review criteria. Publications varied across all PICOS dimensions. The most common audience was healthcare providers (n = 43), and the most common data gathering methods were direct observation (n = 30) and surveys (n = 27). About half of the publications focused on static, concentrated views of data with visuals (n = 36). Evaluations were heterogeneous regarding setting and measurements used. DISCUSSION: When evaluating data visualizations and visual analytics technologies, a variety of approaches have been used. Usability measures were used most often in early (prototype) implementations, whereas clinical outcomes were most common in evaluations of operationally-deployed systems. These findings suggest opportunities for both (1) expanding evaluation practices, and (2) innovation with respect to evaluation methods for data visualizations and visual analytics technologies across health settings.
conclusionEvaluation approaches are varied. New studies should adopt commonly reported metrics, context-appropriate study designs, and phased evaluation strategies.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.