Evidence map›Paper›PMID 42021211›Full record

ArticleBMC medical informatics and decision making2026

Evaluation of a new design solution for the visualisation of a risk-adjusted hospital performance comparison: results of an end user-centred mixed methods study.

Niklaus S Bernet, Michael Flückiger, Silvia Thomann, Jos M G A Schols, Sabine Hahn, Leonie Roos, Mascha Kurpicz-Briki, Irma H J Everink

Abstract read
In one paragraph

Article in BMC medical informatics and decision making, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Niklaus S BernetSchool of Health Professions, Bern University of Applied Sciences, Applied Research & Development in Nursing, Murtenstrasse 10, Bern, 3008, Switzerland. niklausstefan.bernet@bfh.ch.
Michael FlückigerInstitute of Design Research, Bern University of Applied Sciences, Bern Academy of the Arts, Fellerstrasse 11, Bern, 3027, Switzerland.
Silvia ThomannSchool of Health Professions, Bern University of Applied Sciences, Applied Research & Development in Nursing, Murtenstrasse 10, Bern, 3008, Switzerland.
Jos M G A ScholsDepartment of Health Services Research, Care and Public Health Research Institute, Maastricht University, PO BOX 616, Maastricht, 6200 MD, The Netherlands.
Sabine HahnSchool of Health Professions, Bern University of Applied Sciences, Applied Research & Development in Nursing, Murtenstrasse 10, Bern, 3008, Switzerland.
Leonie RoosSchool of Health Professions, Bern University of Applied Sciences, Applied Research & Development in Nursing, Murtenstrasse 10, Bern, 3008, Switzerland.
Mascha Kurpicz-BrikiSchool of Engineering and Computer Science, Applied Machine Intelligence, Bern University of Applied Sciences, Höheweg 80, Biel, 2502, Switzerland.
Irma H J EverinkDepartment of Health Services Research, Care and Public Health Research Institute, Maastricht University, PO BOX 616, Maastricht, 6200 MD, The Netherlands.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundHealthcare stakeholders are increasingly seeking comparative provider performance data to enhance data-driven decision-making and quality improvement. Traditional visualisations, like caterpillar plots, are often difficult for end users to understand and interpret. This study aimed to (1) obtain general feedback from end users on a newly proposed design solution for visualising a risk-adjusted hospital comparison and to develop an understanding of the key criteria they rely on in the evaluation process; (2) test the hypothesis that end users will better understand key messages and rate perceived usability higher with the new design solution than with a caterpillar plot.

methodsAn end user-centred mixed methods study, involving end users of risk-adjusted hospital comparisons across all levels of the Swiss healthcare system, was conducted to evaluate the new design solution. In the qualitative phase, 14 end users from health authorities, insurers, hospital associations, and hospitals were surveyed in 10 semi-structured individual and group interviews, which were analysed using thematic analysis. In the quantitative phase, a non-clinical randomised controlled online trial (A/B testing) was conducted. In total, 200 of the targeted end users, comprising cantonal quality managers, hospital directors, and those responsible for quality and/or the 'National Prevalence Measurement' in hospitals, completed the questionnaire. The data were analysed using comparative descriptive and bivariate statistics.

resultsThematic analysis revealed three key criteria that end users relied on when evaluating a risk-adjusted hospital comparison: (1) 'clarity by design', highlighting strategies for effectively conveying key messages of hospital comparisons; (2) 'usability by design', focusing on end user-centred functionalities and presentation elements; (3) 'suitability for quality development', addressing the conditions for creating a trustworthy and useful comparison to drive quality improvement. Quantitative analysis confirmed the hypothesis that end users understand key messages better and perceived usability is higher with the new design than with the caterpillar plot.

conclusionsThe new design solution improves hospital comparison outputs for end users by combining clear displays with additional interactive features. The identified criteria underlying the evaluation should inform further design projects and research dealing with the visualisation of hospital comparisons. CLINICAL TRIAL NUMBER: Not applicable.

Indexed as

HospitalsQuality ImprovementRisk AdjustmentHumansSwitzerlandAccidental fallsBenchmarkingDecision makingInpatientsPressure ulcerPublic reporting of healthcare dataQuality improvementQuality of health careRisk adjustmentUser-centred design

Identifiers

PMID42021211
PMCPMC13235198

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.