ArticleDiagnostics (Basel, Switzerland)2021
An Extension of the Bland-Altman Plot for Analyzing the Agreement of More than Two Raters.
Article in Diagnostics (Basel, Switzerland), 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 11 papers.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
11 citing papers in PubMed.
- Ultrasound strain mapping of the non-aneurysmal abdominal aorta for detecting age-related aortic stiffening.International journal of cardiology. Cardiovascular risk and prevention · 2026Article
- From Ultrasound to Histopathology: Agreement Analysis and Depth Correction Model for Basal Cell Carcinoma Using a Portable 20 MHz High-Frequency Ultrasound Device.Diagnostics (Basel, Switzerland) · 2026Article
- Upright 0.5 T open MR defaecating proctography proof of concept study: the inter- and intra-rater variability of pelvic floor measures using seated proctography.Magma (New York, N.Y.) · 2026Article
- Automatic coarse-to-fine AC-PC localization on CT using registration-guided 3D-UNets.Frontiers in neuroinformatics · 2026Article
- Inter- and Intrarater Reliability of a Novel Ultrasound Doppler Device (earlybird) for Quantitative Assessment of Peripheral Arterial Flow.Medical devices (Auckland, N.Z.) · 2026Article
- pECGreview: Assessment of a Novel Tool to Evaluate the Accuracy of Pediatric ECG Interpretation Skills.Pediatric cardiology · 2025Article
- Intraoperative Patellofemoral Kinematic Acquisition: The Design, Testing, and Validation of a Setup for Clinical Studies.Journal of clinical medicine · 2024Article
- An interrater reliability analysis of preoperative mortality risk calculators used for elective high-risk noncardiac surgical patients shows poor to moderate reliability.BMC anesthesiology · 2024Article
- Impact of different 3D regions of interest on quantifying dynamic lumbar vertebral microstructure in ovariectomized rats-a micro-CT study.Frontiers in medicine · 2024Article
- Performance and reliability assessment of a lower dose, task-based scoliosis radiography protocol in pediatric patients.Pediatric radiology · 2024Article
- Assessing Inter-Annotator Agreement for Medical Image Segmentation.IEEE access : practical innovations, open solutions · 2023Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
5 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
The Bland-Altman plot is the most common method to analyze and visualize agreement between raters or methods of quantitative outcomes in health research. While very useful for studies with two raters, a limitation of the classical Bland-Altman plot is that it is specifically used for studies with two raters. We propose an extension of the Bland-Altman plot suitable for more than two raters and derive the approximate limits of agreement with 95% confidence intervals. We validated the suggested limit of agreement by a simulation study. Moreover, we offer suggestions on how to present bias, heterogeneity among raters, as well as the uncertainty of the limits of agreement. The resulting plot could be utilized to investigate and present agreement in studies with more than two raters.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.