Evidence map›Paper›PMID 41941100›Full record

ArticleCardiovascular engineering and technology2026

Mind the Gap: Human and AI Uncertainties in Cardiac MRI Segmentation.

Qiao Lin, Xin Chen, Chao Chen, Nikesh Jathanna, Peter P Swoboda, Shahnaz Jamil-Copley, Jonathan M Garibaldi

Abstract readComparative Study
PubMed Publisher
In one paragraph

Article in Cardiovascular engineering and technology, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Qiao LinSchool of Computer Science, University of Nottingham, Ningbo, China. qiao.lin@nottingham.edu.cn.ORCID 0009-0002-6759-9807
Xin ChenSchool of Computer Science, University of Nottingham, Nottingham, NG81BB, UK.
Chao ChenSchool of Computer Science, University of Nottingham, Nottingham, NG81BB, UK.
Nikesh JathannaNottingham University Hospitals NHS Trust, Nottingham, NG51PB, UK.
Peter P SwobodaLeeds Institute of Cardiovascular and Metabolic Medicine, University of Leeds, Leeds, LS29JT, UK.
Shahnaz Jamil-CopleyNottingham University Hospitals NHS Trust, Nottingham, NG51PB, UK.
Jonathan M GaribaldiSchool of Computer Science, University of Nottingham, Ningbo, China.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

purposeThis study conducts quantitative and qualitative analyses to investigate the relationship between human-annotated and AI-derived uncertainty in cardiac MRI segmentation, aiming to enhance the reliability of AI-based cardiac MRI segmentation models and foster better human-AI collaboration.

methodsThe CMRI dataset used in the experiments consists of 483 scans, each with two types of labels: an annotated segmentation mask and an uncertainty score per CMRI slice, both provided by clinicians. First, the AI-derived uncertainty estimated by the fuzzy-based algorithm is utilized to indicate the quality of segmentation. Multiple levels of uncertainties are derived from the method, including class-wise, slice-wise, subject-wise, etc. Subsequently, they are compared to the human-annotated uncertainty scores. Finally, qualitative analyses are conducted with clinicians to investigate all uncertainty measures potentially impacting real clinical applications.

resultsExperimental results show a strong inverse correlation between AI-derived uncertainty and Dice score, a standard metric for segmentation quality, indicating that lower uncertainty predicts higher segmentation quality. Additionally, it is found that human-annotated uncertainty coincides with AI-derived uncertainty for some anatomical structures (e.g., papillary muscle). However, high human-annotated uncertainty does not necessarily correlate with low AI segmentation quality, and there is no obvious association between human-annotated uncertainty and the size of the segmented structure. Concluded from qualitative analysis with clinicians, humans are better at utilizing prior knowledge (e.g. cardiac structural and contextual information) for uncertainty scoring, while the current AI method lacks this capability and is mainly data-driven for decision-making and uncertainty estimation.

conclusionAI-derived uncertainty could be utilized as quality control for CMRI segmentation. Humans utilize structural and contextual information to formulate uncertainty, while AI models currently lack this capability.

Indexed as

Artificial IntelligenceHeartImage Interpretation, Computer-AssistedMagnetic Resonance ImagingDatabases, FactualDatasets as TopicFuzzy LogicHumansPredictive Value of TestsReproducibility of ResultsUncertaintyAI-derived uncertaintyClinical settingsHuman-annotated uncertaintyQuality controlSemantic segmentation

Identifiers

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.