Evidence map›Paper›PMID 40411676›Full record

ArticleMagma (New York, N.Y.)2025

Quantitative image quality metrics enable resource-efficient quality control of clinically applied AI-based reconstructions in MRI.

Owen A White, Joshua Shur, Francesca Castagnoli, Geoff Charles-Edwards, Brandon Whitcher, David J Collins, Matthew T D Cashmore, Matt G Hall, Spencer A Thomas, Andrew Thompson and 4 more

Abstract read
In one paragraph

Article in Magma (New York, N.Y.), 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed.

  1. Article
  2. Reproducibility and quality assurance in MRI.Magma (New York, N.Y.) · 2025
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

14 authors.

Owen A WhiteMRI Unit, The Royal Marsden NHS Foundation Trust, London, UK. owen.white@rmh.nhs.uk.ORCID http://orcid.org/0000-0002-1411-6667
Joshua ShurMRI Unit, The Royal Marsden NHS Foundation Trust, London, UK.ORCID https://orcid.org/0000-0002-4569-4785
Francesca CastagnoliMRI Unit, The Royal Marsden NHS Foundation Trust, London, UK.ORCID https://orcid.org/0000-0003-2407-7451
Geoff Charles-EdwardsMRI Unit, The Royal Marsden NHS Foundation Trust, London, UK.ORCID https://orcid.org/0000-0002-8369-4604
Brandon WhitcherMRI Unit, The Royal Marsden NHS Foundation Trust, London, UK.ORCID https://orcid.org/0000-0002-6452-2399
David J CollinsMRI Unit, The Royal Marsden NHS Foundation Trust, London, UK.ORCID https://orcid.org/0000-0001-8281-1496
Matthew T D CashmoreNational Physical Laboratory, Teddington, UK.ORCID https://orcid.org/0000-0003-0098-0742
Matt G HallNational Physical Laboratory, Teddington, UK.ORCID https://orcid.org/0000-0002-9530-5477
Spencer A ThomasNational Physical Laboratory, Teddington, UK.ORCID https://orcid.org/0000-0002-9260-1561
Andrew ThompsonNational Physical Laboratory, Teddington, UK.ORCID https://orcid.org/0000-0002-4580-0357
Ciara A HarrisonMRI Unit, The Royal Marsden NHS Foundation Trust, London, UK.ORCID https://orcid.org/0009-0005-6229-9030
Georgina HopkinsonMRI Unit, The Royal Marsden NHS Foundation Trust, London, UK.ORCID https://orcid.org/0000-0003-4967-8886
Dow-Mu KohMRI Unit, The Royal Marsden NHS Foundation Trust, London, UK.ORCID https://orcid.org/0000-0001-7654-8011
Jessica M WinfieldMRI Unit, The Royal Marsden NHS Foundation Trust, London, UK.ORCID https://orcid.org/0000-0001-6069-5252

Funding

Cancer Research UK National cancer Imaging Trials Accelerator (NCITA)UK Government's Department for Science, Innovation & Technology National Measurement System (NMS) programmes
6 · The paper itself

Abstract

objectiveAI-based MRI reconstruction techniques improve efficiency by reducing acquisition times whilst maintaining or improving image quality. Recent recommendations from professional bodies suggest centres should perform quality assessments on AI tools. However, monitoring long-term performance presents challenges, due to model drift or system updates. Radiologist-based assessments are resource-intensive and may be subjective, highlighting the need for efficient quality control (QC) measures. This study explores using image quality metrics (IQMs) to assess AI-based reconstructions. MATERIALS AND

methods58 patients undergoing standard-of-care rectal MRI were imaged using AI-based and conventional T2-weighted sequences. Paired and unpaired IQMs were calculated. Sensitivity of IQMs to detect retrospective perturbations in AI-based reconstructions was assessed using control charts, and statistical comparisons between the four MR systems in the evaluation were performed. Two radiologists evaluated the image quality of the perturbed images, giving an indication of their clinical relevance.

resultsPaired IQMs demonstrated sensitivity to changes in AI-reconstruction settings, identifying deviations outside ± 2 standard deviations of the reference dataset. Unpaired metrics showed less sensitivity. Paired IQMs showed no difference in performance between 1.5 T and 3 T systems (p > 0.99), whilst minor but significant (p < 0.0379) differences were noted for unpaired IQMs. DISCUSSION: IQMs are effective for QC of AI-based MR reconstructions, offering resource-efficient alternatives to repeated radiologist evaluations. Future work should expand this to other imaging applications and assess additional measures.

Indexed as

Artificial IntelligenceImage Interpretation, Computer-AssistedImage Processing, Computer-AssistedMagnetic Resonance ImagingAdultAgedAlgorithmsFemaleHumansMaleMiddle AgedQuality ControlRectumReproducibility of ResultsRetrospective StudiesArtificial intelligenceImage reconstructionMagnetic resonance imagingQuality assurance, HealthcareQuality control

Identifiers

PMID40411676
PMCPMC12255595

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.