Evidence map›Paper›PMID 35911553›Full record

SynthesisFrontiers in cardiovascular medicine2022

Quality of reporting in AI cardiac MRI segmentation studies - A systematic review and recommendations for future studies.

Samer Alabed, Ahmed Maiter, Mahan Salehi, Aqeeb Mahmood, Sonali Daniel, Sam Jenkins, Marcus Goodlad, Michael Sharkey, Michail Mamalakis, Vera Rakocevic and 8 more

Abstract readSystematic Review
In one paragraph

Synthesis in Frontiers in cardiovascular medicine, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 12 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
12citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

12 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Review
  9. Review
  10. Article
  11. Article
  12. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

18 authors.

Samer AlabedDepartment of Infection, Immunity and Cardiovascular Disease, The University of Sheffield, Sheffield, United Kingdom.
Ahmed MaiterDepartment of Infection, Immunity and Cardiovascular Disease, The University of Sheffield, Sheffield, United Kingdom.
Mahan SalehiDepartment of Infection, Immunity and Cardiovascular Disease, The University of Sheffield, Sheffield, United Kingdom.
Aqeeb MahmoodMedical School, The University of Sheffield, Sheffield, United Kingdom.
Sonali DanielMedical School, The University of Sheffield, Sheffield, United Kingdom.
Sam JenkinsMedical School, The University of Sheffield, Sheffield, United Kingdom.
Marcus GoodladDepartment of Infection, Immunity and Cardiovascular Disease, The University of Sheffield, Sheffield, United Kingdom.
Michael SharkeyDepartment of Infection, Immunity and Cardiovascular Disease, The University of Sheffield, Sheffield, United Kingdom.
Michail MamalakisDepartment of Infection, Immunity and Cardiovascular Disease, The University of Sheffield, Sheffield, United Kingdom.
Vera RakocevicMedical School, The University of Sheffield, Sheffield, United Kingdom.
Krit DwivediDepartment of Infection, Immunity and Cardiovascular Disease, The University of Sheffield, Sheffield, United Kingdom.
Hosamadin AssadiUniversity of East Anglia, Norwich Medical School, Norwich, United Kingdom.
Jim M WildDepartment of Infection, Immunity and Cardiovascular Disease, The University of Sheffield, Sheffield, United Kingdom.
Haiping LuINSIGNEO, Institute for in silico Medicine, The University of Sheffield, Sheffield, United Kingdom.
Declan P O'ReganMRC London Institute of Medical Sciences, Imperial College London, London, United Kingdom.
Rob J van der GeestLeiden University Medical Center, Leiden, Netherlands.
Pankaj GargUniversity of East Anglia, Norwich Medical School, Norwich, United Kingdom.
Andrew J SwiftDepartment of Infection, Immunity and Cardiovascular Disease, The University of Sheffield, Sheffield, United Kingdom.

Funding

British Heart Foundation NH/17/1/32725British Heart Foundation SP/14/6/31350Medical Research Council MC_UP_1605/13Medical Research Council MR/M008894/1Wellcome Trust 205188/Z/16/Z
6 · The paper itself

Abstract

Background: There has been a rapid increase in the number of Artificial Intelligence (AI) studies of cardiac MRI (CMR) segmentation aiming to automate image analysis. However, advancement and clinical translation in this field depend on researchers presenting their work in a transparent and reproducible manner. This systematic review aimed to evaluate the quality of reporting in AI studies involving CMR segmentation. Methods: MEDLINE and EMBASE were searched for AI CMR segmentation studies in April 2022. Any fully automated AI method for segmentation of cardiac chambers, myocardium or scar on CMR was considered for inclusion. For each study, compliance with the Checklist for Artificial Intelligence in Medical Imaging (CLAIM) was assessed. The CLAIM criteria were grouped into study, dataset, model and performance description domains. Results: 209 studies published between 2012 and 2022 were included in the analysis. Studies were mainly published in technical journals (58%), with the majority (57%) published since 2019. Studies were from 37 different countries, with most from China (26%), the United States (18%) and the United Kingdom (11%). Short axis CMR images were most frequently used (70%), with the left ventricle the most commonly segmented cardiac structure (49%). Median compliance of studies with CLAIM was 67% (IQR 59-73%). Median compliance was highest for the model description domain (100%, IQR 80-100%) and lower for the study (71%, IQR 63-86%), dataset (63%, IQR 50-67%) and performance (60%, IQR 50-70%) description domains. Conclusion: This systematic review highlights important gaps in the literature of CMR studies using AI. We identified key items missing-most strikingly poor description of patients included in the training and validation of AI models and inadequate model failure analysis-that limit the transparency, reproducibility and hence validity of published AI studies. This review may support closer adherence to established frameworks for reporting standards and presents recommendations for improving the quality of reporting in this field. Systematic Review Registration: [www.crd.york.ac.uk/prospero/], identifier [CRD42022279214].

Indexed as

artificial intelligencecardiac MRImachine learningqualityreportingsegmentationsystematic review

Identifiers

PMID35911553
PMCPMC9334661

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.