Evidence map›Paper›PMID 31446280›Full record

ArticleMedical image analysis2019

Evaluation of algorithms for Multi-Modality Whole Heart Segmentation: An open-access grand challenge.

Xiahai Zhuang, Lei Li, Christian Payer, Darko Štern, Martin Urschler, Mattias P Heinrich, Julien Oster, Chunliang Wang, Örjan Smedby, Cheng Bian and 24 more

Abstract readEvaluation Study
In one paragraph

Article in Medical image analysis, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 77 papers, 3 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
77citing papers in PubMed, 3 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

77 citing papers in PubMed, 3 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Article
  5. Article
  6. Review
  7. Article
  8. Article
  9. Review
  10. Review
  11. Article
  12. Modality-AGnostic image Cascade (MAGIC) for multi-modality cardiac substructure segmentation.Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology · 2026
    Article
  13. Review
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Review
  20. Article

17 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

34 authors.

Xiahai ZhuangSchool of Data Science, Fudan University, Shanghai, 200433, China; Fudan-Xinzailing Joint Research Center for Big Data, Fudan University, Shanghai, 200433, China. Electronic address: zxh@fudan.edu.cn.
Lei LiSchool of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, 200240, China. Electronic address: lilei.sky@sjtu.edu.cn.
Christian PayerInstitute of Computer Graphics and Vision, Graz University of Technology, Graz, 8010, Austria.
Darko ŠternLudwig Boltzmann Institute for Clinical Forensic Imaging, Graz, 8010, Austria.
Martin UrschlerLudwig Boltzmann Institute for Clinical Forensic Imaging, Graz, 8010, Austria.
Mattias P HeinrichInstitute of Medical Informatics, University of Lubeck, Lubeck, 23562, Germany.
Julien OsterInserm, Université de Lorraine, IADI, U1254, Nancy, France.
Chunliang WangDepartment of Biomedical Engineering and Health Systems, KTH Royal Institute of Technology, Stockholm SE-14152, Sweden.
Örjan SmedbyDepartment of Biomedical Engineering and Health Systems, KTH Royal Institute of Technology, Stockholm SE-14152, Sweden.
Cheng BianSchool of Biomed. Eng., Health Science Centre, Shenzhen University, Shenzhen, 518060, China.
Xin YangDept. of Comp. Sci. and Eng., The Chinese University of Hong Kong, Hong Kong, China.
Pheng-Ann HengDept. of Comp. Sci. and Eng., The Chinese University of Hong Kong, Hong Kong, China.
Aliasghar MortaziCenter for Research in Computer Vision (CRCV), University of Central Florida, Orlando, 32816, U.S.
Ulas BagciCenter for Research in Computer Vision (CRCV), University of Central Florida, Orlando, 32816, U.S.
Guanyu YangSchool of Computer Science and Engineering, Southeast University, Nanjing, 210096, China.
Chenchen SunSchool of Computer Science and Engineering, Southeast University, Nanjing, 210096, China.
Gaetan GalisotLIFAT (EA6300), Université de Tours, 64 avenue Jean Portalis, Tours, 37200, France.
Jean-Yves RamelLIFAT (EA6300), Université de Tours, 64 avenue Jean Portalis, Tours, 37200, France.
Thierry BrouardLIFAT (EA6300), Université de Tours, 64 avenue Jean Portalis, Tours, 37200, France.
Qianqian TongSchool of Computer Science, Wuhan University, Wuhan, 430072, China.
Weixin SiGuangdong Provincial Key Laboratory of Computer Vision and Virtual Reality Technology, SIAT, Shenzhen, China.
Xiangyun LiaoShenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China.
Guodong ZengSchool of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, 200240, China; Institute for Surgical Technology & Biomechanics, University of Bern, Bern, 3014, Switzerland.
Zenglin ShiInstitute for Surgical Technology & Biomechanics, University of Bern, Bern, 3014, Switzerland.
Guoyan ZhengSchool of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, 200240, China; Institute for Surgical Technology & Biomechanics, University of Bern, Bern, 3014, Switzerland.
Chengjia WangBHF Centre for Cardiovascular Science, University of Edinburgh, Edinburgh, U.K.; Edinburgh Imaging Facility QMRI, University of Edinburgh, Edinburgh, U.K.
Tom MacGillivrayEdinburgh Imaging Facility QMRI, University of Edinburgh, Edinburgh, U.K.
David NewbyBHF Centre for Cardiovascular Science, University of Edinburgh, Edinburgh, U.K.; Edinburgh Imaging Facility QMRI, University of Edinburgh, Edinburgh, U.K.
Kawal RhodeSchool of Biomedical Engineering and Imaging Sciences, Kings College London, London, U.K.
Sebastien OurselinSchool of Biomedical Engineering and Imaging Sciences, Kings College London, London, U.K.
Raad MohiaddinCardiovascular Research Centre, Royal Brompton Hospital, London, SW3 6NP, U.K.; National Heart and Lung Institute, Imperial College London, London, SW7 2AZ, London, U.K.
Jennifer KeeganCardiovascular Research Centre, Royal Brompton Hospital, London, SW3 6NP, U.K.; National Heart and Lung Institute, Imperial College London, London, SW7 2AZ, London, U.K.
David FirminCardiovascular Research Centre, Royal Brompton Hospital, London, SW3 6NP, U.K.; National Heart and Lung Institute, Imperial College London, London, SW7 2AZ, London, U.K.
Guang YangCardiovascular Research Centre, Royal Brompton Hospital, London, SW3 6NP, U.K.; National Heart and Lung Institute, Imperial College London, London, SW7 2AZ, London, U.K.. Electronic address: g.yang@imperial.ac.uk.

Funding

British Heart Foundation CH/09/002/26360British Heart Foundation PG/16/78/32402British Heart Foundation RG/16/10/32375British Heart Foundation RG/19/1/34160Medical Research Council G0701127
6 · The paper itself

Abstract

Knowledge of whole heart anatomy is a prerequisite for many clinical applications. Whole heart segmentation (WHS), which delineates substructures of the heart, can be very valuable for modeling and analysis of the anatomy and functions of the heart. However, automating this segmentation can be challenging due to the large variation of the heart shape, and different image qualities of the clinical data. To achieve this goal, an initial set of training data is generally needed for constructing priors or for training. Furthermore, it is difficult to perform comparisons between different methods, largely due to differences in the datasets and evaluation metrics used. This manuscript presents the methodologies and evaluation results for the WHS algorithms selected from the submissions to the Multi-Modality Whole Heart Segmentation (MM-WHS) challenge, in conjunction with MICCAI 2017. The challenge provided 120 three-dimensional cardiac images covering the whole heart, including 60 CT and 60 MRI volumes, all acquired in clinical environments with manual delineation. Ten algorithms for CT data and eleven algorithms for MRI data, submitted from twelve groups, have been evaluated. The results showed that the performance of CT WHS was generally better than that of MRI WHS. The segmentation of the substructures for different categories of patients could present different levels of challenge due to the difference in imaging and variations of heart shapes. The deep learning (DL)-based methods demonstrated great potential, though several of them reported poor results in the blinded evaluation. Their performance could vary greatly across different network structures and training strategies. The conventional algorithms, mainly based on multi-atlas segmentation, demonstrated good performance, though the accuracy and computational efficiency could be limited. The challenge, including provision of the annotated training data and the blinded evaluation for submitted algorithms on the test data, continues as an ongoing benchmarking resource via its homepage (www.sdspeople.fudan.edu.cn/zhuangxiahai/0/mmwhs/).

Indexed as

AlgorithmsMagnetic Resonance ImagingTomography, X-Ray ComputedDatasets as TopicHeartHumansImage Processing, Computer-AssistedBenchmarkChallengeMulti-modalityWhole Heart Segmentation

Identifiers

PMID31446280
PMCPMC6839613

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.