Evidence map›Paper›PMID 29268169›Full record

ArticleMedical image analysis2018

The first MICCAI challenge on PET tumor segmentation.

Mathieu Hatt, Baptiste Laurent, Anouar Ouahabi, Hadi Fayad, Shan Tan, Laquan Li, Wei Lu, Vincent Jaouen, Clovis Tauber, Jakub Czakon and 11 more

Abstract readComparative Study
In one paragraph

Article in Medical image analysis, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 60 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
60citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

60 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Guideline
  2. Pooled it
  3. Article
  4. Article
  5. The utility of quantitativeAsia Oceania journal of nuclear medicine & biology · 2025
    Article
  6. [Diagnostics (Basel, Switzerland) · 2024
    Review
  7. Review
  8. Article
  9. Article
  10. Article
  11. Article
  12. A multi-label CNN model for the automatic detection and segmentation of gliomas using [European journal of nuclear medicine and molecular imaging · 2023
    Article
  13. Article
  14. Review
  15. Multimodal Pediatric Lymphoma Detection using PET and MRI.AMIA ... Annual Symposium proceedings. AMIA Symposium · 2023
    Article
  16. Article
  17. Overview of the HECKTOR Challenge at MICCAI 2022: Automatic Head and Neck Tumor Segmentation and Outcome Prediction in PET/CT.Head and neck tumor segmentation and outcome prediction : third challenge, HECKTOR 2022, held in conjunction with MICCAI 2022, Singapore, September 22, 2022, Proceedings. Head and Neck Tumor Segmentation Challenge (3rd : 2022 : Singapor... · 2023
    Article
  18. Article
  19. An EANM position paper on the application of artificial intelligence in nuclear medicine.European journal of nuclear medicine and molecular imaging · 2022
    Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

21 authors.

Mathieu HattLaTIM, UMR 1101, INSERM, IBSAM, UBO, UBL, Brest, France. Electronic address: hatt@univ-brest.fr.
Baptiste LaurentLaTIM, UMR 1101, INSERM, IBSAM, UBO, UBL, Brest, France.
Anouar OuahabiLaTIM, UMR 1101, INSERM, IBSAM, UBO, UBL, Brest, France.
Hadi FayadLaTIM, UMR 1101, INSERM, IBSAM, UBO, UBL, Brest, France.
Shan TanKey Laboratory of Image Processing and Intelligent Control of Ministry of Education of China, School of Automation, Huazhong University of Science and Technology, Wuhan 430074, China.
Laquan LiKey Laboratory of Image Processing and Intelligent Control of Ministry of Education of China, School of Automation, Huazhong University of Science and Technology, Wuhan 430074, China.
Wei LuMemorial Sloan-Kettering Cancer Center, New-York, USA.
Vincent JaouenLaTIM, UMR 1101, INSERM, IBSAM, UBO, UBL, Brest, France.
Clovis TauberINSERM, UMR 930, Imaging and brain, University of Tours, France.
Jakub CzakonStermedia Sp. z o. o., ul. A. Ostrowskiego 13, Wroclaw, Poland.
Filip DrapejkowskiStermedia Sp. z o. o., ul. A. Ostrowskiego 13, Wroclaw, Poland.
Witold DyrkaStermedia Sp. z o. o., ul. A. Ostrowskiego 13, Wroclaw, Poland; Wroclaw University of Science and Technology, Faculty of Fundamental Problems of Technology, Department of Biomedical Engineering, Poland.
Sorina Camarasu-PopUniversité de Lyon, CREATIS, CNRS UMR5220, INSERM UMR 1044, INSA-Lyon, Université Lyon 1, Lyon, France.
Frédéric CervenanskyUniversité de Lyon, CREATIS, CNRS UMR5220, INSERM UMR 1044, INSA-Lyon, Université Lyon 1, Lyon, France.
Pascal GirardUniversité de Lyon, CREATIS, CNRS UMR5220, INSERM UMR 1044, INSA-Lyon, Université Lyon 1, Lyon, France.
Tristan GlatardDepartment of Computer Science and Software Engineering, Concordia University, Montreal, Canada.
Michael KainINRIA, Visages project-team, CNRS, IRISA 6074, INSERM, Visages, UMR 1228, University of Rennes I, Rennes Cx 35042, France.
Yao YaoINRIA, Visages project-team, CNRS, IRISA 6074, INSERM, Visages, UMR 1228, University of Rennes I, Rennes Cx 35042, France.
Christian BarillotINRIA, Visages project-team, CNRS, IRISA 6074, INSERM, Visages, UMR 1228, University of Rennes I, Rennes Cx 35042, France.
Assen KirovMemorial Sloan-Kettering Cancer Center, New-York, USA.
Dimitris VisvikisLaTIM, UMR 1101, INSERM, IBSAM, UBO, UBL, Brest, France.

Funding

X-RAY CRYSTALLOGRAPHYP30CA008748 · NCI · SLOAN-KETTERING INSTITUTE FOR CANCER RES · PI Nicholas D Socci · 1985 to 2026
$347.4M
Quantitative PET/CT Analysis to Improve Evaluation of Tumor ResponseR01CA172638 · NCI · UNIVERSITY OF MARYLAND BALTIMORE · PI LU, WEI · 2013 to 2016
$1.3M
NCI NIH HHS P30 CA008748NCI NIH HHS R01 CA172638
6 · The paper itself

Abstract

introductionAutomatic functional volume segmentation in PET images is a challenge that has been addressed using a large array of methods. A major limitation for the field has been the lack of a benchmark dataset that would allow direct comparison of the results in the various publications. In the present work, we describe a comparison of recent methods on a large dataset following recommendations by the American Association of Physicists in Medicine (AAPM) task group (TG) 211, which was carried out within a MICCAI (Medical Image Computing and Computer Assisted Intervention) challenge. MATERIALS AND

methodsOrganization and funding was provided by France Life Imaging (FLI). A dataset of 176 images combining simulated, phantom and clinical images was assembled. A website allowed the participants to register and download training data (n = 19). Challengers then submitted encapsulated pipelines on an online platform that autonomously ran the algorithms on the testing data (n = 157) and evaluated the results. The methods were ranked according to the arithmetic mean of sensitivity and positive predictive value.

resultsSixteen teams registered but only four provided manuscripts and pipeline(s) for a total of 10 methods. In addition, results using two thresholds and the Fuzzy Locally Adaptive Bayesian (FLAB) were generated. All competing methods except one performed with median accuracy above 0.8. The method with the highest score was the convolutional neural network-based segmentation, which significantly outperformed 9 out of 12 of the other methods, but not the improved K-Means, Gaussian Model Mixture and Fuzzy C-Means methods.

conclusionThe most rigorous comparative study of PET segmentation algorithms to date was carried out using a dataset that is the largest used in such studies so far. The hierarchy amongst the methods in terms of accuracy did not depend strongly on the subset of datasets or the metrics (or combination of metrics). All the methods submitted by the challengers except one demonstrated good performance with median accuracy scores above 0.8.

Indexed as

AlgorithmsBayes TheoremFuzzy LogicHumansImage Processing, Computer-AssistedMachine LearningNeoplasmsNeural Networks, ComputerPhantoms, ImagingPositron-Emission TomographyPredictive Value of TestsSensitivity and SpecificityComparative studyImage segmentationMICCAI challengePET functional volumes

Identifiers

PMID29268169
PMCPMC7460722

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.