Evidence map›Paper›PMID 36194301›Full record

ArticleInsights into imaging2022

Standardised lesion segmentation for imaging biomarker quantitation: a consensus recommendation from ESR and EORTC.

Nandita M deSouza, Aad van der Lugt, Christophe M Deroose, Angel Alberich-Bayarri, Luc Bidaut, Laure Fournier, Lena Costaridou, Daniela E Oprea-Lager, Elmar Kotter, Marion Smits and 20 more

Abstract read
In one paragraph

Article in Insights into imaging, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 17 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
17citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

17 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Review
  4. Article
  5. Article
  6. Review
  7. Pulmonary contusion volume and radiomics as predictors of early-onset pneumonia in trauma patients, a retrospective single-centre study.European journal of trauma and emergency surgery : official publication of the European Trauma Society · 2025
    Observational
  8. Article
  9. Article
  10. Article
  11. Color-map recommendation for MR relaxometry maps.Magnetic resonance in medicine · 2025
    Article
  12. Review
  13. Review
  14. Article
  15. Article
  16. Advanced MR Techniques for Preoperative Glioma Characterization: Part 1.Journal of magnetic resonance imaging : JMRI · 2023
    Review
  17. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

30 authors.

Nandita M deSouzaDivision of Radiotherapy and Imaging, The Institute of Cancer Research and Royal Marsden NHS Foundation Trust, London, UK. nandita.deSouza@icr.ac.uk.ORCID http://orcid.org/0000-0003-4232-476X
Aad van der LugtDepartment of Radiology and Nuclear Medicine, Erasmus MC, University Medical Center, Rotterdam, The Netherlands.
Christophe M DerooseNuclear Medicine, University Hospitals Leuven, Leuven, Belgium.
Angel Alberich-BayarriQuantitative Imaging Biomarkers in Medicine (QUIBIM), Valencia, Spain.
Luc BidautCollege of Science, University of Lincoln, Lincoln, Lincoln, LN6 7TS, UK.
Laure FournierINSERM, Radiology Department, AP-HP, Hopital Europeen Georges Pompidou, Université de Paris, PARCC, 75015, Paris, France.
Lena CostaridouSchool of Medicine, University of Patras, University Campus, Rio, 26 500, Patras, Greece.
Daniela E Oprea-LagerDepartment of Radiology and Nuclear Medicine, Amsterdam, UMC, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands.
Elmar KotterDepartment of Radiology, University Medical Center Freiburg, Freiburg, Germany.
Marion SmitsDepartment of Radiology and Nuclear Medicine, Erasmus MC, University Medical Center, Rotterdam, The Netherlands.
Marius E MayerhoeferDepartment of Biomedical Imaging and Image-Guided Therapy, Medical University of Vienna, Vienna, Austria.
Ronald BoellaardDepartment of Radiology and Nuclear Medicine, Amsterdam, UMC, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands.
Anna CaroliDepartment of Biomedical Engineering, Istituto di Ricerche Farmacologiche Mario Negri IRCCS, Bergamo, Italy.
Lioe-Fee de Geus-OeiDepartment of Radiology, Leiden University Medical Center, Leiden, The Netherlands.
Wolfgang G KunzDepartment of Radiology, University Hospital, LMU Munich, Munich, Germany.
Edwin H OeiDepartment of Radiology and Nuclear Medicine, Erasmus MC, University Medical Center, Rotterdam, The Netherlands.
Frederic LecouvetDepartment of Radiology, Institut de Recherche Expérimentale et Clinique (IREC), Cliniques Universitaires Saint Luc, Université Catholique de Louvain (UCLouvain), 10 Avenue Hippocrate, 1200, Brussels, Belgium.
Manuela FrancaDepartment of Radiology, Centro Hospitalar Universitário do Porto, Instituto de Ciências Biomédicas de Abel Salazar, University of Porto, Porto, Portugal.
Christian LoeweDivision of Cardiovascular and Interventional Radiology, Department for Bioimaging and Image-Guided Therapy, Medical University of Vienna, Vienna, Austria.
Egesta LopciNuclear Medicine, IRCCS - Humanitas Research Hospital, via Manzoni 56, Rozzano, MI, Italy.
Caroline CaramellaRadiology Department, Hôpital Marie Lannelongue, Institut d'Oncologie Thoracique, Université Paris-Saclay, Le Plessis-Robinson, France.
Anders PerssonDepartment of Radiology, and Department of Health, Medicine and Caring Sciences, Center for Medical Image Science and Visualization (CMIV), Linköping University, Linköping, Sweden.
Xavier GolayQueen Square Institute of Neurology, University College London, London, UK.
Marc DeweyDepartment of Radiology, Charité Universitätsmedizin Berlin, Berlin, Germany.
James P B O'ConnorDivision of Radiotherapy and Imaging, The Institute of Cancer Research and Royal Marsden NHS Foundation Trust, London, UK.
Pim deGraafDepartment of Radiology and Nuclear Medicine, Amsterdam, UMC, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands.
Sergios GatidisDepartment of Radiology, University of Tubingen, Tübingen, Germany.
Gudrun ZahlmannRadiological Society of North America (RSNA), Oak Brook, IL, USA.
European Society of Radiology
European Organisation for Research and Treatment of Cancer

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundLesion/tissue segmentation on digital medical images enables biomarker extraction, image-guided therapy delivery, treatment response measurement, and training/validation for developing artificial intelligence algorithms and workflows. To ensure data reproducibility, criteria for standardised segmentation are critical but currently unavailable.

methodsA modified Delphi process initiated by the European Imaging Biomarker Alliance (EIBALL) of the European Society of Radiology (ESR) and the European Organisation for Research and Treatment of Cancer (EORTC) Imaging Group was undertaken. Three multidisciplinary task forces addressed modality and image acquisition, segmentation methodology itself, and standards and logistics. Devised survey questions were fed via a facilitator to expert participants. The 58 respondents to Round 1 were invited to participate in Rounds 2-4. Subsequent rounds were informed by responses of previous rounds. RESULTS/

conclusionsItems with ≥ 75% consensus are considered a recommendation. These include system performance certification, thresholds for image signal-to-noise, contrast-to-noise and tumour-to-background ratios, spatial resolution, and artefact levels. Direct, iterative, and machine or deep learning reconstruction methods, use of a mixture of CE marked and verified research tools were agreed and use of specified reference standards and validation processes considered essential. Operator training and refreshment were considered mandatory for clinical trials and clinical research. Items with a 60-74% agreement require reporting (site-specific accreditation for clinical research, minimal pixel number within lesion segmented, use of post-reconstruction algorithms, operator training refreshment for clinical practice). Items with ≤ 60% agreement are outside current recommendations for segmentation (frequency of system performance tests, use of only CE-marked tools, board certification of operators, frequency of operator refresher training). Recommendations by anatomical area are also specified.

Indexed as

mDelphiModality-specificOrgan-specificRegion of interestSegmentation and standardisation

Identifiers

PMID36194301
PMCPMC9532485

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.