Evidence map›Paper›PMID 34655313›Full record

ArticleEuropean radiology2022

Sources of variation in multicenter rectal MRI data and their effect on radiomics feature reproducibility.

Niels W Schurink, Simon R van Kranen, Sander Roberti, Joost J M van Griethuysen, Nino Bogveradze, Francesca Castagnoli, Najim El Khababi, Frans C H Bakers, Shira H de Bie, Gerlof P T Bosma and 8 more

Open access · hybridAbstract readMulticenter Study
In one paragraph

Article in European radiology, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 27 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
27citing papers in PubMed, 1 pooled it
4.6field-weighted citation impact, top 5% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

27 citing papers in PubMed, 1 synthesis or guideline pooled it, 44 citations in OpenAlex.

  1. Pooled it
  2. Review
  3. Article
  4. Article
  5. Article
  6. Review
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Uncertainties in outcome modelling in radiation oncology.Physics and imaging in radiation oncology · 2025
    Review
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. The Role of Radiomics in Rectal Cancer.Journal of gastrointestinal cancer · 2023
    Review
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

18 authors at 13 institutions in 3 countries.

Niels W SchurinkDepartment of Radiology, The Netherlands Cancer Institute, POB 90203, 1006 BE, Amsterdam, The Netherlands.
Simon R van KranenDepartment of Radiation Oncology, The Netherlands Cancer Institute, Amsterdam, The Netherlands.
Sander RobertiDepartment of Epidemiology and Biostatistics, The Netherlands Cancer Institute, Amsterdam, The Netherlands.
Joost J M van GriethuysenDepartment of Radiology, The Netherlands Cancer Institute, POB 90203, 1006 BE, Amsterdam, The Netherlands.
Nino BogveradzeDepartment of Radiology, The Netherlands Cancer Institute, POB 90203, 1006 BE, Amsterdam, The Netherlands.
Francesca CastagnoliDepartment of Radiology, The Netherlands Cancer Institute, POB 90203, 1006 BE, Amsterdam, The Netherlands.
Najim El KhababiDepartment of Radiology, The Netherlands Cancer Institute, POB 90203, 1006 BE, Amsterdam, The Netherlands.
Frans C H BakersDepartment of Radiology, Maastricht University Medical Centre, Maastricht, The Netherlands.
Shira H de BieDepartment of Radiology, Deventer Ziekenhuis, Deventer, The Netherlands.
Gerlof P T BosmaDepartment of Interventional Radiology, Elisabeth Tweesteden Hospital, Tilburg, The Netherlands.
Vincent C CappendijkDepartment of Radiology, Jeroen Bosch Hospital, 's-Hertogenbosch, The Netherlands.
Remy W F GeenenDepartment of Radiology, Northwest Clinics, Alkmaar, The Netherlands.
Peter A NeijenhuisDepartment of Surgery, Alrijne Hospital, Leiderdorp, The Netherlands.
Gerald M PetersonDepartment of Radiology, Spaarne Gasthuis, Haarlem, The Netherlands.
Cornelis J VeekenDepartment of Radiology, IJsselland Hospital, Capelle Aan Den IJssel, The Netherlands.
Roy F A VliegenDepartment of Radiology, Zuyderland Medical Center, Heerlen, The Netherlands.
Regina G H Beets-TanDepartment of Radiology, The Netherlands Cancer Institute, POB 90203, 1006 BE, Amsterdam, The Netherlands. r.beetstan@nki.nl.
Doenja M J LambregtsDepartment of Radiology, The Netherlands Cancer Institute, POB 90203, 1006 BE, Amsterdam, The Netherlands. d.lambregts@nki.nl.
The Netherlands Cancer Institute · NLMaastricht University · NLAlrijne Ziekenhuis · NLDeventer Ziekenhuis · NLElisabeth-TweeSteden Ziekenhuis · NLIJsselland Ziekenhuis · NLJeroen Bosch Ziekenhuis · NLMaastricht University Medical Centre · NLNorthwest Hospital · USOncode Institute · NLSpaarne Gasthuis · NLTbilisi State Medical University · GEZuyderland Medisch Centrum · NL

Funding

kwf kankerbestrijding 10138
6 · The paper itself

Abstract

objectivesTo investigate sources of variation in a multicenter rectal cancer MRI dataset focusing on hardware and image acquisition, segmentation methodology, and radiomics feature extraction software.

methodsT2W and DWI/ADC MRIs from 649 rectal cancer patients were retrospectively acquired in 9 centers. Fifty-two imaging features (14 first-order/6 shape/32 higher-order) were extracted from each scan using whole-volume (expert/non-expert) and single-slice segmentations using two different software packages (PyRadiomics/CapTk). Influence of hardware, acquisition, and patient-intrinsic factors (age/gender/cTN-stage) on ADC was assessed using linear regression. Feature reproducibility was assessed between segmentation methods and software packages using the intraclass correlation coefficient.

resultsImage features differed significantly (p < 0.001) between centers with more substantial variations in ADC compared to T2W-MRI. In total, 64.3% of the variation in mean ADC was explained by differences in hardware and acquisition, compared to 0.4% by patient-intrinsic factors. Feature reproducibility between expert and non-expert segmentations was good to excellent (median ICC 0.89-0.90). Reproducibility for single-slice versus whole-volume segmentations was substantially poorer (median ICC 0.40-0.58). Between software packages, reproducibility was good to excellent (median ICC 0.99) for most features (first-order/shape/GLCM/GLRLM) but poor for higher-order (GLSZM/NGTDM) features (median ICC 0.00-0.41).

conclusionsSignificant variations are present in multicenter MRI data, particularly related to differences in hardware and acquisition, which will likely negatively influence subsequent analysis if not corrected for. Segmentation variations had a minor impact when using whole volume segmentations. Between software packages, higher-order features were less reproducible and caution is warranted when implementing these in prediction models. KEY POINTS: • Features derived from T2W-MRI and in particular ADC differ significantly between centers when performing multicenter data analysis. • Variations in ADC are mainly (> 60%) caused by hardware and image acquisition differences and less so (< 1%) by patient- or tumor-intrinsic variations. • Features derived using different image segmentations (expert/non-expert) were reproducible, provided that whole-volume segmentations were used. When using different feature extraction software packages with similar settings, higher-order features were less reproducible.

Indexed as

Magnetic Resonance ImagingRectal NeoplasmsDiffusion Magnetic Resonance ImagingHumansImage Processing, Computer-AssistedReproducibility of ResultsRetrospective StudiesImage processing, Computer-assistedMagnetic resonance imagingMulticenter studyRectal neoplasmsReproducibility of results

Identifiers

PMID34655313
PMCPMC8831294
OpenAlexW3205389983

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.