Evidence map›Paper›PMID 33169295›Full record

Trial reportEuropean radiology experimental2020

Impact of inter-reader contouring variability on textural radiomics of colorectal liver metastases.

Francesco Rizzetto, Francesca Calderoni, Cristina De Mattia, Arianna Defeudis, Valentina Giannini, Simone Mazzetti, Lorenzo Vassallo, Silvia Ghezzi, Andrea Sartore-Bianchi, Silvia Marsoni and 4 more

Abstract readClinical Trial, Phase IIMulticenter Study
In one paragraph

Trial report in European radiology experimental, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 28 papers.

0numbers the graph read from it
0cells of the map it votes in
28citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

28 citing papers in PubMed.

  1. Review
  2. Review
  3. Article
  4. Article
  5. Article
  6. Article
  7. Review
  8. Article
  9. Article
  10. Article
  11. Review
  12. Review
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

14 authors.

Francesco RizzettoDepartment of Radiology, ASST Grande Ospedale Metropolitano Niguarda, Piazza Ospedale Maggiore 3, 20162, Milan, Italy.
Francesca CalderoniDepartment of Medical Physics, ASST Grande Ospedale Metropolitano Niguarda, Piazza Ospedale Maggiore 3, 20162, Milan, Italy.
Cristina De MattiaDepartment of Medical Physics, ASST Grande Ospedale Metropolitano Niguarda, Piazza Ospedale Maggiore 3, 20162, Milan, Italy.
Arianna DefeudisDepartment of Surgical Sciences, University of Turin, via Verdi 8, 10124, Turin, Italy.
Valentina GianniniDepartment of Surgical Sciences, University of Turin, via Verdi 8, 10124, Turin, Italy.
Simone MazzettiDepartment of Surgical Sciences, University of Turin, via Verdi 8, 10124, Turin, Italy.
Lorenzo VassalloRadiology Unit, SS Annunziata Hospital ASLCN1 Cuneo, via Ospedali 14, 12038, Cuneo, Savigliano, Italy.
Silvia GhezziNiguarda Cancer Center, Grande Ospedale Metropolitano Niguarda, Piazza Ospedale Maggiore 3, 20162, Milan, Italy.
Andrea Sartore-BianchiNiguarda Cancer Center, Grande Ospedale Metropolitano Niguarda, Piazza Ospedale Maggiore 3, 20162, Milan, Italy.
Silvia MarsoniPrecision Oncology, IFOM - The FIRC Institute of Molecular Oncology, via Adamello 16, 20139, Milan, Italy.
Salvatore SienaNiguarda Cancer Center, Grande Ospedale Metropolitano Niguarda, Piazza Ospedale Maggiore 3, 20162, Milan, Italy.
Daniele ReggeDepartment of Surgical Sciences, University of Turin, via Verdi 8, 10124, Turin, Italy.
Alberto TorresinDepartment of Medical Physics, ASST Grande Ospedale Metropolitano Niguarda, Piazza Ospedale Maggiore 3, 20162, Milan, Italy.
Angelo VanzulliDepartment of Radiology, ASST Grande Ospedale Metropolitano Niguarda, Piazza Ospedale Maggiore 3, 20162, Milan, Italy. angelo.vanzulli@unimi.it.ORCID 0000-0002-2452-3370

Funding

Associazione Italiana per la Ricerca sul Cancro 21091
6 · The paper itself

Abstract

backgroundRadiomics is expected to improve the management of metastatic colorectal cancer (CRC). We aimed at evaluating the impact of liver lesion contouring as a source of variability on radiomic features (RFs).

methodsAfter Ethics Committee approval, 70 liver metastases in 17 CRC patients were segmented on contrast-enhanced computed tomography scans by two residents and checked by experienced radiologists. RFs from grey level co-occurrence and run length matrices were extracted from three-dimensional (3D) regions of interest (ROIs) and the largest two-dimensional (2D) ROIs. Inter-reader variability was evaluated with Dice coefficient and Hausdorff distance, whilst its impact on RFs was assessed using mean relative change (MRC) and intraclass correlation coefficient (ICC). For the main lesion of each patient, one reader also segmented a circular ROI on the same image used for the 2D ROI.

resultsThe best inter-reader contouring agreement was observed for 2D ROIs according to both Dice coefficient (median 0.85, interquartile range 0.78-0.89) and Hausdorff distance (0.21 mm, 0.14-0.31 mm). Comparing RF values, MRC ranged 0-752% for 2D and 0-1567% for 3D. For 24/32 RFs (75%), MRC was lower for 2D than for 3D. An ICC > 0.90 was observed for more RFs for 2D (53%) than for 3D (34%). Only 2/32 RFs (6%) showed a variability between 2D and circular ROIs higher than inter-reader variability.

conclusionsA 2D contouring approach may help mitigate overall inter-reader variability, albeit stable RFs can be extracted from both 3D and 2D segmentations of CRC liver metastases.

Indexed as

Observer VariationAdultAgedColorectal NeoplasmsContrast MediaFemaleHumansLiver NeoplasmsMaleMiddle AgedRadiographic Image Interpretation, Computer-AssistedReproducibility of ResultsTomography, X-Ray ComputedContrast MediaColorectal neoplasmscomputed)Image processing (computer-assisted)Liver neoplasmsRadiomicsTomography (x-ray

Identifiers

PMID33169295
PMCPMC7652946

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.