Evidence map›Paper›PMID 35896707›Full record

ArticleScientific reports2022

The impact of inter-observer variation in delineation on robustness of radiomics features in non-small cell lung cancer.

Gargi Kothari, Beverley Woon, Cameron J Patrick, James Korte, Leonard Wee, Gerard G Hanna, Tomas Kron, Nicholas Hardcastle, Shankar Siva

Open access · goldAbstract read
In one paragraph

Article in Scientific reports, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 21 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
21citing papers in PubMed, 1 pooled it
2.4field-weighted citation impact, top 11% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

21 citing papers in PubMed, 1 synthesis or guideline pooled it, 19 citations in OpenAlex.

  1. Pooled it
  2. Review
  3. Review
  4. Article
  5. Review
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Review
  12. Review
  13. Article
  14. Article
  15. Article
  16. Article
  17. Prediction ofCancers · 2023
    Article
  18. Article
  19. Article
  20. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors at 4 institutions in 2 countries.

Gargi KothariDepartment of Radiation Oncology, Peter MacCallum Cancer Centre, Victorian Comprehensive Cancer Centre Building, 305 Grattan Street, Melbourne, VIC, 3000, Australia. Gargi.Kothari@petermac.org.
Beverley WoonSir Peter MacCallum Department of Oncology, Peter MacCallum Cancer Centre, University of Melbourne, Melbourne, VIC, Australia.
Cameron J PatrickStatistical Consulting Centre, University of Melbourne, Parkville, Australia.
James KorteDepartment of Physical Sciences, Peter MacCallum Cancer Centre, Melbourne, VIC, Australia.
Leonard WeeDepartment of Radiotherapy (MAASTRO), GROW School of Oncology, Maastricht University Medical Centre+, Maastricht, The Netherlands.
Gerard G HannaDepartment of Radiation Oncology, Peter MacCallum Cancer Centre, Victorian Comprehensive Cancer Centre Building, 305 Grattan Street, Melbourne, VIC, 3000, Australia.
Tomas KronSir Peter MacCallum Department of Oncology, Peter MacCallum Cancer Centre, University of Melbourne, Melbourne, VIC, Australia.
Nicholas HardcastleSir Peter MacCallum Department of Oncology, Peter MacCallum Cancer Centre, University of Melbourne, Melbourne, VIC, Australia.
Shankar SivaDepartment of Radiation Oncology, Peter MacCallum Cancer Centre, Victorian Comprehensive Cancer Centre Building, 305 Grattan Street, Melbourne, VIC, 3000, Australia.
University of Melbourne · AUPeter MacCallum Cancer Centre · AUMaastro Clinic · NLVictorian Comprehensive Cancer Centre · AU

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Artificial intelligence and radiomics have the potential to revolutionise cancer prognostication and personalised treatment. Manual outlining of the tumour volume for extraction of radiomics features (RF) is a subjective process. This study investigates robustness of RF to inter-observer variation (IOV) in contouring in lung cancer. We utilised two public imaging datasets: 'NSCLC-Radiomics' and 'NSCLC-Radiomics-Interobserver1' ('Interobserver'). For 'NSCLC-Radiomics', we created an additional set of manual contours for 92 patients, and for 'Interobserver', there were five manual and five semi-automated contours available for 20 patients. Dice coefficients (DC) were calculated for contours. 1113 RF were extracted including shape, first order and texture features. Intraclass correlation coefficient (ICC) was computed to assess robustness of RF to IOV. Cox regression analysis for overall survival (OS) was performed with a previously published radiomics signature. The median DC ranged from 0.81 ('NSCLC-Radiomics') to 0.85 ('Interobserver'-semi-automated). The median ICC for the 'NSCLC-Radiomics', 'Interobserver' (manual) and 'Interobserver' (semi-automated) were 0.90, 0.88 and 0.93 respectively. The ICC varied by feature type and was lower for first order and gray level co-occurrence matrix (GLCM) features. Shape features had a lower median ICC in the 'NSCLC-Radiomics' dataset compared to the 'Interobserver' dataset. Survival analysis showed similar separation of curves for three of four RF apart from 'original_shape_Compactness2', a feature with low ICC (0.61). The majority of RF are robust to IOV, with first order, GLCM and shape features being the least robust. Semi-automated contouring improves feature stability. Decreased robustness of a feature is significant as it may impact upon the features' prognostic capability.

Indexed as

Carcinoma, Non-Small-Cell LungLung NeoplasmsArtificial IntelligenceHumansObserver VariationPrognosis

Identifiers

PMID35896707
PMCPMC9329346
OpenAlexW4288067243

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.