Evidence map›Paper›PMID 32548288›Full record

ArticleTomography (Ann Arbor, Mich.)2020

Standardization in Quantitative Imaging: A Multicenter Comparison of Radiomic Features from Different Software Packages on Digital Reference Objects and Patient Data Sets.

M McNitt-Gray, S Napel, A Jaggi, S A Mattonen, L Hadjiiski, M Muzi, D Goldgof, Y Balagurunathan, L A Pierce, P E Kinahan and 19 more

Abstract readMulticenter Study
In one paragraph

Article in Tomography (Ann Arbor, Mich.), 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 45 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
45citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

45 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Guideline
  3. Trial
  4. Article
  5. Article
  6. Article
  7. Review
  8. Review
  9. Review
  10. Article
  11. Article
  12. Article
  13. Review
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

29 authors.

M McNitt-GrayDavid Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA.
S NapelStanford University School of Medicine, Stanford, CA.
A JaggiStanford University School of Medicine, Stanford, CA.
S A MattonenStanford University School of Medicine, Stanford, CA.
L HadjiiskiUniversity of Michigan, Ann Arbor, MI.
M MuziUniversity of Washington, Seattle, WA.
D GoldgofUniversity of South Florida, Tampa, FL.
Y BalagurunathanH. Lee Moffitt Cancer Center, Tampa, FL.
L A PierceUniversity of Washington, Seattle, WA.
P E KinahanUniversity of Washington, Seattle, WA.
E F JonesUC San Francisco, School of Medicine, San Francisco, CA.
A NguyenUC San Francisco, School of Medicine, San Francisco, CA.
A VirkudUniversity of Michigan, Ann Arbor, MI.
H P ChanUniversity of Michigan, Ann Arbor, MI.
N EmaminejadDavid Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA.
M Wahi-AnwarDavid Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA.
M DalyDavid Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA.
M AbdalahH. Lee Moffitt Cancer Center, Tampa, FL.
H YangColumbia University Medical Center, New York, NY.
L LuColumbia University Medical Center, New York, NY.
W LvBC Cancer Research Centre, Vancouver, BC, Canada.
A RahmimBC Cancer Research Centre, Vancouver, BC, Canada.
A GastouniotiCenter for Biomedical Image Computing and Analytics (CBICA), University of Pennsylvania, Philadelphia, PA.
S PatiCenter for Biomedical Image Computing and Analytics (CBICA), University of Pennsylvania, Philadelphia, PA.
S BakasCenter for Biomedical Image Computing and Analytics (CBICA), University of Pennsylvania, Philadelphia, PA.
D KontosCenter for Biomedical Image Computing and Analytics (CBICA), University of Pennsylvania, Philadelphia, PA.
B ZhaoColumbia University Medical Center, New York, NY.
J Kalpathy-CramerMassachusetts General Hospital, Boston, MA; and.
K FarahaniNational Cancer Institute, Bethesda, MD.

Funding

TRANSLATIONAL RESEARCHP30CA076292 · NCI · UNIVERSITY OF SOUTH FLORIDA · PI Christine O'Connell · 1998 to 2026
$93.5M
Quantitative Imaging Clinical Validation Center at Moffitt Cancer CenterU01CA200464 · NCI · H. LEE MOFFITT CANCER CTR & RES INST · PI JOHN J HEINE, Matthew B. Schabath · 2016 to 2026
$9.2M
Statistical atlases of brain tumor MRI:do imaging phenotypes predict progression?R01NS042645 · NINDS · UNIVERSITY OF PENNSYLVANIA · PI DAVATZIKOS, CHRISTOS · 2002 to 2024
$8.7M
Advanced PET/CT Imaging for Improving Clinical TrialsU01CA148131 · NCI · UNIVERSITY OF WASHINGTON · PI KINAHAN, PAUL E., LINDEN, HANNAH M · 2010 to 2019
$6.0M
Radiomics of NSCLCU01CA143062 · NCI · H. LEE MOFFITT CANCER CTR & RES INST · PI GILLIES, ROBERT J., SCHABATH, MATTHEW B. · 2010 to 2020
$5.7M
Informatics Tools for Optimized Imaging Biomarkers for Cancer Research&DiscoveryU24CA180927 · NCI · MASSACHUSETTS GENERAL HOSPITAL · PI KALPATHY-CRAMER, JAYASHREE, ROSEN, BRUCE R · 2014 to 2018
$3.4M
Quantitative MRI of Glioblastoma ResponseU01CA154601 · NCI · MASSACHUSETTS GENERAL HOSPITAL · PI KALPATHY-CRAMER, JAYASHREE · 2011 to 2016
$3.4M
Quantitative Imaging for Assessing Breast Cancer Response to TreatmentU01CA225427 · NCI · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI HYLTON-WATSON, NOLA M. · 2018 to 2022
$3.2M
Cancer imaging phenomics software suite: application to brain and breast cancerU24CA189523 · NCI · UNIVERSITY OF PENNSYLVANIA · PI DAVATZIKOS, CHRISTOS, KONTOS, DESPINA · 2015 to 2019
$3.2M
Radiogenomic Biomarkers of Breast Cancer RecurrenceR01CA223816 · NCI · UNIVERSITY OF PENNSYLVANIA · PI CHODOSH, LEWIS A, KONTOS, DESPINA · 2018 to 2022
$3.1M
Biomarker-Based Tools for Treatment Response Decision Support of Bladder CancerU01CA232931 · NCI · UNIVERSITY OF MICHIGAN AT ANN ARBOR · PI ALVA, AJJAI SHIVARAM, HADJIYSKI, LUBOMIR M · 2019 to 2024
$3.1M
Integrating Radiomics into S0819 and Lung-MAP, Biomarker Driven Clinical Trials for Lung CancerU01CA225431 · NCI · SLOAN-KETTERING INST CAN RESEARCH · PI SCHWARTZ, LAWRENCE H, ZHAO, BINSHENG · 2018 to 2022
$3.1M
NCI NIH HHS P30 CA076292NCI NIH HHS R01 CA223816NCI NIH HHS R50 CA211270NCI NIH HHS U01 CA143062NCI NIH HHS U01 CA148131NCI NIH HHS U01 CA154601NCI NIH HHS U01 CA181156NCI NIH HHS U01 CA187947NCI NIH HHS U01 CA200464NCI NIH HHS U01 CA225427NCI NIH HHS U01 CA225431NCI NIH HHS U01 CA232931NCI NIH HHS U24 CA180927NCI NIH HHS U24 CA189523NIH HHS S10 OD023495NINDS NIH HHS R01 NS042645
6 · The paper itself

Abstract

Radiomic features are being increasingly studied for clinical applications. We aimed to assess the agreement among radiomic features when computed by several groups by using different software packages under very tightly controlled conditions, which included standardized feature definitions and common image data sets. Ten sites (9 from the NCI's Quantitative Imaging Network] positron emission tomography-computed tomography working group plus one site from outside that group) participated in this project. Nine common quantitative imaging features were selected for comparison including features that describe morphology, intensity, shape, and texture. The common image data sets were: three 3D digital reference objects (DROs) and 10 patient image scans from the Lung Image Database Consortium data set using a specific lesion in each scan. Each object (DRO or lesion) was accompanied by an already-defined volume of interest, from which the features were calculated. Feature values for each object (DRO or lesion) were reported. The coefficient of variation (CV), expressed as a percentage, was calculated across software packages for each feature on each object. Thirteen sets of results were obtained for the DROs and patient data sets. Five of the 9 features showed excellent agreement with CV < 1%; 1 feature had moderate agreement (CV < 10%), and 3 features had larger variations (CV ≥ 10%) even after attempts at harmonization of feature calculations. This work highlights the value of feature definition standardization as well as the need to further clarify definitions for some features.

Indexed as

Image Processing, Computer-AssistedPositron Emission Tomography Computed TomographyRadiometrySoftwareHumansNeoplasmsReference StandardsFeature DefinitionsMulti-centerQuantitative ImagingRadiomicsStandardization

Identifiers

PMID32548288
PMCPMC7289262

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.