Evidence map›Paper›PMID 26847203›Full record

ArticleJournal of digital imaging2016

A Comparison of Lung Nodule Segmentation Algorithms: Methods and Results from a Multi-institutional Study.

Jayashree Kalpathy-Cramer, Binsheng Zhao, Dmitry Goldgof, Yuhua Gu, Xingwei Wang, Hao Yang, Yongqiang Tan, Robert Gillies, Sandy Napel

Abstract readComparative StudyMulticenter Study
In one paragraph

Article in Journal of digital imaging, 2016. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 42 papers.

0numbers the graph read from it
0cells of the map it votes in
42citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

42 citing papers in PubMed.

  1. Article
  2. Article
  3. Review
  4. Article
  5. Review
  6. Article
  7. Multi-scale dense selective network based on border modeling for lung nodule segmentation.International journal of computer assisted radiology and surgery · 2023
    Article
  8. Article
  9. Article
  10. Review
  11. Observational
  12. Article
  13. Article
  14. Review
  15. Review
  16. Article
  17. Article
  18. Article
  19. Review
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors.

Jayashree Kalpathy-CramerMassachusetts General Hospital and Harvard Medical School, Boston, MA, USA.
Binsheng ZhaoDepartment of Radiology, Columbia University Medical Center, New York, NY, USA.
Dmitry GoldgofDepartment of Computer Science and Engineering, University of South Florida, Tampa, FL, USA.
Yuhua GuDepartments of Cancer Imaging and Metabolism, H. Lee Moffitt Cancer Center and Research Institute, Tampa, FL, USA.
Xingwei WangDepartment of Radiology, Stanford University School of Medicine, James H. Clark Center S323 318 Campus Drive, Stanford, CA, 94305-5450, USA.
Hao YangDepartment of Radiology, Columbia University Medical Center, New York, NY, USA.
Yongqiang TanDepartment of Radiology, Columbia University Medical Center, New York, NY, USA.
Robert GilliesDepartments of Cancer Imaging and Metabolism, H. Lee Moffitt Cancer Center and Research Institute, Tampa, FL, USA.
Sandy NapelDepartment of Radiology, Stanford University School of Medicine, James H. Clark Center S323 318 Campus Drive, Stanford, CA, 94305-5450, USA. snapel@stanford.edu.

Funding

Radiomics of NSCLCU01CA143062 · NCI · H. LEE MOFFITT CANCER CTR & RES INST · PI GILLIES, ROBERT J., SCHABATH, MATTHEW B. · 2010 to 2020
$5.7M
Quantitative Image Informatics for Cancer Research (QIICR)U24CA180918 · NCI · BRIGHAM AND WOMEN'S HOSPITAL · PI FEDOROV, ANDRIY, KIKINIS, RON · 2013 to 2017
$4.0M
Informatics Tools for Optimized Imaging Biomarkers for Cancer Research&DiscoveryU24CA180927 · NCI · MASSACHUSETTS GENERAL HOSPITAL · PI KALPATHY-CRAMER, JAYASHREE, ROSEN, BRUCE R · 2014 to 2018
$3.4M
Quantitative MRI of Glioblastoma ResponseU01CA154601 · NCI · MASSACHUSETTS GENERAL HOSPITAL · PI KALPATHY-CRAMER, JAYASHREE · 2011 to 2016
$3.4M
Qualification and Deployment of Imaging Biomarkers of Cancer Treatment ResponseU01CA190214 · NCI · STANFORD UNIVERSITY · PI RUBIN, DANIEL L · 2015 to 2020
$3.1M
Tools for Linking and Mining image and Genomic Data in Non-Small Cell Lung CancerR01CA160251 · NCI · STANFORD UNIVERSITY · PI NAPEL, SANDY A., PLEVRITIS, SYLVIA KATINA · 2011 to 2015
$2.9M
Computing, Optimizing, and Evaluating Quantitative Cancer Imaging BiomarkersU01CA187947 · NCI · STANFORD UNIVERSITY · PI NAPEL, SANDY A., RUBIN, DANIEL L · 2015 to 2019
$2.9M
Quantitative Volume and Density Response Assessment: Sarcoma and HCC as a ModelU01CA140207 · NCI · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI SCHWARTZ, LAWRENCE H, ZHAO, BINSHENG · 2011 to 2015
$2.8M
Studying measurement variability in tumor volume and volume change on MDCTR01CA149490 · NCI · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI ZHAO, BINSHENG · 2011 to 2016
$1.7M
NCI NIH HHS R01 CA149490NCI NIH HHS R01 CA160251NCI NIH HHS U01 CA140207NCI NIH HHS U01 CA143062NCI NIH HHS U01 CA154601NCI NIH HHS U01 CA187947NCI NIH HHS U01 CA190214NCI NIH HHS U24 CA180918NCI NIH HHS U24 CA180927
6 · The paper itself

Abstract

Tumor volume estimation, as well as accurate and reproducible borders segmentation in medical images, are important in the diagnosis, staging, and assessment of response to cancer therapy. The goal of this study was to demonstrate the feasibility of a multi-institutional effort to assess the repeatability and reproducibility of nodule borders and volume estimate bias of computerized segmentation algorithms in CT images of lung cancer, and to provide results from such a study. The dataset used for this evaluation consisted of 52 tumors in 41 CT volumes (40 patient datasets and 1 dataset containing scans of 12 phantom nodules of known volume) from five collections available in The Cancer Imaging Archive. Three academic institutions developing lung nodule segmentation algorithms submitted results for three repeat runs for each of the nodules. We compared the performance of lung nodule segmentation algorithms by assessing several measurements of spatial overlap and volume measurement. Nodule sizes varied from 29 μl to 66 ml and demonstrated a diversity of shapes. Agreement in spatial overlap of segmentations was significantly higher for multiple runs of the same algorithm than between segmentations generated by different algorithms (p < 0.05) and was significantly higher on the phantom dataset compared to the other datasets (p < 0.05). Algorithms differed significantly in the bias of the measured volumes of the phantom nodules (p < 0.05) underscoring the need for assessing performance on clinical data in addition to phantoms. Algorithms that most accurately estimated nodule volumes were not the most repeatable, emphasizing the need to evaluate both their accuracy and precision. There were considerable differences between algorithms, especially in a subset of heterogeneous nodules, underscoring the recommendation that the same software be used at all time points in longitudinal studies.

Indexed as

AlgorithmsTomography, X-Ray ComputedHumansLung NeoplasmsPhantoms, ImagingReproducibility of ResultsSolitary Pulmonary NoduleTumor BurdenComputed tomographyInfrastructureLung cancerQuantitative imagingSegmentation

Identifiers

PMID26847203
PMCPMC4942386

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.