Evidence map›Paper›PMID 28018939›Full record

ArticleJournal of medical imaging (Bellingham, Wash.)2016

LUNGx Challenge for computerized lung nodule classification.

Samuel G Armato, Karen Drukker, Feng Li, Lubomir Hadjiiski, Georgia D Tourassi, Roger M Engelmann, Maryellen L Giger, George Redmond, Keyvan Farahani, Justin S Kirby and 1 more

Abstract read
In one paragraph

Article in Journal of medical imaging (Bellingham, Wash.), 2016. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 38 papers.

0numbers the graph read from it
0cells of the map it votes in
38citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

38 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Review
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Review
  14. Article
  15. Review
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors.

Samuel G ArmatoThe University of Chicago , Department of Radiology, 5841 South Maryland Avenue, MC 2026, Chicago, Illinois 60637, United States.
Karen DrukkerThe University of Chicago , Department of Radiology, 5841 South Maryland Avenue, MC 2026, Chicago, Illinois 60637, United States.
Feng LiThe University of Chicago , Department of Radiology, 5841 South Maryland Avenue, MC 2026, Chicago, Illinois 60637, United States.
Lubomir HadjiiskiUniversity of Michigan , Department of Radiology, 1500 East Medical Center Drive, Ann Arbor, Michigan 48109, United States.
Georgia D TourassiHealth Data Sciences Institute , Biomedical Science and Engineering Center, Oak Ridge National Laboratory, P.O. Box 2008 MS6085 Oak Ridge, Tennessee 37831-6085, United States.
Roger M EngelmannThe University of Chicago , Department of Radiology, 5841 South Maryland Avenue, MC 2026, Chicago, Illinois 60637, United States.
Maryellen L GigerThe University of Chicago , Department of Radiology, 5841 South Maryland Avenue, MC 2026, Chicago, Illinois 60637, United States.
George RedmondNational Cancer Institute , Cancer Imaging Program, Division of Cancer Treatment and Diagnosis, 9609 Medical Center Drive, Bethesda, Maryland 20892, United States.
Keyvan FarahaniNational Cancer Institute , Cancer Imaging Program, Division of Cancer Treatment and Diagnosis, 9609 Medical Center Drive, Bethesda, Maryland 20892, United States.
Justin S KirbyLeidos Biomedical Research, Inc. , Frederick National Laboratory for Cancer Research, Cancer Imaging Program, 8560 Progress Drive, Frederick, Maryland 21702, United States.
Laurence P ClarkeNational Cancer Institute , Cancer Imaging Program, Division of Cancer Treatment and Diagnosis, 9609 Medical Center Drive, Bethesda, Maryland 20892, United States.

Funding

CCR NIH HHS HHSN261200800001CNCI NIH HHS HHSN261200800001E
6 · The paper itself

Abstract

The purpose of this work is to describe the LUNGx Challenge for the computerized classification of lung nodules on diagnostic computed tomography (CT) scans as benign or malignant and report the performance of participants' computerized methods along with that of six radiologists who participated in an observer study performing the same Challenge task on the same dataset. The Challenge provided sets of calibration and testing scans, established a performance assessment process, and created an infrastructure for case dissemination and result submission. Ten groups applied their own methods to 73 lung nodules (37 benign and 36 malignant) that were selected to achieve approximate size matching between the two cohorts. Area under the receiver operating characteristic curve (AUC) values for these methods ranged from 0.50 to 0.68; only three methods performed statistically better than random guessing. The radiologists' AUC values ranged from 0.70 to 0.85; three radiologists performed statistically better than the best-performing computer method. The LUNGx Challenge compared the performance of computerized methods in the task of differentiating benign from malignant lung nodules on CT scans, placed in the context of the performance of radiologists on the same task. The continued public availability of the Challenge cases will provide a valuable resource for the medical imaging research community.

Indexed as

challengeclassificationcomputed tomographycomputer-aided diagnosisimage analysislung nodule

Identifiers

PMID28018939
PMCPMC5166709

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.