Evidence map›Paper›PMID 32701148›Full record

ArticleJAMA oncology2020

Development and Validation of a Deep Learning Algorithm for Gleason Grading of Prostate Cancer From Biopsy Specimens.

Kunal Nagpal, Davis Foote, Fraser Tan, Yun Liu, Po-Hsuan Cameron Chen, David F Steiner, Naren Manoj, Niels Olson, Jenny L Smith, Arash Mohtashamian and 16 more

Abstract read
In one paragraph

Article in JAMA oncology, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 91 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
91citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

91 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Review
  3. Article
  4. Article
  5. Review
  6. Review
  7. Review
  8. Article
  9. Article
  10. Article
  11. Artificial intelligence in prostate cancer.Chinese medical journal · 2025
    Review
  12. Exploring the role of multimodal [European journal of nuclear medicine and molecular imaging · 2025
    Article
  13. Article
  14. Article
  15. Review
  16. Article
  17. Review
  18. Article
  19. DGR-MIL: Exploring Diverse Global Representation in Multiple Instance Learning for Whole Slide Image Classification.Computer vision - ECCV ... : ... European Conference on Computer Vision : proceedings. European Conference on Computer Vision · 2025
    Article
  20. Review

31 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

26 authors.

Kunal NagpalGoogle Health, Google LLC, Mountain View, California.
Davis FooteGoogle Health, Google LLC, Mountain View, California.
Fraser TanGoogle Health, Google LLC, Mountain View, California.
Yun LiuGoogle Health, Google LLC, Mountain View, California.
Po-Hsuan Cameron ChenGoogle Health, Google LLC, Mountain View, California.
David F SteinerGoogle Health, Google LLC, Mountain View, California.
Naren ManojGoogle Health, Google LLC, Mountain View, California.
Niels OlsonLaboratory Department, Naval Medical Center San Diego, San Diego, California.
Jenny L SmithLaboratory Department, Naval Medical Center San Diego, San Diego, California.
Arash MohtashamianLaboratory Department, Naval Medical Center San Diego, San Diego, California.
Brandon PetersonLaboratory Department, Naval Medical Center San Diego, San Diego, California.
Mahul B AminDepartment of Pathology and Laboratory Medicine, University of Tennessee Health Science Center, Memphis.
Andrew J EvansDepartment of Pathology, Laboratory Medicine and Pathology, University Health Network and University of Toronto, Toronto, Ontario, Canada.
Joan W SweetDepartment of Pathology, Laboratory Medicine and Pathology, University Health Network and University of Toronto, Toronto, Ontario, Canada.
Carol CheungDepartment of Pathology, Laboratory Medicine and Pathology, University Health Network and University of Toronto, Toronto, Ontario, Canada.
Theodorus van der KwastDepartment of Pathology, Laboratory Medicine and Pathology, University Health Network and University of Toronto, Toronto, Ontario, Canada.
Ankur R SangoiDepartment of Pathology, El Camino Hospital, Mountain View, California.
Ming ZhouTufts Medical Center, Boston, Massachusetts.
Robert AllanPathology and Laboratory Medicine Service, North Florida/South Georgia Veterans Health System, Gainesville, Florida.
Peter A HumphreyDepartment of Pathology, Yale School of Medicine, New Haven, Connecticut.
Jason D HippGoogle Health, Google LLC, Mountain View, California.
Krishna GadepalliGoogle Health, Google LLC, Mountain View, California.
Greg S CorradoGoogle Health, Google LLC, Mountain View, California.
Lily H PengGoogle Health, Google LLC, Mountain View, California.
Martin C StumpeGoogle Health, Google LLC, Mountain View, California.
Craig H MermelGoogle Health, Google LLC, Mountain View, California.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Importance: For prostate cancer, Gleason grading of the biopsy specimen plays a pivotal role in determining case management. However, Gleason grading is associated with substantial interobserver variability, resulting in a need for decision support tools to improve the reproducibility of Gleason grading in routine clinical practice. Objective: To evaluate the ability of a deep learning system (DLS) to grade diagnostic prostate biopsy specimens. Design, Setting, and Participants: The DLS was evaluated using 752 deidentified digitized images of formalin-fixed paraffin-embedded prostate needle core biopsy specimens obtained from 3 institutions in the United States, including 1 institution not used for DLS development. To obtain the Gleason grade group (GG), each specimen was first reviewed by 2 expert urologic subspecialists from a multi-institutional panel of 6 individuals (years of experience: mean, 25 years; range, 18-34 years). A third subspecialist reviewed discordant cases to arrive at a majority opinion. To reduce diagnostic uncertainty, all subspecialists had access to an immunohistochemical-stained section and 3 histologic sections for every biopsied specimen. Their review was conducted from December 2018 to June 2019. Main Outcomes and Measures: The frequency of the exact agreement of the DLS with the majority opinion of the subspecialists in categorizing each tumor-containing specimen as 1 of 5 categories: nontumor, GG1, GG2, GG3, or GG4-5. For comparison, the rate of agreement of 19 general pathologists' opinions with the subspecialists' majority opinions was also evaluated. Results: For grading tumor-containing biopsy specimens in the validation set (n = 498), the rate of agreement with subspecialists was significantly higher for the DLS (71.7%; 95% CI, 67.9%-75.3%) than for general pathologists (58.0%; 95% CI, 54.5%-61.4%) (P < .001). In subanalyses of biopsy specimens from an external validation set (n = 322), the Gleason grading performance of the DLS remained similar. For distinguishing nontumor from tumor-containing biopsy specimens (n = 752), the rate of agreement with subspecialists was 94.3% (95% CI, 92.4%-95.9%) for the DLS and similar at 94.7% (95% CI, 92.8%-96.3%) for general pathologists (P = .58). Conclusions and Relevance: In this study, the DLS showed higher proficiency than general pathologists at Gleason grading prostate needle core biopsy specimens and generalized to an independent institution. Future research is necessary to evaluate the potential utility of using the DLS as a decision support tool in clinical workflows and to improve the quality of prostate cancer grading for therapy decisions.

Indexed as

Image Interpretation, Computer-AssistedAdolescentAdultAlgorithmsArtificial IntelligenceBiopsy, Large-Core NeedleDeep LearningHumansMaleNeoplasm GradingProstatic NeoplasmsSpecimen HandlingUnited StatesYoung Adult

Identifiers

PMID32701148
PMCPMC7378872

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.