Evidence map›Paper›PMID 33208341›Full record

ArticleClinical cancer research : an official journal of the American Association for Cancer Research2021

Using Machine Learning Algorithms to Predict Immunotherapy Response in Patients with Advanced Melanoma.

Paul Johannet, Nicolas Coudray, Douglas M Donnelly, George Jour, Irineu Illa-Bochaca, Yuhe Xia, Douglas B Johnson, Lee Wheless, James R Patrinely, Sofia Nomikou and 6 more

Abstract readValidation Study
In one paragraph

Article in Clinical cancer research : an official journal of the American Association for Cancer Research, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 94 papers.

0numbers the graph read from it
0cells of the map it votes in
94citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

94 citing papers in PubMed.

  1. Melanoma evolution in the lymph node shapes systemic outcomes.bioRxiv : the preprint server for biology · 2026
    Article
  2. Developing a Histology-Based Artificial Intelligence Biomarker to Predict Adjuvant Chemotherapy Benefit in Pancreatic Cancer.Journal of clinical oncology : official journal of the American Society of Clinical Oncology · 2026
    Article
  3. Review
  4. Review
  5. Review
  6. Article
  7. Review
  8. Review
  9. Review
  10. Review
  11. Review
  12. Review
  13. Article
  14. Review
  15. Review
  16. Review
  17. Article
  18. Artificial Intelligence Algorithm Predicts Response to Immune Checkpoint Inhibitors.Clinical cancer research : an official journal of the American Association for Cancer Research · 2025
    Article
  19. Article
  20. Review

34 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

16 authors.

Paul Johannet *Department of Medicine, NYU Grossman School of Medicine, New York, New York.ORCID 0000-0002-9264-8327
Nicolas Coudray *Applied Bioinformatics Laboratories, NYU Grossman School of Medicine, New York, New York.ORCID 0000-0002-6050-2219
Douglas M DonnellyRonald O. Perelman Department of Dermatology, NYU Grossman School of Medicine, New York, New York.
George JourDepartment of Pathology, NYU Grossman School of Medicine, New York, New York.
Irineu Illa-BochacaRonald O. Perelman Department of Dermatology, NYU Grossman School of Medicine, New York, New York.
Yuhe XiaDepartment of Population Health, NYU Grossman School of Medicine, New York, New York.
Douglas B JohnsonDepartment of Medicine, Vanderbilt University Medical Center, Nashville, Tennessee.
Lee WhelessDepartment of Dermatology, Vanderbilt University Medical Center, Nashville, Tennessee.ORCID 0000-0002-8162-5971
James R PatrinelyDepartment of Medicine, Vanderbilt University Medical Center, Nashville, Tennessee.ORCID 0000-0002-0979-1625
Sofia NomikouDepartment of Pathology, NYU Grossman School of Medicine, New York, New York.
David L RimmDepartment of Pathology, Yale University School of Medicine, New Haven, Connectcut.ORCID 0000-0001-5820-4397
Anna C PavlickPerlmutter Cancer Center, NYU Langone Health, New York, New York.
Jeffrey S WeberPerlmutter Cancer Center, NYU Langone Health, New York, New York.
Judy ZhongDepartment of Population Health, NYU Grossman School of Medicine, New York, New York.
Aristotelis TsirigosApplied Bioinformatics Laboratories, NYU Grossman School of Medicine, New York, New York. iman.osman@nyulangone.org aristotelis.tsirigos@nyulangone.org.ORCID 0000-0002-7512-8477
Iman OsmanRonald O. Perelman Department of Dermatology, NYU Grossman School of Medicine, New York, New York. iman.osman@nyulangone.org aristotelis.tsirigos@nyulangone.org.

Funding

Yale Clinical and Translational Science Award (U Component)UL1TR001863 · NCATS · YALE UNIVERSITY · PI John H. Krystal, LUCILA OHNO-MACHADO · 2016 to 2026
$102.9M
Vaccine FacilityP30CA016087 · NCI · NEW YORK UNIVERSITY SCHOOL OF MEDICINE · PI Drew R Jones · 1985 to 2026
$83.1M
Project 4P50CA225450 · NCI · NEW YORK UNIVERSITY SCHOOL OF MEDICINE · PI OSMAN, IMAN, WEBER, JEFFREY S · 2019 to 2025
$12.5M
NCATS NIH HHS UL1 TR001863NCI NIH HHS P30 CA016087NCI NIH HHS P50 CA225450
6 · The paper itself

Abstract

purposeSeveral biomarkers of response to immune checkpoint inhibitors (ICI) show potential but are not yet scalable to the clinic. We developed a pipeline that integrates deep learning on histology specimens with clinical data to predict ICI response in advanced melanoma. EXPERIMENTAL

designWe used a training cohort from New York University (New York, NY) and a validation cohort from Vanderbilt University (Nashville, TN). We built a multivariable classifier that integrates neural network predictions with clinical data. A ROC curve was generated and the optimal threshold was used to stratify patients as high versus low risk for progression. Kaplan-Meier curves compared progression-free survival (PFS) between the groups. The classifier was validated on two slide scanners (Aperio AT2 and Leica SCN400).

resultsThe multivariable classifier predicted response with AUC 0.800 on images from the Aperio AT2 and AUC 0.805 on images from the Leica SCN400. The classifier accurately stratified patients into high versus low risk for disease progression. Vanderbilt patients classified as high risk for progression had significantly worse PFS than those classified as low risk (

conclusionsHistology slides and patients' clinicodemographic characteristics are readily available through standard of care and have the potential to predict ICI treatment outcomes. With prospective validation, we believe our approach has potential for integration into clinical practice.

Indexed as

Machine LearningAdultAgedDisease ProgressionDrug Resistance, NeoplasmFemaleFollow-Up StudiesHumansImage Processing, Computer-AssistedImmune Checkpoint InhibitorsMaleMelanomaMiddle AgedNeoplasm StagingPrognosisProgression-Free SurvivalImmune Checkpoint Inhibitors

Identifiers

PMID33208341
PMCPMC7785656

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.