Evidence map›Paper›PMID 40240324›Full record

ArticleNature communications2025

A clinical benchmark of public self-supervised pathology foundation models.

Gabriele Campanella, Shengjia Chen, Manbir Singh, Ruchika Verma, Silke Muehlstedt, Jennifer Zeng, Aryeh Stock, Matt Croken, Brandon Veremis, Abdulkadir Elmas and 7 more

Abstract read
In one paragraph

Article in Nature communications, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 70 papers.

0numbers the graph read from it
0cells of the map it votes in
70citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

70 citing papers in PubMed.

  1. Article
  2. Article
  3. Review
  4. Review
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Review
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Review
  18. Article
  19. Review
  20. Article

10 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

17 authors.

Gabriele CampanellaWindreich Department of AI and Human Health, Icahn School of Medicine at Mount Sinai, New York, 10029, NY, USA. gabriele.campanella@mssm.edu.ORCID http://orcid.org/0000-0001-6299-1311
Shengjia ChenWindreich Department of AI and Human Health, Icahn School of Medicine at Mount Sinai, New York, 10029, NY, USA.ORCID http://orcid.org/0000-0003-1556-0679
Manbir SinghWindreich Department of AI and Human Health, Icahn School of Medicine at Mount Sinai, New York, 10029, NY, USA.
Ruchika VermaWindreich Department of AI and Human Health, Icahn School of Medicine at Mount Sinai, New York, 10029, NY, USA.
Silke MuehlstedtWindreich Department of AI and Human Health, Icahn School of Medicine at Mount Sinai, New York, 10029, NY, USA.
Jennifer ZengDepartment of Pathology, Icahn School of Medicine at Mount Sinai, New York, 10029, NY, USA.
Aryeh StockDepartment of Pathology, Icahn School of Medicine at Mount Sinai, New York, 10029, NY, USA.ORCID http://orcid.org/0000-0003-1500-5819
Matt CrokenDepartment of Pathology, Icahn School of Medicine at Mount Sinai, New York, 10029, NY, USA.
Brandon VeremisDepartment of Pathology, Icahn School of Medicine at Mount Sinai, New York, 10029, NY, USA.
Abdulkadir ElmasDepartment of Genetics and Genomics, Icahn School of Medicine at Mount Sinai, New York, 10029, NY, USA.ORCID http://orcid.org/0000-0002-7999-5770
Ivan ShujskiDepartment of Clinical Pathology, Sahlgrenska University Hospital, Gothenburg, Sweden.
Noora NeittaanmäkiDepartment of Clinical Pathology, Sahlgrenska University Hospital, Gothenburg, Sweden.
Kuan-Lin HuangDepartment of Genetics and Genomics, Icahn School of Medicine at Mount Sinai, New York, 10029, NY, USA.ORCID http://orcid.org/0000-0002-5537-5817
Ricky KwanDepartment of Pathology, Icahn School of Medicine at Mount Sinai, New York, 10029, NY, USA.
Jane HouldsworthDepartment of Pathology, Icahn School of Medicine at Mount Sinai, New York, 10029, NY, USA.ORCID http://orcid.org/0000-0002-6781-1700
Adam J SchoenfeldDepartment of Medicine, Memorial Sloan Kettering Cancer Center, New York, 10065, NY, USA.ORCID http://orcid.org/0000-0002-2644-1416
Chad VanderbiltDepartment of Pathology, Memorial Sloan Kettering Cancer Center, New York, 10065, NY, USA. vanderbc@mskcc.org.ORCID http://orcid.org/0000-0002-8114-0237

Funding

X-RAY CRYSTALLOGRAPHYP30CA008748 · NCI · SLOAN-KETTERING INSTITUTE FOR CANCER RES · PI Hongbiao Carl Lekaye · 1985 to 2026
$347.4M
Conduits: Mount Sinai Health System Translational Science HubUL1TR004419 · NCATS · ICAHN SCHOOL OF MEDICINE AT MOUNT SINAI · PI Rosalind J Wright · 2022 to 2026
$46.4M
Integrative Approaches for Identifying Causal Gene-Cell Type Pairs of Complex DiseaseR35GM138113 · NIGMS · ICAHN SCHOOL OF MEDICINE AT MOUNT SINAI · PI Kuan-lin Huang · 2020 to 2026
$3.0M
Multi-modal unsupervised embeddings to advance machine learning in healthcareR01LM013766 · NLM · ICAHN SCHOOL OF MEDICINE AT MOUNT SINAI · PI CAMPANELLA, GABRIELE · 2022 to 2025
$1.4M
NCATS NIH HHS UL1 TR004419NCI NIH HHS P30 CA008748NIGMS NIH HHS R35 GM138113NLM NIH HHS R01 LM013766U.S. Department of Health & Human Services | NIH | U.S. National Library of Medicine (NLM) LM013766
6 · The paper itself

Abstract

The use of self-supervised learning to train pathology foundation models has increased substantially in the past few years. Notably, several models trained on large quantities of clinical data have been made publicly available in recent months. This will significantly enhance scientific research in computational pathology and help bridge the gap between research and clinical deployment. With the increase in availability of public foundation models of different sizes, trained using different algorithms on different datasets, it becomes important to establish a benchmark to compare the performance of such models on a variety of clinically relevant tasks spanning multiple organs and diseases. In this work, we present a collection of pathology datasets comprising clinical slides associated with clinically relevant endpoints including cancer diagnoses and a variety of biomarkers generated during standard hospital operation from three medical centers. We leverage these datasets to systematically assess the performance of public pathology foundation models and provide insights into best practices for training foundation models and selecting appropriate pretrained models. To enable the community to evaluate their models on our clinical datasets, we make available an automated benchmarking pipeline for external use.

Indexed as

BenchmarkingNeoplasmsSupervised Machine LearningAlgorithmsHumans

Identifiers

PMID40240324
PMCPMC12003829

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.