Evidence map›Paper›PMID 41193692›Full record

ArticleNature medicine2025

A multimodal whole-slide foundation model for pathology.

Tong Ding, Sophia J Wagner, Andrew H Song, Richard J Chen, Ming Y Lu, Andrew Zhang, Anurag J Vaidya, Guillaume Jaume, Muhammad Shaban, Ahrong Kim and 19 more

Abstract read
In one paragraph

Article in Nature medicine, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 118 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
118citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

118 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Review
  8. Review
  9. Article
  10. Observational
  11. Article
  12. Article
  13. Article
  14. Article
  15. Review
  16. Review
  17. Review
  18. Article
  19. Review
  20. Article

58 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

29 authors.

Tong Ding *Department of Pathology, Mass General Brigham, Harvard Medical School, Boston, MA, USA.
Sophia J Wagner *Department of Pathology, Mass General Brigham, Harvard Medical School, Boston, MA, USA.ORCID http://orcid.org/0000-0003-3763-2282
Andrew H Song *Department of Pathology, Mass General Brigham, Harvard Medical School, Boston, MA, USA.ORCID http://orcid.org/0000-0001-9356-9156
Richard J Chen *Department of Pathology, Mass General Brigham, Harvard Medical School, Boston, MA, USA.
Ming Y LuDepartment of Pathology, Mass General Brigham, Harvard Medical School, Boston, MA, USA.
Andrew ZhangDepartment of Pathology, Mass General Brigham, Harvard Medical School, Boston, MA, USA.
Anurag J VaidyaDepartment of Pathology, Mass General Brigham, Harvard Medical School, Boston, MA, USA.
Guillaume JaumeDepartment of Pathology, Mass General Brigham, Harvard Medical School, Boston, MA, USA.ORCID http://orcid.org/0000-0002-3832-1390
Muhammad ShabanDepartment of Pathology, Mass General Brigham, Harvard Medical School, Boston, MA, USA.ORCID http://orcid.org/0000-0001-6115-1505
Ahrong KimDepartment of Pathology, Mass General Brigham, Harvard Medical School, Boston, MA, USA.
Drew F K WilliamsonDepartment of Pathology and Laboratory Medicine, Emory University School of Medicine, Atlanta, GA, USA.ORCID http://orcid.org/0000-0003-1745-8846
Harry RobertsonDepartment of Pathology, Mass General Brigham, Harvard Medical School, Boston, MA, USA.
Bowen ChenDepartment of Pathology, Mass General Brigham, Harvard Medical School, Boston, MA, USA.
Cristina Almagro-PérezDepartment of Pathology, Mass General Brigham, Harvard Medical School, Boston, MA, USA.
Paul DoucetDepartment of Pathology, Mass General Brigham, Harvard Medical School, Boston, MA, USA.
Sharifa SahaiDepartment of Pathology, Mass General Brigham, Harvard Medical School, Boston, MA, USA.
Chengkuan ChenDepartment of Pathology, Mass General Brigham, Harvard Medical School, Boston, MA, USA.
Christina S ChenDepartment of Pathology, Mass General Brigham, Harvard Medical School, Boston, MA, USA.
Daisuke KomuraDepartment of Preventive Medicine, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan.ORCID http://orcid.org/0000-0002-0038-728X
Akihiro KawabeDepartment of Preventive Medicine, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan.
Mieko OchiDepartment of Preventive Medicine, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan.
Shinya SatoDepartment of Pathology, Kanagawa Cancer Center Hospital, Kanagawa, Japan.
Tomoyuki YokoseDepartment of Pathology, Kanagawa Cancer Center Hospital, Kanagawa, Japan.
Yohei MiyagiMolecular Pathology and Genetics Division, Kanagawa Cancer Center Research Institute, Kanagawa, Japan.
Shumpei IshikawaDepartment of Preventive Medicine, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan.
Georg GerberDepartment of Pathology, Mass General Brigham, Harvard Medical School, Boston, MA, USA.ORCID http://orcid.org/0000-0002-9149-5509
Tingying PengHelmholtz Munich-German Research Center for Environment and Health, Munich, Germany.
Long Phi LeDepartment of Pathology, Mass General Brigham, Harvard Medical School, Boston, MA, USA. long.le@mgh.harvard.edu.
Faisal MahmoodDepartment of Pathology, Mass General Brigham, Harvard Medical School, Boston, MA, USA. faisalmahmood@bwh.harvard.edu.ORCID http://orcid.org/0000-0001-7587-1562

Funding

Multimodal and Generative AI for PathologyR35GM138216 · NIGMS · BROAD INSTITUTE, INC. · PI Faisal Mahmood · 2020 to 2026
$3.4M
Probabilistic deep learning models and integrated biological experiments for analyzing dynamic and heterogeneous microbiomesR35GM149270 · NIGMS · BRIGHAM AND WOMEN'S HOSPITAL · PI Georg Kurt Gerber · 2023 to 2026
$1.8M
NIGMS NIH HHS R35 GM138216NIGMS NIH HHS R35 GM149270
6 · The paper itself

Abstract

The field of computational pathology has been transformed with recent advances in foundation models that encode histopathology region-of-interests (ROIs) into versatile and transferable feature representations via self-supervised learning. However, translating these advancements to address complex clinical challenges at the patient and slide level remains constrained by limited clinical data in disease-specific cohorts, especially for rare clinical conditions. We propose Transformer-based pathology Image and Text Alignment Network (TITAN), a multimodal whole-slide foundation model pretrained using 335,645 whole-slide images via visual self-supervised learning and vision-language alignment with corresponding pathology reports and 423,122 synthetic captions generated from a multimodal generative AI copilot for pathology. Without any fine-tuning or requiring clinical labels, TITAN can extract general-purpose slide representations and generate pathology reports that generalize to resource-limited clinical scenarios such as rare disease retrieval and cancer prognosis. We evaluate TITAN on diverse clinical tasks and find that it outperforms both ROI and slide foundation models across machine learning settings, including linear probing, few-shot and zero-shot classification, rare cancer retrieval, cross-modal retrieval and pathology report generation.

Indexed as

Image Processing, Computer-AssistedNeoplasmsPathologyHumansMachine Learning

Identifiers

PMID41193692
PMCPMC12618242

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.