Evidence map›Paper›PMID 40343333›Full record

ArticleResearch square2025

A Systematic Review and Implementation Guidelines of Multimodal Foundation Models in Medical Imaging.

Shih-Cheng Huang, Malte Jensen, Serena Yeung-Levy, Matthew P Lungren, Hoifung Poon, Akshay S Chaudhari

Abstract readPreprint
In one paragraph

Article in Research square, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed.

  1. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Shih-Cheng HuangStanford University.
Malte JensenStanford University.
Serena Yeung-LevyStanford University.
Matthew P LungrenStanford University.
Hoifung PoonMicrosoft Research.
Akshay S ChaudhariStanford University.

Funding

Rapid MRI for Evaluation of OsteoarthritisR01EB002524 · NIBIB · STANFORD UNIVERSITY · PI Akshay Chaudhari, Garry E Gold · 2003 to 2026
$10.1M
TR&D Project 3: OpenSim for PredictionP41EB027060 · NIBIB · STANFORD UNIVERSITY · PI Joy P Ku · 2020 to 2026
$9.7M
RADX TECH - CERES NANOSCIENCE INC NANOTRAP PARTICLE MANUFACTURING75N92020C00021 · NHLBI · CERES NANOSCIENCES, LLLP · PI DUNLAP, ROSS · 2021 to 2021
$4.0M
Rapid Low-Cost Quantitative 3D MRI and Gait Assessment of the KneeR01AR077604 · NIAMS · STANFORD UNIVERSITY · PI HARGREAVES, BRIAN ANDREW · 2020 to 2024
$3.2M
Imaging of Joint Response to Physiological Stress with Age, Sex and in OsteoarthritisR01AR079431 · NIAMS · STANFORD UNIVERSITY · PI Feliks Kogan · 2022 to 2026
$2.9M
Novel Incidental Calcium Evaluation (NICE)R01HL169345 · NHLBI · STANFORD UNIVERSITY · PI Imon Banerjee, Akshay Chaudhari · 2024 to 2026
$2.1M
Population-level Pulmonary Embolism Outcome Prediction with Imaging and Clinical Data: A Multi-Center StudyR01HL155410 · NHLBI · STANFORD UNIVERSITY · PI LANGLOTZ, CURTIS P, SHAH, NIGAM H · 2021 to 2024
$2.1M
Deep Learning for Pulmonary Embolism Imaging Decision Support: A Multi-institutional CollaborationR01LM012966 · NLM · STANFORD UNIVERSITY · PI SHAH, NIGAM H · 2018 to 2021
$1.4M
NHLBI NIH HHS 75N92020C00008NHLBI NIH HHS 75N92020C00021NHLBI NIH HHS R01 HL155410NHLBI NIH HHS R01 HL169345NIAMS NIH HHS R01 AR077604NIAMS NIH HHS R01 AR079431NIBIB NIH HHS P41 EB027060NIBIB NIH HHS R01 EB002524NLM NIH HHS R01 LM012966
6 · The paper itself

Abstract

Artificial Intelligence (AI) holds immense potential to transform healthcare, yet progress is often hindered by the reliance on large labeled datasets and unimodal data. Multimodal Foundation Models (FMs), particularly those leveraging Self-Supervised Learning (SSL) on multimodal data, offer a paradigm shift towards label-efficient, holistic patient modeling. However, the rapid emergence of these complex models has created a fragmented landscape. Here, we provide a systematic review of multimodal FMs for medical imaging applications. Through rigorous screening of 1,144 publications (2012-2024) and in-depth analysis of 48 studies, we establish a unified terminology and comprehensively assess the current state-of-the-art. Our review aggregates current knowledge, critically identifies key limitations and underexplored opportunities, and culminates in actionable guidelines for researchers, clinicians, developers, and policymakers. This work provides a crucial roadmap to navigate and accelerate the responsible development and clinical translation of next-generation multimodal AI in healthcare.

Identifiers

PMID40343333
PMCPMC12060978

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.