Evidence map›Paper›PMID 40169573›Full record

ArticleNature communications2025

A clinically accessible small multimodal radiology model and evaluation metric for chest X-ray findings.

Juan Manuel Zambrano Chaves, Shih-Cheng Huang, Yanbo Xu, Hanwen Xu, Naoto Usuyama, Sheng Zhang, Fei Wang, Yujia Xie, Mahmoud Khademi, Ziyi Yang and 17 more

Abstract read
In one paragraph

Article in Nature communications, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 9 papers.

0numbers the graph read from it
0cells of the map it votes in
9citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

9 citing papers in PubMed.

  1. Article
  2. Review
  3. Article
  4. Review
  5. Review
  6. Article
  7. Article
  8. Review
  9. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

27 authors.

Juan Manuel Zambrano Chaves *Microsoft Research, Redmond, WA, USA.ORCID http://orcid.org/0000-0002-7274-8072
Shih-Cheng Huang *Stanford University, Stanford, CA, USA.ORCID http://orcid.org/0000-0001-9882-833X
Yanbo Xu *Microsoft Research, Redmond, WA, USA.
Hanwen Xu *University of Washington, Seattle, WA, USA.
Naoto Usuyama *Microsoft Research, Redmond, WA, USA.
Sheng Zhang *Microsoft Research, Redmond, WA, USA.
Fei WangUniversity of Southern California, Los Angeles, CA, USA.
Yujia XieMicrosoft Research, Redmond, WA, USA.
Mahmoud KhademiMicrosoft Research, Redmond, WA, USA.
Ziyi YangMicrosoft Research, Redmond, WA, USA.
Hany AwadallaMicrosoft Research, Redmond, WA, USA.
Julia GongMicrosoft Research, Redmond, WA, USA.ORCID http://orcid.org/0000-0003-2488-0121
Houdong HuMicrosoft Research, Redmond, WA, USA.
Jianwei YangMicrosoft Research, Redmond, WA, USA.
Chunyuan LiMicrosoft Research, Redmond, WA, USA.
Jianfeng GaoMicrosoft Research, Redmond, WA, USA.
Yu GuMicrosoft Research, Redmond, WA, USA.
Cliff WongMicrosoft Research, Redmond, WA, USA.
Mu WeiMicrosoft Research, Redmond, WA, USA.
Tristan NaumannMicrosoft Research, Redmond, WA, USA.ORCID http://orcid.org/0000-0003-2150-1747
Muhao ChenUniversity of California, Davis, CA, USA.ORCID http://orcid.org/0000-0003-0118-3147
Matthew P LungrenMicrosoft Research, Redmond, WA, USA.
Akshay ChaudhariStanford University, Stanford, CA, USA.ORCID http://orcid.org/0000-0002-3667-6796
Serena Yeung-LevyStanford University, Stanford, CA, USA.ORCID http://orcid.org/0000-0003-0529-0628
Curtis P LanglotzStanford University, Stanford, CA, USA.ORCID http://orcid.org/0000-0002-8972-8051
Sheng WangUniversity of Washington, Seattle, WA, USA. swang@cs.washington.edu.ORCID http://orcid.org/0000-0002-0439-5199
Hoifung PoonMicrosoft Research, Redmond, WA, USA. hoifung@microsoft.com.ORCID http://orcid.org/0000-0002-9067-0918

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Large foundation models show promise in biomedicine but face challenges in clinical use due to performance gaps, accessibility, cost, and lack of scalable evaluation. Here we show that open-source small multimodal models can bridge these gaps in radiology by generating free-text findings from chest X-ray images. Our data-centric approach leverages 697K curated radiology image-text pairs to train a specialized, domain-adapted chest X-ray encoder. We integrate this encoder with pre-trained language models via a lightweight adapter that aligns image and text modalities. To enable robust, clinically relevant evaluation, we develop and validate CheXprompt, a GPT-4-based metric for assessing factual accuracy aligned with radiologists' evaluations. Benchmarked with CheXprompt and other standard factuality metrics, LLaVA-Rad (7B) achieves state-of-the-art performance, outperforming much larger models like GPT-4V and Med-PaLM M (84B). While not immediately ready for real-time clinical deployment, LLaVA-Rad is a scalable, privacy-preserving and cost-effective step towards clinically adaptable multimodal AI for radiology.

Indexed as

Multimodal ImagingRadiography, ThoracicAlgorithmsHumans

Identifiers

PMID40169573
PMCPMC11962106

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.