Evidence map›Paper›PMID 38537293›Full record

ReviewPhysics in medicine and biology2024

Advancing medical imaging with language models: featuring a spotlight on ChatGPT.

Mingzhe Hu, Joshua Qian, Shaoyan Pan, Yuheng Li, Richard L J Qiu, Xiaofeng Yang

Abstract readReview
In one paragraph

Review in Physics in medicine and biology, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 18 papers.

0numbers the graph read from it
0cells of the map it votes in
18citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

18 citing papers in PubMed.

  1. Review
  2. Article
  3. Review
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Review
  12. Article
  13. Article
  14. Article
  15. Review
  16. Article
  17. Article
  18. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Mingzhe HuDepartment of Computer Science and Informatics, Emory University,  Atlanta, GA,  United States of America.ORCID 0000-0001-7523-8927
Joshua QianDepartment of Radiation Oncology, Winship Cancer Institute, School of Medicine, Emory University,  Atlanta, GA,  United States of America.ORCID 0000-0002-3094-9052
Shaoyan PanDepartment of Computer Science and Informatics, Emory University,  Atlanta, GA,  United States of America.
Yuheng LiDepartment of Biomedical Engineering, Emory University,  Atlanta, GA,  United States of America.
Richard L J QiuDepartment of Radiation Oncology, Winship Cancer Institute, School of Medicine, Emory University,  Atlanta, GA,  United States of America.
Xiaofeng YangDepartment of Computer Science and Informatics, Emory University,  Atlanta, GA,  United States of America.ORCID 0000-0001-9023-5855

Funding

eXtended Modular ANthropomorphic (XMAN) phantom for Imaging and Treatment Optimization in Radiotherapy.R01EB032680 · NIBIB · UNIVERSITY OF MARYLAND BALTIMORE · PI REN, LEI, YANG, XIAOFENG · 2022 to 2025
$2.4M
Real-time Volumetric Imaging for Motion Management and Dose Delivery VerificationR01CA272991 · NCI · EMORY UNIVERSITY · PI Zhen Tian, Xiaofeng Yang · 2023 to 2026
$2.3M
Multiparametric MRI-guided Prostate HDR Brachytherapy with Focal Tumor BoostR01CA215718 · NCI · EMORY UNIVERSITY · PI YANG, XIAOFENG · 2018 to 2022
$1.8M
Artificial Intelligence Driven Platform for PET/MR ImagingR56EB033332 · NIBIB · EMORY UNIVERSITY · PI MAO, HUI, YANG, XIAOFENG · 2022 to 2022
$764k
NCI NIH HHS R01 CA215718NCI NIH HHS R01 CA272991NIBIB NIH HHS R01 EB032680NIBIB NIH HHS R56 EB033332
6 · The paper itself

Abstract

This review paper aims to serve as a comprehensive guide and instructional resource for researchers seeking to effectively implement language models in medical imaging research. First, we presented the fundamental principles and evolution of language models, dedicating particular attention to large language models. We then reviewed the current literature on how language models are being used to improve medical imaging, emphasizing a range of applications such as image captioning, report generation, report classification, findings extraction, visual question response systems, interpretable diagnosis and so on. Notably, the capabilities of ChatGPT were spotlighted for researchers to explore its further applications. Furthermore, we covered the advantageous impacts of accurate and efficient language models in medical imaging analysis, such as the enhancement of clinical workflow efficiency, reduction of diagnostic errors, and assistance of clinicians in providing timely and accurate diagnoses. Overall, our goal is to have better integration of language models with medical imaging, thereby inspiring new ideas and innovations. It is our aspiration that this review can serve as a useful resource for researchers in this field, stimulating continued investigative and innovative pursuits of the application of language models in medical imaging.

Indexed as

Diagnostic ImagingHumansImage Processing, Computer-AssistedLanguageBERTChatGPTlarge language modelmedical imagingmultimodal learning

Identifiers

PMID38537293
PMCPMC11075180

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.