Evidence map›Paper›PMID 39284899›Full record

ArticleCommunications engineering2024

Interactive computer-aided diagnosis on medical image using large language models.

Sheng Wang, Zihao Zhao, Xi Ouyang, Tianming Liu, Qian Wang, Dinggang Shen

Abstract read
In one paragraph

Article in Communications engineering, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 53 papers.

0numbers the graph read from it
0cells of the map it votes in
53citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

53 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Review
  8. Review
  9. Review
  10. Article
  11. Review
  12. Article
  13. Generative AI and foundation models in medical image.Radiological physics and technology · 2025
    Review
  14. Article
  15. State of the art review of AI in renal imaging.Abdominal radiology (New York) · 2025
    Review
  16. Article
  17. Article
  18. Article
  19. Review
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Sheng Wang *School of Biomedical Engineering & State Key Laboratory of Advanced Medical Materials and Devices, ShanghaiTech University, Shanghai, China.
Zihao Zhao *School of Biomedical Engineering & State Key Laboratory of Advanced Medical Materials and Devices, ShanghaiTech University, Shanghai, China.ORCID http://orcid.org/0009-0001-8044-7683
Xi OuyangDepartment of Research and Development, Shanghai United Imaging Intelligence Co., Ltd., Shanghai, China.
Tianming LiuSchool of Computing, University of Georgia, Athens, GA, USA.
Qian WangSchool of Biomedical Engineering & State Key Laboratory of Advanced Medical Materials and Devices, ShanghaiTech University, Shanghai, China. qianwang@shanghaitech.edu.cn.
Dinggang ShenSchool of Biomedical Engineering & State Key Laboratory of Advanced Medical Materials and Devices, ShanghaiTech University, Shanghai, China. dinggang.shen@gmail.com.

Funding

National Natural Science Foundation of China (National Science Foundation of China) 62250710165National Natural Science Foundation of China (National Science Foundation of China) U23A20295Science and Technology Commission of Shanghai Municipality (Shanghai Municipal Science and Technology Commission) 21010502600
6 · The paper itself

Abstract

Computer-aided diagnosis (CAD) has advanced medical image analysis, while large language models (LLMs) have shown potential in clinical applications. However, LLMs struggle to interpret medical images, which are critical for decision-making. Here we show a strategy integrating LLMs with CAD networks. The framework uses LLMs' medical knowledge and reasoning to enhance CAD network outputs, such as diagnosis, lesion segmentation, and report generation, by summarizing information in natural language. The generated reports are of higher quality and can improve the performance of vision-based CAD models. In chest X-rays, an LLM using ChatGPT improved diagnosis performance by 16.42 percentage points compared to state-of-the-art models, while GPT-3 provided a 15.00 percentage point F1-score improvement. Our strategy allows accurate report generation and creates a patient-friendly interactive system, unlike conventional CAD systems only understood by professionals. This approach has the potential to revolutionize clinical decision-making and patient communication.

Identifiers

PMID39284899
PMCPMC11405679

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.