Evidence map›Paper›PMID 40502255›Full record

ArticleAMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science2025

Enhancing Disease Detection in Radiology Reports Through Fine-tuning Lightweight LLM on Weak Labels.

Yishu Wei, Xindi Wang, Hanley Ong, Yiliang Zhou, Adam Flanders, George Shih, Yifan Peng

Abstract read
In one paragraph

Article in AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 7 papers.

0numbers the graph read from it
0cells of the map it votes in
7citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

7 citing papers in PubMed.

  1. Natural Language Processing Algorithm Accurately Classifies Diverticulitis-Related Complications and Predicts Long-Term Outcomes.Clinical gastroenterology and hepatology : the official clinical practice journal of the American Gastroenterological Association · 2026
    Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Review
  7. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Yishu WeiDepartment of Population Health Sciences, Weill Cornell Medicine, New York.
Xindi WangDepartment of Radiology, Weill Cornell Medicine, New York.
Hanley OngDepartment of Radiology, Weill Cornell Medicine, New York.
Yiliang ZhouDepartment of Population Health Sciences, Weill Cornell Medicine, New York.
Adam FlandersDepartment of Radiology, Thomas Jefferson University Hospital, Philadelphia.
George ShihDepartment of Population Health Sciences, Weill Cornell Medicine, New York.
Yifan PengDepartment of Population Health Sciences, Weill Cornell Medicine, New York.

Funding

Multimodal AI Fusion Model for Early Detection for Pancreatic CancerR01CA289249 · NCI · MAYO CLINIC ARIZONA · PI Imon Banerjee, Yifan Peng · 2024 to 2026
$2.8M
NCI NIH HHS R01 CA289249
6 · The paper itself

Abstract

Despite significant progress in applying large language models (LLMs) to the medical domain, several limitations still prevent them from practical applications. Among these are the constraints on model size and the lack of cohort-specific labeled datasets. In this work, we investigated the potential of improving a lightweight LLM, such as Llama 3.1-8B, through fine-tuning with datasets using synthetic labels. Two tasks are jointly trained by combining their respective instruction datasets. When the quality of the task-specific synthetic labels is relatively high (e.g., generated by GPT4-o), Llama 3.1-8B achieves satisfactory performance on the open-ended disease detection task, with a micro F1 score of 0.91. Conversely, when the quality of the task-relevant synthetic labels is relatively low (e.g., from the MIMIC-CXR dataset), fine-tuned Llama 3.1-8B is able to surpass its noisy teacher labels (micro F1 score of 0.67 v.s. 0.63) when calibrated against curated labels, indicating the strong inherent underlying capability of the model. These findings demonstrate the potential offine-tuning LLMs with synthetic labels, offering a promising direction for future research on LLM specialization in the medical domain.

Identifiers

PMID40502255
PMCPMC12150749

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.