Evidence map›Paper›PMID 40451964›Full record

ArticleEmergency radiology2025

Fine-tuned large Language model for extracting newly identified acute brain infarcts based on computed tomography or magnetic resonance imaging reports.

Nana Fujita, Koichiro Yasaka, Shigeru Kiryu, Osamu Abe

Abstract read
In one paragraph

Article in Emergency radiology, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Nana FujitaDepartment of Radiology, National Center for Global Health and Medicine, Japan Institute for Health Security, Tokyo, Japan.ORCID http://orcid.org/0000-0002-4314-5475
Koichiro YasakaDepartment of Radiology, The University of Tokyo, Tokyo, Japan. koyasaka@gmail.com.ORCID http://orcid.org/0000-0002-0324-6562
Shigeru KiryuDepartment of Radiology, International University of Health and Welfare, Narita, Japan.ORCID http://orcid.org/0000-0003-1440-9483
Osamu AbeDepartment of Radiology, The University of Tokyo, Tokyo, Japan.ORCID http://orcid.org/0000-0002-1180-2629

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

purposeThis study aimed to develop an automated early warning system using a large language model (LLM) to identify acute to subacute brain infarction from free-text computed tomography (CT) or magnetic resonance imaging (MRI) radiology reports.

methodsIn this retrospective study, 5,573, 1,883, and 834 patients were included in the training (mean age, 67.5 ± 17.2 years; 2,831 males), validation (mean age, 61.5 ± 18.3 years; 994 males), and test (mean age, 66.5 ± 16.1 years; 488 males) datasets. An LLM (Japanese Bidirectional Encoder Representations from Transformers model) was fine-tuned to classify the CT and MRI reports into three groups (group 0, newly identified acute to subacute infarction; group 1, known acute to subacute infarction or old infarction; group 2, without infarction). The training and validation processes were repeated 15 times, and the best-performing model on the validation dataset was selected to further evaluate its performance on the test dataset.

resultsThe best fine-tuned model exhibited sensitivities of 0.891, 0.905, and 0.959 for groups 0, 1, and 2, respectively, in the test dataset. The macrosensitivity (the average of sensitivity for all groups) and accuracy were 0.918 and 0.923, respectively. The model's performance in extracting newly identified acute brain infarcts was high, with an area under the receiver operating characteristic curve of 0.979 (95% confidence interval, 0.956-1.000). The average prediction time was 0.115 ± 0.037 s per patient.

conclusionA fine-tuned LLM could extract newly identified acute to subacute brain infarcts based on CT or MRI findings with high performance.

Indexed as

Brain InfarctionMagnetic Resonance ImagingNatural Language ProcessingTomography, X-Ray ComputedAgedFemaleHumansLarge Language ModelsMaleMiddle AgedRetrospective StudiesSensitivity and SpecificityArtificial intelligenceBrain infarctionComputed tomographyLarge language modelMagnetic resonance imagingNatural language processing

Identifiers

PMID40451964
PMCPMC12328549

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.