Evidence map›Paper›PMID 39518061›Full record

ArticleCancers2024

Exploring Multilingual Large Language Models for Enhanced TNM Classification of Radiology Report in Lung Cancer Staging.

Hidetoshi Matsuo, Mizuho Nishio, Takaaki Matsunaga, Koji Fujimoto, Takamichi Murakami

Abstract read
In one paragraph

Article in Cancers, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 13 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
13citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

13 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. LLM-powered prostate cancer staging from PSMA-PET/CT reports using PROMISE v2.European journal of nuclear medicine and molecular imaging · 2026
    Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Review
  8. Article
  9. Article
  10. Article
  11. Review
  12. Article
  13. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Hidetoshi MatsuoDepartment of Radiology, Kobe University Graduate School of Medicine, Kobe 650-0017, Japan.
Mizuho NishioDepartment of Radiology, Kobe University Graduate School of Medicine, Kobe 650-0017, Japan.
Takaaki MatsunagaDepartment of Radiology, Kobe University Graduate School of Medicine, Kobe 650-0017, Japan.
Koji FujimotoAdvanced Imaging in Medical Magnetic Resonance, Kyoto University, Kyoto 606-8507, Japan.
Takamichi MurakamiDepartment of Radiology, Kobe University Graduate School of Medicine, Kobe 650-0017, Japan.

Funding

Cross-ministerial Strategic Innovation Promotion Program (SIP) and Construction of Integrated Health Care System JPJ01242Japan Society for the Promotion of Science 22K07665, 23KK0148, and 23K17229
6 · The paper itself

Abstract

BACKGROUND/

objectivesThis study aimed to investigate the accuracy of Tumor, Node, Metastasis (TNM) classification based on radiology reports using GPT3.5-turbo (GPT3.5) and the utility of multilingual large language models (LLMs) in both Japanese and English.

methodsUtilizing GPT3.5, we developed a system to automatically generate TNM classifications from chest computed tomography reports for lung cancer and evaluate its performance. We statistically analyzed the impact of providing full or partial TNM definitions in both languages using a generalized linear mixed model.

resultsThe highest accuracy was attained with full TNM definitions and radiology reports in English (M = 94%, N = 80%, T = 47%, and TNM combined = 36%). Providing definitions for each of the T, N, and M factors statistically improved their respective accuracies (T: odds ratio [OR] = 2.35,

conclusionsThis study underscores the potential of multilingual LLMs for automatic TNM classification in radiology reports. Even without additional model training, performance improvements were evident with the provided TNM definitions, indicating LLMs' relevance in radiology contexts.

Indexed as

lung cancermultilingual large language modelsradiologyTNM classification

Identifiers

PMID39518061
PMCPMC11544964

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.