Evidence map›Paper›PMID 40973166›Full record

ArticleThe oncologist2025

Large language model processing capabilities of ChatGPT 4.0 to generate molecular tumor board recommendations-a critical evaluation on real world data.

Maximilian Schmutz, Sebastian Sommer, Julia Sander, David Graumann, Johannes Raffler, Iñaki Soto-Rey, Seyedmostafa Sheikhalishahi, Lisa Schmidt, Leonhard Paul Unkelbach, Levent Ortak and 8 more

Abstract read
In one paragraph

Article in The oncologist, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 10 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
10citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

10 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Review
  4. Article
  5. Article
  6. Article
  7. Review
  8. Article
  9. Review
  10. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

18 authors.

Maximilian SchmutzDepartment of Hematology and Oncology, Faculty of Medicine, University of Augsburg, Augsburg 86156, Germany.ORCID 0000-0002-7453-7260
Sebastian SommerDepartment of Hematology and Oncology, Faculty of Medicine, University of Augsburg, Augsburg 86156, Germany.
Julia SanderDepartment of Data Management and Clinical Decision Support, Faculty of Medicine, University of Augsburg, Augsburg 86356, Germany.
David GraumannDepartment of Hematology and Oncology, Faculty of Medicine, University of Augsburg, Augsburg 86156, Germany.
Johannes RafflerDepartment of Data Management and Clinical Decision Support, Faculty of Medicine, University of Augsburg, Augsburg 86356, Germany.ORCID 0000-0003-2495-4020
Iñaki Soto-ReyDepartment of Data Management and Clinical Decision Support, Faculty of Medicine, University of Augsburg, Augsburg 86356, Germany.
Seyedmostafa SheikhalishahiDepartment of Data Management and Clinical Decision Support, Faculty of Medicine, University of Augsburg, Augsburg 86356, Germany.
Lisa SchmidtFaculty of Medicine, University of Augsburg, Augsburg 86195, Germany.
Leonhard Paul UnkelbachFaculty of Medicine, University of Augsburg, Augsburg 86195, Germany.
Levent OrtakFaculty of Medicine, University of Augsburg, Augsburg 86195, Germany.
Tina SchallerGeneral Pathology and Molecular Diagnostics, Faculty of Medicine, University of Augsburg, Augsburg 86156, Germany.
Sebastian DintnerGeneral Pathology and Molecular Diagnostics, Faculty of Medicine, University of Augsburg, Augsburg 86156, Germany.
Kathrin HildebrandGeneral Pathology and Molecular Diagnostics, Faculty of Medicine, University of Augsburg, Augsburg 86156, Germany.
Michaela KuhlenPediatrics and Adolescent Medicine, Faculty of Medicine, University of Augsburg, Augsburg 86156, Germany.ORCID 0000-0003-4577-0503
Frank JordanDepartment of Hematology and Oncology, Faculty of Medicine, University of Augsburg, Augsburg 86156, Germany.
Martin TrepelDepartment of Hematology and Oncology, Faculty of Medicine, University of Augsburg, Augsburg 86156, Germany.
Christian HinskeDepartment of Data Management and Clinical Decision Support, Faculty of Medicine, University of Augsburg, Augsburg 86356, Germany.
Rainer ClausDepartment of Hematology and Oncology, Faculty of Medicine, University of Augsburg, Augsburg 86156, Germany.ORCID 0000-0003-2617-8766

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundLarge language models (LLMs) like ChatGPT 4.0 hold promise for enhancing clinical decision-making in precision oncology, particularly within molecular tumor boards (MTBs). This study assesses ChatGPT 4.0's performance in generating therapy recommendations for complex real-world cancer cases compared to expert human MTB (hMTB) teams.

methodsWe retrospectively analyzed 20 anonymized MTB cases from the Comprehensive Cancer Center Augsburg (CCCA), covering breast cancer (n = 3), glioblastoma (n = 3), colorectal cancer (n = 2), and rare tumors. ChatGPT 4.0 recommendations were evaluated against hMTB outputs using metrics including recommendation type (therapeutic/diagnostic), information density (IDM), consistency, quality (level of evidence [LoE]), and efficiency. Each case was prompted thrice to evaluate variability (Fleiss' Kappa).

resultsChatGPT 4.0 generated more therapeutic recommendations per case than hMTB (median 3 vs 1, P = .005), with comparable diagnostic suggestions (median 1 vs 2, P = .501). Therapeutic scope from ChatGPT 4.0 included off-label and clinical trial options. IDM scores indicated similar content depth between ChatGPT 4.0 (median 0.67) and hMTB (median 0.75; P = .084). Moderate consistency was observed across replicate runs (median Fleiss' Kappa = 0.51). ChatGPT 4.0 occasionally utilized lower-level or preclinical evidence more frequently (P = .0019). Efficiency favored ChatGPT 4.0 significantly (median 15.2 vs 34.7 minutes; P < .001).

conclusionIncorporating ChatGPT 4.0 into MTB workflows enhances efficiency and provides relevant recommendations, especially in guideline-supported cases. However, variability in evidence prioritization highlights the need for ongoing human oversight. A hybrid approach, integrating human expertise with LLM support, may optimize precision oncology decision-making.

Indexed as

NeoplasmsPrecision MedicineClinical Decision-MakingFemaleGenerative Artificial IntelligenceHumansLarge Language ModelsRetrospective Studiesartificial intelligenceChatGPT 4.0large language modelsmolecular tumor boardprecision oncologyvariant annotation

Identifiers

PMID40973166
PMCPMC12557318

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.