Evidence map›Paper›PMID 40133589›Full record

ArticleClinical & translational oncology : official publication of the Federation of Spanish Oncology Societies and of the National Cancer Institute of Mexico2025

Assessing the accuracy of the GPT-4 model in multidisciplinary tumor board decision prediction.

Efe Cem Erdat, Merih Yalçıner, Mehmet Berk Örüncü, Yüksel Ürün, Filiz Çay Şenler

Abstract read
In one paragraph

Article in Clinical & translational oncology : official publication of the Federation of Spanish Oncology Societies and of the National Cancer Institute of Mexico, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 12 papers.

0numbers the graph read from it
0cells of the map it votes in
12citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

12 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. ChatGPT-4o as a decision-support tool in a urological tumour board: a prospective evaluation.Clinical & translational oncology : official publication of the Federation of Spanish Oncology Societies and of the National Cancer Institute of Mexico · 2026
    Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Review
  10. Article
  11. Article
  12. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Efe Cem ErdatDepartment of Medical Oncology, Ankara University Faculty of Medicine, Tip Fakultesi Cd. No 1 Mamak, Ankara, Turkey. cemerdat@gmail.com.ORCID http://orcid.org/0000-0002-1250-1297
Merih YalçınerDepartment of Medical Oncology, Ankara University Faculty of Medicine, Tip Fakultesi Cd. No 1 Mamak, Ankara, Turkey.ORCID http://orcid.org/0000-0003-3337-2188
Mehmet Berk ÖrüncüDepartment of Medical Oncology, Ankara University Faculty of Medicine, Tip Fakultesi Cd. No 1 Mamak, Ankara, Turkey.ORCID http://orcid.org/0000-0002-2808-4897
Yüksel ÜrünDepartment of Medical Oncology, Ankara University Faculty of Medicine, Tip Fakultesi Cd. No 1 Mamak, Ankara, Turkey.ORCID http://orcid.org/0000-0002-9152-9887
Filiz Çay ŞenlerDepartment of Medical Oncology, Ankara University Faculty of Medicine, Tip Fakultesi Cd. No 1 Mamak, Ankara, Turkey.ORCID http://orcid.org/0000-0002-7156-4650

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

purposeArtificial intelligence models like GPT-4 (OpenAI) have the potential to support clinical decision-making in oncology. This study aimed to assess the consistency between multidisciplinary tumor board (MTB) decisions and GPT-4 model predictions in cancer patient management. PATIENTS AND

methodsA cross-sectional study was conducted involving patients aged ≥ 18 years with definite or suspicious cancer diagnoses presented at MTBs in Ankara University Hospitals, Türkiye, from February 2021 to June 2023. GPT-4 was utilized to generate treatment recommendations based on case summaries. Three independent raters evaluated the compatibility between MTB decisions and GPT-4 predictions using a 4-point Likert scale. Cases with mean compatibility scores equal to or below 2 were reviewed by two expert oncologists for appropriateness.

resultsA total of 610 patients were included. The mean compatibility score across raters was 3.59 (SD = 0.81), indicating high agreement between GPT-4 predictions and MTB decisions. Cronbach's alpha was 0.950 (95% CI 0.935-0.960), demonstrating excellent interrater reliability. Sixty-two cases (10.2%) had mean compatibility scores below the threshold of 2. The first expert oncologist deemed GPT-4's predictions inappropriate in 8 of these cases (12.9%), while the second deemed them inappropriate in 16 cases (25.8%). Cohen's kappa showed moderate agreement (κ = 0.50, 95% CI 0.25-0.75, p < 0.001). Discrepancies were often due to rare cases lacking guideline information or misunderstandings of case presentations.

conclusionGPT-4 exhibited high compatibility with MTB decisions in cancer patient management, suggesting its potential as a supportive tool in clinical oncology. However, limitations exist, especially in rare or complex cases.

Indexed as

Artificial IntelligenceClinical Decision-MakingNeoplasmsAdultAgedAged, 80 and overCross-Sectional StudiesFemaleHumansMaleMedical OncologyMiddle AgedReproducibility of ResultsArtificial intelligenceCancer treatmentMachine learningMultidisciplinary approachReal-world dataTumor board

Identifiers

PMID40133589
PMCPMC12399707

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.