Evidence map›Paper›PMID 40523995›Full record

ArticleEuropean archives of oto-rhino-laryngology : official journal of the European Federation of Oto-Rhino-Laryngological Societies (EUFOS) : affiliated with the German Society for Oto-Rhino-Laryngology - Head and Neck Surgery2025

ChatGPT versus DeepSeek in head and neck cancer staging and treatment planning: guideline-based study.

Burcu Vural Camalan, Sumeyra Doluoglu, Nazlim Hilal Taraf, Mehmet Murat Gunay, Samet Ozlugedik

Abstract readComparative Study
In one paragraph

Article in European archives of oto-rhino-laryngology : official journal of the European Federation of Oto-Rhino-Laryngological Societies (EUFOS) : affiliated with the German Society for Oto-Rhino-Laryngology - Head and Neck Surgery, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 13 papers.

0numbers the graph read from it
0cells of the map it votes in
13citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

13 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Response to: "ChatGPT and deepseek in head and neck cancers: objective scales could strengthen AI research in Medicine".European archives of oto-rhino-laryngology : official journal of the European Federation of Oto-Rhino-Laryngological Societies (EUFOS) : affiliated with the German Society for Oto-Rhino-Laryngology - Head and Neck Surgery · 2026
    Article
  8. ChatGPT and deepseek in head and neck cancers: objective scales could strengthen AI research in medicine.European archives of oto-rhino-laryngology : official journal of the European Federation of Oto-Rhino-Laryngological Societies (EUFOS) : affiliated with the German Society for Oto-Rhino-Laryngology - Head and Neck Surgery · 2026
    Article
  9. Article
  10. Review
  11. Article
  12. Article
  13. Review
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

5 authors.

Burcu Vural CamalanDepartment of Otorhinolaryngology Head and Neck Surgery, University of Health Sciences Ankara Etlik City Hospital, Varlık Mahallesi, Halil Sezai Erkut Caddesi, No:5, 06170, Yenimahalle, Ankara, Turkey. burcuvural@gmail.com.ORCID http://orcid.org/0000-0002-4157-3396
Sumeyra DoluogluDepartment of Otorhinolaryngology Head and Neck Surgery, University of Health Sciences Ankara Etlik City Hospital, Varlık Mahallesi, Halil Sezai Erkut Caddesi, No:5, 06170, Yenimahalle, Ankara, Turkey.ORCID http://orcid.org/0000-0002-7264-6578
Nazlim Hilal TarafDepartment of Otorhinolaryngology Head and Neck Surgery, University of Health Sciences Ankara Etlik City Hospital, Varlık Mahallesi, Halil Sezai Erkut Caddesi, No:5, 06170, Yenimahalle, Ankara, Turkey.ORCID http://orcid.org/0000-0002-7735-4224
Mehmet Murat GunayDepartment of Otorhinolaryngology Head and Neck Surgery, University of Health Sciences Ankara Etlik City Hospital, Varlık Mahallesi, Halil Sezai Erkut Caddesi, No:5, 06170, Yenimahalle, Ankara, Turkey.ORCID http://orcid.org/0000-0003-1880-8334
Samet OzlugedikDepartment of Otorhinolaryngology Head and Neck Surgery, University of Health Sciences Ankara Etlik City Hospital, Varlık Mahallesi, Halil Sezai Erkut Caddesi, No:5, 06170, Yenimahalle, Ankara, Turkey.ORCID http://orcid.org/0000-0001-7909-9100

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

purposeThis prospective simulation study was conducted to evaluate and compare the performance of ChatGPT (o1, 2023) and DeepSeek (V3, 2024) in staging and treatment planning for head and neck cancers.

methodsThis prospective simulation study was conducted in March 2025 to evaluate and compare the performance of two advanced artificial intelligence (AI) models, ChatGPT (o1, 2023) and DeepSeek (V3, 2024), in clinical decision-making for head and neck malignancies. A total of 50 hypothetical, guideline-based clinical scenarios were carefully designed in English by two otorhinolaryngologists in alignment with the National Comprehensive Cancer Network® (NCCN®) Guidelines Version 2.2025.

resultsIn the overall analysis of treatment planning performance, DeepSeek (V3, 2024) demonstrated statistically superior accuracy compared to ChatGPT (o1, 2023) (p = 0.04). Both models showed comparable performance in tumor staging (p = 0.83). Both DeepSeek (p = 0.0001) and ChatGPT (p = 0.02) were statistically successful in respect of staging accuracy and providing fully correct answers on the subject of treatment.

conclusionAlthough DeepSeek V3 demonstrated promising capability for clinical decision support in head and neck oncology, these artificial intelligence tools cannot replace multidisciplinary tumor boards. However, they can significantly streamline clinical workflows by rapidly organizing patient data, thereby enhancing board efficiency. Future efforts should prioritize the development and integration of secure, institution-specific, local large language models tailored for oncological decision-making.

Indexed as

Artificial IntelligenceClinical Decision-MakingHead and Neck NeoplasmsNeoplasm StagingGenerative Artificial IntelligenceHumansPractice Guidelines as TopicProspective StudiesArtificial intelligenceChatGPTDeepSeekHead and neck cancerLarge language models

Identifiers

PMID40523995
PMCPMC12423241

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.