ArticleCureus2025
Performance of GPT-4o and DeepSeek-R1 in the Polish Infectious Diseases Specialty Exam.
Article in Cureus, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 15 papers.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
15 citing papers in PubMed.
- Assessment of various artificial intelligence applications' performance in responding to multiple-choice endodontics questions.BMC oral health · 2026Article
- Performance of five large language models in oral and maxillofacial surgery exam questions: a comparative study.BMC oral health · 2026Article
- Benchmark evaluation of deepseek AI models in antibacterial clinical decision-making for infectious diseases.BMC medical informatics and decision making · 2026Article
- Evaluation of Large Language Models in Infectious Disease Decision-Making: From Examination to Clinical Practice.Infection and drug resistance · 2026Article
- Performance of deepseek-R1 and ChatGPT-5.4 thinking in the medical laboratory professional title examination: accuracy, stability, and comparison with interns.Frontiers in digital health · 2026Article
- From algorithms to operating room: can large language models master China's attending anesthesiology exam? A cross-sectional evaluation.International journal of surgery (London, England) · 2026Article
- Complementary AI in higher education: behavioral, cognitive, and ethical implications of ChatGPT and DeepSeek.Frontiers in psychology · 2026Article
- When AI models take the exam: large language models vs medical students on multiple-choice course exams.Medical education online · 2025Article
- Assessing AI-Based Large Language Models (ChatGPT, Google Gemini, and DeepSeek) for Common Parent Questions about Autism: Acceptability, Readability, and Accuracy.The Psychiatric quarterly · 2025Article
- Comparative performance of Chinese and international large language models on the Chinese radiology attending physician qualification examination.Scientific reports · 2025Article
- Article
- Comparison of GPT-4o With Human Performance in the Polish Vascular Surgery Specialty Examination.Cureus · 2025Article
- Article
- Performance of the ChatGPT-4o Language Model in Solving the Ophthalmology Specialization Exam.Cureus · 2025Article
- Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
14 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
Background The past few years have been a time of rapid development in artificial intelligence (AI) and its implementation across numerous fields. This study aimed to compare the performance of GPT-4o (OpenAI, San Francisco, CA, USA) and DeepSeek-R1 (DeepSeek AI, Zhejiang, China) on the Polish specialty examination in infectious diseases. Materials and methods The study was conducted from April 1 to April 4, 2025, using the Autumn 2024 Polish specialty examination in infectious diseases. The examination comprised 120 questions, each presenting five answer options, with only one correct choice. The Center for Medical Education (CEM) in Łódź, Poland decided to withdraw one question due to the absence of a definitive correct answer and inconsistency with up-to-date clinical guidelines. Furthermore, the questions were classified as either 'clinical cases' or 'other' to enable a more in-depth evaluation of the potential of artificial intelligence in real-world clinical practice. The accuracy of the responses was verified using the official answer key approved by the CEM. To assess the accuracy and confidence level of the responses provided by GPT-4o and DeepSeek-R1, statistical methods were employed, including Pearson's χ
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.