Evidence map›Paper›PMID 39383119›Full record

ArticlePloS one2024

ChatGPT M.D.: Is there any room for generative AI in neurology?

Bernát Nógrádi, Tamás Ferenc Polgár, Valéria Meszlényi, Zalán Kádár, Péter Hertelendy, Anett Csáti, László Szpisjak, Dóra Halmi, Barbara Erdélyi-Furka, Máté Tóth and 7 more

Abstract read
In one paragraph

Article in PloS one, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 14 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
14citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

14 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. AI for clinical neurology: Comparing five large language models in neurological diagnosis and lesion localization.Neurological sciences : official journal of the Italian Neurological Society and of the Italian Society of Clinical Neurophysiology · 2026
    Article
  4. Article
  5. Cautionary lessons from real-world testing of GPT-4.1 AI for pediatric foreign body aspiration.European archives of oto-rhino-laryngology : official journal of the European Federation of Oto-Rhino-Laryngological Societies (EUFOS) : affiliated with the German Society for Oto-Rhino-Laryngology - Head and Neck Surgery · 2026
    Article
  6. Article
  7. Article
  8. Large Language Models in Neurological Practice: Real-World Study.Journal of medical Internet research · 2025
    Article
  9. Article
  10. Review
  11. Article
  12. Article
  13. Review
  14. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

17 authors.

Bernát NógrádiInstitute of Biophysics, HUN-REN Biological Research Centre, Szeged, Hungary.ORCID 0000-0001-8643-0367
Tamás Ferenc PolgárInstitute of Biophysics, HUN-REN Biological Research Centre, Szeged, Hungary.ORCID 0000-0002-6287-1093
Valéria MeszlényiInstitute of Biophysics, HUN-REN Biological Research Centre, Szeged, Hungary.
Zalán KádárInstitute of Biophysics, HUN-REN Biological Research Centre, Szeged, Hungary.
Péter HertelendyDepartment of Neurology, Albert Szent-Györgyi Health Centre, University of Szeged, Szeged, Hungary.
Anett CsátiDepartment of Neurology, Albert Szent-Györgyi Health Centre, University of Szeged, Szeged, Hungary.
László SzpisjakDepartment of Neurology, Albert Szent-Györgyi Health Centre, University of Szeged, Szeged, Hungary.
Dóra HalmiMetabolic Diseases and Cell Signaling Research Group, Department of Biochemistry, Albert Szent-Györgyi Medical School, University of Szeged, Szeged, Hungary.
Barbara Erdélyi-FurkaMetabolic Diseases and Cell Signaling Research Group, Department of Biochemistry, Albert Szent-Györgyi Medical School, University of Szeged, Szeged, Hungary.
Máté TóthSecond Department of Internal Medicine and Cardiology Centre, Albert Szent-Györgyi Health Centre, University of Szeged, Szeged, Hungary.
Fanny MolnárDepartment of Family Medicine, Albert Szent-Györgyi Health Centre, University of Szeged, Szeged, Hungary.
Dávid TóthDepartment of Oncotherapy, Albert Szent-Györgyi Health Centre, University of Szeged, Szeged, Hungary.
Zsófia BőszeDepartment of Internal Medicine, Albert Szent-Györgyi Health Centre, University of Szeged, Szeged, Hungary.
Krisztina BodaDepartment of Medical Physics and Informatics, University of Szeged, Szeged, Hungary.
Péter KlivényiDepartment of Neurology, Albert Szent-Györgyi Health Centre, University of Szeged, Szeged, Hungary.
László SiklósInstitute of Biophysics, HUN-REN Biological Research Centre, Szeged, Hungary.
Roland PataiInstitute of Biophysics, HUN-REN Biological Research Centre, Szeged, Hungary.ORCID 0000-0002-5302-2815

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

ChatGPT, a general artificial intelligence, has been recognized as a powerful tool in scientific writing and programming but its use as a medical tool is largely overlooked. The general accessibility, rapid response time and comprehensive training database might enable ChatGPT to serve as a diagnostic augmentation tool in certain clinical settings. The diagnostic process in neurology is often challenging and complex. In certain time-sensitive scenarios, rapid evaluation and diagnostic decisions are needed, while in other cases clinicians are faced with rare disorders and atypical disease manifestations. Due to these factors, the diagnostic accuracy in neurology is often suboptimal. Here we evaluated whether ChatGPT can be utilized as a valuable and innovative diagnostic augmentation tool in various neurological settings. We used synthetic data generated by neurological experts to represent descriptive anamneses of patients with known neurology-related diseases, then the probability for an appropriate diagnosis made by ChatGPT was measured. To give clarity to the accuracy of the AI-determined diagnosis, all cases have been cross-validated by other experts and general medical doctors as well. We found that ChatGPT-determined diagnostic accuracy (ranging from 68.5% ± 3.28% to 83.83% ± 2.73%) can reach the accuracy of other experts (81.66% ± 2.02%), furthermore, it surpasses the probability of an appropriate diagnosis if the examiner is a general medical doctor (57.15% ± 2.64%). Our results showcase the efficacy of general artificial intelligence like ChatGPT as a diagnostic augmentation tool in medicine. In the future, AI-based supporting tools might be useful amendments in medical practice and help to improve the diagnostic process in neurology.

Indexed as

Artificial IntelligenceNervous System DiseasesNeurologyAdultFemaleHumansMaleMiddle Aged

Identifiers

PMID39383119
PMCPMC11463752

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.