Evidence map›Paper›PMID 40354107›Full record

ArticleJournal of medical Internet research2025

Clinical Value of ChatGPT for Epilepsy Presurgical Decision-Making: Systematic Evaluation of Seizure Semiology Interpretation.

Yaxi Luo, Meng Jiao, Neel Fotedar, Jun-En Ding, Ioannis Karakis, Vikram R Rao, Melissa Asmar, Xiaochen Xian, Orwa Aboud, Yuxin Wen and 5 more

Abstract read
In one paragraph

Article in Journal of medical Internet research, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 9 papers.

0numbers the graph read from it
0cells of the map it votes in
9citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

9 citing papers in PubMed.

  1. Review
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Review
  9. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

15 authors.

Yaxi Luo *Department of Computer Science, Schaefer School of Engineering & Science, Stevens Institute of Technology, Hoboken, NJ, United States.ORCID https://orcid.org/0009-0009-1391-0146
Meng Jiao *Department of Systems and Enterprises, Schaefer School of Engineering & Science, Stevens Institute of Technology, Hoboken, NJ, United States.ORCID https://orcid.org/0009-0009-1585-0511
Neel FotedarSchool of Medicine, Case Western Reserve University, Cleveland, OH, United States.ORCID https://orcid.org/0000-0003-0424-7767
Jun-En DingDepartment of Systems and Enterprises, Schaefer School of Engineering & Science, Stevens Institute of Technology, Hoboken, NJ, United States.ORCID https://orcid.org/0000-0002-1233-138X
Ioannis KarakisDepartment of Neurology, School of Medicine, Emory University, Atlanta, GA, United States.ORCID https://orcid.org/0000-0001-5122-7211
Vikram R RaoDepartment of Neurology and Weill Institute for Neurosciences, University of California, San Francisco, San Francisco, CA, United States.ORCID https://orcid.org/0000-0002-6389-2638
Melissa AsmarDepartment of Neurology, University of California, Davis, Davis, CA, United States.ORCID https://orcid.org/0009-0008-0220-0264
Xiaochen XianH. Milton Stewart School of Industrial and Systems Engineering, Georgia Institute of Technology, Atlanta, GA, United States.ORCID https://orcid.org/0000-0001-7099-2488
Orwa AboudDepartment of Neurology and Neurological Surgery, University of California, Davis, Davis, CA, United States.ORCID https://orcid.org/0000-0002-7916-1629
Yuxin WenFowler School of Engineering, Chapman University, Orange, CA, United States.ORCID https://orcid.org/0000-0002-2352-5622
Jack J LinDepartment of Neurology, University of California, Davis, Davis, CA, United States.ORCID https://orcid.org/0000-0003-1304-227X
Fang-Ming HungCenter of Artificial Intelligence, Far Eastern Memorial Hospital, New Taipei City, Taiwan.ORCID https://orcid.org/0000-0003-3501-5459
Hai SunDepartment of Neurosurgery, Rutgers Robert Wood Johnson Medical School, Rutgers, The State University of New Jersey, New Brunswick, NJ, United States.ORCID https://orcid.org/0000-0001-8878-8776
Felix RosenowDepartment of Neurology, Epilepsy Center Frankfurt Rhine-Main, Goethe University Frankfurt, Frankfurt am Main, Germany.ORCID https://orcid.org/0000-0002-3989-7471
Feng LiuDepartment of Systems and Enterprises, Schaefer School of Engineering & Science, Stevens Institute of Technology, Hoboken, NJ, United States.ORCID https://orcid.org/0000-0002-5225-8199

Funding

UC Davis Paul Calabresi K12 Clinical Oncology Research Career Development ProgramK12CA138464 · NCI · UNIVERSITY OF CALIFORNIA AT DAVIS · PI BIRKELAND, ANDREW CHARLES, LARA, PRIMO N. · 2011 to 2025
$11.4M
NCI NIH HHS K12 CA138464
6 · The paper itself

Abstract

backgroundFor patients with drug-resistant focal epilepsy, surgical resection of the epileptogenic zone (EZ) is an effective treatment to control seizures. Accurate localization of the EZ is crucial and is typically achieved through comprehensive presurgical approaches such as seizure semiology interpretation, electroencephalography (EEG), magnetic resonance imaging (MRI), and intracranial EEG (iEEG). However, interpreting seizure semiology is challenging because it heavily relies on expert knowledge. The semiologies are often inconsistent and incoherent, leading to variability and potential limitations in presurgical evaluation. To overcome these challenges, advanced technologies like large language models (LLMs)-with ChatGPT being a notable example-offer valuable tools for analyzing complex textual information, making them well-suited to interpret detailed seizure semiology descriptions and accurately localize the EZ.

objectiveThis study evaluates the clinical value of ChatGPT for interpreting seizure semiology to localize EZs in presurgical assessments for patients with focal epilepsy and compares its performance with that of epileptologists.

methodsWe compiled 2 data cohorts: a publicly sourced cohort of 852 semiology-EZ pairs from 193 peer-reviewed journal publications and a private cohort of 184 semiology-EZ pairs collected from Far Eastern Memorial Hospital (FEMH) in Taiwan. ChatGPT was evaluated to predict the most likely EZ locations using 2 prompt methods: zero-shot prompting (ZSP) and few-shot prompting (FSP). To compare the performance of ChatGPT, 8 epileptologists were recruited to participate in an online survey to interpret 100 randomly selected semiology records. The responses from ChatGPT and epileptologists were compared using 3 metrics: regional sensitivity (RSens), weighted sensitivity (WSens), and net positive inference rate (NPIR).

resultsIn the publicly sourced cohort, ChatGPT demonstrated high RSens reliability, achieving 80% to 90% for the frontal and temporal lobes; 20% to 40% for the parietal lobe, occipital lobe, and insular cortex; and only 3% for the cingulate cortex. The WSens, which accounts for biased data distribution, consistently exceeded 67%, while the mean NPIR remained around 0. These evaluation results based on the private FEMH cohort are consistent with those from the publicly sourced cohort. A group t test with 1000 bootstrap samples revealed that ChatGPT-4 significantly outperformed epileptologists in RSens for the most frequently implicated EZs, such as the frontal and temporal lobes (P<.001). Additionally, ChatGPT-4 demonstrated superior overall performance in WSens (P<.001). However, no significant differences were observed between ChatGPT and the epileptologists in NPIR, highlighting comparable performance in this metric.

conclusionsChatGPT demonstrated clinical value as a tool to assist decision-making during epilepsy preoperative workups. With ongoing advancements in LLMs, their reliability and accuracy are anticipated to improve.

Indexed as

EpilepsySeizuresAdultDrug Resistant EpilepsyElectroencephalographyFemaleGenerative Artificial IntelligenceHumansMagnetic Resonance ImagingMaleAI for health careChatGPTclinical valueepilepsy presurgical evaluationepileptogenic zone localizationlarge language modelsseizure semiology

Identifiers

PMID40354107
PMCPMC12107199

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.