ArticleBrain pathology (Zurich, Switzerland)2024
Evaluating the performance of large language models: ChatGPT and Google Bard in generating differential diagnoses in clinicopathological conferences of neurodegenerative disorders.
Article in Brain pathology (Zurich, Switzerland), 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 51 papers, 2 of them syntheses that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
51 citing papers in PubMed, 2 syntheses or guidelines pooled it.
- Accuracy of Large Language Models When Answering Clinical Research Questions: Systematic Review and Network Meta-Analysis.Journal of medical Internet research · 2025Pooled it
- Comparative analysis of ChatGPT and Gemini (Bard) in medical inquiry: a scoping review.Frontiers in digital health · 2025Pooled it
- Leveraging time-series electronic health records with large language models for chronic kidney disease diagnosis in primary care.BMJ health & care informatics · 2026Article
- Artificial intelligence for detection, grading, and prognostication in prostate cancer pathology: A scoping review.Histology and histopathology · 2026Article
- Agentic AI for scaling diagnosis and care in neurodegenerative disease.Nature aging · 2026Review
- Assessing AI and Neurologist Diagnostic Reasoning Against Neuropathological Ground Truth.medRxiv : the preprint server for health sciences · 2026Article
- Artificial Intelligence Chatbots as Sources of Implant Dentistry Information for the Public: Validity and Reliability Assessment.European journal of dentistry · 2026Article
- A multicenter multifunctional assessment of large language models in pure-tone audiogram interpretation for patients.NPJ digital medicine · 2026Article
- Bias Patterns in the Application of LLMs for Clinical Decision Support: A Comprehensive Study.Delaware journal of public health · 2026Article
- Large language models for bioinformatics.Quantitative biology (Beijing, China) · 2026Review
- Review of Artificial Intelligence for Clinical Use in Alzheimer's Disease and Related Dementias.Seminars in neurology · 2026Review
- Article
- Article
- Assessing the role of large language models in adolescent idiopathic scoliosis care: a comparison between ChatGPT and Google Gemini.Acta orthopaedica et traumatologica turcica · 2025Article
- Clinical applications of large language models in medicine and surgery: A scoping review.The Journal of international medical research · 2025Article
- Large Language Models in Medical Diagnostics: Scoping Review With Bibliometric Analysis.Journal of medical Internet research · 2025Article
- A large language model improves clinicians' diagnostic performance in complex critical illness cases.Critical care (London, England) · 2025Article
- Enhancing the Accuracy of Human Phenotype Ontology Identification: Comparative Evaluation of Multimodal Large Language Models.Journal of medical Internet research · 2025Article
- Chatbots' Role in Generating Single Best Answer Questions for Undergraduate Medical Student Assessment: Comparative Analysis.JMIR medical education · 2025Article
- A systematic review and meta-analysis of diagnostic performance comparison between generative AI and physicians.NPJ digital medicine · 2025Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
3 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
This study explores the utility of the large language models (LLMs), specifically ChatGPT and Google Bard, in predicting neuropathologic diagnoses from clinical summaries. A total of 25 cases of neurodegenerative disorders presented at Mayo Clinic brain bank Clinico-Pathological Conferences were analyzed. The LLMs provided multiple pathologic diagnoses and their rationales, which were compared with the final clinical diagnoses made by physicians. ChatGPT-3.5, ChatGPT-4, and Google Bard correctly made primary diagnoses in 32%, 52%, and 40% of cases, respectively, while correct diagnoses were included in 76%, 84%, and 76% of cases, respectively. These findings highlight the potential of artificial intelligence tools like ChatGPT in neuropathology, suggesting they may facilitate more comprehensive discussions in clinicopathological conferences.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.