Evidence map›Paper›PMID 41551028›Full record

ArticleNorth American Spine Society journal2026

Performance of ChatGPT versus spine surgeons as an emergency department spine call consultant.

Taha M Taka, Seena Sebt, Sarah Meng, Andrew Cabrera, David Shin, Vahe Yacoubian, Weyjuin Chao, Daniel Rossie, Zhengle Xu, Melissa Erickson and 7 more

Abstract read
In one paragraph

Article in North American Spine Society journal, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 4 papers.

0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

4 citing papers in PubMed.

  1. Review
  2. Large language models in the vertical integration of spine surgery workflow: a scoping review.European spine journal : official publication of the European Spine Society, the European Spinal Deformity Society, and the European Section of the Cervical Spine Research Society · 2026
    Review
  3. Article
  4. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

17 authors.

Taha M TakaDepartment of Orthopaedic Surgery, Loma Linda University Health System, 11234 Anderson St., Loma Linda, CA 92354, United States.
Seena SebtDepartment of Orthopaedic Surgery, Cedars Sinai Medical Center, 8700 Beverly Blvd., Los Angeles, CA 90048, United States.
Sarah MengLoma Linda University School of Medicine, 11175 Campus St., Loma Linda, CA 92350, United States.
Andrew CabreraDepartment of Orthopaedic Surgery, Loma Linda University Health System, 11234 Anderson St., Loma Linda, CA 92354, United States.
David ShinLoma Linda University School of Medicine, 11175 Campus St., Loma Linda, CA 92350, United States.
Vahe YacoubianDepartment of Orthopaedic Surgery, Loma Linda University Health System, 11234 Anderson St., Loma Linda, CA 92354, United States.
Weyjuin ChaoDepartment of Emergency Medicine, Loma Linda University Health System, 11234 Anderson St., Loma Linda, CA 92354, United States.
Daniel RossieDepartment of Emergency Medicine, Loma Linda University Health System, 11234 Anderson St., Loma Linda, CA 92354, United States.
Zhengle XuDepartment of Emergency Medicine, Loma Linda University Health System, 11234 Anderson St., Loma Linda, CA 92354, United States.
Melissa EricksonDepartment of Orthopedic and Neurological Surgery, Duke University Health System, 10 Duke Medicine Cir., Durham, NC 27710, United States.
Brett RocosDepartment of Orthopedic and Neurological Surgery, Duke University Health System, 10 Duke Medicine Cir., Durham, NC 27710, United States.
Khoi ThanDepartment of Orthopedic and Neurological Surgery, Duke University Health System, 10 Duke Medicine Cir., Durham, NC 27710, United States.
Elizabeth YuDepartment of Orthopedic Surgery, Ohio State University Wexner Medical Center, 410 W 10th Ave., Columbus, OH 43210, United States.
Nicholas AhnDepartment of Orthopedic Surgery, University of Louisville, 530 South Jackson St., Louisville, KY 40202, United States.
Christopher BonoDepartment of Orthopedic Surgery, Massachusetts General Hospital, Harvard Medical School, 55 Fruit St., Boston, MA 02114, United States.
Wayne ChengDepartment of Orthopedic Surgery, Jerry L. Pettis Veterans Affairs (VA) Medical Center, 11201 Benton St., Loma Linda, CA 92357, United States.
Olumide DanisaDepartment of Orthopedic and Neurological Surgery, Duke University Health System, 10 Duke Medicine Cir., Durham, NC 27710, United States.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Background: Large language models (LLMs) like ChatGPT are increasingly being recognized as credible tools for use across diverse healthcare settings. While artificial intelligence (AI) use has previously been evaluated in emergency medicine, its use in subspecialty care - particularly spine surgery - remains underexplored. This study evaluates the clinical accuracy, management appropriateness, completeness, helpfulness, and overall quality of ChatGPT responses compared to those of board-certified, spine surgeons in response to common emergency department (ED) consultations. Methods: A 7-part questionnaire was developed based on common ED spine consultations (eg, Cauda Equina Syndrome, compression fracture in elderly patients, purulent drainage from surgical wound, acute lumbar disc herniation, incomplete spinal cord injury, epidural abscess, and metastatic spine disease). Each case included 3-4 questions pertaining to examination, diagnosis, management, and counseling. Responses from ChatGPT and 7 board-certified spine surgeons were restricted to 3-4 sentences per question. Three emergency medicine physicians rated each de-identified questionnaire response using a 5-point Likert scale. Statistical analysis was conducted using a 2-sample T-test with unequal variance. Inter-rater reliability was assessed using pairwise weighted Cohen's kappa coefficient (κ). Results: When comparing AI responses versus spine surgeon responses to proposed ED consultations, AI responses were rated to be superior across all 5 metrics of clinical accuracy, management appropriateness, completeness, helpfulness, and overall quality (p<.05). Inter-rater reliability was assessed using the average pairwise weighted Cohen's kappa coefficient which showed substantial agreement (κ=0.76). Conclusions: ChatGPT responses to emergency department spine consultations were rated as significantly higher compared to board-certified spine surgeons by emergency medicine providers. Though further improvement and validation is warranted, these findings suggest that ChatGPT can be a useful clinical adjunct for spine-related emergency department consultations.

Indexed as

Artificial IntelligenceChatgptConsultEmergencySpine

Identifiers

PMID41551028
PMCPMC12811425

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.