Evidence map›Paper›PMID 40728044›Full record

ArticleActa orthopaedica et traumatologica turcica2025

Assessing the role of large language models in adolescent idiopathic scoliosis care: a comparison between ChatGPT and Google Gemini.

Semih Yaş, Dilek Yapar, Aliekber Yapar, Tayfun Özel, Mehmet Ali Tokgöz, Alim Can Baymurat, Alpaslan Şenköylü

Abstract readComparative Study
In one paragraph

Article in Acta orthopaedica et traumatologica turcica, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 8 papers.

0numbers the graph read from it
0cells of the map it votes in
8citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

8 citing papers in PubMed.

  1. Observational
  2. Article
  3. Article
  4. An expert-led benchmark using common patient questions: evaluating large language models for adolescent idiopathic scoliosis education.European spine journal : official publication of the European Spine Society, the European Spinal Deformity Society, and the European Section of the Cervical Spine Research Society · 2026
    Article
  5. Article
  6. Article
  7. Article
  8. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Semih YaşDepartment of Orthopaedics and Traumatology, Turkish Ministry of Health, Dr. Abdurrahman Yurtaslan Ankara Oncology Training and Research Hospital, Ankara, Türkiye.ORCID 0000-0001-7823-3400
Dilek YaparDepartment of Public Health, Turkish Ministry of Health, Muratpasa District Health Directorate, Antalya, Türkiye.ORCID 0000-0001-7656-1152
Aliekber YaparDepartment of Orthopaedics and Traumatology, Antalya Training and Research Hospital, Antalya, Türkiye.ORCID 0000-0003-2227-2173
Tayfun ÖzelDepartment of Orthopaedics and Traumatology, Ankara Training and Research Hospital, Ankara, Türkiye.ORCID 0000-0003-1049-609X
Mehmet Ali TokgözDepartment of Orthopaedics and Traumatology, Gazi University Faculty of Medicine, Ankara, Türkiye.ORCID 0000-0002-4056-3743
Alim Can BaymuratDepartment of Orthopaedics and Traumatology, Gazi University Faculty of Medicine, Ankara, Türkiye.ORCID 0000-0002-0062-621X
Alpaslan ŞenköylüDepartment of Orthopaedics and Traumatology, Gazi University Faculty of Medicine, Ankara, Türkiye.ORCID 0000-0001-6870-5515

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Objective: To evaluate the accuracy, applicability, comprehensiveness, and communication quality of responses generated by ChatGPT and Google Gemini in adolescent idiopathic scoliosis (AIS)-related scenarios, with the aim of assessing their potential utility as tools in patient management. Methods: Six case-based questions reflecting common patient concerns related to adolescent idiopathic scoliosis were developed by orthopedic specialists. Responses generated by ChatGPT and Google Gemini were independently evaluated by 61 orthopedic surgeons using a standardized rubric assessing accuracy, applicability, comprehensiveness, and communication clarity, each rated on a 1-5 Likert scale. Comparative analyses between platforms were performed using the Mann-Whitney U and Wilcoxon signed-rank tests. Additionally, open-ended feedback was collected to explore participants' perspectives on the potential and limitations of AI-based consultations. Results: ChatGPT outperformed Google Gemini in terms of accuracy (P = .013) in postoperative care scenarios. The results for applicability (P = .119), comprehensiveness (P = .619), and communication (P = .240) were not statistically significant. Orthopedic specialists rated both AI models significantly higher than residents in accuracy, applicability, and comprehensiveness. Most evaluators acknowledged the potential of AI to reduce physician workload and support patient guidance; however, concerns were raised regarding reliability, ethical implications, and the current limitations of AI in ensuring patient safety. Conclusion: ChatGPT and Google Gemini demonstrated moderate accuracy and communication quality in adolescent idiopathic scoliosis-related scenarios, with ChatGPT showing a modest advantage. Although both models show promising results as supportive tools for patient education and preliminary consultations, their current limitations in accuracy and comprehensiveness restrict their clinical reliability. Multidisciplinary collaboration is crucial to ensure e!ective applications of AI in orthopedic practice. Level of Evidence: Level III, Diagnostic Study.

Indexed as

ScoliosisAdolescentCommunicationFemaleGenerative Artificial IntelligenceHumansLanguageLarge Language ModelsMaleReproducibility of ResultsSurveys and Questionnaires

Identifiers

PMID40728044
PMCPMC12362497

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.