ArticleKnee surgery, sports traumatology, arthroscopy : official journal of the ESSKA2023
Exploring the potential of ChatGPT as a supplementary tool for providing orthopaedic information.
Article in Knee surgery, sports traumatology, arthroscopy : official journal of the ESSKA, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 57 papers, 4 of them syntheses that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
57 citing papers in PubMed, 4 syntheses or guidelines pooled it.
- ChatGPT provides accurate and safe responses to patient questions on hip arthroscopy, while completeness remains variable: A systematic review and single-arm meta-analysis.Knee surgery, sports traumatology, arthroscopy : official journal of the ESSKA · 2026Pooled it
- Applications of natural language processing and large language models in sports injury assessment and rehabilitation decision-making: a scoping review.Frontiers in medicine · 2026Pooled it
- Clinical applications of large language models in knee osteoarthritis: a systematic review.Frontiers in medicine · 2025Pooled it
- Examining the Role of Large Language Models in Orthopedics: Systematic Review.Journal of medical Internet research · 2024Pooled it
- Large language models show distinct multidimensional performance profiles and variable reproducibility in consensus-based bone stress injury.Journal of experimental orthopaedics · 2026Article
- Guideline-augmented prompting improves comparative preference and response consistency of large language model outputs for orthopaedic anaesthesia questions: A controlled prompting study.Journal of experimental orthopaedics · 2026Article
- Are large language models such as ChatGPT, capable of supporting patients and general practitioners after spine surgery?European spine journal : official publication of the European Spine Society, the European Spinal Deformity Society, and the European Section of the Cervical Spine Research Society · 2026Article
- Evaluation of Large Language Models in Generating Physical Exercise Rehabilitation Programs for Musculoskeletal Disorders Across Multiple Clinical Scenarios.Healthcare (Basel, Switzerland) · 2026Article
- Factors Shaping Trust and Satisfaction With AI Medical Chatbots: A Mixed Methods Vignette Survey of Caregivers Seeking Guidance on Pediatric Infectious Diseases.Journal of medical Internet research · 2026Article
- Article
- Promising performance of locally deployed large language models for postoperative orthopaedic patient questions: An In Silico analysis.Journal of experimental orthopaedics · 2026Article
- Shaping AI in Pelvic Floor Physiotherapy: The Impact of Role-Play Prompting on ChatGPT Response Quality.International urogynecology journal · 2026Article
- Evaluating deepresearch and deepthink in total knee arthroplasty patient education: ChatGPT-4o excels in comprehensiveness, Deepseek R1 leads in clarity and readability of orthopedic information.Joint diseases and related surgery · 2026Article
- Assessing ChatGPT Responses to Commonly Asked Questions About Hypoglossal Nerve Stimulation.World journal of otorhinolaryngology - head and neck surgery · 2026Article
- Evaluation of surgical recommendation algorithms in hallux valgus cases using ChatGPT models: an artificial intelligence approach based on 50 simulated scenarios.Acta orthopaedica et traumatologica turcica · 2026Article
- Gemini 1.5 Flash provides the most reliable content while ChatGPT-4o offers the highest readability for patient education on meniscal tears.Knee surgery, sports traumatology, arthroscopy : official journal of the ESSKA · 2026Article
- ChatGPT models provide higher-quality but lower-readability responses than Google Gemini regarding anterior shoulder instability, with no added benefit of the orthopaedic expert plugin.Knee surgery, sports traumatology, arthroscopy : official journal of the ESSKA · 2026Article
- Benchmarking Open-Source Vision Language Models in Orthopedic In-Training Examination: A Comparison with Residents, Domain-Specific Evaluation, and Parameter Scaling.Clinics in orthopedic surgery · 2026Article
- Limitations in Chest X-Ray Interpretation by Vision-Capable Large Language Models, Gemini 1.0, Gemini 1.5 Pro, GPT-4 Turbo, and GPT-4o.Diagnostics (Basel, Switzerland) · 2026Article
- A Comparative Analysis of GPT-3.5, GPT-4, GPT-4 Omni, Gemini Advanced, and Gemini 1.5 in Answering Total Knee Replacement-Related Questions.Orthopaedic journal of sports medicine · 2026Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
8 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
purposeTo investigate the potential use of large language models (LLMs) in orthopaedics by presenting queries pertinent to anterior cruciate ligament (ACL) surgery to generative pre-trained transformer (ChatGPT, specifically using its GPT-4 model of March 14th 2023). Additionally, this study aimed to evaluate the depth of the LLM's knowledge and investigate its adaptability to different user groups. It was hypothesized that the ChatGPT would be able to adapt to different target groups due to its strong language understanding and processing capabilities.
methodsChatGPT was presented with 20 questions and response was requested for two distinct target audiences: patients and non-orthopaedic medical doctors. Two board-certified orthopaedic sports medicine surgeons and two expert orthopaedic sports medicine surgeons independently evaluated the responses generated by ChatGPT. Mean correctness, completeness, and adaptability to the target audiences (patients and non-orthopaedic medical doctors) were determined. A three-point response scale facilitated nuanced assessment.
resultsChatGPT exhibited fair accuracy, with average correctness scores of 1.69 and 1.66 (on a scale from 0, incorrect, 1, partially correct, to 2, correct) for patients and medical doctors, respectively. Three of the 20 questions (15.0%) were deemed incorrect by any of the four orthopaedic sports medicine surgeon assessors. Moreover, overall completeness was calculated to be 1.51 and 1.64 for patients and medical doctors, respectively, while overall adaptiveness was determined to be 1.75 and 1.73 for patients and doctors, respectively.
conclusionOverall, ChatGPT was successful in generating correct responses in approximately 65% of the cases related to ACL surgery. The findings of this study imply that LLMs offer potential as a supplementary tool for acquiring orthopaedic knowledge. However, although ChatGPT can provide guidance and effectively adapt to diverse target audiences, it cannot supplant the expertise of orthopaedic sports medicine surgeons in diagnostic and treatment planning endeavours due to its limited understanding of orthopaedic domains and its potential for erroneous responses. LEVEL OF EVIDENCE: V.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.