ArticleJournal of orthopaedics and traumatology : official journal of the Italian Society of Orthopaedics and Traumatology2023
Arthrosis diagnosis and treatment recommendations in clinical practice: an exploratory investigation with the generative AI model GPT-4.
Article in Journal of orthopaedics and traumatology : official journal of the Italian Society of Orthopaedics and Traumatology, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 19 papers, 3 of them syntheses that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
19 citing papers in PubMed, 3 syntheses or guidelines pooled it.
- Testing and Evaluation of Health Care Applications of Large Language Models: A Systematic Review.JAMA · 2025Pooled it
- Clinical applications of large language models in knee osteoarthritis: a systematic review.Frontiers in medicine · 2025Pooled it
- Examining the Role of Large Language Models in Orthopedics: Systematic Review.Journal of medical Internet research · 2024Pooled it
- Evaluating and Validating Large Language Models for Health Education on Developmental Dysplasia of the Hip: 2-Phase Study With Expert Ratings and a Pilot Randomized Controlled Trial.Journal of medical Internet research · 2026Trial
- Performance of DeepSeek V3.2 and ChatGPT 5.1 in Musculoskeletal Triage and Differential Diagnosis of Outpatients With Low Back Pain: Multidimensional Comparative Study.Journal of medical Internet research · 2026Article
- Exploratory study of large language models in surgical decision-making for lumbar disc herniation: a multicenter analysis based on multisource clinical information.BMC medical informatics and decision making · 2026Article
- Assessing large language models as assistive tools in selecting first trial lens parameters for orthokeratology.Frontiers in medicine · 2026Article
- Two-stage prompting framework with predefined verification steps for evaluating diagnostic reasoning tasks on two datasets.NPJ digital medicine · 2025Article
- Large Language Models in Medical Diagnostics: Scoping Review With Bibliometric Analysis.Journal of medical Internet research · 2025Article
- Understanding Large Language Models in Healthcare: A Guide to Clinical Implementation and Interpreting Publications.Cureus · 2025Review
- Assessment of Artificial Intelligence Chatbot Responses to Common Patient Questions on Bone Sarcoma.Journal of surgical oncology · 2025Article
- Digital Health for Equitable Rheumatic Care: Integrating Real-World Experiences to Guide Policy Pathways.Healthcare (Basel, Switzerland) · 2025Review
- Is the treatment of ankle osteoarthritis changing over time in Italy? Analysis of temporal trends for fusion and arthroplasty in a population-based study from 2001 to 2022 on the National Hospital Discharge Record database.Journal of orthopaedics and traumatology : official journal of the Italian Society of Orthopaedics and Traumatology · 2025Article
- Evaluating ChatGPT, Gemini and other Large Language Models (LLMs) in orthopaedic diagnostics: A prospective clinical study.Computational and structural biotechnology journal · 2025Article
- Exploring prospects, hurdles, and road ahead for generative artificial intelligence in orthopedic education and training.BMC medical education · 2024Review
- Assessing the accuracy of artificial intelligence in the diagnosis and management of orbital fractures: Is this the future of surgical decision-making?JPRAS open · 2024Article
- Exploring the landscape of AI-assisted decision-making in head and neck cancer treatment: a comparative analysis of NCCN guidelines and ChatGPT responses.European archives of oto-rhino-laryngology : official journal of the European Federation of Oto-Rhino-Laryngological Societies (EUFOS) : affiliated with the German Society for Oto-Rhino-Laryngology - Head and Neck Surgery · 2024Article
- Microsoft Bing outperforms five other generative artificial intelligence chatbots in the Antwerp University multiple choice medical license exam.PLOS digital health · 2024Article
- Machine Learning and Deep Learning in Spinal Injury: A Narrative Review of Algorithms in Diagnosis and Prognosis.Journal of clinical medicine · 2024Review
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
7 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
backgroundThe spread of artificial intelligence (AI) has led to transformative advancements in diverse sectors, including healthcare. Specifically, generative writing systems have shown potential in various applications, but their effectiveness in clinical settings has been barely investigated. In this context, we evaluated the proficiency of ChatGPT-4 in diagnosing gonarthrosis and coxarthrosis and recommending appropriate treatments compared with orthopaedic specialists.
methodsA retrospective review was conducted using anonymized medical records of 100 patients previously diagnosed with either knee or hip arthrosis. ChatGPT-4 was employed to analyse these historical records, formulating both a diagnosis and potential treatment suggestions. Subsequently, a comparative analysis was conducted to assess the concordance between the AI's conclusions and the original clinical decisions made by the physicians.
resultsIn diagnostic evaluations, ChatGPT-4 consistently aligned with the conclusions previously drawn by physicians. In terms of treatment recommendations, there was an 83% agreement between the AI and orthopaedic specialists. The therapeutic concordance was verified by the calculation of a Cohen's Kappa coefficient of 0.580 (p < 0.001). This indicates a moderate-to-good level of agreement. In recommendations pertaining to surgical treatment, the AI demonstrated a sensitivity and specificity of 78% and 80%, respectively. Multivariable logistic regression demonstrated that the variables reduced quality of life (OR 49.97, p < 0.001) and start-up pain (OR 12.54, p = 0.028) have an influence on ChatGPT-4's recommendation for a surgery.
conclusionThis study emphasises ChatGPT-4's notable potential in diagnosing conditions such as gonarthrosis and coxarthrosis and in aligning its treatment recommendations with those of orthopaedic specialists. However, it is crucial to acknowledge that AI tools such as ChatGPT-4 are not meant to replace the nuanced expertise and clinical judgment of seasoned orthopaedic surgeons, particularly in complex decision-making scenarios regarding treatment indications. Due to the exploratory nature of the study, further research with larger patient populations and more complex diagnoses is necessary to validate the findings and explore the broader potential of AI in healthcare. LEVEL OF EVIDENCE: Level III evidence.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.