ArticleActa orthopaedica2024
ChatGPT-4 generates orthopedic discharge documents faster than humans maintaining comparable quality: a pilot study of 6 cases.
Article in Acta orthopaedica, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 25 papers, 1 of them a synthesis that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
25 citing papers in PubMed, 1 synthesis or guideline pooled it.
- Application of artificial intelligence tools and clinical documentation burden: a systematic review and meta-analysis.BMC medical informatics and decision making · 2025Pooled it
- Patient-Representing Population's Perceptions of GPT-Generated Versus Standard Emergency Department Discharge Instructions: Randomized Blind Survey Assessment.Journal of medical Internet research · 2024Trial
- Perspective: A European artificial intelligence sovereignty agenda for healthcare.Acta orthopaedica · 2026Article
- Artificial Intelligence-Mediated Discharge Document for Accessible Health Care (AIM-HEALTH): Protocol for a Prospective, Observational, Noninterventional Study.JMIR research protocols · 2026Observational
- Article
- Training Empathetic Communication Skills in Medical Students With a Role-Prompted GPT-4o Chatbot: Quasi-Experimental Intervention Study.JMIR medical education · 2026Article
- Eliminating Nonvalue-Added Tasks in Health Care: Artificial Intelligence in the Orthopedic Office.Journal of hand surgery global online · 2026Article
- Artificial Intelligence in Orthopaedics: Clinical Performance, Limitations, and Translational Readiness-A Review.Journal of clinical medicine · 2026Review
- Comparative Impact of ChatGPT and Conventional Search Tools on Clinical Reasoning Performance: A Randomized Crossover Study in Preclinical Medical Students.Advances in medical education and practice · 2026Article
- Artificial intelligence algorithms in orthopaedics: A narrative review of methods and clinical applications.Journal of experimental orthopaedics · 2025Review
- Placebo, Nocebo, and Machine Learning: How Generative AI Could Shape Patient Perception in Mental Health Care.JMIR mental health · 2025Article
- Generative Artificial Intelligence in Primary Care: Qualitative Study of UK General Practitioners' Views.Journal of medical Internet research · 2025Article
- Large Language Models in Spine Surgery: A Promising Technology.HSS journal : the musculoskeletal journal of Hospital for Special Surgery · 2025Review
- Verifiable Summarization of Electronic Health Records Using Large Language Models to Support Chart Review.medRxiv : the preprint server for health sciences · 2025Article
- ChatGPT-3.5 and -4.0 Do Not Reliably Create Readable Patient Education Materials for Common Orthopaedic Upper- and Lower-Extremity Conditions.Arthroscopy, sports medicine, and rehabilitation · 2025Article
- Evaluating retrieval augmented generation and ChatGPT's accuracy on orthopaedic examination assessment questions.Annals of joint · 2025Article
- Benefits, limits, and risks of ChatGPT in medicine.Frontiers in artificial intelligence · 2025Review
- Generative artificial intelligence in medicine: a mixed-methods survey of UK general practitioners.BMJ digital health & AI · 2025Article
- Integration of customised LLM for discharge summary generation in real-world clinical settings: a pilot study on RUSSELL GPT.The Lancet regional health. Western Pacific · 2024Article
- Artificial intelligence can be used in the identification and classification of shoulder osteoarthritis and avascular necrosis on plain radiographs: a training study of 7,139 radiograph sets.Acta orthopaedica · 2024Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
8 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
background and purposeLarge language models like ChatGPT-4 have emerged. They hold the potential to reduce the administrative burden by generating everyday clinical documents, thus allowing the physician to spend more time with the patient. We aimed to assess both the quality and efficiency of discharge documents generated by ChatGPT-4 in comparison with those produced by physicians. PATIENTS AND
methodsTo emulate real-world situations, the health records of 6 fictional orthopedic cases were created. Discharge documents for each case were generated by a junior attending orthopedic surgeon and an advanced orthopedic resident. ChatGPT-4 was then prompted to generate the discharge documents using the same health record information. The quality assessment was performed by an expert panel (n = 15) blinded to the source of the documents. As secondary outcome, the time required to generate the documents was compared, logging the duration of the creation of the discharge documents by the physician and by ChatGPT-4.
resultsOverall, both ChatGPT-4 and physician-generated notes were comparable in quality. Notably, ChatGPT-4 generated discharge documents 10 times faster than the traditional method. 4 events of hallucinations were found in the ChatGPT-4-generated content, compared with 6 events in the human/physician produced notes.
conclusionChatGPT-4 creates orthopedic discharge notes faster than physicians, with comparable quality. This shows it has great potential for making these documents more efficient in orthopedic care. ChatGPT-4 has the potential to significantly reduce the administrative burden on healthcare professionals.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.