Evidence map›Paper›PMID 38375341›Full record

ArticleArthroscopy, sports medicine, and rehabilitation2024

ChatGPT Can Offer Satisfactory Responses to Common Patient Questions Regarding Elbow Ulnar Collateral Ligament Reconstruction.

William L Johns, Alec Kellish, Dominic Farronato, Michael G Ciccotti, Sommer Hammoud

Abstract read
In one paragraph

Article in Arthroscopy, sports medicine, and rehabilitation, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 31 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
31citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

31 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. An expert-based assessment of the quality, reliability, understandability, and readability of ChatGPT responses on cerebral palsy.Child's nervous system : ChNS : official journal of the International Society for Pediatric Neurosurgery · 2026
    Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Review
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

William L JohnsRothman Orthopaedic Institute at Thomas Jefferson University, Philadelphia, Pennsylvania, U.S.A.
Alec KellishRothman Orthopaedic Institute at Thomas Jefferson University, Philadelphia, Pennsylvania, U.S.A.
Dominic FarronatoSidney Kimmel Medical College at Thomas Jefferson University, Philadelphia, Pennsylvania, U.S.A.
Michael G CiccottiRothman Orthopaedic Institute at Thomas Jefferson University, Philadelphia, Pennsylvania, U.S.A.
Sommer HammoudRothman Orthopaedic Institute at Thomas Jefferson University, Philadelphia, Pennsylvania, U.S.A.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Purpose: To determine whether ChatGPT effectively responds to 10 commonly asked questions concerning ulnar collateral ligament (UCL) reconstruction. Methods: A comprehensive list of 90 UCL reconstruction questions was initially created, with a final set of 10 "most commonly asked" questions ultimately selected. Questions were presented to ChatGPT and its response was documented. Responses were evaluated independently by 3 authors using an evidence-based methodology, resulting in a grading system categorized as follows: (1) excellent response not requiring clarification; (2) satisfactory requiring minimal clarification; (3) satisfactory requiring moderate clarification; and (4) unsatisfactory requiring substantial clarification. Results: Six of 10 ten responses were rated as "excellent" or "satisfactory." Of those 6 responses, 2 were determined to be "excellent response not requiring clarification," 3 were "satisfactory requiring minimal clarification," and 1 was "satisfactory requiring moderate clarification." Four questions encompassing inquiries about "What are the potential risks of UCL reconstruction surgery?" "Which type of graft should be used for my UCL reconstruction?" and "Should I have UCL reconstruction or repair?" were rated as "unsatisfactory requiring substantial clarification." Conclusions: ChatGPT exhibited the potential to improve a patient's basic understanding of UCL reconstruction and provided responses that were deemed satisfactory to excellent for 60% of the most commonly asked questions. For the other 40% of questions, ChatGPT gave unsatisfactory responses, primarily due to a lack of relevant details or the need for further explanation. Clinical Relevance: ChatGPT can assist in patient education regarding UCL reconstruction; however, its ability to appropriately answer more complex questions remains to be an area of skepticism and future improvement.

Identifiers

PMID38375341
PMCPMC10875189

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.