Evidence map›Paper›PMID 39006779›Full record

ArticleArthroscopy, sports medicine, and rehabilitation2024

ChatGPT-4 Generates More Accurate and Complete Responses to Common Patient Questions About Anterior Cruciate Ligament Reconstruction Than Google's Search Engine.

Michael A Gaudiani, Joshua P Castle, Muhammad J Abbas, Brittaney A Pratt, Marquisha D Myles, Vasilios Moutzouros, T Sean Lynch

Abstract read
In one paragraph

Article in Arthroscopy, sports medicine, and rehabilitation, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 9 papers.

0numbers the graph read from it
0cells of the map it votes in
9citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

9 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Review
  6. Review
  7. A custom ChatGPT can accurately answer questions from an international expert osteotomy consensus statement.European journal of orthopaedic surgery & traumatology : orthopedie traumatologie · 2025
    Article
  8. Article
  9. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Michael A GaudianiDepartment of Orthopedic Surgery, Henry Ford Health, Detroit, Michigan, U.S.A.
Joshua P CastleDepartment of Orthopedic Surgery, Henry Ford Health, Detroit, Michigan, U.S.A.
Muhammad J AbbasDepartment of Orthopedic Surgery, Henry Ford Health, Detroit, Michigan, U.S.A.
Brittaney A PrattDepartment of Orthopedic Surgery, Henry Ford Health, Detroit, Michigan, U.S.A.
Marquisha D MylesMichigan State University College of Human Medicine, Detroit, Michigan, U.S.A.
Vasilios MoutzourosDepartment of Orthopedic Surgery, Henry Ford Health, Detroit, Michigan, U.S.A.
T Sean LynchDepartment of Orthopedic Surgery, Henry Ford Health, Detroit, Michigan, U.S.A.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Purpose: To replicate a patient's internet search to evaluate ChatGPT's appropriateness in answering common patient questions about anterior cruciate ligament reconstruction compared with a Google web search. Methods: A Google web search was performed by searching the term "anterior cruciate ligament reconstruction." The top 20 frequently asked questions and responses were recorded. The prompt "What are the 20 most popular patient questions related to 'anterior cruciate ligament reconstruction?'" was input into ChatGPT and questions and responses were recorded. Questions were classified based on the Rothwell system and responses assessed via Flesch-Kincaid Grade Level, correctness, and completeness were for both Google web search and ChatGPT. Results: Three of 20 (15%) questions were similar between Google web search and ChatGPT. The most common question types among the Google web search were value (8/20, 40%), fact (7/20, 35%), and policy (5/20, 25%). The most common question types amongst the ChatGPT search were fact (12/20, 60%), policy (6/20, 30%), and value (2/20, 10%). Mean Flesch-Kincaid Grade Level for Google web search responses was significantly lower (11.8 ± 3.8 vs 14.3 ± 2.2; Conclusions: ChatGPT-4 generated more accurate and complete responses to common patient questions about anterior cruciate ligament reconstruction than Google's search engine. Clinical Relevance: The use of artificial intelligence such as ChatGPT is expanding. It is important to understand the quality of information as well as how the results of ChatGPT queries compare with those from Google web searches.

Identifiers

PMID39006779
PMCPMC11240040

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.