Evidence map›Paper›PMID 41141329›Full record

ArticleJournal of hand surgery global online2025

Limitations of Artificial Intelligence Generated Images for Hand Surgery Patient Education.

Jessica L Duggan, Omar Mohamed, Euan Forrest, Jessica Guo, Tamara D Rozental

Abstract read
In one paragraph

Article in Journal of hand surgery global online, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Jessica L DugganHarvard Combined Orthopaedic Residency Program, Boston, MA.
Omar MohamedDepartment of Hand and Upper Extremity Surgery, Beth Israel Deaconess Medical Center, Boston, MA.
Euan ForrestHarvard Medical School, Boston, MA.
Jessica GuoDepartment of Hand and Upper Extremity Surgery, Beth Israel Deaconess Medical Center, Boston, MA.
Tamara D RozentalDepartment of Hand and Upper Extremity Surgery, Beth Israel Deaconess Medical Center, Boston, MA.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Purpose: The role of artificial intelligence (AI) in medicine is rapidly evolving, with potential to improve both the clinician and patient experience. We sought to evaluate whether popular AI text-to-image generators could create anatomically accurate images of common hand surgery procedures. We hypothesized that the AI-generated images would not be adequate as patient education materials. Methods: We queried five AI text-to-image generators: Craiyon, DALL-E, DeepSeek, Gemini, Midjourney, and Stable Diffusion. They were given the prompt, "Create an anatomically accurate image with labels of [Condition] surgical approach to be used as a visual aid for patient education," with the following conditions inserted: carpal tunnel syndrome, Dupuytren contracture, trigger finger, thumb carpometacarpal arthritis, and de Quervain tenosynovitis. Images were then graded on legibility, detail and clarity, anatomical realism and accuracy, appropriate surgical site, and lack of fabricated anatomy. Images could score a maximum of 2 points per each criterion, with an assumed Control score of 10 points. Results: A total of 1,500 images were generated and reviewed. When comparing total scores, all AI generators performed significantly lower than the Control, except for DALL-E's images of Dupuytren contracture. For the image detail and clarity category, DALL-E, DeepSeek, Gemini, and Midjourney all scored similarly to the Control and each other. For the remaining criteria (legibility, anatomic realism, surgical site, fabricated anatomy), each of the AI generators scored significantly lower than the Control generator. In total, 99.8% of images contained at least some degree of fabricated anatomy. DALL-E consistently had the highest scores for each category, while Craiyon had the lowest. Conclusions: Although the AI servers successfully produced highly detailed and visually engaging images, they failed to portray accurate anatomy and often included fictitious structures. Further work is needed to train and fine tune AI models to produce accurate and appropriate images. Type of study/level of evidence: Therapeutic V.

Indexed as

AIArtificial intelligenceHand surgeryPatient educationText-to-image generation

Identifiers

PMID41141329
PMCPMC12547223

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.