Evidence map›Paper›PMID 41746691›Full record

Trial reportJournal of medical Internet research2026

Impact of GPT-4-Generated Discharge Letters on Patients' Medical Comprehension: Prospective Crossover Study.

Friederike Holderried, Alessandra Sonanini, Christian Stegemann-Philipps, Anne Herrmann-Werner, Philipp Spitzer, Martina Guthoff, Nils Heyne, Konstantin Sering, Martin Holderried, Felix Eisinger

Abstract readRandomized Controlled Trial
In one paragraph

Trial report in Journal of medical Internet research, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed.

  1. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

Friederike Holderried *Tübingen Institute for Medical Education (TIME), University of Tübingen, Tübingen, Germany.ORCID https://orcid.org/0000-0003-1828-0920
Alessandra Sonanini *Tübingen Institute for Medical Education (TIME), University of Tübingen, Tübingen, Germany.ORCID https://orcid.org/0009-0009-4893-3989
Christian Stegemann-PhilippsTübingen Institute for Medical Education (TIME), University of Tübingen, Tübingen, Germany.ORCID https://orcid.org/0000-0002-8122-5724
Anne Herrmann-WernerTübingen Institute for Medical Education (TIME), University of Tübingen, Tübingen, Germany.ORCID https://orcid.org/0000-0003-2413-7047
Philipp SpitzerDepartment of Psychiatry and Psychotherapy, University of Erlangen-Nürnberg, Erlangen, Germany.ORCID https://orcid.org/0000-0001-9555-605X
Martina GuthoffNephrological Center Villingen-Schwenningen, Villingen-Schwenningen, Germany.ORCID https://orcid.org/0000-0002-4294-980X
Nils HeyneDepartment of Diabetology, Endocrinology, Nephrology, University of Tübingen, Tübingen, Germany.ORCID https://orcid.org/0000-0001-9982-5093
Konstantin SeringTübingen Institute for Medical Education (TIME), University of Tübingen, Tübingen, Germany.ORCID https://orcid.org/0000-0002-1178-7932
Martin HolderriedKarlsruhe Municipal Hospital, Karlsruhe, Germany.ORCID https://orcid.org/0000-0002-1337-0516
Felix EisingerDepartment of Diabetology, Endocrinology, Nephrology, University of Tübingen, Tübingen, Germany.ORCID https://orcid.org/0009-0009-8902-532X

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundPatients often struggle to understand standard hospital discharge letters, increasing the risk of medication errors and misunderstandings. According to cognitive load theory (CLT), complex, information-dense texts can overload working memory and impair comprehension. Artificial intelligence tools that generate patient-centered versions could help reduce extraneous cognitive load and bridge this gap. However, evidence for their effectiveness remains limited.

objectiveThis study aimed to evaluate whether GPT-4 (OpenAI)-generated patient-centered letters improve standardized patients' retention and understanding of safety-relevant medical information compared with standard hospital discharge letters, and to explore potential effects on cognitive load as described by CLT.

methodsIn this prospective, randomized, crossover study, 48 trained standardized patients received a conventional discharge letter for an assigned disease (out of 3) and its matching GPT-4-generated patient-centered letter. Participants read one version first, identified predefined safety-relevant "learning objectives," and then repeated the task with the alternate version. The primary outcome was the proportion of learning objectives fully, partially, or not reported. In a secondary analysis, results were stratified by content field (Medication, Organization, Prevention of Complications, Lifestyle/Disease Management) and Bloom taxonomy level ("Remember," "Understand").

resultsThe letter type significantly influenced comprehension (odds ratio [OR] 1.74, 95% CI 1.45-2.08; P<.001). Patient letters, compared with discharge letters, led to higher rates of fully (490/1073, 45.7% vs 413/1073, 38.5%) or partially (322/1073, 30% vs 287/1073, 26.7%) stated learning objectives and fewer omissions (261/1073, 24.3% vs 373/1073, 34.8%). Participants performed better on "Remember" than on "Understand" learning objectives, regardless of letter type (OR 3.33, 95% CI 1.96-5.88; P<.001). Compared with standard hospital discharge letters, patient letters consistently improved results at both cognitive levels ("Remember": 278/545, 51% vs 242/545, 44.4%; "Understand": 212/528, 40.2% vs 171/528, 32.4% fully stated). The effect of patient letters varied by content field (P<.001). The greatest improvements were observed for "Medication" (170/254, 66.9% vs 129/254, 50.8% fully stated) and "Organization" (78/158, 49.4% vs 62/158, 39.2% fully stated). Improvements in the content field "Prevention of Complications" were modest, and those for "Lifestyle/Disease Management" were even smaller across all conditions. A total of 24.3% (261/1073) of key information remained unrecognized.

conclusionsIn this explanatory study, GPT-4-generated patient letters improved comprehension of safety-relevant discharge information among standardized patients, particularly regarding medication and organizational aspects. However, they were less effective in supporting higher-order understanding, such as risk prevention or lifestyle management. These hypothesis-driven findings can be interpreted within a CLT framework and may motivate prospective evaluation of multimodal, iterative supports.

Indexed as

ComprehensionPatient DischargeAdultAgedCognitionCross-Over StudiesFemaleGenerative Artificial IntelligenceHumansMaleMiddle AgedProspective Studiesartificial intelligenceGPT-4health care communicationlarge language modelspatient educationpatient letterspatient safety

Identifiers

PMID41746691
PMCPMC12982961

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.