Evidence map›Paper›PMID 40106236›Full record

ArticleJMIR cancer2025

Using ChatGPT to Improve the Presentation of Plain Language Summaries of Cochrane Systematic Reviews About Oncology Interventions: Cross-Sectional Study.

Jelena Šuto Pavičić, Ana Marušić, Ivan Buljan

Registry-linked trialAbstract read
In one paragraph

Article in JMIR cancer, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT07140107 (Patients' Perceptions and Comprehension of Original Versus AI-Generated Plain Language Summaries of Cochrane Oncology Systematic Reviews), which is not on this map. Cited by 6 papers.

0numbers the graph read from it
0cells of the map it votes in
6citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT07140107 naenrolling by invitationnot on this map

Patients' Perceptions and Comprehension of Original Versus AI-Generated Plain Language Summaries of Cochrane Oncology Systematic Reviews

TypeinterventionalSponsorUniversity of Split, School of MedicineRan2025 to 2026Enrolled130ConditionsNon-Metastatic Breast CancerArmsAI-generated PLS, Original PLS
3 · Its place in the literature

Who cites it

6 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Editor's view: What makes science successful?Journal of global health · 2025
    Article
  6. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Jelena Šuto PavičićDepartment of Oncology and Radiotherapy, University Hospital of Split, Spinciceva 1, Split, 21000, Croatia, 385 2155817.ORCID 0000-0003-2050-1112
Ana MarušićDepartment of Research in Biomedicine in Health, Centre for Evidence-based Medicine, University of Split School of Medicine, Split, Croatia.ORCID 0000-0001-6272-0917
Ivan BuljanDepartment of Psychology, Faculty of Humanities and Social Sciences, University of Split, Split, Croatia.ORCID 0000-0002-8719-7277

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Background: Plain language summaries (PLSs) of Cochrane systematic reviews are a simple format for presenting medical information to the lay public. This is particularly important in oncology, where patients have a more active role in decision-making. However, current PLS formats often exceed the readability requirements for the general population. There is still a lack of cost-effective and more automated solutions to this problem. Objective: This study assessed whether a large language model (eg, ChatGPT) can improve the readability and linguistic characteristics of Cochrane PLSs about oncology interventions, without changing evidence synthesis conclusions. Methods: The dataset included 275 scientific abstracts and corresponding PLSs of Cochrane systematic reviews about oncology interventions. ChatGPT-4 was tasked to make each scientific abstract into a PLS using 3 prompts as follows: (1) rewrite this scientific abstract into a PLS to achieve a Simple Measure of Gobbledygook (SMOG) index of 6, (2) rewrite the PLS from prompt 1 so it is more emotional, and (3) rewrite this scientific abstract so it is easier to read and more appropriate for the lay audience. ChatGPT-generated PLSs were analyzed for word count, level of readability (SMOG index), and linguistic characteristics using Linguistic Inquiry and Word Count (LIWC) software and compared with the original PLSs. Two independent assessors reviewed the conclusiveness categories of ChatGPT-generated PLSs and compared them with original abstracts to evaluate consistency. The conclusion of each abstract about the efficacy and safety of the intervention was categorized as conclusive (positive/negative/equal), inconclusive, or unclear. Group comparisons were conducted using the Friedman nonparametric test. Results: ChatGPT-generated PLSs using the first prompt (SMOG index 6) were the shortest and easiest to read, with a median SMOG score of 8.2 (95% CI 8-8.4), compared with the original PLSs (median SMOG score 13.1, 95% CI 12.9-13.4). These PLSs had a median word count of 240 (95% CI 232-248) compared with the original PLSs' median word count of 364 (95% CI 339-388). The second prompt (emotional tone) generated PLSs with a median SMOG score of 11.4 (95% CI 11.1-12), again lower than the original PLSs. PLSs produced with the third prompt (write simpler and easier) had a median SMOG score of 8.7 (95% CI 8.4-8.8). ChatGPT-generated PLSs across all prompts demonstrated reduced analytical tone and increased authenticity, clout, and emotional tone compared with the original PLSs. Importantly, the conclusiveness categorization of the original abstracts was unchanged in the ChatGPT-generated PLSs. Conclusions: ChatGPT can be a valuable tool in simplifying PLSs as medically related formats for lay audiences. More research is needed, including oversight mechanisms to ensure that the information is accurate, reliable, and culturally relevant for different audiences.

Indexed as

LanguageMedical OncologyNeoplasmsSystematic Reviews as TopicComprehensionCross-Sectional StudiesGenerative Artificial IntelligenceHumansPlain Language SummariesAIartificial intelligenceChatGPTCochranedecision-makinghealth communicationhealth literacylarge language modelmedical informationneoplasmsoncologypatient educationplain language

Identifiers

PMID40106236
PMCPMC11939027

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.