Evidence map›Paper›PMID 39719077›Full record

ArticleJournal of medical Internet research2024

Large Language Models May Help Patients Understand Peer-Reviewed Scientific Articles About Ophthalmology: Development and Usability Study.

Reza Kianian, Deyu Sun, William Rojas-Carabali, Rupesh Agrawal, Edmund Tsui

Abstract read
In one paragraph

Article in Journal of medical Internet research, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 14 papers.

0numbers the graph read from it
0cells of the map it votes in
14citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

14 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Review
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Review
  14. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Reza Kianian *Stein Eye Institute, Department of Ophthalmology, David Geffen School of Medicine, Los Angeles, CA, United States.ORCID 0000-0002-2737-8818
Deyu Sun *Stein Eye Institute, Department of Ophthalmology, David Geffen School of Medicine, Los Angeles, CA, United States.ORCID 0000-0003-4637-0763
William Rojas-Carabali *Nanyang Technological University, Lee Kong Chian School of Medicine, Singapore, Singapore.ORCID 0000-0002-9976-8989
Rupesh Agrawal *Nanyang Technological University, Lee Kong Chian School of Medicine, Singapore, Singapore.ORCID 0000-0002-6662-5850
Edmund Tsui *Stein Eye Institute, Department of Ophthalmology, David Geffen School of Medicine, Los Angeles, CA, United States.ORCID 0000-0001-7532-9191

Funding

Objective Measures of Intraocular Inflammation in Pediatric Anterior UveitisK23EY032990 · NEI · UNIVERSITY OF CALIFORNIA LOS ANGELES · PI TSUI, EDMUND · 2021 to 2025
$1.2M
NEI NIH HHS K23 EY032990
6 · The paper itself

Abstract

backgroundAdequate health literacy has been shown to be important for the general health of a population. To address this, it is recommended that patient-targeted medical information is written at a sixth-grade reading level. To make well-informed decisions about their health, patients may want to interact directly with peer-reviewed open access scientific articles. However, studies have shown that such text is often written with highly complex language above the levels that can be comprehended by the general population. Previously, we have published on the use of large language models (LLMs) in easing the readability of patient-targeted health information on the internet. In this study, we continue to explore the advantages of LLMs in patient education.

objectiveThis study aimed to explore the use of LLMs, specifically ChatGPT (OpenAI), to enhance the readability of peer-reviewed scientific articles in the field of ophthalmology.

methodsA total of 12 open access, peer-reviewed papers published by the senior authors of this study (ET and RA) were selected. Readability was assessed using the Flesch-Kincaid Grade Level and Simple Measure of Gobbledygook tests. ChatGPT 4.0 was asked "I will give you the text of a peer-reviewed scientific paper. Considering that the recommended readability of the text is 6th grade, can you simplify the following text so that a layperson reading this text can fully comprehend it? - Insert Manuscript Text -". Appropriateness was evaluated by the 2 uveitis-trained ophthalmologists. Statistical analysis was performed in Microsoft Excel.

resultsChatGPT significantly lowered the readability and length of the selected papers from 15th to 7th grade (P<.001) while generating responses that were deemed appropriate by expert ophthalmologists.

conclusionsLLMs show promise in improving health literacy by enhancing the accessibility of peer-reviewed scientific articles and allowing the general population to interact directly with medical literature.

Indexed as

Health LiteracyOphthalmologyComprehensionHumansInternetLanguagePeer Reviewartificial intelligenceChatGPThealth literacylarge language modelsLLMsmedical informationophthalmologypatient educationpeer reviewreadabilityuveitis

Identifiers

PMID39719077
PMCPMC11707445

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.