Evidence map›Paper›PMID 38194058›Full record

ArticleCardiology and therapy2024

Can Artificial Intelligence Improve the Readability of Patient Education Materials on Aortic Stenosis? A Pilot Study.

Armaun D Rouhi, Yazid K Ghanem, Laman Yolchieva, Zena Saleh, Hansa Joshi, Matthew C Moccia, Alejandro Suarez-Pierre, Jason J Han

Abstract read
In one paragraph

Article in Cardiology and therapy, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 56 papers, 3 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
56citing papers in PubMed, 3 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

56 citing papers in PubMed, 3 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Trial
  5. Article
  6. Observational
  7. Review
  8. Article
  9. Article
  10. Article
  11. Article
  12. Readability of Online Patient Education Materials for Myopia Management.Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians (Optometrists) · 2026
    Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Armaun D RouhiDepartment of Surgery, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA.ORCID http://orcid.org/0000-0002-7724-1457
Yazid K GhanemDepartment of Surgery, Cooper University Hospital, Camden, NJ, USA.
Laman YolchievaCollege of Arts and Sciences, University of Pennsylvania, Philadelphia, PA, USA.
Zena SalehDepartment of Surgery, Cooper University Hospital, Camden, NJ, USA.
Hansa JoshiDepartment of Surgery, Cooper University Hospital, Camden, NJ, USA.
Matthew C MocciaDepartment of Surgery, Cooper University Hospital, Camden, NJ, USA.ORCID http://orcid.org/0009-0008-4607-3615
Alejandro Suarez-PierreDepartment of Surgery, University of Colorado School of Medicine, Aurora, CO, USA.ORCID http://orcid.org/0000-0003-1821-6240
Jason J HanDivision of Cardiovascular Surgery, Department of Surgery, Perelman School of Medicine, Hospital of the University of Pennsylvania, Philadelphia, PA, USA. Jason.Han@pennmedicine.upenn.edu.ORCID http://orcid.org/0000-0001-9288-3725

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

introductionThe advent of generative artificial intelligence (AI) dialogue platforms and large language models (LLMs) may help facilitate ongoing efforts to improve health literacy. Additionally, recent studies have highlighted inadequate health literacy among patients with cardiac disease. The aim of the present study was to ascertain whether two freely available generative AI dialogue platforms could rewrite online aortic stenosis (AS) patient education materials (PEMs) to meet recommended reading skill levels for the public.

methodsOnline PEMs were gathered from a professional cardiothoracic surgical society and academic institutions in the USA. PEMs were then inputted into two AI-powered LLMs, ChatGPT-3.5 and Bard, with the prompt "translate to 5th-grade reading level". Readability of PEMs before and after AI conversion was measured using the validated Flesch Reading Ease (FRE), Flesch-Kincaid Grade Level (FKGL), Simple Measure of Gobbledygook Index (SMOGI), and Gunning-Fog Index (GFI) scores.

resultsOverall, 21 PEMs on AS were gathered. Original readability measures indicated difficult readability at the 10th-12th grade reading level. ChatGPT-3.5 successfully improved readability across all four measures (p < 0.001) to the approximately 6th-7th grade reading level. Bard successfully improved readability across all measures (p < 0.001) except for SMOGI (p = 0.729) to the approximately 8th-9th grade level. Neither platform generated PEMs written below the recommended 6th-grade reading level. ChatGPT-3.5 demonstrated significantly more favorable post-conversion readability scores, percentage change in readability scores, and conversion time compared to Bard (all p < 0.001).

conclusionAI dialogue platforms can enhance the readability of PEMs for patients with AS but may not fully meet recommended reading skill levels, highlighting potential tools to help strengthen cardiac health literacy in the future.

Indexed as

Aortic stenosisArtificial intelligenceChatbotsChatGPTHealth literacyHeart valve diseaseLarge language modelsPatient education materialReadability

Identifiers

PMID38194058
PMCPMC10899139

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.