ArticleJournal of the American Medical Informatics Association : JAMIA2024
Leveraging artificial intelligence to summarize abstracts in lay language for increasing research accessibility and transparency.
Article in Journal of the American Medical Informatics Association : JAMIA, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 16 papers.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
16 citing papers in PubMed.
- From patient advocacy to patient-driven research: Building active partnerships beginning at the bench to reach the bedside.FEBS open bio · 2026Article
- Why do AI projects fail in drug development and pharma? Insights from multi-year Pistoia Alliance studies.Journal of computer-aided molecular design · 2026Article
- Generative artificial intelligence implementation in REDCap.JAMIA open · 2026Article
- Plain Language Summarization of Environmental Health Research Using Generative AI: Community-Engaged Qualitative Study.Journal of medical Internet research · 2026Article
- Digital and community-engaged approaches to improve research participant recruitment - Advice from forty convened experts.Journal of clinical and translational science · 2026Article
- Article
- Using ChatGPT-4 for Lay Summarization in Prostate Cancer Research to Advance Patient-Centered Communication: Large-Scale Generative AI Performance Evaluation.Journal of medical Internet research · 2025Article
- [Making prostate cancer research accessible: chatGPT-4 as a tool to enhance lay communication].Urologie (Heidelberg, Germany) · 2025Article
- Letter to the editors in response to "Leveraging artificial intelligence to summarize abstracts in lay language for increasing research accessibility and transparency".Journal of the American Medical Informatics Association : JAMIA · 2025Article
- Reply to Layne et al.'s Letter to the Editor.Journal of the American Medical Informatics Association : JAMIA · 2025Article
- Leveraging Large Language Models for High-Quality Lay Summaries: Efficacy of ChatGPT-4 with Custom Prompts in a Consecutive Series of Prostate Cancer Manuscripts.Current oncology (Toronto, Ont.) · 2025Article
- Evaluating a large language model's ability to answer clinicians' requests for evidence summaries.Journal of the Medical Library Association : JMLA · 2025Article
- Summarizing clinical evidence utilizing large language models for cancer treatments: a blinded comparative analysis.Frontiers in digital health · 2025Article
- Artificial Intelligence in Medical Affairs: A New Paradigm with Novel Opportunities.Pharmaceutical medicine · 2024Review
- Artificial intelligence: Revolutionizing pediatric emergency care - A narrative review.International journal of critical illness and injury scienceReview
- Can Large Language Models Answer Questions about Spinal Cord Injury? Risks, Challenges, and Opportunities-A Narrative Review.Neurotrauma reportsReview
Corrections and comments
- Commented on by
- Commented on by
Authors and funding
13 authors.
Funding
Abstract
objectiveReturning aggregate study results is an important ethical responsibility to promote trust and inform decision making, but the practice of providing results to a lay audience is not widely adopted. Barriers include significant cost and time required to develop lay summaries and scarce infrastructure necessary for returning them to the public. Our study aims to generate, evaluate, and implement ChatGPT 4 lay summaries of scientific abstracts on a national clinical study recruitment platform, ResearchMatch, to facilitate timely and cost-effective return of study results at scale. MATERIALS AND
methodsWe engineered prompts to summarize abstracts at a literacy level accessible to the public, prioritizing succinctness, clarity, and practical relevance. Researchers and volunteers assessed ChatGPT-generated lay summaries across five dimensions: accuracy, relevance, accessibility, transparency, and harmfulness. We used precision analysis and adaptive random sampling to determine the optimal number of summaries for evaluation, ensuring high statistical precision.
resultsChatGPT achieved 95.9% (95% CI, 92.1-97.9) accuracy and 96.2% (92.4-98.1) relevance across 192 summary sentences from 33 abstracts based on researcher review. 85.3% (69.9-93.6) of 34 volunteers perceived ChatGPT-generated summaries as more accessible and 73.5% (56.9-85.4) more transparent than the original abstract. None of the summaries were deemed harmful. We expanded ResearchMatch's technical infrastructure to automatically generate and display lay summaries for over 750 published studies that resulted from the platform's recruitment mechanism. DISCUSSION AND
conclusionImplementing AI-generated lay summaries on ResearchMatch demonstrates the potential of a scalable framework generalizable to broader platforms for enhancing research accessibility and transparency.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.