Evidence map›Paper›PMID 39178375›Full record

ArticleJournal of the American Medical Informatics Association : JAMIA2024

Generating colloquial radiology reports with large language models.

Cynthia Crystal Tang, Supriya Nagesh, David A Fussell, Justin Glavis-Bloom, Nina Mishra, Charles Li, Gillean Cortes, Robert Hill, Jasmine Zhao, Angellica Gordon and 4 more

Abstract read
In one paragraph

Article in Journal of the American Medical Informatics Association : JAMIA, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 7 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
7citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

7 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Review
  6. Review
  7. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

14 authors.

Cynthia Crystal TangDepartment of Radiological Sciences, University of California, Irvine, Irvine, CA 92868, United States.
Supriya NageshAmazon Web Services, East Palo Alto, CA 94303, United States.
David A FussellDepartment of Radiological Sciences, University of California, Irvine, Irvine, CA 92868, United States.ORCID 0009-0003-0833-9148
Justin Glavis-BloomDepartment of Radiological Sciences, University of California, Irvine, Irvine, CA 92868, United States.
Nina MishraAmazon Web Services, East Palo Alto, CA 94303, United States.
Charles LiDepartment of Radiological Sciences, University of California, Irvine, Irvine, CA 92868, United States.
Gillean CortesDepartment of Radiological Sciences, University of California, Irvine, Irvine, CA 92868, United States.
Robert HillDepartment of Radiological Sciences, University of California, Irvine, Irvine, CA 92868, United States.
Jasmine ZhaoDepartment of Radiological Sciences, University of California, Irvine, Irvine, CA 92868, United States.
Angellica GordonDepartment of Radiological Sciences, University of California, Irvine, Irvine, CA 92868, United States.
Joshua WrightDepartment of Radiological Sciences, University of California, Irvine, Irvine, CA 92868, United States.
Hayden TrouttDepartment of Radiological Sciences, University of California, Irvine, Irvine, CA 92868, United States.
Rod TarragoAmazon Web Services, Seattle, WA 98121, United States.
Daniel S ChowDepartment of Radiological Sciences, University of California, Irvine, Irvine, CA 92868, United States.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectivesPatients are increasingly being given direct access to their medical records. However, radiology reports are written for clinicians and typically contain medical jargon, which can be confusing. One solution is for radiologists to provide a "colloquial" version that is accessible to the layperson. Because manually generating these colloquial translations would represent a significant burden for radiologists, a way to automatically produce accurate, accessible patient-facing reports is desired. We propose a novel method to produce colloquial translations of radiology reports by providing specialized prompts to a large language model (LLM). MATERIALS AND

methodsOur method automatically extracts and defines medical terms and includes their definitions in the LLM prompt. Using our method and a naive strategy, translations were generated at 4 different reading levels for 100 de-identified neuroradiology reports from an academic medical center. Translations were evaluated by a panel of radiologists for accuracy, likability, harm potential, and readability.

resultsOur approach translated the Findings and Impression sections at the 8th-grade level with accuracies of 88% and 93%, respectively. Across all grade levels, our approach was 20% more accurate than the baseline method. Overall, translations were more readable than the original reports, as evaluated using standard readability indices.

conclusionWe find that our translations at the eighth-grade level strike an optimal balance between accuracy and readability. Notably, this corresponds to nationally recognized recommendations for patient-facing health communication. We believe that using this approach to draft patient-accessible reports will benefit patients without significantly increasing the burden on radiologists.

Indexed as

Natural Language ProcessingComprehensionElectronic Health RecordsHumansRadiologyRadiology Information SystemsTerminology as Topiclarge language modelmachine learningnatural language processingprompt engineeringradiology

Identifiers

PMID39178375
PMCPMC11491646

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.