Evidence map›Paper›PMID 37794249›Full record

ArticleEuropean radiology2024

ChatGPT makes medicine easy to swallow: an exploratory case study on simplified radiology reports.

Katharina Jeblick, Balthasar Schachtner, Jakob Dexl, Andreas Mittermeier, Anna Theresa Stüber, Johanna Topalis, Tobias Weber, Philipp Wesp, Bastian Oliver Sabel, Jens Ricke and 1 more

Abstract read
In one paragraph

Article in European radiology, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 259 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
259citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

259 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Review
  16. Article
  17. Large language models for lumbar spondylolisthesis detection: a multi-center pilot comparative radiographic accuracy study.European journal of orthopaedic surgery & traumatology : orthopedie traumatologie · 2026
    Article
  18. Article
  19. Patient understanding of AI-simplified oncology imaging reports requires further validation.Cancer imaging : the official publication of the International Cancer Imaging Society · 2026
    Article
  20. Article

199 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors.

Katharina Jeblick *Department of Radiology, LMU University Hospital, LMU Munich, Munich, Germany. katharina.jeblick@med.uni-muenchen.de.ORCID http://orcid.org/0000-0002-8678-7152
Balthasar Schachtner *Department of Radiology, LMU University Hospital, LMU Munich, Munich, Germany.
Jakob DexlDepartment of Radiology, LMU University Hospital, LMU Munich, Munich, Germany.
Andreas MittermeierDepartment of Radiology, LMU University Hospital, LMU Munich, Munich, Germany.
Anna Theresa StüberDepartment of Radiology, LMU University Hospital, LMU Munich, Munich, Germany.
Johanna TopalisDepartment of Radiology, LMU University Hospital, LMU Munich, Munich, Germany.
Tobias WeberDepartment of Radiology, LMU University Hospital, LMU Munich, Munich, Germany.
Philipp WespDepartment of Radiology, LMU University Hospital, LMU Munich, Munich, Germany.
Bastian Oliver SabelDepartment of Radiology, LMU University Hospital, LMU Munich, Munich, Germany.
Jens RickeDepartment of Radiology, LMU University Hospital, LMU Munich, Munich, Germany.
Michael IngrischDepartment of Radiology, LMU University Hospital, LMU Munich, Munich, Germany.

Funding

Deutsche Forschungsgemeinschaft 460037581
6 · The paper itself

Abstract

objectivesTo assess the quality of simplified radiology reports generated with the large language model (LLM) ChatGPT and to discuss challenges and chances of ChatGPT-like LLMs for medical text simplification.

methodsIn this exploratory case study, a radiologist created three fictitious radiology reports which we simplified by prompting ChatGPT with "Explain this medical report to a child using simple language." In a questionnaire, we tasked 15 radiologists to rate the quality of the simplified radiology reports with respect to their factual correctness, completeness, and potential harm for patients. We used Likert scale analysis and inductive free-text categorization to assess the quality of the simplified reports.

resultsMost radiologists agreed that the simplified reports were factually correct, complete, and not potentially harmful to the patient. Nevertheless, instances of incorrect statements, missed relevant medical information, and potentially harmful passages were reported.

conclusionWhile we see a need for further adaption to the medical field, the initial insights of this study indicate a tremendous potential in using LLMs like ChatGPT to improve patient-centered care in radiology and other medical domains. CLINICAL RELEVANCE STATEMENT: Patients have started to use ChatGPT to simplify and explain their medical reports, which is expected to affect patient-doctor interaction. This phenomenon raises several opportunities and challenges for clinical routine. KEY POINTS: • Patients have started to use ChatGPT to simplify their medical reports, but their quality was unknown. • In a questionnaire, most participating radiologists overall asserted good quality to radiology reports simplified with ChatGPT. However, they also highlighted a notable presence of errors, potentially leading patients to draw harmful conclusions. • Large language models such as ChatGPT have vast potential to enhance patient-centered care in radiology and other medical domains. To realize this potential while minimizing harm, they need supervision by medical experts and adaption to the medical field.

Indexed as

Radiology Information SystemsHumansPatient-Centered CarePhysician-Patient RelationsRadiologistsRadiologySurveys and QuestionnairesNatural language processingPatient-centered careRadiology

Identifiers

PMID37794249
PMCPMC11126432

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.