Evidence map›Paper›PMID 38750546›Full record

ArticleBMC medical education2024

Expert assessment of ChatGPT's ability to generate illness scripts: an evaluative study.

Yasutaka Yanagita, Daiki Yokokawa, Fumitoshi Fukuzawa, Shun Uchida, Takanori Uehara, Masatomi Ikusaka

Abstract read
In one paragraph

Article in BMC medical education, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 14 papers.

0numbers the graph read from it
0cells of the map it votes in
14citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

14 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. AntiBMPNN: Structure-Guided Graph Neural Networks for Precision Antibody Engineering.Advanced science (Weinheim, Baden-Wurttemberg, Germany) · 2025
    Article
  7. Article
  8. Article
  9. Article
  10. Review
  11. Article
  12. Article
  13. Article
  14. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Yasutaka YanagitaDepartment of General Medicine, Chiba University Hospital, 1-8-1, Inohana, Chuo-Ku, Chiba, Chiba Pref, Japan. y.yanagita@gmail.com.
Daiki YokokawaDepartment of General Medicine, Chiba University Hospital, 1-8-1, Inohana, Chuo-Ku, Chiba, Chiba Pref, Japan.
Fumitoshi FukuzawaDepartment of General Medicine, Chiba University Hospital, 1-8-1, Inohana, Chuo-Ku, Chiba, Chiba Pref, Japan.
Shun UchidaUchida Internal Medicine Clinic, Saitama, Japan.
Takanori UeharaDepartment of General Medicine, Chiba University Hospital, 1-8-1, Inohana, Chuo-Ku, Chiba, Chiba Pref, Japan.
Masatomi IkusakaDepartment of General Medicine, Chiba University Hospital, 1-8-1, Inohana, Chuo-Ku, Chiba, Chiba Pref, Japan.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundAn illness script is a specific script format geared to represent patient-oriented clinical knowledge organized around enabling conditions, faults (i.e., pathophysiological process), and consequences. Generative artificial intelligence (AI) stands out as an educational aid in continuing medical education. The effortless creation of a typical illness script by generative AI could help the comprehension of key features of diseases and increase diagnostic accuracy. No systematic summary of specific examples of illness scripts has been reported since illness scripts are unique to each physician.

objectiveThis study investigated whether generative AI can generate illness scripts.

methodsWe utilized ChatGPT-4, a generative AI, to create illness scripts for 184 diseases based on the diseases and conditions integral to the National Model Core Curriculum in Japan for undergraduate medical education (2022 revised edition) and primary care specialist training in Japan. Three physicians applied a three-tier grading scale: "A" denotes that the content of each disease's illness script proves sufficient for training medical students, "B" denotes that it is partially lacking but acceptable, and "C" denotes that it is deficient in multiple respects.

resultsBy leveraging ChatGPT-4, we successfully generated each component of the illness script for 184 diseases without any omission. The illness scripts received "A," "B," and "C" ratings of 56.0% (103/184), 28.3% (52/184), and 15.8% (29/184), respectively.

conclusionUseful illness scripts were seamlessly and instantaneously created using ChatGPT-4 by employing prompts appropriate for medical students. The technology-driven illness script is a valuable tool for introducing medical students to key features of diseases.

Indexed as

Clinical CompetenceEducation, Medical, UndergraduateArtificial IntelligenceCurriculumEducational MeasurementHumansJapanStudents, MedicalAIChatGPT-4Generative pretrained transformer (GPT)Illness scriptMedical education

Identifiers

PMID38750546
PMCPMC11095028

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.