Evidence map›Paper›PMID 38269644›Full record

ReviewJournal of the American Medical Informatics Association : JAMIA2024

Harnessing the potential of large language models in medical education: promise and pitfalls.

Trista M Benítez, Yueyuan Xu, J Donald Boudreau, Alfred Wei Chieh Kow, Fernando Bello, Le Van Phuoc, Xiaofei Wang, Xiaodong Sun, Gilberto Ka-Kit Leung, Yanyan Lan and 5 more

Registry-linked trialOpen access · greenAbstract readReview
In one paragraph

Review in Journal of the American Medical Informatics Association : JAMIA, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT06759012 (An Agentic Co-educator System for Personalized Medical Education), which is not on this map. Cited by 48 papers.

0numbers the graph read from it
0cells of the map it votes in
48citing papers in PubMed
9.6field-weighted citation impact, top 2% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT06759012 nacompletednot on this mapstarted 2025, after this paper: background citation

An Agentic Co-educator System for Personalized Medical Education

TypeinterventionalSponsorTsinghua UniversityRan2025 to 2026Enrolled269ConditionsMedical EducationArmsEyeTeacher
3 · Its place in the literature

Who cites it

48 citing papers in PubMed, 80 citations in OpenAlex.

  1. Trial
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Review
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. What patients want from healthcare chatbots: insights from a mixed-methods study.Journal of the American Medical Informatics Association : JAMIA · 2025
    Article
  15. Article
  16. Article
  17. Review
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

15 authors at 11 institutions in 6 countries.

Trista M BenítezDepartment of Surgery, University of Michigan Medical School, Ann Arbor, MI 48109, United States.
Yueyuan XuTsinghua Medicine, Tsinghua University, Beijing, 100084, China.
J Donald BoudreauInstitute of Health Sciences Education, Faculty of Medicine and Health Sciences, McGill University, Montreal, QC H3A 0G4, Canada.
Alfred Wei Chieh KowDepartment of Surgery, Yong Loo Lin School of Medicine, National University of Singapore, 117597, Singapore.
Fernando BelloTechnology Enhanced Learning and Innovation Department, Duke-NUS Medical School, National University of Singapore, 169857, Singapore.
Le Van PhuocCollege of Health Sciences, VinUniversity, Hanoi, 100000, Vietnam.
Xiaofei WangKey Laboratory for Biomechanics and Mechanobiology of Ministry of Education, Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, China.
Xiaodong SunDepartment of Ophthalmology, Shanghai General Hospital, School of Medicine, Shanghai JiaoTong University, Shanghai, 200240, China.
Gilberto Ka-Kit LeungDepartment of Surgery, School of Clinical Medicine, LKS Faculty of Medicine, The University of Hong Kong, Queen Mary Hospital, Hong Kong, 999077, China.
Yanyan LanInstitute of AI Industrial Research, Tsinghua University, Beijing, 100084, China.
Yaxing WangBeijing Institute of Ophthalmology, Beijing Tongren Hospital, Beijing Ophthalmology and Visual Sciences Key Laboratory, Capital University of Medical Science, Beijing, 100730, China.
Davy ChengSchool of Medicine, The Chinese University of Hong Kong (Shenzhen), Shenzhen, 518172, China.
Yih-Chung ThamCentre for Innovation and Precision Eye Health; and Department of Ophthalmology, Yong Loo Lin School of Medicine, National University of Singapore, 117597, Singapore.ORCID 0000-0002-6752-797X
Tien Yin WongTsinghua Medicine, Tsinghua University, Beijing, 100084, China.ORCID 0000-0002-8448-1264
Kevin C ChungDepartment of Surgery, University of Michigan Medical School, Ann Arbor, MI 48109, United States.
National University of Singapore · SGTsinghua University · CNUniversity of Michigan · USBeihang University · CNBeijing Tongren Hospital · CNChinese University of Hong Kong, Shenzhen · CNMcGill University Health Centre · CAQueen Mary Hospital · CNShanghai Jiao Tong University · CNSingapore National Eye Center · SGVinUniversity · VN

Funding

NIH HHS
6 · The paper itself

Abstract

objectivesTo provide balanced consideration of the opportunities and challenges associated with integrating Large Language Models (LLMs) throughout the medical school continuum. PROCESS: Narrative review of published literature contextualized by current reports of LLM application in medical education.

conclusionsLLMs like OpenAI's ChatGPT can potentially revolutionize traditional teaching methodologies. LLMs offer several potential advantages to students, including direct access to vast information, facilitation of personalized learning experiences, and enhancement of clinical skills development. For faculty and instructors, LLMs can facilitate innovative approaches to teaching complex medical concepts and fostering student engagement. Notable challenges of LLMs integration include the risk of fostering academic misconduct, inadvertent overreliance on AI, potential dilution of critical thinking skills, concerns regarding the accuracy and reliability of LLM-generated content, and the possible implications on teaching staff.

Indexed as

Clinical CompetenceEducation, MedicalHumansLanguageLearningReproducibility of ResultsChatGPTlarge language modelsmedical education

Identifiers

PMID38269644
PMCPMC10873781
OpenAlexW4391225179

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.