Evidence map›Paper›PMID 39236008›Full record

ArticlePLOS digital health2024

ChatGPT and large language models (LLMs) awareness and use. A prospective cross-sectional survey of U.S. medical students.

Conner Ganjavi, Michael Eppler, Devon O'Brien, Lorenzo Storino Ramacciotti, Muhammad Shabbeer Ghauri, Issac Anderson, Jae Choi, Darby Dwyer, Claudia Stephens, Victoria Shi and 4 more

Abstract read
In one paragraph

Article in PLOS digital health, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 31 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
31citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

31 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Observational
  4. Article
  5. Diagnostic accuracy and citation integrity of four large language models on otolaryngology vignettes.European archives of oto-rhino-laryngology : official journal of the European Federation of Oto-Rhino-Laryngological Societies (EUFOS) : affiliated with the German Society for Oto-Rhino-Laryngology - Head and Neck Surgery · 2026
    Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Review
  17. Article
  18. Review
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

14 authors.

Conner GanjaviUSC Institute of Urology and Catherine and Joseph Aresty Department of Urology, Keck School of Medicine, University of Southern California, Los Angeles, California United States of America.ORCID https://orcid.org/0000-0001-9698-964X
Michael EpplerUSC Institute of Urology and Catherine and Joseph Aresty Department of Urology, Keck School of Medicine, University of Southern California, Los Angeles, California United States of America.
Devon O'BrienKeck School of Medicine, University of Southern California, Los Angeles, California, United States of America.
Lorenzo Storino RamacciottiUSC Institute of Urology and Catherine and Joseph Aresty Department of Urology, Keck School of Medicine, University of Southern California, Los Angeles, California United States of America.ORCID https://orcid.org/0000-0002-0615-9720
Muhammad Shabbeer GhauriCalifornia University of Science and Medicine, Colton, California, United States of America.ORCID https://orcid.org/0000-0001-6387-589X
Issac AndersonWayne State University School of Medicine, Detroid, Michigan, United States of America.
Jae ChoiUT Southwestern Medical School, Dallas, Texas, United States of America.
Darby DwyerTexas A&M School of Medicine, Bryan, Texas, United States of America.
Claudia StephensFrederick P. Whiddon College of Medicine, University of South Alabama, Mobile, Alabama, United States of America.
Victoria ShiUniversity of Missouri-Kansas City School of Medicine, Kansas City, Missouri, United States of America.ORCID https://orcid.org/0000-0002-1309-0098
Madeline EbertMedical College of Wisconsin, Milwaukee, Wisconsin, United States of America.
Michaela DerbySanford School of Medicine, University of South Dakota, Vermillion, South Dakota, United States of America.
Bayan YazdiStritch School of Medicine, Loyola University Chicago, Maywood, Illinois, United States of America.ORCID https://orcid.org/0000-0003-2948-8030
Giovanni E CacciamaniUSC Institute of Urology and Catherine and Joseph Aresty Department of Urology, Keck School of Medicine, University of Southern California, Los Angeles, California United States of America.ORCID https://orcid.org/0000-0002-8892-5539

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Generative-AI (GAI) models like ChatGPT are becoming widely discussed and utilized tools in medical education. For example, it can be used to assist with studying for exams, shown capable of passing the USMLE board exams. However, there have been concerns expressed regarding its fair and ethical use. We designed an electronic survey for students across North American medical colleges to gauge their views on and current use of ChatGPT and similar technologies in May, 2023. Overall, 415 students from at least 28 medical schools completed the questionnaire and 96% of respondents had heard of ChatGPT and 52% had used it for medical school coursework. The most common use in pre-clerkship and clerkship phase was asking for explanations of medical concepts and assisting with diagnosis/treatment plans, respectively. The most common use in academic research was for proof reading and grammar edits. Respondents recognized the potential limitations of ChatGPT, including inaccurate responses, patient privacy, and plagiarism. Students recognized the importance of regulations to ensure proper use of this novel technology. Understanding the views of students is essential to crafting workable instructional courses, guidelines, and regulations that ensure the safe, productive use of generative-AI in medical school.

Identifiers

PMID39236008
PMCPMC11376538

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.