Evidence map›Paper›PMID 39801619›Full record

ArticleArXiv2024

Demystifying Large Language Models for Medicine: A Primer.

Qiao Jin, Nicholas Wan, Robert Leaman, Shubo Tian, Zhizheng Wang, Yifan Yang, Zifeng Wang, Guangzhi Xiong, Po-Ting Lai, Qingqing Zhu and 13 more

Abstract readPreprint
In one paragraph

Article in ArXiv, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

23 authors.

Qiao JinNational Library of Medicine (NLM), National Institutes of Health (NIH), Bethesda, MD, USA.
Nicholas WanNational Library of Medicine (NLM), National Institutes of Health (NIH), Bethesda, MD, USA.
Robert LeamanNational Library of Medicine (NLM), National Institutes of Health (NIH), Bethesda, MD, USA.
Shubo TianNational Library of Medicine (NLM), National Institutes of Health (NIH), Bethesda, MD, USA.
Zhizheng WangNational Library of Medicine (NLM), National Institutes of Health (NIH), Bethesda, MD, USA.
Yifan YangNational Library of Medicine (NLM), National Institutes of Health (NIH), Bethesda, MD, USA.
Zifeng WangDepartment of Computer Science, University of Illinois Urbana-Champaign, Champaign, IL, USA.
Guangzhi XiongDepartment of Computer Science, University of Virginia, Charlottesville, VA, USA.
Po-Ting LaiNational Library of Medicine (NLM), National Institutes of Health (NIH), Bethesda, MD, USA.
Qingqing ZhuNational Library of Medicine (NLM), National Institutes of Health (NIH), Bethesda, MD, USA.
Benjamin HouNational Library of Medicine (NLM), National Institutes of Health (NIH), Bethesda, MD, USA.
Maame Sarfo-GyamfiNational Library of Medicine (NLM), National Institutes of Health (NIH), Bethesda, MD, USA.
Gongbo ZhangDepartment of Biomedical Informatics, Columbia University, New York, NY, USA.
Aidan GilsonSchool of Medicine, Yale University, New Haven, CT, USA.
Balu BhasuranSchool of Information, Florida State University, Tallahassee, FL, USA.
Zhe HeSchool of Information, Florida State University, Tallahassee, FL, USA.
Aidong ZhangDepartment of Computer Science, University of Virginia, Charlottesville, VA, USA.
Jimeng SunDepartment of Computer Science, University of Illinois Urbana-Champaign, Champaign, IL, USA.
Chunhua WengDepartment of Biomedical Informatics, Columbia University, New York, NY, USA.
Ronald M SummersDepartment of Radiology and Imaging Sciences, NIH Clinical Center, Bethesda, MD, USA.
Qingyu ChenSchool of Medicine, Yale University, New Haven, CT, USA.
Yifan PengDepartment of Population Health Sciences, Weill Cornell Medicine, New York, NY, USA.
Zhiyong LuNational Library of Medicine (NLM), National Institutes of Health (NIH), Bethesda, MD, USA.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Large language models (LLMs) represent a transformative class of AI tools capable of revolutionizing various aspects of healthcare by generating human-like responses across diverse contexts and adapting to novel tasks following human instructions. Their potential application spans a broad range of medical tasks, such as clinical documentation, matching patients to clinical trials, and answering medical questions. In this primer paper, we propose an actionable guideline to help healthcare professionals more efficiently utilize LLMs in their work, along with a set of best practices. This approach consists of several main phases, including formulating the task, choosing LLMs, prompt engineering, fine-tuning, and deployment. We start with the discussion of critical considerations in identifying healthcare tasks that align with the core capabilities of LLMs and selecting models based on the selected task and data, performance requirements, and model interface. We then review the strategies, such as prompt engineering and fine-tuning, to adapt standard LLMs to specialized medical tasks. Deployment considerations, including regulatory compliance, ethical guidelines, and continuous monitoring for fairness and bias, are also discussed. By providing a structured step-by-step methodology, this tutorial aims to equip healthcare professionals with the tools necessary to effectively integrate LLMs into clinical practice, ensuring that these powerful technologies are applied in a safe, reliable, and impactful manner.

Identifiers

PMID39801619
PMCPMC11722506

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.