Evidence map›Paper›PMID 38630580›Full record

ArticleJournal of the American Medical Informatics Association : JAMIA2024

Generative large language models are all-purpose text analytics engines: text-to-text learning is all your need.

Cheng Peng, Xi Yang, Aokun Chen, Zehao Yu, Kaleb E Smith, Anthony B Costa, Mona G Flores, Jiang Bian, Yonghui Wu

Abstract read
In one paragraph

Article in Journal of the American Medical Informatics Association : JAMIA, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 16 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
16citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

16 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Review
  4. Article
  5. Review
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Identifying Opioid Overdose and Opioid Use Disorder and Related Information from Clinical Narratives Using Large Language Models.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2025
    Article
  13. Automatic Summarization of Doctor-Patient Encounter Dialogues Using Large Language Model through Prompt Tuning.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2025
    Article
  14. Article
  15. LEAP: LLM instruction-example adaptive prompting framework for biomedical relation extraction.Journal of the American Medical Informatics Association : JAMIA · 2024
    Article
  16. Large language models in biomedicine and health: current research landscape and future directions.Journal of the American Medical Informatics Association : JAMIA · 2024
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors.

Cheng PengDepartment of Health Outcomes and Biomedical Informatics, College of Medicine, University of Florida, Gainesville, FL 32611, United States.ORCID 0000-0002-1994-893X
Xi YangDepartment of Health Outcomes and Biomedical Informatics, College of Medicine, University of Florida, Gainesville, FL 32611, United States.
Aokun ChenDepartment of Health Outcomes and Biomedical Informatics, College of Medicine, University of Florida, Gainesville, FL 32611, United States.
Zehao YuDepartment of Health Outcomes and Biomedical Informatics, College of Medicine, University of Florida, Gainesville, FL 32611, United States.
Kaleb E SmithNVIDIA, Santa Clara, CA 95051, United States.
Anthony B CostaNVIDIA, Santa Clara, CA 95051, United States.
Mona G FloresNVIDIA, Santa Clara, CA 95051, United States.
Jiang BianDepartment of Health Outcomes and Biomedical Informatics, College of Medicine, University of Florida, Gainesville, FL 32611, United States.ORCID 0000-0002-2238-5429
Yonghui WuDepartment of Health Outcomes and Biomedical Informatics, College of Medicine, University of Florida, Gainesville, FL 32611, United States.ORCID 0000-0002-6780-6135

Funding

ACTS (AD Clinical Trial Simulation): Developing Advanced Informatics Approaches for an Alzheimer's Disease Clinical Trial Simulation SystemR01AG084236 · NIA · UNIVERSITY OF TEXAS HLTH SCI CTR HOUSTON · PI Jiang Bian, Cui Tao · 2023 to 2026
$4.1M
Computational Drug Repurposing for AD/ADRD with Integrative Analysis of Real World Data and Biomedical KnowledgeR01AG076234 · NIA · WEILL MEDICAL COLL OF CORNELL UNIV · PI Jiang Bian, Fei Wang · 2022 to 2026
$3.8M
An end-to-end informatics framework to study Multiple Chronic Conditions (MCC)'s impact on Alzheimer's disease using harmonized electronic health recordsR01AG083039 · NIA · UNIVERSITY OF TEXAS HLTH SCI CTR HOUSTON · PI BIAN, JIANG, JIANG, XIAOQIAN · 2023 to 2025
$3.4M
Eligibility criteria design for Alzheimer's trials with real-world data and explainable AIR01AG080991 · NIA · WEILL MEDICAL COLL OF CORNELL UNIV · PI Jiang Bian, Fei Wang · 2023 to 2026
$3.1M
Disparities of Alzheimer's disease progression in Sexual Minority IndividualsR01AG080624 · NIA · UNIVERSITY OF FLORIDA · PI Jiang Bian, Yi Guo · 2023 to 2026
$3.1M
Artificial Intelligence and Counterfactually Actionable Responses to End HIV (AI-CARE-HIV)R01AI172875 · NIAID · UNIVERSITY OF FLORIDA · PI Jiang Bian, Mattia Prosperi · 2023 to 2026
$2.8M
Identifying pediatric asthma subtypes using novel privacy-preserving federated machine learning methodsR01HL169277 · NHLBI · UNIVERSITY OF FLORIDA · PI Jennifer Noel Fishe, Jie Xu · 2023 to 2026
$2.7M
Post-Acute Sequelae of SARS-CoV-2 Infection and Subsequent Disease Progression in Individuals with AD/ADRD: Influence of the Social and Environmental Determinants of HealthRF1AG084178 · NIA · BRIGHAM AND WOMEN'S HOSPITAL · PI BIAN, JIANG, HU, HUI · 2023 to 2023
$2.6M
Standardizing and Harmonizing Behavioral and Social Science Research Factors in Alzheimer's Disease through Ontology-Based ApproachesU01AG088076 · NIA · MAYO CLINIC JACKSONVILLE · PI Jiang Bian, Cui Tao · 2024 to 2026
$2.3M
Advancing Interdisciplinary Science of Aging through Identification of Iatrogenic Complications: The UF EHR Clinical Data Infrastructure for Enhanced Patient Safety among the Elderly (UF-ECLIPSE)R33AG062884 · NIA · UNIVERSITY OF FLORIDA · PI INGIBJARGARDOTTIR BJARNADOTTIR, RAGNHILDUR, LUCERO, ROBERT J · 2021 to 2023
$2.1M
The benefits and harms of lung cancer screening in FloridaR01CA246418 · NCI · UNIVERSITY OF FLORIDA · PI BIAN, JIANG, GUO, YI · 2020 to 2023
$1.7M
Advancing Drug Repositioning for Alzheimer’s Disease using Real-world DataR56AG069880 · NIA · UNIVERSITY OF FLORIDA · PI BIAN, JIANG, CHEN, YONG · 2021 to 2022
$1.6M
Cancer Informatics Shared ResourceEd and Ethel Moore Alzheimer's Disease Research Program 23A09National Institute of Allergy and Infectious Diseases NIAID R01AI172875NCCDPHP CDC HHS U18 DP006512NCI NIH HHS R01 CA246418NCI NIH HHS R01CA246418NHLBI NIH HHS NHLBI R01HL169277NHLBI NIH HHS R01 HL169277NIAID NIH HHS R01 AI172875NIA NIH HHS NIA R56AG069880NIA NIH HHS R01 AG076234NIA NIH HHS R01 AG080624NIA NIH HHS R01 AG080991NIA NIH HHS R01 AG083039NIA NIH HHS R01 AG084236NIA NIH HHS R33 AG062884NIA NIH HHS R56 AG069880NIA NIH HHS RF1 AG084178NIA NIH HHS U01 AG088076Patient-Centered Outcomes Research Institute ME-2018C3-14754UF Clinical and Translational Science Institute Biomedical Informatics ProgramUF Health Cancer Center
6 · The paper itself

Abstract

objectiveTo solve major clinical natural language processing (NLP) tasks using a unified text-to-text learning architecture based on a generative large language model (LLM) via prompt tuning.

methodsWe formulated 7 key clinical NLP tasks as text-to-text learning and solved them using one unified generative clinical LLM, GatorTronGPT, developed using GPT-3 architecture and trained with up to 20 billion parameters. We adopted soft prompts (ie, trainable vectors) with frozen LLM, where the LLM parameters were not updated (ie, frozen) and only the vectors of soft prompts were updated, known as prompt tuning. We added additional soft prompts as a prefix to the input layer, which were optimized during the prompt tuning. We evaluated the proposed method using 7 clinical NLP tasks and compared them with previous task-specific solutions based on Transformer models. RESULTS AND

conclusionThe proposed approach achieved state-of-the-art performance for 5 out of 7 major clinical NLP tasks using one unified generative LLM. Our approach outperformed previous task-specific transformer models by ∼3% for concept extraction and 7% for relation extraction applied to social determinants of health, 3.4% for clinical concept normalization, 3.4%-10% for clinical abbreviation disambiguation, and 5.5%-9% for natural language inference. Our approach also outperformed a previously developed prompt-based machine reading comprehension (MRC) model, GatorTron-MRC, for clinical concept and relation extraction. The proposed approach can deliver the "one model for all" promise from training to deployment using a unified generative LLM.

Indexed as

Natural Language ProcessingElectronic Health RecordsHumansMachine Learningclinical natural language processinglarge language modelprompt tuningtext generationtransformer model

Identifiers

PMID38630580
PMCPMC11339507

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.