Evidence map›Paper›PMID 39779929›Full record

ReviewNature medicine2025

The TRIPOD-LLM reporting guideline for studies using large language models.

Jack Gallifant, Majid Afshar, Saleem Ameen, Yindalon Aphinyanaphongs, Shan Chen, Giovanni Cacciamani, Dina Demner-Fushman, Dmitriy Dligach, Roxana Daneshjou, Chrystinne Fernandes and 15 more

Abstract readReview
In one paragraph

Review in Nature medicine, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 304 papers, 3 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
304citing papers in PubMed, 3 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

304 citing papers in PubMed, 3 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Trial
  5. Article
  6. Article
  7. Review
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Accountability for large language models in health care.Bulletin of the World Health Organization · 2026
    Article
  16. The consensus-based CINEX guideline for reporting clinical information extraction studies.Journal of the American Medical Informatics Association : JAMIA · 2026
    Article
  17. Multicenter Evaluation of Large Language Models Versus Hepatologists for Prognostic Prediction in Drug-Induced Liver Injury.Liver international : official journal of the International Association for the Study of the Liver · 2026
    Article
  18. Article
  19. Article
  20. Article

244 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

25 authors.

Jack GallifantLaboratory for Computational Physiology, Massachusetts Institute of Technology, Cambridge, MA, USA.ORCID 0000-0003-1306-2334
Majid Afshar *Department of Medicine, University of Wisconsin-Madison, Madison, WI, USA.
Saleem Ameen *Laboratory for Computational Physiology, Massachusetts Institute of Technology, Cambridge, MA, USA.ORCID 0000-0002-2549-4540
Yindalon Aphinyanaphongs *Department of Population Health, NYU Grossman School of Medicine and Langone Health, New York, NY, USA.ORCID 0000-0001-8605-5392
Shan Chen *Artificial Intelligence in Medicine (AIM) Program, Mass General Brigham, Harvard Medical School, Boston, MA, USA.ORCID 0000-0001-7999-7410
Giovanni Cacciamani *USC Institute of Urology and Catherine and Joseph Aresty Department of Urology, Keck School of Medicine, University of Southern California, Los Angeles, CA, USA.ORCID 0000-0002-8892-5539
Dina Demner-Fushman *National Library of Medicine, NIH, HHS, Bethesda, MD, USA.
Dmitriy Dligach *Department of Computer Science, Loyola University, Chicago, IL, USA.
Roxana Daneshjou *Department of Dermatology, Stanford School of Medicine, Redwood City, CA, USA.ORCID 0000-0001-7988-9356
Chrystinne Fernandes *Laboratory for Computational Physiology, Massachusetts Institute of Technology, Cambridge, MA, USA.
Lasse Hyldig Hansen *Laboratory for Computational Physiology, Massachusetts Institute of Technology, Cambridge, MA, USA.ORCID 0009-0005-1556-679X
Adam Landman *Mass General Brigham, Boston, MA, USA.
Lisa Lehmann *Mass General Brigham, Boston, MA, USA.
Liam G McCoy *Faculty of Medicine and Dentistry, University of Alberta, Edmonton, Alberta, Canada.
Timothy Miller *Computational Health Informatics Program, Boston Children's Hospital, Harvard Medical School, Boston, MA, USA.ORCID 0000-0003-4513-403X
Amy Moreno *Department of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA.
Nikolaj Munch *Laboratory for Computational Physiology, Massachusetts Institute of Technology, Cambridge, MA, USA.
David Restrepo *Laboratory for Computational Physiology, Massachusetts Institute of Technology, Cambridge, MA, USA.ORCID 0000-0002-3789-1957
Guergana Savova *Computational Health Informatics Program, Boston Children's Hospital, Harvard Medical School, Boston, MA, USA.
Renato Umeton *Dana-Farber Cancer Institute, Boston, MA, USA.ORCID 0000-0002-5561-6932
Judy Wawira Gichoya *Department of Radiology, Emory University School of Medicine, Atlanta, GA, USA.ORCID 0000-0002-1097-316X
Gary S CollinsCentre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology, and Musculoskeletal Sciences, University of Oxford, Oxford, UK.ORCID 0000-0002-2772-2316
Karel G M MoonsJulius Center for Health Sciences and Primary Care, UMC Utrecht, Utrecht University, Utrecht, the Netherlands.
Leo A CeliLaboratory for Computational Physiology, Massachusetts Institute of Technology, Cambridge, MA, USA.ORCID 0000-0001-6712-6626
Danielle S BittermanArtificial Intelligence in Medicine (AIM) Program, Mass General Brigham, Harvard Medical School, Boston, MA, USA. dbitterman@bwh.harvard.edu.

Funding

Project-005UL1TR001445 · NCATS · NEW YORK UNIVERSITY SCHOOL OF MEDICINE · PI BREDELLA, MIRIAM ANTOINETTE, HOCHMAN, JUDITH S · 2015 to 2025
$103.5M
Bridge2AI: Patient-Focused Collaborative Hospital Repository Uniting Standards (CHoRUS) for Equitable AIOT2OD032701 · OD · MASSACHUSETTS GENERAL HOSPITAL · PI BIHORAC, AZRA, CLERMONT, GILLES · 2022 to 2025
$24.6M
Shared Resource Core 2: Clinical Artificial Intelligence CoreU54CA274516 · NCI · DANA-FARBER CANCER INST · PI Dipanjan Chowdhury · 2023 to 2026
$8.1M
MUST Data Science Research Hub (MUDSReH) - Democratized Trusted Research Environment (dTRE)U54TW012043 · FIC · MBARARA UNIVERSITY/SCIENCE/ TECHNOLOGY · PI Leo Anthony G Celi, Jessica Elizabeth Haberer · 2021 to 2026
$6.9M
RADX TECH - CERES NANOSCIENCE INC NANOTRAP PARTICLE MANUFACTURING75N92020C00021 · NHLBI · CERES NANOSCIENCES, LLLP · PI DUNLAP, ROSS · 2021 to 2021
$4.0M
Critical Care Informatics: Ethical considerations around the use and sharing of health-related dataR01EB017205 · NIBIB · MASSACHUSETTS INSTITUTE OF TECHNOLOGY · PI CELI, LEO ANTHONY G, MARK, ROGER GREENWOOD · 2014 to 2021
$3.8M
Opportunistic Screening for ASCVD using a Multimodal Deep Learning Risk Prediction ModelR01HL167811 · NHLBI · MAYO CLINIC ARIZONA · PI Imon Banerjee, Judy Gichoya · 2024 to 2026
$2.1M
Transfer Learning for Digital Curation of the EMR Clinical NarrativeR01LM013486 · NLM · BOSTON CHILDREN'S HOSPITAL · PI SAVOVA, GUERGANA K. · 2021 to 2024
$1.5M
Informatics strategies to improve immune-related adverse event detection in cancer patientsR01CA294033 · NCI · BRIGHAM AND WOMEN'S HOSPITAL · PI Hugo Aerts · 2024 to 2026
$1.3M
FIC NIH HHS U54 TW012043National Science Foundation (NSF) 1928614 & #2129076NCATS NIH HHS UL1 TR001445NCI NIH HHS R01 CA294033NCI NIH HHS U54 CA274516NHLBI NIH HHS 75N92020C00008NHLBI NIH HHS 75N92020C00021NHLBI NIH HHS R01 HL167811NIBIB NIH HHS R01 EB017205NIH HHS OT2 OD032701NLM NIH HHS R01 LM013486
6 · The paper itself

Abstract

Large language models (LLMs) are rapidly being adopted in healthcare, necessitating standardized reporting guidelines. We present transparent reporting of a multivariable model for individual prognosis or diagnosis (TRIPOD)-LLM, an extension of the TRIPOD + artificial intelligence statement, addressing the unique challenges of LLMs in biomedical applications. TRIPOD-LLM provides a comprehensive checklist of 19 main items and 50 subitems, covering key aspects from title to discussion. The guidelines introduce a modular format accommodating various LLM research designs and tasks, with 14 main items and 32 subitems applicable across all categories. Developed through an expedited Delphi process and expert consensus, TRIPOD-LLM emphasizes transparency, human oversight and task-specific performance reporting. We also introduce an interactive website ( https://tripod-llm.vercel.app/ ) facilitating easy guideline completion and PDF generation for submission. As a living document, TRIPOD-LLM will evolve with the field, aiming to enhance the quality, reproducibility and clinical applicability of LLM research in healthcare through comprehensive reporting.

Indexed as

Guidelines as TopicArtificial IntelligenceDelphi TechniqueHumansLarge Language ModelsPrognosisResearch Design

Identifiers

PMID39779929
PMCPMC12104976

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.