Evidence map›Paper›PMID 37205549›Full record

ArticleResearch square2023

Almanac: Retrieval-Augmented Language Models for Clinical Medicine.

Cyril Zakka, Akash Chaurasia, Rohan Shad, Alex R Dalal, Jennifer L Kim, Michael Moor, Kevin Alexander, Euan Ashley, Jack Boyd, Kathleen Boyd and 4 more

Abstract readPreprint
In one paragraph

Article in Research square, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed.

  1. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

14 authors.

Cyril ZakkaDepartment of Cardiothoracic Surgery, Stanford Medicine.
Akash ChaurasiaDepartment of Cardiothoracic Surgery, Stanford Medicine.
Rohan ShadDivision of Cardiovascular Surgery, Penn Medicine.
Alex R DalalDepartment of Cardiothoracic Surgery, Stanford Medicine.
Jennifer L KimDepartment of Cardiothoracic Surgery, Stanford Medicine.
Michael MoorDepartment of Computer Science, Stanford University.
Kevin AlexanderDivision of Cardiovascular Medicine, Stanford Medicine.
Euan AshleyDivision of Cardiovascular Medicine, Stanford Medicine.
Jack BoydDepartment of Cardiothoracic Surgery, Stanford Medicine.
Kathleen BoydDepartment of Pediatrics, Stanford Medicine.
Karen HirschDepartment of Neurology, Stanford Medicine.s.
Curt LanglotzDepartment of Radiology and Biomedical Informatics, Stanford Medicine.
Joanna NelsonDivision of Infectious Diseases, Stanford Medicine.
William HiesingerDepartment of Cardiothoracic Surgery, Stanford Medicine.

Funding

Radiomics approach to engineering an artificial intelligence based echocardiography platform to predict cardiovascular surgery and heart failure outcomes.R01HL157235 · NHLBI · STANFORD UNIVERSITY · PI William Hiesinger · 2022 to 2026
$3.1M
NHLBI NIH HHS R01 HL157235
6 · The paper itself

Abstract

Large-language models have recently demonstrated impressive zero-shot capabilities in a variety of natural language tasks such as summarization, dialogue generation, and question-answering. Despite many promising applications in clinical medicine, adoption of these models in real-world settings has been largely limited by their tendency to generate incorrect and sometimes even toxic statements. In this study, we develop Almanac, a large language model framework augmented with retrieval capabilities for medical guideline and treatment recommendations. Performance on a novel dataset of clinical scenarios (

Identifiers

PMID37205549
PMCPMC10187428

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.