Evidence map›Paper›PMID 38570554›Full record

ArticleNPJ digital medicine2024

Evaluating large language models as agents in the clinic.

Nikita Mehandru, Brenda Y Miao, Eduardo Rodriguez Almaraz, Madhumita Sushil, Atul J Butte, Ahmed Alaa

Abstract read
In one paragraph

Article in NPJ digital medicine, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 75 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
75citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

75 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Large Language Models and Empathy: Systematic Review.Journal of medical Internet research · 2024
    Pooled it
  2. Trial
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Review
  12. Article
  13. Article
  14. MedQA-CS: Objective Structured Clinical Examination (OSCE)-Style Benchmark for Evaluating LLM Clinical Skills.Proceedings of the conference. Association for Computational Linguistics. European Chapter. Conference · 2026
    Article
  15. Article
  16. Article
  17. Article
  18. Review
  19. A Secure Sandbox Environment for Orchestrating Medical AI Agents Using Model Context Protocols and Role-Based Access Control.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2026
    Article
  20. Article

15 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Nikita Mehandru *University of California, Berkeley, 2195 Hearst Ave, Warren Hall Suite, 120C, Berkeley, CA, USA.ORCID http://orcid.org/0000-0002-7374-7127
Brenda Y Miao *Bakar Computational Health Sciences Institute, University of California San Francisco, San Francisco, CA, USA.
Eduardo Rodriguez Almaraz *Neurosurgery Department Division of Neuro-Oncology, University of California San Francisco, 400 Parnassus Avenue, 8th floor, RM A808, San Francisco, CA, USA.ORCID http://orcid.org/0000-0003-0978-1117
Madhumita SushilBakar Computational Health Sciences Institute, University of California San Francisco, San Francisco, CA, USA.ORCID http://orcid.org/0000-0001-7884-0526
Atul J ButteBakar Computational Health Sciences Institute, University of California San Francisco, San Francisco, CA, USA.ORCID http://orcid.org/0000-0002-7433-2740
Ahmed AlaaUniversity of California, Berkeley, 2195 Hearst Ave, Warren Hall Suite, 120C, Berkeley, CA, USA. amalaa@berkeley.edu.ORCID http://orcid.org/0000-0001-9936-7141

Funding

Computational models of naturally acquired immunity to falciparum malariaU01AI150741 · NIAID · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI BUTTE, ATUL J, GREENHOUSE, BRYAN R · 2020 to 2024
$7.4M
California Precision Medicine ConsortiumOT2OD024611 · OD · UNIVERSITY OF CALIFORNIA, SAN DIEGO · PI ANTON-CULVER, HODA A, BUTTE, ATUL J · 2016 to 2017
$3.6M
NIAID NIH HHS U01 AI150741NIH HHS OT2 OD024611
6 · The paper itself

Abstract

PubMed holds no abstract for this paper.

Identifiers

PMID38570554
PMCPMC10991271

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.