Evidence map›Paper›PMID 39557832›Full record

ArticleNature communications2024

Matching patients to clinical trials with large language models.

Qiao Jin, Zifeng Wang, Charalampos S Floudas, Fangyuan Chen, Changlin Gong, Dara Bracken-Clarke, Elisabetta Xue, Yifan Yang, Jimeng Sun, Zhiyong Lu

Abstract read
In one paragraph

Article in Nature communications, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 151 papers.

0numbers the graph read from it
0cells of the map it votes in
151citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

151 citing papers in PubMed.

  1. Article
  2. Article
  3. Review
  4. Article
  5. Article
  6. Article
  7. Article
  8. Review
  9. Review
  10. Article
  11. Review
  12. AI-based augmentation of oncology clinical trials.Nature reviews. Clinical oncology · 2026
    Review
  13. Article
  14. Review
  15. Article
  16. Review
  17. Article
  18. Article
  19. Review
  20. Review

91 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

10 authors.

Qiao JinNational Center for Biotechnology Information (NCBI), National Library of Medicine (NLM), National Institutes of Health (NIH), Bethesda, USA.ORCID 0000-0002-1268-7239
Zifeng WangDepartment of Computer Science, University of Illinois Urbana-Champaign, Urbana, IL, USA.
Charalampos S FloudasCenter for Immuno-Oncology, Center for Cancer Research, National Cancer Institute, National Institutes of Health, Bethesda, USA.ORCID 0000-0002-0020-237X
Fangyuan ChenSchool of Medicine, University of Pittsburgh, Pittsburgh, USA.ORCID 0000-0002-9891-4753
Changlin GongJacob Medical Center, Albert Einstein College of Medicine, Bronx, USA.ORCID 0000-0001-9932-0538
Dara Bracken-ClarkeCenter for Immuno-Oncology, Center for Cancer Research, National Cancer Institute, National Institutes of Health, Bethesda, USA.
Elisabetta XueCenter for Immuno-Oncology, Center for Cancer Research, National Cancer Institute, National Institutes of Health, Bethesda, USA.
Yifan YangNational Center for Biotechnology Information (NCBI), National Library of Medicine (NLM), National Institutes of Health (NIH), Bethesda, USA.ORCID 0000-0003-4414-9176
Jimeng SunDepartment of Computer Science, University of Illinois Urbana-Champaign, Urbana, IL, USA.ORCID 0000-0003-1512-6426
Zhiyong LuNational Center for Biotechnology Information (NCBI), National Library of Medicine (NLM), National Institutes of Health (NIH), Bethesda, USA. zhiyong.lu@nih.gov.ORCID 0000-0001-9998-916X

Funding

NIH Intramural Research Program, National Library of Medicine.
6 · The paper itself

Abstract

Patient recruitment is challenging for clinical trials. We introduce TrialGPT, an end-to-end framework for zero-shot patient-to-trial matching with large language models. TrialGPT comprises three modules: it first performs large-scale filtering to retrieve candidate trials (TrialGPT-Retrieval); then predicts criterion-level patient eligibility (TrialGPT-Matching); and finally generates trial-level scores (TrialGPT-Ranking). We evaluate TrialGPT on three cohorts of 183 synthetic patients with over 75,000 trial annotations. TrialGPT-Retrieval can recall over 90% of relevant trials using less than 6% of the initial collection. Manual evaluations on 1015 patient-criterion pairs show that TrialGPT-Matching achieves an accuracy of 87.3% with faithful explanations, close to the expert performance. The TrialGPT-Ranking scores are highly correlated with human judgments and outperform the best-competing models by 43.8% in ranking and excluding trials. Furthermore, our user study reveals that TrialGPT can reduce the screening time by 42.6% in patient recruitment. Overall, these results have demonstrated promising opportunities for patient-to-trial matching with TrialGPT.

Indexed as

Clinical Trials as TopicPatient SelectionAlgorithmsHumansLanguage

Identifiers

PMID39557832
PMCPMC11574183

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.