Evidence map›Paper›PMID 39753967›Full record

ArticleNature medicine2025

Evaluating generalizability of oncology trial results to real-world patients using machine learning-based trial emulations.

Xavier Orcutt, Kan Chen, Ronac Mamtani, Qi Long, Ravi B Parikh

Abstract read
In one paragraph

Article in Nature medicine, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 30 papers.

0numbers the graph read from it
0cells of the map it votes in
30citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

30 citing papers in PubMed.

  1. Review
  2. AI-based augmentation of oncology clinical trials.Nature reviews. Clinical oncology · 2026
    Review
  3. Article
  4. Article
  5. Review
  6. Article
  7. Review
  8. Review
  9. Article
  10. Review
  11. Article
  12. Article
  13. Review
  14. Review
  15. Review
  16. The Five-Decade Journey of Small Cell Lung Cancer.Cancer communications (London, England) · 2026
    Review
  17. Article
  18. Article
  19. Article
  20. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Xavier OrcuttNavajo Indian Health Service, Chinle, AZ, USA.ORCID http://orcid.org/0009-0005-3024-8298
Kan ChenDepartment of Biostatistics, Harvard University, Boston, MA, USA.
Ronac MamtaniPerelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA.ORCID http://orcid.org/0000-0002-8267-5356
Qi LongPerelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA. qlong@upenn.edu.ORCID http://orcid.org/0000-0003-0660-5230
Ravi B ParikhEmory University School of Medicine, Atlanta, GA, USA. ravi.bharat.parikh@emory.edu.ORCID http://orcid.org/0000-0003-2692-6306

Funding

UNIVERSITY OF PENNSYLVANIA CAN CTR SUPPORT GRANTP30CA016520 · NCI · UNIVERSITY OF PENNSYLVANIA · PI Robert H. Vonderheide · 1985 to 2026
$222.3M
Robust privacy preserving distributed analysis platform for cancer research: addressing data bias and disparitiesU01CA274576 · NCI · UNIVERSITY OF PENNSYLVANIA · PI JIANG, XIAOQIAN, LONG, QI · 2023 to 2025
$1.2M
Human-Machine Collaborations to Improve Prognosis and Clinical Decision-Making in Advanced CancerK08CA263541 · NCI · UNIVERSITY OF PENNSYLVANIA · PI PARIKH, RAVI BHARAT · 2021 to 2025
$1.2M
NCI NIH HHS K08 CA263541NCI NIH HHS P30 CA016520NCI NIH HHS U01 CA274576
6 · The paper itself

Abstract

Randomized controlled trials (RCTs) evaluating anti-cancer agents often lack generalizability to real-world oncology patients. Although restrictive eligibility criteria contribute to this issue, the role of selection bias related to prognostic risk remains unclear. In this study, we developed TrialTranslator, a framework designed to systematically evaluate the generalizability of RCTs for oncology therapies. Using a nationwide database of electronic health records from Flatiron Health, this framework emulates RCTs across three prognostic phenotypes identified through machine learning models. We applied this approach to 11 landmark RCTs that investigated anti-cancer regimens considered standard of care for the four most prevalent advanced solid malignancies. Our analyses reveal that patients in low-risk and medium-risk phenotypes exhibit survival times and treatment-associated survival benefits similar to those observed in RCTs. In contrast, high-risk phenotypes show significantly lower survival times and treatment-associated survival benefits compared to RCTs. Our results were corroborated by a comprehensive robustness assessment, including examinations of specific patient subgroups, holdout validation and semi-synthetic data simulation. These findings suggest that the prognostic heterogeneity among real-world oncology patients plays a substantial role in the limited generalizability of RCT results. Machine learning frameworks may facilitate individual patient-level decision support and estimation of real-world treatment benefits to guide trial design.

Indexed as

Machine LearningMedical OncologyNeoplasmsRandomized Controlled Trials as TopicAntineoplastic AgentsElectronic Health RecordsFemaleHumansMalePrognosisAntineoplastic Agents

Identifiers

PMID39753967
PMCPMC11835724

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.