Evidence map›Paper›PMID 39532885›Full record

ArticleNature communications2024

Shareable artificial intelligence to extract cancer outcomes from electronic health records for precision oncology research.

Kenneth L Kehl, Justin Jee, Karl Pichotta, Morgan A Paul, Pavel Trukhanov, Christopher Fong, Michele Waters, Ziad Bakouny, Wenxin Xu, Toni K Choueiri and 3 more

Abstract read
In one paragraph

Article in Nature communications, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 17 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
17citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

17 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Review
  3. Review
  4. Review
  5. Review
  6. Article
  7. Article
  8. Article
  9. Article
  10. Learning Patient Similarity from Genomics for Precision Oncology.medRxiv : the preprint server for health sciences · 2025
    Article
  11. Article
  12. Article
  13. Review
  14. Article
  15. Review
  16. Review
  17. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

13 authors.

Kenneth L KehlDana-Farber Cancer Institute, 450 Brookline Ave, Boston, MA, USA. kenneth_kehl@dfci.harvard.edu.ORCID 0000-0001-5339-9797
Justin JeeMemorial Sloan Kettering Cancer Center, 1275 York Ave, New York, NY, USA.ORCID 0000-0001-9783-0139
Karl PichottaMemorial Sloan Kettering Cancer Center, 1275 York Ave, New York, NY, USA.
Morgan A PaulDana-Farber Cancer Institute, 450 Brookline Ave, Boston, MA, USA.
Pavel TrukhanovDana-Farber Cancer Institute, 450 Brookline Ave, Boston, MA, USA.
Christopher FongMemorial Sloan Kettering Cancer Center, 1275 York Ave, New York, NY, USA.
Michele WatersMemorial Sloan Kettering Cancer Center, 1275 York Ave, New York, NY, USA.ORCID 0000-0002-5416-5172
Ziad BakounyMemorial Sloan Kettering Cancer Center, 1275 York Ave, New York, NY, USA.
Wenxin XuDana-Farber Cancer Institute, 450 Brookline Ave, Boston, MA, USA.ORCID 0000-0002-8450-2037
Toni K ChoueiriDana-Farber Cancer Institute, 450 Brookline Ave, Boston, MA, USA.ORCID 0000-0002-9201-3217
Chelsea NicholsMemorial Sloan Kettering Cancer Center, 1275 York Ave, New York, NY, USA.
Deborah SchragMemorial Sloan Kettering Cancer Center, 1275 York Ave, New York, NY, USA.ORCID 0000-0002-4334-5717
Nikolaus SchultzMemorial Sloan Kettering Cancer Center, 1275 York Ave, New York, NY, USA.ORCID 0000-0002-0131-4904

Funding

X-RAY CRYSTALLOGRAPHYP30CA008748 · NCI · SLOAN-KETTERING INSTITUTE FOR CANCER RES · PI Hongbiao Carl Lekaye · 1985 to 2026
$347.4M
VectorP30CA006516 · NCI · DANA-FARBER CANCER INSTITUTE · PI JENNIFER W MACK · 1985 to 2026
$330.6M
Treating the P13-Kinase/AKTP50CA101942 · NCI · BETH ISRAEL DEACONESS MEDICAL CENTER · PI David McDermott · 2003 to 2026
$53.4M
Project 3: Predictors of sensitivity to immunotherapy and targeted treatments based on real world evidenceP01CA275746 · NCI · SLOAN-KETTERING INST CAN RESEARCH · PI CHARLES L. SAWYERS · 2024 to 2026
$9.4M
CLINICAL SCHOLARS BIOMEDICAL RESEARCH TRAINING PROGRAMT32CA009512 · NCI · SLOAN-KETTERING INSTITUTE FOR CANCER RES · PI Ping Chi · 1985 to 2026
$6.3M
Deep clinical trajectory modeling to optimize accrual to cancer clinical trialsR00CA245899 · NCI · DANA-FARBER CANCER INST · PI KEHL, KENNETH L · 2022 to 2024
$747k
NCI NIH HHS P01 CA275746NCI NIH HHS P30 CA006516NCI NIH HHS P30 CA008748NCI NIH HHS P50 CA101942NCI NIH HHS R00 CA245899NCI NIH HHS T32 CA009512U.S. Department of Defense (United States Department of Defense) W81XWH-22-1-0086U.S. Department of Health & Human Services | NIH | National Cancer Institute (NCI) 5P30CA006516-56U.S. Department of Health & Human Services | NIH | National Cancer Institute (NCI) P30CA008748U.S. Department of Health & Human Services | NIH | National Cancer Institute (NCI) P30CA008748vU.S. Department of Health & Human Services | NIH | National Cancer Institute (NCI) R00CA245899
6 · The paper itself

Abstract

Databases that link molecular data to clinical outcomes can inform precision cancer research into novel prognostic and predictive biomarkers. However, outside of clinical trials, cancer outcomes are typically recorded only in text form within electronic health records (EHRs). Artificial intelligence (AI) models have been trained to extract outcomes from individual EHRs. However, patient privacy restrictions have historically precluded dissemination of these models beyond the centers at which they were trained. In this study, the vulnerability of text classification models trained directly on protected health information to membership inference attacks is confirmed. A teacher-student distillation approach is applied to develop shareable models for annotating outcomes from imaging reports and medical oncologist notes. 'Teacher' models trained on EHR data from Dana-Farber Cancer Institute (DFCI) are used to label imaging reports and discharge summaries from the Medical Information Mart for Intensive Care (MIMIC)-IV dataset. 'Student' models are trained to use these MIMIC documents to predict the labels assigned by teacher models and sent to Memorial Sloan Kettering (MSK) for evaluation. The student models exhibit high discrimination across outcomes in both the DFCI and MSK test sets. Leveraging private labeling of public datasets to distill publishable clinical AI models from academic centers could facilitate deployment of machine learning to accelerate precision oncology research.

Indexed as

Artificial IntelligenceElectronic Health RecordsMedical OncologyNeoplasmsPrecision MedicineHumans

Identifiers

PMID39532885
PMCPMC11557593

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.