Evidence map›Paper›PMID 34232304›Full record

ArticleJAMA network open2021

Performance of a Machine Learning Algorithm Using Electronic Health Record Data to Identify and Estimate Survival in a Longitudinal Cohort of Patients With Lung Cancer.

Qianyu Yuan, Tianrun Cai, Chuan Hong, Mulong Du, Bruce E Johnson, Michael Lanuti, Tianxi Cai, David C Christiani

Open access · goldAbstract read
In one paragraph

Article in JAMA network open, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 47 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
47citing papers in PubMed, 1 pooled it
10.6field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

47 citing papers in PubMed, 1 synthesis or guideline pooled it, 87 citations in OpenAlex.

  1. Pooled it
  2. Trial
  3. Article
  4. Article
  5. Validating ICD code case definitions for condition case ascertainment in multimorbidity measurement: a retrospective chart review.The journals of gerontology. Series A, Biological sciences and medical sciences · 2026
    Article
  6. Article
  7. Article
  8. Review
  9. Article
  10. Article
  11. Article
  12. Large language models in perioperative medicine-applications and future prospects: a narrative review.Canadian journal of anaesthesia = Journal canadien d'anesthesie · 2025
    Review
  13. Review
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

8 authors at 4 institutions in 2 countries.

Qianyu YuanDepartment of Environmental Health, Harvard T.H. Chan School of Public Health, Boston, Massachusetts.
Tianrun CaiDivision of Rheumatology, Immunology, and Allergy, Brigham and Women's Hospital, Boston, Massachusetts.
Chuan HongDepartment of Biostatistics, Harvard T.H. Chan School of Public Health, Boston, Massachusetts.
Mulong DuDepartment of Environmental Health, Harvard T.H. Chan School of Public Health, Boston, Massachusetts.
Bruce E JohnsonDepartment of Medical Oncology, Dana-Farber Cancer Institute, Boston, Massachusetts.
Michael LanutiCenter for Thoracic Cancers, Division of Thoracic Surgery, Massachusetts General Hospital Cancer Center, Boston, Massachusetts.
Tianxi CaiDepartment of Biostatistics, Harvard T.H. Chan School of Public Health, Boston, Massachusetts.
David C ChristianiDepartment of Environmental Health, Harvard T.H. Chan School of Public Health, Boston, Massachusetts.
Harvard University · USBrigham and Women's Hospital · USMassachusetts General Hospital · USDana-Farber Cancer Institute · US

Funding

The Boston Lung Cancer Survival CohortU01CA209414 · NCI · HARVARD UNIVERSITY D/B/A HARVARD SCHOOL OF PUBLIC HEALTH · PI David C Christiani · 2017 to 2026
$12.2M
VERITY: Value and Evidence in Rheumatology using bioInformaTics, and advanced analYticsP30AR072577 · NIAMS · BRIGHAM AND WOMEN'S HOSPITAL · PI Daniel Hal Solomon · 2017 to 2026
$9.8M
NCI NIH HHS U01 CA209414NIAMS NIH HHS P30 AR072577
6 · The paper itself

Abstract

Importance: Electronic health records (EHRs) provide a low-cost means of accessing detailed longitudinal clinical data for large populations. A lung cancer cohort assembled from EHR data would be a powerful platform for clinical outcome studies. Objective: To investigate whether a clinical cohort assembled from EHRs could be used in a lung cancer prognosis study. Design, Setting, and Participants: In this cohort study, patients with lung cancer were identified among 76 643 patients with at least 1 lung cancer diagnostic code deposited in an EHR in Mass General Brigham health care system from July 1988 to October 2018. Patients were identified via a semisupervised machine learning algorithm, for which clinical information was extracted from structured and unstructured data via natural language processing tools. Data completeness and accuracy were assessed by comparing with the Boston Lung Cancer Study and against criterion standard EHR review results. A prognostic model for non-small cell lung cancer (NSCLC) overall survival was further developed for clinical application. Data were analyzed from March 2019 through July 2020. Exposures: Clinical data deposited in EHRs for cohort construction and variables of interest for the prognostic model were collected. Main Outcomes and Measures: The primary outcomes were the performance of the lung cancer classification model and the quality of the extracted variables; the secondary outcome was the performance of the prognostic model. Results: Among 76 643 patients with at least 1 lung cancer diagnostic code, 42 069 patients were identified as having lung cancer, with a positive predictive value of 94.4%. The study cohort consisted of 35 375 patients (16 613 men [47.0%] and 18 756 women [53.0%]; 30 140 White individuals [85.2%], 1040 Black individuals [2.9%], and 857 Asian individuals [2.4%]) after excluding patients with lung cancer history and less than 14 days of follow-up after initial diagnosis. The median (interquartile range) age at diagnosis was 66.7 (58.4-74.1) years. The area under the receiver operating characteristic curves of the prognostic model for overall survival with NSCLC were 0.828 (95% CI, 0.815-0.842) for 1-year prediction, 0.825 (95% CI, 0.812-0.836) for 2-year prediction, 0.814 (95% CI, 0.800-0.826) for 3-year prediction, 0.814 (95% CI, 0.799-0.828) for 4-year prediction, and 0.812 (95% CI, 0.798-0.825) for 5-year prediction. Conclusions and Relevance: These findings suggest the feasibility of assembling a large-scale EHR-based lung cancer cohort with detailed longitudinal clinical measurements and that EHR data may be applied in cancer progression with a set of generalizable approaches.

Indexed as

AlgorithmsArea Under CurveBostonCohort StudiesElectronic Health RecordsFemaleHumansLung NeoplasmsMachine LearningMalePrognosisROC CurveSurvival AnalysisSurvivors

Identifiers

PMID34232304
PMCPMC8264641
OpenAlexW3181025656

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.