Evidence map›Paper›PMID 34097438›Full record

ArticleJCO clinical cancer informatics2021

Clinical Inflection Point Detection on the Basis of EHR Data to Identify Clinical Trial-Ready Patients With Cancer.

Kenneth L Kehl, Stefan Groha, Eva M Lepisto, Haitham Elmarakeby, James Lindsay, Alexander Gusev, Eliezer M Van Allen, Michael J Hassett, Deborah Schrag

Abstract read
In one paragraph

Article in JCO clinical cancer informatics, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 13 papers.

0numbers the graph read from it
0cells of the map it votes in
13citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

13 citing papers in PubMed.

  1. Trial
  2. Review
  3. AI for clinical trials in oncology.ESMO real world data and digital oncology · 2026
    Review
  4. Review
  5. Article
  6. Article
  7. Article
  8. Article
  9. Artificial intelligence for optimizing recruitment and retention in clinical trials: a scoping review.Journal of the American Medical Informatics Association : JAMIA · 2024
    Article
  10. Review
  11. Article
  12. Review
  13. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors.

Kenneth L KehlDivision of Population Sciences, the Knowledge Systems Group, Department of Medical Oncology, Dana-Farber Cancer Institute, Harvard Medical School, Boston, MA.ORCID 0000-0001-5339-9797
Stefan GrohaDivision of Population Sciences, the Knowledge Systems Group, Department of Medical Oncology, Dana-Farber Cancer Institute, Harvard Medical School, Boston, MA.
Eva M LepistoDivision of Population Sciences, the Knowledge Systems Group, Department of Medical Oncology, Dana-Farber Cancer Institute, Harvard Medical School, Boston, MA.
Haitham ElmarakebyDivision of Population Sciences, the Knowledge Systems Group, Department of Medical Oncology, Dana-Farber Cancer Institute, Harvard Medical School, Boston, MA.ORCID 0000-0002-4315-4347
James LindsayDivision of Population Sciences, the Knowledge Systems Group, Department of Medical Oncology, Dana-Farber Cancer Institute, Harvard Medical School, Boston, MA.ORCID 0000-0002-6295-098X
Alexander GusevDivision of Population Sciences, the Knowledge Systems Group, Department of Medical Oncology, Dana-Farber Cancer Institute, Harvard Medical School, Boston, MA.ORCID 0000-0002-7980-4620
Eliezer M Van AllenDivision of Population Sciences, the Knowledge Systems Group, Department of Medical Oncology, Dana-Farber Cancer Institute, Harvard Medical School, Boston, MA.
Michael J HassettDivision of Population Sciences, the Knowledge Systems Group, Department of Medical Oncology, Dana-Farber Cancer Institute, Harvard Medical School, Boston, MA.ORCID 0000-0003-0754-3510
Deborah SchragDivision of Population Sciences, the Knowledge Systems Group, Department of Medical Oncology, Dana-Farber Cancer Institute, Harvard Medical School, Boston, MA.

Funding

Deep clinical trajectory modeling to optimize accrual to cancer clinical trialsK99CA245899 · NCI · DANA-FARBER CANCER INST · PI KEHL, KENNETH L · 2020 to 2021
$340k
NCI NIH HHS K99 CA245899
6 · The paper itself

Abstract

purposeTo inform precision oncology, methods are needed to use electronic health records (EHRs) to identify patients with cancer who are experiencing clinical inflection points, consistent with worsening prognosis or a high propensity to change treatment, at specific time points. Such patients might benefit from real-time screening for clinical trials.

methodsUsing serial unstructured imaging reports for patients with solid tumors or lymphoma participating in a single-institution precision medicine study, we trained a deep neural network natural language processing (NLP) model to dynamically predict patients' prognoses and propensity to start new palliative-intent systemic therapy within 30 days. Model performance was evaluated using Harrell's c-index (for prognosis) and the area under the receiver operating characteristic curve (AUC; for new treatment and new clinical trial enrollment). Associations between model outputs and manual annotations of cancer progression were also evaluated using the AUC.

resultsA deep NLP model was trained and evaluated using 302,688 imaging reports for 16,780 patients. In a held-out test set of 34,770 reports for 1,952 additional patients, the model predicted survival with a c-index of 0.76 and initiation of new treatment with an AUC of 0.77. Model-generated prognostic scores were associated with annotation of cancer progression on the basis of manual EHR review (n = 1,488 reports for 110 patients with lung or colorectal cancer) with an AUC of 0.78, and predictions of new treatment were associated with annotation of cancer progression on the basis of manual EHR review with an AUC of 0.84.

conclusionTraining a deep NLP model to identify clinical inflection points among patients with cancer is feasible. This approach could identify patients who may benefit from real-time targeted clinical trial screening interventions at health system scale.

Indexed as

NeoplasmsElectronic Health RecordsHumansNatural Language ProcessingPrecision MedicinePrognosis

Identifiers

PMID34097438
PMCPMC8240790

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.