Evidence map›Paper›PMID 41342192›Full record

ArticleJMIR bioinformatics and biotechnology2025

Systemic Anticancer Therapy Timelines Extraction From Electronic Medical Records Text: Algorithm Development and Validation.

Jiarui Yao, Eli Goldner, Harry Hochheiser, Sean Finan, John Levander, David Harris, Piet C de Groen, Elizabeth Buchbinder, Danielle Bitterman, Jeremy L Warner and 1 more

Abstract read
In one paragraph

Article in JMIR bioinformatics and biotechnology, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed.

  1. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors.

Jiarui Yao *Computational Health Informatics Program, Boston Children's Hospital, Harvard Medical School, 401 Park Drive, Boston, MA, 02115, United States, 1 7813545014.ORCID http://orcid.org/0000-0003-0285-9348
Eli Goldner *Computational Health Informatics Program, Boston Children's Hospital, Harvard Medical School, 401 Park Drive, Boston, MA, 02115, United States, 1 7813545014.ORCID http://orcid.org/0000-0003-3226-0942
Harry HochheiserDepartment of Biomedical Informatics, University of Pittsburgh, Pittsburgh, PA, United States.ORCID http://orcid.org/0000-0001-8793-9982
Sean FinanComputational Health Informatics Program, Boston Children's Hospital, Harvard Medical School, 401 Park Drive, Boston, MA, 02115, United States, 1 7813545014.ORCID http://orcid.org/0000-0003-1572-5875
John LevanderDepartment of Biomedical Informatics, University of Pittsburgh, Pittsburgh, PA, United States.ORCID http://orcid.org/0000-0002-4475-896X
David HarrisComputational Health Informatics Program, Boston Children's Hospital, Harvard Medical School, 401 Park Drive, Boston, MA, 02115, United States, 1 7813545014.ORCID http://orcid.org/0009-0003-1985-3871
Piet C de GroenDepartment of Medicine, Division of Gastroenterology, Hepatology and Nutrition, University of Minnesota, Minneapolis, MN, United States.ORCID http://orcid.org/0000-0002-2560-1254
Elizabeth BuchbinderDepartment of Medical Oncology, Dana Farber Cancer Institute, Boston, MA, United States.ORCID http://orcid.org/0000-0002-7979-8953
Danielle BittermanArtificial Intelligence in Medicine (AIM) Program, Mass General Brigham, Harvard Medical School, Boston, MA, United States.ORCID http://orcid.org/0000-0003-0345-2232
Jeremy L WarnerCenter for Clinical Cancer Informatics and Data Science, Legorreta Cancer Center, Brown University, Providence, RI, United States.ORCID http://orcid.org/0000-0002-2851-7242
Guergana SavovaComputational Health Informatics Program, Boston Children's Hospital, Harvard Medical School, 401 Park Drive, Boston, MA, 02115, United States, 1 7813545014.ORCID http://orcid.org/0000-0002-5887-200X

Funding

Temporal relation discovery for clinical textR01LM010090 · NLM · BOSTON CHILDREN'S HOSPITAL · PI MARTIN, JAMES H., SAVOVA, GUERGANA K. · 2010 to 2022
$7.1M
Cancer Deep Phenotyping from Electronic Medical RecordsU24CA248010 · NCI · BOSTON CHILDREN'S HOSPITAL · PI HARRY S HOCHHEISER, GUERGANA K. SAVOVA · 2020 to 2026
$6.1M
Enhancing the HemOnc Knowledgebase of Chemotherapy Drugs and RegimensU24CA265879 · NCI · RHODE ISLAND HOSPITAL · PI Jeremy L Warner · 2022 to 2026
$3.4M
Transfer Learning for Digital Curation of the EMR Clinical NarrativeR01LM013486 · NLM · BOSTON CHILDREN'S HOSPITAL · PI SAVOVA, GUERGANA K. · 2021 to 2024
$1.5M
Informatics strategies to improve immune-related adverse event detection in cancer patientsR01CA294033 · NCI · BRIGHAM AND WOMEN'S HOSPITAL · PI Hugo Aerts · 2024 to 2026
$1.3M
NCI NIH HHS R01 CA294033NCI NIH HHS U24 CA248010NCI NIH HHS U24 CA265879NLM NIH HHS R01 LM010090NLM NIH HHS R01 LM013486
6 · The paper itself

Abstract

Background: The systemic treatment of cancer typically requires the use of multiple anticancer agents in combination or sequentially. Clinical narrative texts often contain extensive descriptions of the temporal sequencing of systemic anticancer therapy (SACT), setting up an important task that may be amenable to automated extraction of SACT timelines. Objective: We aimed to explore automatic methods for extracting patient-level SACT timelines from clinical narratives in the electronic medical records (EMRs). Methods: We used two datasets from two institutions: (1) a colorectal cancer (CRC) dataset including the entire EMR of the 199 patients in the THYME (Temporal Histories of Your Medical Event) dataset and (2) the 2024 ChemoTimelines shared task dataset including 149 patients with ovarian cancer, breast cancer, and melanoma. We explored finetuning smaller language models trained to attend to events and time expressions, and few-shot prompting of large language models (LLMs). Evaluation used the 2024 ChemoTimelines shared task configuration-Subtask1 involving the construction of SACT timelines from manually annotated SACT event and time expression mentions provided as input in addition to the patient's notes and Subtask2 requiring extraction of SACT timelines directly from the patient's notes. Results: Our task-specific finetuned EntityBERT model achieved 93% F1-score, outperforming the best results in Subtask1 of the 2024 ChemoTimelines shared task (90%). It ranked second in Subtask2. LLM (LLaMA2, LLaMA3.1, and Mixtral) performance lagged the task-specific finetuned model performance for both the THYME and shared task datasets. On the shared task datasets, the best LLM performance was 77% macro F1-score, 16% points lower than the task-specific finetuned system (Subtask1). Conclusions: In this paper, we explored approaches for patient-level timeline extraction through the SACT timeline extraction task. Our results and analysis add to the knowledge of extracting treatment timelines from EMR clinical narratives using language modeling methods.

Indexed as

electronic medical recordslarge language modelsnatural language processingsystemic anticancer therapytreatment timelines extraction

Identifiers

PMID41342192
PMCPMC12408058

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.