Evidence map›Paper›PMID 38088912›Full record

ArticleCancer epidemiology, biomarkers & prevention : a publication of the American Association for Cancer Research, cosponsored by the American Society of Preventive Oncology2024

Evaluation of Algorithms Using Automated Health Plan Data to Identify Breast Cancer Recurrences.

Erin J Aiello Bowles, Candyce H Kroenke, Jessica Chubak, Jenna Bhimani, Kelli O'Connell, Susan Brandzel, Emily Valice, Rachael Doud, Mary Kay Theis, Janise M Roh and 6 more

Open access · greenAbstract read
In one paragraph

Article in Cancer epidemiology, biomarkers & prevention : a publication of the American Association for Cancer Research, cosponsored by the American Society of Preventive Oncology, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
0.5field-weighted citation impact, top 25% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed, 2 citations in OpenAlex.

  1. Review
  2. Article
  3. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

16 authors at 5 institutions in 1 country.

Erin J Aiello BowlesKaiser Permanente Washington Health Research Institute, Kaiser Permanente Washington, Seattle, Washington.ORCID 0000-0001-6287-7391
Candyce H KroenkeDivision of Research, Kaiser Permanente Northern California, Oakland, California.ORCID 0000-0002-6128-3118
Jessica ChubakKaiser Permanente Washington Health Research Institute, Kaiser Permanente Washington, Seattle, Washington.ORCID 0000-0003-1630-9021
Jenna BhimaniDepartment of Epidemiology and Biostatistics, Memorial Sloan Kettering Cancer Center, New York, New York.ORCID 0000-0002-9962-7019
Kelli O'ConnellDepartment of Epidemiology and Biostatistics, Memorial Sloan Kettering Cancer Center, New York, New York.ORCID 0000-0002-4021-0788
Susan BrandzelKaiser Permanente Washington Health Research Institute, Kaiser Permanente Washington, Seattle, Washington.ORCID 0000-0002-9880-3797
Emily ValiceDivision of Research, Kaiser Permanente Northern California, Oakland, California.ORCID 0000-0003-2408-9727
Rachael DoudKaiser Permanente Washington Health Research Institute, Kaiser Permanente Washington, Seattle, Washington.ORCID 0009-0004-2179-9816
Mary Kay TheisKaiser Permanente Washington Health Research Institute, Kaiser Permanente Washington, Seattle, Washington.ORCID 0000-0002-4337-6994
Janise M RohDivision of Research, Kaiser Permanente Northern California, Oakland, California.ORCID 0000-0002-8615-4320
Narre HeonDepartment of Epidemiology and Biostatistics, Memorial Sloan Kettering Cancer Center, New York, New York.ORCID 0009-0003-5239-0821
Sonia PersaudDepartment of Epidemiology and Biostatistics, Memorial Sloan Kettering Cancer Center, New York, New York.ORCID 0009-0008-5666-7994
Jennifer J GriggsDepartments of Internal Medicine, Hematology and Oncology Division, and Health Management and Policy, Institute for Healthcare Policy and Innovation, University of Michigan, Ann Arbor, Michigan.ORCID 0000-0002-1598-4562
Elisa V BanderaCancer Epidemiology and Health Outcomes, Rutgers Cancer Institute of New Jersey, Rutgers, the State University of New Jersey, New Brunswick, New Jersey.ORCID 0000-0002-8789-2755
Lawrence H KushiDivision of Research, Kaiser Permanente Northern California, Oakland, California.ORCID 0000-0001-9136-1175
Elizabeth D KantorDepartment of Epidemiology and Biostatistics, Memorial Sloan Kettering Cancer Center, New York, New York.ORCID 0000-0002-9124-5323
Kaiser Permanente Washington Health Research Institute · USMemorial Sloan Kettering Cancer Center · USKaiser Permanente · USRutgers, The State University of New Jersey · USVA Center for Clinical Management Research · US

Funding

X-RAY CRYSTALLOGRAPHYP30CA008748 · NCI · SLOAN-KETTERING INSTITUTE FOR CANCER RES · PI Hongbiao Carl Lekaye · 1985 to 2026
$347.4M
Risk-based Imaging Strategies to Improve Breast Cancer Surveillance OutcomesP01CA154292 · NCI · UNIVERSITY OF CALIFORNIA AT DAVIS · PI KARLA M KERLIKOWSKE · 2011 to 2026
$52.9M
Obesity, chemotherapy dosing, and breast cancer outcomesR37CA222793 · NCI · SLOAN-KETTERING INST CAN RESEARCH · PI KANTOR, ELIZABETH DAVID · 2018 to 2024
$4.0M
Social networks and disparities in health behaviors and breast cancer outcomes in immigrant womenR01CA230440 · NCI · KAISER FOUNDATION RESEARCH INSTITUTE · PI KROENKE, CANDYCE H · 2019 to 2024
$3.2M
An Electronic Health Record-Based Tool to Identify Newly Diagnosed Breast Cancer Patients at Risk of Low Social SupportR01CA253028 · NCI · KAISER FOUNDATION RESEARCH INSTITUTE · PI KROENKE, CANDYCE H · 2020 to 2025
$2.6M
Group Health Cancer Research Program Research Specialist AwardR50CA211115 · NCI · KAISER FOUNDATION RESEARCH INSTITUTE · PI BOWLES, ERIN JANELLE AIELLO · 2017 to 2021
$919k
NCI NIH HHS HHSN261201300012INCI NIH HHS N01 PC035142NCI NIH HHS P01 CA154292NCI NIH HHS P30 CA008748NCI NIH HHS R01 CA230440NCI NIH HHS R01 CA253028NCI NIH HHS R37 CA222793NCI NIH HHS R50 CA211115
6 · The paper itself

Abstract

backgroundWe updated algorithms to identify breast cancer recurrences from administrative data, extending previously developed methods.

methodsIn this validation study, we evaluated pairs of breast cancer recurrence algorithms (vs. individual algorithms) to identify recurrences. We generated algorithm combinations that categorized discordant algorithm results as no recurrence [High Specificity and PPV (positive predictive value) Combination] or recurrence (High Sensitivity Combination). We compared individual and combined algorithm results to manually abstracted recurrence outcomes from a sample of 600 people with incident stage I-IIIA breast cancer diagnosed between 2004 and 2015. We used Cox regression to evaluate risk factors associated with age- and stage-adjusted recurrence rates using different recurrence definitions, weighted by inverse sampling probabilities.

resultsAmong 600 people, we identified 117 recurrences using the High Specificity and PPV Combination, 505 using the High Sensitivity Combination, and 118 using manual abstraction. The High Specificity and PPV Combination had good specificity [98%, 95% confidence interval (CI): 97-99] and PPV (72%, 95% CI: 63-80) but modest sensitivity (64%, 95% CI: 44-80). The High Sensitivity Combination had good sensitivity (80%, 95% CI: 49-94) and specificity (83%, 95% CI: 80-86) but low PPV (29%, 95% CI: 25-34). Recurrence rates using combined algorithms were similar in magnitude for most risk factors.

conclusionsBy combining algorithms, we identified breast cancer recurrences with greater PPV than individual algorithms, without additional review of discordant records. IMPACT: Researchers should consider tradeoffs between accuracy and manual chart abstraction resources when using previously developed algorithms. We provided guidance for future studies that use breast cancer recurrence algorithms with or without supplemental manual chart abstraction.

Indexed as

Breast NeoplasmsAlgorithmsFemaleHumansPredictive Value of TestsRisk FactorsSensitivity and Specificity

Identifiers

PMID38088912
PMCPMC10922110
OpenAlexW4389670162

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.