Evidence map›Paper›PMID 30869998›Full record

ArticleJCO clinical cancer informatics2019

Performance of Cancer Recurrence Algorithms After Coding Scheme Switch From International Classification of Diseases 9th Revision to International Classification of Diseases 10th Revision.

Nikki M Carroll, Debra P Ritzwoller, Matthew P Banegas, Maureen O'Keeffe-Rosetti, Angel M Cronin, Hajime Uno, Mark C Hornbrook, Michael J Hassett

Abstract read
In one paragraph

Article in JCO clinical cancer informatics, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 13 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
13citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

13 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Evaluation of Algorithms Using Automated Health Plan Data to Identify Breast Cancer Recurrences.Cancer epidemiology, biomarkers & prevention : a publication of the American Association for Cancer Research, cosponsored by the American Society of Preventive Oncology · 2024
    Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Nikki M CarrollKaiser Permanente Colorado, Denver, CO.
Debra P RitzwollerKaiser Permanente Colorado, Denver, CO.
Matthew P BanegasKaiser Permanente Center for Health Research, Portland, OR.
Maureen O'Keeffe-RosettiKaiser Permanente Center for Health Research, Portland, OR.
Angel M CroninDana-Farber Cancer Institute, Boston, MA.
Hajime UnoDana-Farber Cancer Institute, Boston, MA.
Mark C HornbrookKaiser Permanente Center for Health Research, Portland, OR.
Michael J HassettDana-Farber Cancer Institute, Boston, MA.

Funding

Cancer Recurrence: Detection in Administrative Data, Incidence, and CostsR01CA172143 · NCI · DANA-FARBER CANCER INST · PI HASSETT, MICHAEL JAMES, RITZWOLLER, DEBRA P · 2013 to 2016
$1.7M
NCI NIH HHS R01 CA172143
6 · The paper itself

Abstract

purposeWe previously developed and validated informatic algorithms that used International Classification of Diseases 9th revision (ICD9)-based diagnostic and procedure codes to detect the presence and timing of cancer recurrence (the RECUR Algorithms). In 2015, ICD10 replaced ICD9 as the worldwide coding standard. To understand the impact of this transition, we evaluated the performance of the RECUR Algorithms after incorporating ICD10 codes.

methodsUsing publicly available translation tables along with clinician and other expertise, we updated the algorithms to include ICD10 codes as additional input variables. We evaluated the performance of the algorithms using gold standard recurrence measures associated with a contemporary cohort of patients with stage I to III breast, colorectal, and lung (excluding IIIB) cancer and derived performance measures, including the area under the receiver operating curve, average absolute prediction error, and correct classification rate. These values were compared with the performance measures derived from the validation of the original algorithms.

resultsA total of 659 colorectal, 280 lung, and 2,053 breast cancer cases were identified. Area under the receiver operating curve derived from the updated algorithms was 89.0% (95% CI, 82.3% to 95.7%), 88.9% (95% CI, 79.3% to 98.2%), and 80.5% (95% CI, 72.8% to 88.2%) for the colorectal, lung, and breast cancer algorithms, respectively. Average absolute prediction errors for recurrence timing were 2.7 (SE, 11.3%), 2.4 (SE, 10.4%), and 5.6 months (SE, 21.8%), respectively, and timing estimates were within 6 months of actual recurrence for more than 80% of colorectal, more than 90% of lung, and more than 50% of breast cancer cases using the updated algorithm.

conclusionPerformance measures derived from the updated and original algorithms had overlapping confidence intervals, suggesting that the ICD9 to ICD10 transition did not affect the RECUR Algorithm performance.

Indexed as

International Classification of DiseasesAlgorithmsCombined Modality TherapyDiagnostic ImagingFemaleHumansNeoplasmsNeoplasm StagingRecurrenceReproducibility of ResultsTreatment Outcome

Identifiers

PMID30869998
PMCPMC6706070

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.