Evidence map›Paper›PMID 27195309›Full record

ArticleEGEMS (Washington, DC)2016

Preparing for the ICD-10-CM Transition: Automated Methods for Translating ICD Codes in Clinical Phenotype Definitions.

Kin Wah Fung, Rachel Richesson, Michelle Smerek, Katherine C Pereira, Beverly B Green, Ashwin Patkar, Megan Clowse, Alan Bauck, Olivier Bodenreider

Abstract read
In one paragraph

Article in EGEMS (Washington, DC), 2016. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 39 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
39citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

39 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Observational
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Risk of Duplicate ICD Codes for Orthopedic and Injury Related Research.Perspectives in health information managemen · 2023
    Article
  15. Article
  16. Article
  17. Sequential Mapping - A Novel Approach to Map from ICD-10-CM to ICD-11.Studies in health technology and informatics · 2022
    Article
  18. The clinical impact of frailty on the postoperative outcomes of patients undergoing gastrectomy for gastric cancer: a propensity-score matched database study.Gastric cancer : official journal of the International Gastric Cancer Association and the Japanese Gastric Cancer Association · 2022
    Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors.

Kin Wah FungNational Library of Medicine.
Rachel RichessonDuke University School of Nursing.
Michelle SmerekDuke Clinical Research Institute.
Katherine C PereiraDuke University School of Nursing.
Beverly B GreenGroup Health Research Institute.
Ashwin PatkarDuke Clinical Research Institute; Duke University School of Medicine.
Megan ClowseDuke University School of Medicine.
Alan BauckCenter for Health Research, Kaiser Permanente Northwest.
Olivier BodenreiderNational Library of Medicine.

Funding

National Biomedical Information ServicesZIHLM200888 · NLM · NATIONAL LIBRARY OF MEDICINE · PI PALTOO, DINA · 2009 to 2025
$5200.7M
Health Care Systems Research Collaboratory SupplementU54AT007748 · NCCIH · DUKE UNIVERSITY · PI CURTIS, LESLEY H, HERNANDEZ, ADRIAN · 2012 to 2017
$15.1M
Pragmatic Trial of Population-based Programs to Prevent Suicide AttemptUH3MH007755 · NIMH · KAISER FOUNDATION HEALTH PLAN OF WASHINGTON · PI SIMON, GREGORY E. · 2014 to 2018
$8.9M
PPACT Administrative Supplement for Research on Sleep Disturbances and Impact on Chronic PainUH3NS088731 · NINDS · KAISER FOUNDATION RESEARCH INSTITUTE · PI DEBAR, LYNN L. · 2014 to 2017
$7.7M
Strategies and Opportunities to Stop Colon Cancer in Priority PopulationsUH3CA188640 · NCI · KAISER FOUNDATION RESEARCH INSTITUTE · PI CORONADO, GLORIA D · 2014 to 2017
$6.1M
NCCIH NIH HHS U54 AT007748NCI NIH HHS UH3 CA188640NIMH NIH HHS UH3 MH007755NINDS NIH HHS UH3 NS088731
6 · The paper itself

Abstract

backgroundThe national mandate for health systems to transition from ICD-9-CM to ICD-10-CM in October 2015 has an impact on research activities. Clinical phenotypes defined by ICD-9-CM codes need to be converted to ICD-10-CM, which has nearly four times more codes and a very different structure than ICD-9-CM.

methodsWe used the Centers for Medicare & Medicaid Services (CMS) General Equivalent Maps (GEMs) to translate, using four different methods, condition-specific ICD-9-CM code sets used for pragmatic trials (n=32) into ICD-10-CM. We calculated the recall, precision, and F score of each method. We also used the ICD-9-CM and ICD-10-CM value sets defined for electronic quality measure as an additional evaluation of the mapping methods.

resultsThe forward-backward mapping (FBM) method had higher precision, recall and F-score metrics than simple forward mapping (SFM). The more aggressive secondary (SM) and tertiary mapping (TM) methods resulted in higher recall but lower precision. For clinical phenotype definition, FBM was the best (F=0.67), but was close to SM (F=0.62) and TM (F=0.60), judging on the F-scores alone. The overall difference between the four methods was statistically significant (one-way ANOVA, F=5.749, p=0.001). However, pairwise comparisons between FBM, SM, and TM did not reach statistical significance. A similar trend was found for the quality measure value sets. DISCUSSION: The optimal method for using the GEMs depends on the relative importance of recall versus precision for a given use case. It appears that for clinically distinct and homogenous conditions, the recall of FBM is sufficient. The performance of all mapping methods was lower for heterogeneous conditions. Since code sets used for phenotype definition and quality measurement can be very similar, there is a possibility of cross-fertilization between the two activities.

conclusionDifferent mapping approaches yield different collections of ICD-10-CM codes. All methods require some level of human validation.

Indexed as

Cohort IdentificationElectronic Health Record (EHR)Health Information TechnologyStandardized Data Collection

Identifiers

PMID27195309
PMCPMC4862764

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.