Evidence map›Paper›PMID 31144403›Full record

ArticlePharmacoepidemiology and drug safety2019

Assessment of ICD-10-CM code assignment validity for case finding of outpatient anticoagulant-related bleeding among Medicare beneficiaries.

Nadine Shehab, Robert Ziemba, Kyle N Campbell, Andrew I Geller, Ruth N Moro, Brian F Gage, Daniel S Budnitz, Tsu-Hsuan Yang

Abstract readMulticenter StudyValidation Study
In one paragraph

Article in Pharmacoepidemiology and drug safety, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 28 papers, 3 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
28citing papers in PubMed, 3 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

28 citing papers in PubMed, 3 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Article
  5. Article
  6. Article
  7. Article
  8. Increasing risk of hemorrhage following concurrent use ofTherapeutic advances in drug safety · 2026
    Article
  9. Article
  10. Article
  11. Article
  12. Natural Language Processing andJMIR medical informatics · 2025
    Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Tracheostomy Incidence and Complications: A National Database Analysis.Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery · 2024
    Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Nadine ShehabDivision of Healthcare Quality Promotion, Centers for Disease Control and Prevention, Atlanta, Georgia.ORCID 0000-0001-8700-8539
Robert ZiembaPharmacy and Quality Measurement Division, Health Services Advisory Group, Inc., Tampa, Florida.
Kyle N CampbellPharmacy and Quality Measurement Division, Health Services Advisory Group, Inc., Tampa, Florida.
Andrew I GellerDivision of Healthcare Quality Promotion, Centers for Disease Control and Prevention, Atlanta, Georgia.
Ruth N MoroNorthrop Grumman Corporation, contractor to the Division of Healthcare Quality Promotion, Centers for Disease Control and Prevention, Atlanta, Georgia.
Brian F GageDepartment of Medicine, Washington University in St. Louis, St. Louis, Missouri.
Daniel S BudnitzDivision of Healthcare Quality Promotion, Centers for Disease Control and Prevention, Atlanta, Georgia.
Tsu-Hsuan YangPharmacy and Quality Measurement Division, Health Services Advisory Group, Inc., Tampa, Florida.

Funding

CDC HHS 200-2016-91960Intramural CDC HHS CC999999
6 · The paper itself

Abstract

purposeTo assess performance of International Classification of Diseases, Tenth Revision, Clinical Modification (ICD-10-CM) code assignments for identifying bleeding events resulting in emergency department visits and hospitalizations among outpatient Medicare beneficiaries prescribed anticoagulants.

methodsPerformance of 206 ICD-10-CM code assignments indicative of bleeding, five anticoagulant adverse effect/poisoning codes, and five coagulopathy codes (according to Medicare Parts A and B claims) as assessed among Medicare fee-for-service beneficiaries prescribed anticoagulants between October 1, 2015 and September 30, 2016 (according to Part D claims). Structured medical record review was the gold standard for validating the presence of anticoagulant-related bleeding. Sensitivity was adjusted to correct for partial verification bias due to sampling design.

resultsBased on the study sample of 1166 records (583 cases, 583 controls), 57 of 206 codes yielded the optimal performance for anticoagulant-related bleeding (diagnostic odds ratio, 51; positive predictive value (PPV), 75.7% [95% CI, 72.0%-79.1%]; adjusted sensitivity, 70.0% [95% CI, 63.2%-77.7%]). Codes for intracranial bleeding demonstrated the highest PPV (85.0%) and adjusted sensitivity (91.0%). Bleeding codes in the primary position demonstrated high PPV (86.9%), but low adjusted sensitivity (36.0%). The adjusted sensitivity improved to 69.5% when codes in a secondary position were added. Only one adverse effect/poisoning code was used, appearing in 7.8% of cases and controls (PPV, 71.4% and adjusted sensitivity, 6.8%).

conclusionsPerformance of ICD-10-CM code assignments for bleeding among patients prescribed anticoagulants varied by bleed type and code position. Adverse effect/poisoning codes were not commonly used and would have missed over 90% of anticoagulant-related bleeding cases.

Indexed as

OutpatientsAdultAgedAged, 80 and overAnticoagulantsDiagnosis-Related GroupsDrug-Related Side Effects and Adverse ReactionsFemaleHemorrhageHumansMaleMedicareMiddle AgedPharmacoepidemiologyReproducibility of ResultsRetrospective StudiesAnticoagulantsaccuracyadverse drug eventsanticoagulantsbleedingdiagnosis codeshemorrhageInternational Classification of Diseasespharmacoepidemiologyvalidation

Identifiers

PMID31144403
PMCPMC13086182

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.