Evidence map›Paper›PMID 31992429›Full record

ArticleJournal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine2020

Multisite validation of a simple electronic health record algorithm for identifying diagnosed obstructive sleep apnea.

Brendan T Keenan, H Lester Kirchner, Olivia J Veatch, Kenneth M Borthwick, Vicki A Davenport, John C Feemster, Maged Gendy, Thomas R Gossard, Frances M Pack, Laura Sirikulvadhana and 8 more

Abstract read
In one paragraph

Article in Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 23 papers.

0numbers the graph read from it
0cells of the map it votes in
23citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

23 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Identifying clusters of patient comorbidities associated with obstructive sleep apnea using electronic health records.Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine · 2024
    Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Observational
  14. Article
  15. Article
  16. Article
  17. Use and limitations of databases and big data in sleep-disordered breathing research.Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine · 2022
    Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

18 authors.

Brendan T KeenanDivision of Sleep Medicine/Department of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania.
H Lester KirchnerBiomedical and Translational Informatics, Geisinger, Danville, Pennsylvania.
Olivia J VeatchDivision of Sleep Medicine/Department of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania.
Kenneth M BorthwickBiomedical and Translational Informatics, Geisinger, Danville, Pennsylvania.
Vicki A DavenportBiomedical and Translational Informatics, Geisinger, Danville, Pennsylvania.
John C FeemsterCenter for Sleep Medicine, Mayo Clinic, Rochester, Minnesota.
Maged GendyCenter for Circadian and Sleep Medicine, Feinberg School of Medicine, Northwestern University, Chicago, Illinois.
Thomas R GossardCenter for Sleep Medicine, Mayo Clinic, Rochester, Minnesota.
Frances M PackDivision of Sleep Medicine/Department of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania.
Laura SirikulvadhanaDepartment of Research and Evaluation, Kaiser Permanente Southern California, Pasadena, California.
Luke N TeigenCenter for Sleep Medicine, Mayo Clinic, Rochester, Minnesota.
Paul C TimmCenter for Sleep Medicine, Mayo Clinic, Rochester, Minnesota.
Beth A MalowSleep Disorders Division, Vanderbilt University Medical Center, Nashville, Tennessee.
Timothy I MorgenthalerCenter for Sleep Medicine, Mayo Clinic, Rochester, Minnesota.
Phyllis C ZeeCenter for Circadian and Sleep Medicine, Feinberg School of Medicine, Northwestern University, Chicago, Illinois.
Allan I PackDivision of Sleep Medicine/Department of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania.
Janet D RobishawCharles E. Schmidt College of Medicine, Florida Atlantic University, Boca Raton, Florida.
Stephen F DeroseDepartment of Research and Evaluation, Kaiser Permanente Southern California, Pasadena, California.

Funding

Understanding the relationship between obesity and tongue fat in humans and ratsP01HL094307 · NHLBI · UNIVERSITY OF PENNSYLVANIA · PI PACK, ALLAN I · 2009 to 2020
$23.7M
Approaches to Genetic Heterogeneity of Obstructive Sleep ApneaR01HL134015 · NHLBI · UNIVERSITY OF PENNSYLVANIA · PI PACK, ALLAN I, ROBISHAW, JANET D · 2016 to 2019
$3.2M
NHLBI NIH HHS P01 HL094307NHLBI NIH HHS R01 HL134015
6 · The paper itself

Abstract

STUDY

objectivesWe examined the performance of a simple algorithm to accurately distinguish cases of diagnosed obstructive sleep apnea (OSA) and noncases using the electronic health record (EHR) across six health systems in the United States.

methodsRetrospective analysis of EHR data was performed. The algorithm defined cases as individuals with ≥ 2 instances of specific International Classification of Diseases (ICD)-9 and/or ICD-10 diagnostic codes (327.20, 327.23, 327.29, 780.51, 780.53, 780.57, G4730, G4733 and G4739) related to sleep apnea on separate dates in their EHR. Noncases were defined by the absence of these codes. Using chart reviews on 120 cases and 100 noncases at each site (n = 1,320 total), positive predictive value (PPV) and negative predictive value (NPV) were calculated.

resultsThe algorithm showed excellent performance across sites, with a PPV (95% confidence interval) of 97.1 (95.6, 98.2) and NPV of 95.5 (93.5, 97.0). Similar performance was seen at each site, with all NPV and PPV estimates ≥ 90% apart from a somewhat lower PPV of 87.5 (80.2, 92.8) at one site. A modified algorithm of ≥ 3 instances improved PPV to 94.9 (88.5, 98.3) at this site, but excluded an additional 18.3% of cases. Thus, performance may be further improved by requiring additional codes, but this reduces the number of determinate cases.

conclusionsA simple EHR-based case-identification algorithm for diagnosed OSA showed excellent predictive characteristics in a multisite sample from the United States. Future analyses should be performed to understand the effect of undiagnosed disease in EHR-defined noncases. This algorithm has wide-ranging applications for EHR-based OSA research.

Indexed as

Electronic Health RecordsSleep Apnea, ObstructiveAlgorithmsHumansInternational Classification of DiseasesRetrospective Studiescase-identification algorithmdiagnostic codeselectronic health recordobstructive sleep apneaphenotype

Identifiers

PMID31992429
PMCPMC7053021

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.