Evidence map›Paper›PMID 24717952›Full record

ArticleAmerican journal of rhinology & allergy

Accuracy of phenotyping chronic rhinosinusitis in the electronic health record.

Joy Hsu, Jennifer A Pacheco, Whitney W Stevens, Maureen E Smith, Pedro C Avila

Abstract read
In one paragraph

Article in American journal of rhinology & allergy. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 22 papers.

0numbers the graph read from it
0cells of the map it votes in
22citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

22 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Review
  7. Article
  8. White blood cells and chronic rhinosinusitis: a Mendelian randomization study.Allergy, asthma, and clinical immunology : official journal of the Canadian Society of Allergy and Clinical Immunology · 2022
    Article
  9. Virtual Care and the Inverse Care Law: Implications for Policy, Practice, Research, Public and Patients.International journal of environmental research and public health · 2022
    Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Economics of Chronic Rhinosinusitis.Current allergy and asthma reports · 2017
    Review
  17. The role of infection and antibiotics in chronic rhinosinusitis.Laryngoscope investigative otolaryngology · 2017
    Review
  18. Article
  19. A diagnostic dilemma: chronic sinusitis diagnosed by non-otolaryngologists.International forum of allergy & rhinology · 2016
    Article
  20. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Joy HsuDivision of Allergy-Immunology, Northwestern University Feinberg School of Medicine, Chicago, Illinois, USA.
Jennifer A Pacheco
Whitney W Stevens
Maureen E Smith
Pedro C Avila

Funding

MULTIDISCIPLINARY CLINICAL AND TRANSLATIONAL SCIENCE (MCTS) PROGRAM (UL1)UL1RR025741 · NCRR · NORTHWESTERN UNIVERSITY AT CHICAGO · PI GREENLAND, PHILIP · 2008 to 2011
$24.7M
A Personalized Genomic Medicine Pilot Program Using the NJgene eMERGE ExperienceU01HG006388 · NHGRI · NORTHWESTERN UNIVERSITY AT CHICAGO · PI CHISHOLM, REX L, SMITH, MAUREEN E · 2011 to 2014
$4.1M
Northwestern University Allergy Immunology Research Program (NUAIR)T32AI083216 · NIAID · NORTHWESTERN UNIVERSITY AT CHICAGO · PI Stephanie Caroline Eisenbarth, ADAM WILLIAMS · 2010 to 2026
$4.1M
New Paradigms in Gene Regulation During Influenza Virus InfectionsU01AI082984 · NIAID · NORTHWESTERN UNIVERSITY · PI HORVATH, CURT M · 2009 to 2013
$3.6M
Systems Genetics Approach to Gene Discovery in Chronic RhinosinusitisP01AI106683 · NIAID · NORTHWESTERN UNIVERSITY AT CHICAGO · PI SCHLEIMER, ROBERT P · 2013 to 2013
$1.7M
NCRR NIH HHS UL1 RR025741NCRR NIH HHS UL1RR025741NHGRI NIH HHS U01 HG006388NIAID NIH HHS P01 AI106683NIAID NIH HHS R01 AI082984NIAID NIH HHS T32 AI083216NIAID NIH HHS U01 AI082984
6 · The paper itself

Abstract

backgroundChronic rhinosinusitis (CRS) is prevalent, morbid, and poorly understood. Extraction of electronic health record (EHR) data of patients with CRS may facilitate research on CRS. However, the accuracy of using structured billing codes for EHR-driven phenotyping of CRS is unknown. We sought to accurately identify CRS cases and controls using EHR data and to determine the accuracy of structured billing codes for identifying patients with CRS.

methodsWe developed and validated distinct algorithms to identify patients with CRS and controls using International Classification of Diseases, Ninth Revision (ICD-9) and Current Procedural Terminology codes. We used blinded clinician chart review as the reference standard to evaluate algorithm and billing code accuracy.

resultsOur initial control algorithm achieved a control positive predictive value (PPV) of 100% (i.e., negative predictive value of 100% for CRS). Our initial algorithm for CRS cases relied exclusively on billing codes and had a low case PPV (54%). Notably, ICD-9 code 471.x was associated with a case PPV of 85%, whereas the case PPV of ICD-9 code 473.x was only 34%. After multiple algorithm iterations, we increased the case PPV of our final algorithm to 91% by adding several requirements, e.g., that ICD-9 codes occur with 1 or more evaluations by a CRS specialist to enhance availability of objective clinical data for accurately phenotyping CRS.

conclusionThese algorithms are an important first step to identify patients with CRS, and may facilitate EHR-based research on CRS pathogenesis, morbidity, and management. Exclusive use of coded data for phenotyping CRS has limited accuracy, especially because CRS symptomatology overlaps with that of other illnesses. Incorporating natural language processing (e.g., to evaluate results of nasal endoscopy or sinus computed tomography) into future work may increase algorithm accuracy and identify patients whose disease status may not be ascertained by only using billing codes.

Indexed as

Electronic Health RecordsAlgorithmsChronic DiseaseEndoscopyHumansInternational Classification of DiseasesNatural Language ProcessingObserver VariationPhenotypePredictive Value of TestsReference StandardsReproducibility of ResultsRhinitisSinusitisTomography, X-Ray Computed

Identifiers

PMID24717952
PMCPMC5517777

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.