Evidence map›Paper›PMID 36324333›Full record

ArticleHarvard data science review2022

Data Quality in Electronic Health Record Research: An Approach for Validation and Quantitative Bias Analysis for Imperfectly Ascertained Health Outcomes Via Diagnostic Codes.

Neal D Goldstein, Deborah Kahal, Karla Testa, Ed J Gracely, Igor Burstyn

Abstract read
In one paragraph

Article in Harvard data science review, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 17 papers.

0numbers the graph read from it
0cells of the map it votes in
17citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

17 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Differences in admission to trauma centres by sex among adults with traumatic brain injury: a population-based cohort study.CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne · 2026
    Article
  5. Review
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Review
  16. Article
  17. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Neal D GoldsteinDepartment of Epidemiology and Biostatistics, Dornsife School of Public Health, Drexel University, Philadelphia, Pennsylvania, United States of America.
Deborah KahalWilliam J. Holloway Community Program, ChristianaCare, Wilmington, Delaware, United States of America; Sydney Kimmel College of Medicine, Thomas Jefferson University, Philadelphia, Pennsylvania, United States of America.
Karla TestaSydney Kimmel College of Medicine, Thomas Jefferson University, Philadelphia, Pennsylvania, United States of America; Westside Family Healthcare, Wilmington, Delaware, United States of America.
Ed J GracelyDepartment of Epidemiology and Biostatistics, Dornsife School of Public Health, Drexel University, Philadelphia, Pennsylvania, United States of America; Department of Family, Community, and Preventive Medicine, College of Medicine, Drexel University, Philadelphia, Pennsylvania, United States of America.
Igor BurstynDepartment of Epidemiology and Biostatistics, Dornsife School of Public Health, Drexel University, Philadelphia, Pennsylvania, United States of America; Department of Environmental and Occupational Health, Dornsife School of Public Health, Drexel University, Philadelphia, Pennsylvania, United States of America.

Funding

Towards prevention of HIV among vulnerable and stigmatized populations using geospatial dataK01AI143356 · NIAID · DREXEL UNIVERSITY · PI GOLDSTEIN, NEAL D · 2019 to 2023
$607k
NIAID NIH HHS K01 AI143356
6 · The paper itself

Abstract

It is incumbent upon all researchers who use the electronic health record (EHR), including data scientists, to understand the quality of such data. EHR data may be subject to measurement error or misclassification that have the potential to bias results, unless one applies the available computational techniques specifically created for this problem. In this article, we begin with a discussion of data-quality issues in the EHR focusing on health outcomes. We review the concepts of sensitivity, specificity, positive and negative predictive values, and demonstrate how the imperfect classification of a dichotomous outcome variable can bias an analysis, both in terms of prevalence of the outcome, and relative risk of the outcome under one treatment regime (aka exposure) compared to another. This is then followed by a description of a generalizable approach to probabilistic (quantitative) bias analysis using a combination of regression estimation of the parameters that relate the true and observed data and application of these estimates to adjust the prevalence and relative risk that may have existed if there was no misclassification. We describe bias analysis that accounts for both random and systematic errors and highlight its limitations. We then motivate a case study with the goal of validating the accuracy of a health outcome, chronic infection with hepatitis C virus, derived from a diagnostic code in the EHR. Finally, we demonstrate our approaches on the case study and conclude by summarizing the literature on outcome misclassification and quantitative bias analysis.

Indexed as

biasdata qualityelectronic health recordhepatitis CInternational Classification of Diseasesvalidation

Identifiers

PMID36324333
PMCPMC9624477

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.