Evidence map›Paper›PMID 31365086›Full record

ReviewJournal of the American Medical Informatics Association : JAMIA2019

A primer on quantitative bias analysis with positive predictive values in research using electronic health data.

Sophia R Newcomer, Stan Xu, Martin Kulldorff, Matthew F Daley, Bruce Fireman, Jason M Glanz

Abstract readReview
In one paragraph

Review in Journal of the American Medical Informatics Association : JAMIA, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 17 papers.

0numbers the graph read from it
0cells of the map it votes in
17citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

17 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Inherent Bias in Electronic Health Records: A Scoping Review of Sources of Bias.medRxiv : the preprint server for health sciences · 2024
    Article
  8. Article
  9. Observational
  10. Article
  11. Article
  12. Review
  13. Review
  14. Oral Fluoroquinolone Use and the Risk of Acute Liver Injury: A Nationwide Cohort Study.Clinical infectious diseases : an official publication of the Infectious Diseases Society of America · 2022
    Article
  15. Article
  16. Article
  17. Review of Clinical Research Informatics.Yearbook of medical informatics · 2020
    Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Sophia R NewcomerSchool of Public and Community Health Sciences, University of Montana, Missoula, Montana, USA.
Stan XuInstitute for Health Research, Kaiser Permanente Colorado, Aurora, Colorado, USA.
Martin KulldorffDivision of Pharmacoepidemiology and Pharmacoeconomics, Brigham and Women's Hospital and Harvard Medical School, Boston, Massachusetts, USA.
Matthew F DaleyInstitute for Health Research, Kaiser Permanente Colorado, Aurora, Colorado, USA.
Bruce FiremanDivision of Research, Vaccine Study Center, Kaiser Permanente Northern California, Oakland, California, USA.
Jason M GlanzInstitute for Health Research, Kaiser Permanente Colorado, Aurora, Colorado, USA.

Funding

Methods for Safety Evaluation of Vaccination SchedulesR01AI107721 · NIAID · HARVARD PILGRIM HEALTH CARE, INC. · PI KULLDORFF, MARTIN · 2014 to 2017
$1.6M
NIAID NIH HHS R01 AI107721
6 · The paper itself

Abstract

objectiveIn health informatics, there have been concerns with reuse of electronic health data for research, including potential bias from incorrect or incomplete outcome ascertainment. In this tutorial, we provide a concise review of predictive value-based quantitative bias analysis (QBA), which comprises epidemiologic methods that use estimates of data quality accuracy to quantify the bias caused by outcome misclassification. TARGET AUDIENCE: Health informaticians and investigators reusing large, electronic health data sources for research. SCOPE: When electronic health data are reused for research, validation of outcome case definitions is recommended, and positive predictive values (PPVs) are the most commonly reported measure. Typically, case definitions with high PPVs are considered to be appropriate for use in research. However, in some studies, even small amounts of misclassification can cause bias. In this tutorial, we introduce methods for quantifying this bias that use predictive values as inputs. Using epidemiologic principles and examples, we first describe how multiple factors influence misclassification bias, including outcome misclassification levels, outcome prevalence, and whether outcome misclassification levels are the same or different by exposure. We then review 2 predictive value-based QBA methods and why outcome PPVs should be stratified by exposure for bias assessment. Using simulations, we apply and evaluate the methods in hypothetical electronic health record-based immunization schedule safety studies. By providing an overview of predictive value-based QBA, we hope to bridge the disciplines of health informatics and epidemiology to inform how the impact of data quality issues can be quantified in research using electronic health data sources.

Indexed as

BiasElectronic Health RecordsOutcome Assessment, Health CareEpidemiologic MethodsHumansMedical InformaticsPredictive Value of TestsPublic Health SurveillanceReproducibility of ResultsSensitivity and Specificitybiaselectronic health recordsmedical informaticsoutcome assessment

Identifiers

PMID31365086
PMCPMC6857512

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.