Evidence map›Paper›PMID 22692254›Full record

ArticleMedical care2012

A pragmatic framework for single-site and multisite data quality assessment in electronic health record-based clinical research.

Michael G Kahn, Marsha A Raebel, Jason M Glanz, Karen Riedlinger, John F Steiner

Abstract read
In one paragraph

Article in Medical care, 2012. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 142 papers, 4 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
142citing papers in PubMed, 4 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

142 citing papers in PubMed, 4 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Digital Health Data Quality Issues: Systematic Review.Journal of medical Internet research · 2023
    Pooled it
  4. Pooled it
  5. Trial
  6. Trial
  7. Trial
  8. Review
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. A cohort study of engagement in telehealth psychotherapy versus in-person services.Psychotherapy research : journal of the Society for Psychotherapy Research · 2025
    Article
  17. Optimizing the efficiency and effectiveness of data quality assurance in a multicenter clinical dataset.Journal of the American Medical Informatics Association : JAMIA · 2025
    Article
  18. Article
  19. Article
  20. Navigating electronic health record accuracy by examination of sex incongruent conditions.Journal of the American Medical Informatics Association : JAMIA · 2024
    Article

82 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

5 authors.

Michael G KahnDepartment of Pediatrics, Anschutz Medical Center, Colorado Clinical and Translational Sciences Institute, University of Colorado, Aurora 80045, USA. michael.kahn@ucdenver.edu
Marsha A Raebel
Jason M Glanz
Karen Riedlinger
John F Steiner

Funding

CTSA INFRASTRUCTURE FOR PEDIATRIC RESEARCHUL1RR025780 · NCRR · UNIVERSITY OF COLORADO DENVER · PI SOKOL, RONALD J. · 2008 to 2011
$61.3M
Scalable Architecture for Federated Therapeutic Inquiries Network (SAFTINet)R01HS019908 · AHRQ · UNIVERSITY OF COLORADO DENVER · PI SCHILLING, LISA M · 2010 to 2010
$8.3M
Scalable PArtnering Network for CER: Across Lifespan, Conditions, and SettingsR01HS019912 · AHRQ · KAISER FOUNDATION RESEARCH INSTITUTE · PI DALEY, MATTHEW FREDRICK · 2010 to 2010
$8.3M
AHRQ HHS 1R01HS019908AHRQ HHS 1R01HS019912-01AHRQ HHS R01 HS019908AHRQ HHS R01 HS019912NCRR NIH HHS UL1 RR025780NCRR NIH HHS UL1RR025780
6 · The paper itself

Abstract

introductionAnswers to clinical and public health research questions increasingly require aggregated data from multiple sites. Data from electronic health records and other clinical sources are useful for such studies, but require stringent quality assessment. Data quality assessment is particularly important in multisite studies to distinguish true variations in care from data quality problems.

methodsWe propose a "fit-for-use" conceptual model for data quality assessment and a process model for planning and conducting single-site and multisite data quality assessments. These approaches are illustrated using examples from prior multisite studies. APPROACH: Critical components of multisite data quality assessment include: thoughtful prioritization of variables and data quality dimensions for assessment; development and use of standardized approaches to data quality assessment that can improve data utility over time; iterative cycles of assessment within and between sites; targeting assessment toward data domains known to be vulnerable to quality problems; and detailed documentation of the rationale and outcomes of data quality assessments to inform data users. The assessment process requires constant communication between site-level data providers, data coordinating centers, and principal investigators. DISCUSSION: A conceptually based and systematically executed approach to data quality assessment is essential to achieve the potential of the electronic revolution in health care. High-quality data allow "learning health care organizations" to analyze and act on their own information, to compare their outcomes to peers, and to address critical scientific questions from the population perspective.

Indexed as

Electronic Health RecordsOutcome and Process Assessment, Health CareComparative Effectiveness ResearchCooperative BehaviorHumansMedical InformaticsPatient-Centered CareQuality Assurance, Health CareUnited States

Identifiers

PMID22692254
PMCPMC3833692

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.