ArticleJournal of the American Medical Informatics Association : JAMIA2020
Assessing the practice of data quality evaluation in a national clinical data research network through a systematic scoping review in the era of real-world data.
Article in Journal of the American Medical Informatics Association : JAMIA, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 55 papers, 3 of them syntheses that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
55 citing papers in PubMed, 3 syntheses or guidelines pooled it.
- Common data models and data standards for tabular health data: a systematic review.BMC medical informatics and decision making · 2025Pooled it
- Challenges for Data Quality in the Clinical Data Life Cycle: Systematic Review.Journal of medical Internet research · 2025Pooled it
- Data Quality-Driven Improvement in Health Care: Systematic Literature Review.Journal of medical Internet research · 2024Pooled it
- Assessment of Electronic Clinical Monitoring Systems in the Pediatric Intensive Care Unit: Prospective Concordance Study.JMIR formative research · 2026Article
- Real-World Imaging Data: Opportunities and Challenges.JMIR medical informatics · 2026Article
- Implementing a quality assurance and maintenance framework for standardized clinical terminology data in a multi-institutional setting.BMC medical informatics and decision making · 2026Article
- Assessing the quality of electronic health record data and the claims linked data for target trial emulation studies.JAMIA open · 2026Article
- A Practical Approach to Assessing the Completeness of Electronic Health Records for Medical Research: Data Quality Study.JMIR medical informatics · 2026Article
- Design and evaluation of an automated pediatric acute lymphoblastic leukemia registry from clinical data warehouses.BMC medical informatics and decision making · 2026Article
- A method to enable clinical and translational research teams with custom real-world data from electronic health record systems.Journal of clinical and translational science · 2026Article
- Assessing Data Quality in Heterogeneous Health Care Integration: Simulation Study of the AIDAVA Framework.JMIR medical informatics · 2025Article
- The Guardian Research Network: A Real-World Data Source for Pharmacoepidemiologic Research and Regulatory Applications.Pharmacoepidemiology and drug safety · 2025Article
- Data from Routine Primary Healthcare: Opportunities and Threats for Obesity Epidemiological Research.Portuguese journal of public health · 2025Article
- Impact of a monitoring and evaluation training in 3 PEPFAR-supported countries.Evaluation and program planning · 2025Article
- New implementation of data standards for AI in oncology: Experience from the EuCanImage project.GigaScience · 2025Article
- Examine frameworks policies and strategies for effective information governance in healthcare organizations.PloS one · 2025Article
- Editorial: The need for pragmatic trials in genitourinary oncology.Frontiers in oncology · 2025Article
- INSIGHT: A Tool for Fit-for-Purpose Evaluation and Quality Assessment of Standardized Observational Data Sources for Real World Evidence on Medicine and Vaccine Safety.Pharmacoepidemiology and drug safety · 2025Article
- Reusing routine electronic health record data for nationwide COVID-19 surveillance in nursing homes: barriers, facilitators, and lessons learned.BMC medical informatics and decision making · 2024Article
- Building a Foundation for High-Quality Health Data: Multihospital Case Study in Belgium.JMIR medical informatics · 2024Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
12 authors.
Funding
Abstract
objectiveTo synthesize data quality (DQ) dimensions and assessment methods of real-world data, especially electronic health records, through a systematic scoping review and to assess the practice of DQ assessment in the national Patient-centered Clinical Research Network (PCORnet). MATERIALS AND
methodsWe started with 3 widely cited DQ literature-2 reviews from Chan et al (2010) and Weiskopf et al (2013a) and 1 DQ framework from Kahn et al (2016)-and expanded our review systematically to cover relevant articles published up to February 2020. We extracted DQ dimensions and assessment methods from these studies, mapped their relationships, and organized a synthesized summarization of existing DQ dimensions and assessment methods. We reviewed the data checks employed by the PCORnet and mapped them to the synthesized DQ dimensions and methods.
resultsWe analyzed a total of 3 reviews, 20 DQ frameworks, and 226 DQ studies and extracted 14 DQ dimensions and 10 assessment methods. We found that completeness, concordance, and correctness/accuracy were commonly assessed. Element presence, validity check, and conformance were commonly used DQ assessment methods and were the main focuses of the PCORnet data checks. DISCUSSION: Definitions of DQ dimensions and methods were not consistent in the literature, and the DQ assessment practice was not evenly distributed (eg, usability and ease-of-use were rarely discussed). Challenges in DQ assessments, given the complex and heterogeneous nature of real-world data, exist.
conclusionThe practice of DQ assessment is still limited in scope. Future work is warranted to generate understandable, executable, and reusable DQ measures.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.