ArticleJournal of the American Medical Informatics Association : JAMIA2021
Increasing trust in real-world evidence through evaluation of observational data quality.
Article in Journal of the American Medical Informatics Association : JAMIA, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 63 papers, 4 of them syntheses that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
63 citing papers in PubMed, 4 syntheses or guidelines pooled it.
- Digital Public Reporting Systems for Evaluating Health Care Quality: Systematic Review.JMIR medical informatics · 2026Pooled it
- Data quality assessment in healthcare, dimensions, methods and tools: a systematic review.BMC medical informatics and decision making · 2025Pooled it
- Data Quality-Driven Improvement in Health Care: Systematic Literature Review.Journal of medical Internet research · 2024Pooled it
- Evaluation of reporting quality of cohort studies using real-world data based on RECORD: systematic review.BMC medical research methodology · 2023Pooled it
- A comparison of Fast Healthcare Interoperability Resources and Observational Medical Mutcomes Partnership electronic health record data within the All of Us Research Program.Journal of the American Medical Informatics Association : JAMIA · 2026Article
- Active Safety Surveillance Using Real-World Evidence (ASSURE) Implementation: Transparent and Reproducible Real-World Evidence Standardized Framework to Support Safety Signal Evaluation.Pharmacoepidemiology and drug safety · 2026Article
- Data Resource Profile: EST-Health-30.International journal of epidemiology · 2026Article
- Measuring the Quality of Datasets: Development of the IDEFIM Indicator Set for Empirical Health Research.Journal of medical Internet research · 2026Article
- Implementing a quality assurance and maintenance framework for standardized clinical terminology data in a multi-institutional setting.BMC medical informatics and decision making · 2026Article
- A Practical Approach to Assessing the Completeness of Electronic Health Records for Medical Research: Data Quality Study.JMIR medical informatics · 2026Article
- Beyond Missingness: Systematizing Methods for Comprehensive Data Fitness Assessment in Clinical Research.Journal of medical Internet research · 2026Article
- Article
- Characteristics, treatment and survival of patients with chondrosarcoma in five European countries: a DARWIN EU® cohort study.Acta oncologica (Stockholm, Sweden) · 2026Article
- Privacy-preserving data quality assessment for federated health data networks.BMC medical informatics and decision making · 2026Article
- Preparing real-world data through common data model harmonization of cancer patient records in the COMNet platform at the Modena Oncology Center.Frontiers in digital health · 2026Article
- The AIR·MS data platform for artificial intelligence in healthcare.JAMIA open · 2025Article
- Clinical implementation of an AI-based prediction model for decision support for patients undergoing colorectal cancer surgery.Nature medicine · 2025Article
- Challenges and Recommendations for Electronic Health Records Data Extraction and Preparation for Dynamic Prediction Modeling in Hospitalized Patients: Practical Guide and Tutorial.Journal of medical Internet research · 2025Article
- Medical Science Data Value Evaluation Model: Mixed Methods Study.JMIR medical informatics · 2025Article
- Advancing Real-World Evidence Through a Federated Health Data Network (EHDEN): Descriptive Study.Journal of medical Internet research · 2025Article
3 more citing papers are in PubMed but not listed here.
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
4 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
objectiveAdvances in standardization of observational healthcare data have enabled methodological breakthroughs, rapid global collaboration, and generation of real-world evidence to improve patient outcomes. Standardizations in data structure, such as use of common data models, need to be coupled with standardized approaches for data quality assessment. To ensure confidence in real-world evidence generated from the analysis of real-world data, one must first have confidence in the data itself. MATERIALS AND
methodsWe describe the implementation of check types across a data quality framework of conformance, completeness, plausibility, with both verification and validation. We illustrate how data quality checks, paired with decision thresholds, can be configured to customize data quality reporting across a range of observational health data sources. We discuss how data quality reporting can become part of the overall real-world evidence generation and dissemination process to promote transparency and build confidence in the resulting output.
resultsThe Data Quality Dashboard is an open-source R package that reports potential quality issues in an OMOP CDM instance through the systematic execution and summarization of over 3300 configurable data quality checks. DISCUSSION: Transparently communicating how well common data model-standardized databases adhere to a set of quality measures adds a crucial piece that is currently missing from observational research.
conclusionAssessing and improving the quality of our data will inherently improve the quality of the evidence we generate.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.