ArticleNature communications2022
Reproducibility of real-world evidence studies using clinical practice data to inform regulatory and coverage decisions.
Article in Nature communications, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 60 papers, 1 of them a synthesis that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
60 citing papers in PubMed, 1 synthesis or guideline pooled it.
- Evaluation of reporting quality of cohort studies using real-world data based on RECORD: systematic review.BMC medical research methodology · 2023Pooled it
- Using real-world data to predict findings of an ongoing phase IV trial: glycemic control of semaglutide versus standard of care.BMJ open diabetes research & care · 2025Trial
- Predicting Treatment Effects of a New-to-Market Drug in Clinical Practice Based on Phase III Randomized Trial Results.Clinical pharmacology and therapeutics · 2023Trial
- Retrieval-to-abstraction LLM-assisted literature synthesis: Case demonstrations in digital health technology-enabled randomized controlled trial outcome reporting.PLOS digital health · 2026Article
- External Control Arms in Japan: A Systematic Case Analysis of Documented Regulatory Implementation and Uncertainty Management.Clinical pharmacology and therapeutics · 2026Article
- The replicability of real-world evidence for the surgical treatment of proximal humeral fractures in older patients evaluated using sceptical p-value.Scientific reports · 2026Observational
- Feasibility of Reconstructing Survival Outcomes from Unstructured Electronic Medical Records under Japan's Next-Generation Medical Infrastructure Act: A Historical Cohort Study of Atezolizumab in Non-small Cell Lung Cancer.Drugs - real world outcomes · 2026Article
- Assessment of real-world evidence research competencies in federated research networks: a maternal health fellowship program evaluation.JAMIA open · 2026Article
- Article
- Empowering clinical trial design with agentic intelligence and real-world data.Nature communications · 2026Article
- Naturally Derived Psilocybin for Therapeutic Use: A Six-Criterion Framework for Evidence, Safety, and Benefit-Risk Considerations in Policy and Clinical Development.Biomolecules · 2026Review
- Bleeding Risk With Apixaban Versus Rivaroxaban: A Reference Trial Emulation Predicting the Results of COBRRA-VTE and COBRRA-AF Using US Health Care Claims.Circulation. Population health and outcomes · 2026Observational
- Article
- Article
- Trends in paediatric antiseizure-medication use and costs in France, 2014-2023: a nationwide population-based analysis.The Lancet regional health. Europe · 2026Article
- Article
- Article
- Fluticasone- vs Budesonide-Based Dual Therapy for COPD.JAMA network open · 2026Article
- An LLM-assisted framework for accelerated and verifiable clinical hypothesis testing from electronic health records.medRxiv : the preprint server for health sciences · 2026Article
- Comparative Effectiveness of Current Glucose-lowering Medications in Type 2 Diabetes Mellitus: Emulation of a Modified GRADE Trial.Journal of general internal medicine · 2026Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
4 authors.
Funding
Abstract
Studies that generate real-world evidence on the effects of medical products through analysis of digital data collected in clinical practice provide key insights for regulators, payers, and other healthcare decision-makers. Ensuring reproducibility of such findings is fundamental to effective evidence-based decision-making. We reproduce results for 150 studies published in peer-reviewed journals using the same healthcare databases as original investigators and evaluate the completeness of reporting for 250. Original and reproduction effect sizes were positively correlated (Pearson's correlation = 0.85), a strong relationship with some room for improvement. The median and interquartile range for the relative magnitude of effect (e.g., hazard ratio
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.