Evidence map›Paper›PMID 30652356›Full record

ArticleStatistics in medicine2019

Using simulation studies to evaluate statistical methods.

Tim P Morris, Ian R White, Michael J Crowther

Registry-linked trialAbstract read
In one paragraph

Article in Statistics in medicine, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT07016282 (Simulated and Synthetic Health Data), which is not on this map. Cited by 575 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
575citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT07016282 active not recruitingnot on this mapstarted 2025, after this paper: background citation

Simulated and Synthetic Health Data: Improving Clinical Research on Rare Diseases. A Real-World Data Simulation of Autosomal Dominant Polycystic Kidney Disease (ADPKD) Trials. A Retrospective, Observational Study

TypeobservationalSponsorMario Negri Institute for Pharmacological ResearchRan2025 to 2027Enrolled100ConditionsAutosomal Dominant Polycystic Kidney Disease (ADPKD)
3 · Its place in the literature

Who cites it

575 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Trial
  4. Review
  5. A Framework for the Estimation of Quality-Adjusted Life-Years Using Joint Models of Longitudinal and Survival Data.Medical decision making : an international journal of the Society for Medical Decision Making · 2026
    Article
  6. Article
  7. Article
  8. Article
  9. Review
  10. Article
  11. Article
  12. Article
  13. Article
  14. Combining Observational Studies to Reduce Multiple Biases.Epidemiology (Cambridge, Mass.) · 2026
    Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article

515 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Tim P MorrisLondon Hub for Trials Methodology Research, MRC Clinical Trials Unit at UCL, London, United Kingdom.ORCID 0000-0001-5850-3610
Ian R WhiteLondon Hub for Trials Methodology Research, MRC Clinical Trials Unit at UCL, London, United Kingdom.ORCID 0000-0002-6718-7661
Michael J CrowtherBiostatistics Research Group, Department of Health Sciences, University of Leicester, Leicester, United Kingdom.ORCID 0000-0001-8378-8259

Funding

Medical Research Council MC_UU_12023/21Medical Research Council MC_UU_12023/29Medical Research Council MR/P015433/1
6 · The paper itself

Abstract

Simulation studies are computer experiments that involve creating data by pseudo-random sampling. A key strength of simulation studies is the ability to understand the behavior of statistical methods because some "truth" (usually some parameter/s of interest) is known from the process of generating the data. This allows us to consider properties of methods, such as bias. While widely used, simulation studies are often poorly designed, analyzed, and reported. This tutorial outlines the rationale for using simulation studies and offers guidance for design, execution, analysis, reporting, and presentation. In particular, this tutorial provides a structured approach for planning and reporting simulation studies, which involves defining aims, data-generating mechanisms, estimands, methods, and performance measures ("ADEMP"); coherent terminology for simulation studies; guidance on coding simulation studies; a critical discussion of key performance measures and their estimation; guidance on structuring tabular and graphical presentation of results; and new graphical presentations. With a view to describing recent practice, we review 100 articles taken from Volume 34 of Statistics in Medicine, which included at least one simulation study and identify areas for improvement.

Indexed as

Computer SimulationModels, StatisticalBiasBiostatisticsGuidelines as TopicMonte Carlo MethodResearch Designgraphics for simulationMonte Carlosimulation designsimulation reportingsimulation studies

Identifiers

PMID30652356
PMCPMC6492164

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.