Evidence map›Paper›PMID 33539930›Full record

ArticleJournal of clinical epidemiology2021

Framework for the treatment and reporting of missing data in observational studies: The Treatment And Reporting of Missing data in Observational Studies framework.

Katherine J Lee, Kate M Tilling, Rosie P Cornish, Roderick J A Little, Melanie L Bell, Els Goetghebeur, Joseph W Hogan, James R Carpenter, STRATOS initiative

Abstract read
In one paragraph

Article in Journal of clinical epidemiology, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 208 papers, 9 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
208citing papers in PubMed, 9 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

208 citing papers in PubMed, 9 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Causal Model Building in the Context of Cardiac Rehabilitation: A Systematic Review.International journal of environmental research and public health · 2023
    Pooled it
  7. Pooled it
  8. How to assess applicability and methodological quality of comparative studies of operative interventions in orthopedic trauma surgery.European journal of trauma and emergency surgery : official publication of the European Trauma Society · 2022
    Pooled it
  9. Pooled it
  10. Article
  11. The state of play among youth in South Korea.Journal of exercise science and fitness · 2026
    Article
  12. Article
  13. Article
  14. Association between time to transfusion and outcomes in patients with traumatic haemorrhagic shock: an analysis of a nationwide trauma registry in Japan.European journal of trauma and emergency surgery : official publication of the European Trauma Society · 2026
    Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article

148 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors.

Katherine J LeeClinical Epidemiology and Biostatistics Unit, Murdoch Children's Research Institute, Melbourne, Australia; Department of Paediatrics, University of Melbourne, Melbourne, Australia. Electronic address: Katherine.lee@mcri.edu.au.
Kate M TillingMRC Integrative Epidemiology Unit, University of Bristol, Bristol, UK.
Rosie P CornishMRC Integrative Epidemiology Unit, University of Bristol, Bristol, UK.
Roderick J A LittleDepartment of Statistics, University of Michigan, MI, USA.
Melanie L BellDepartment of Epidemiology and Biostatistics, University of Arizona, AZ, USA.
Els GoetghebeurDepartment of Applied Mathematics, Computer Science and Statistics, Ghent University, Ghent, Belgium.
Joseph W HoganDepartment of Biostatistics, Brown University, RI, USA.
James R CarpenterMRC Clinical Trials Unit, London School of Hygiene and Tropical Medicine, London, UK.
STRATOS initiative

Funding

Translational ScienceP30AI042853 · NIAID · MIRIAM HOSPITAL · PI CURT G BECKWITH · 1998 to 2026
$51.7M
Medical Research Council G9815508Medical Research Council MC_PC_15018Medical Research Council MC_PC_19009Medical Research Council MC_UU_00004/07Medical Research Council MC_UU_00011/3Medical Research Council MC_UU_00011/6Medical Research Council MC UU 12023/21Medical Research Council MC_UU_12023/21Medical Research Council MC UU 12023/29Medical Research Council MC_UU_12023/29Medical Research Council MR/L012081/1NIAID NIH HHS P30 AI042853Wellcome TrustWellcome Trust 102215/2/13/2
6 · The paper itself

Abstract

Missing data are ubiquitous in medical research. Although there is increasing guidance on how to handle missing data, practice is changing slowly and misapprehensions abound, particularly in observational research. Importantly, the lack of transparency around methodological decisions is threatening the validity and reproducibility of modern research. We present a practical framework for handling and reporting the analysis of incomplete data in observational studies, which we illustrate using a case study from the Avon Longitudinal Study of Parents and Children. The framework consists of three steps: 1) Develop an analysis plan specifying the analysis model and how missing data are going to be addressed. An important consideration is whether a complete records' analysis is likely to be valid, whether multiple imputation or an alternative approach is likely to offer benefits and whether a sensitivity analysis regarding the missingness mechanism is required; 2) Examine the data, checking the methods outlined in the analysis plan are appropriate, and conduct the preplanned analysis; and 3) Report the results, including a description of the missing data, details on how the missing data were addressed, and the results from all analyses, interpreted in light of the missing data and the clinical relevance. This framework seeks to support researchers in thinking systematically about missing data and transparently reporting the potential effect on the study results, therefore increasing the confidence in and reproducibility of research findings.

Indexed as

AdultChildData Interpretation, StatisticalHumansLongitudinal StudiesObservational Studies as TopicReproducibility of ResultsResearch DesignALSPACMissing dataMultiple imputationObservational studiesReportingSTRATOS initiative

Identifiers

PMID33539930
PMCPMC8168830

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.