Evidence map›Paper›PMID 32293286›Full record

ArticleBMC medical research methodology2020

An evaluation of inverse probability weighting using the propensity score for baseline covariate adjustment in smaller population randomised controlled trials with a continuous outcome.

Hanaya Raad, Victoria Cornelius, Susan Chan, Elizabeth Williamson, Suzie Cro

Open access · goldAbstract read
In one paragraph

Article in BMC medical research methodology, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 45 papers.

0numbers the graph read from it
0cells of the map it votes in
45citing papers in PubMed
9.5field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

45 citing papers in PubMed, 76 citations in OpenAlex.

  1. Trial
  2. Trial
  3. Trial
  4. Cannabinoid impacts on ethnic modulation of atrial septal defect prevalence USA.Journal of perinatology : official journal of the California Perinatal Association · 2026
    Article
  5. Article
  6. Effect of the Rural Interprofessional Faculty Development Initiative on VHA Clinician Turnover by Level of Program Engagement.The Journal of rural health : official journal of the American Rural Health Association and the National Rural Health Care Association · 2026
    Article
  7. Article
  8. Use of Inverse Probability Weighting in Cardiovascular Surgical Outcomes Research: Principles, Limitations, and Recommendations.European journal of cardio-thoracic surgery : official journal of the European Association for Cardio-thoracic Surgery · 2026
    Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Relationship Difficulty Is Associated With Poorer Mental Health in Later Life.The journals of gerontology. Series B, Psychological sciences and social sciences · 2025
    Article
  14. Propensity score weighting.Nature methods · 2025
    Article
  15. Comment on: Rapid reduction in fracture risk after the discontinuation of long-term oral glucocorticoid therapy: a retrospective cohort study using a nationwide health insurance claims database in Japan.Osteoporosis international : a journal established as result of cooperation between the European Foundation for Osteoporosis and the National Osteoporosis Foundation of the USA · 2025
    Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Intra-aortic balloon pump for ST-elevation myocardial infarction necessitating urgent coronary artery bypass grafting, still a valid indication?Netherlands heart journal : monthly journal of the Netherlands Society of Cardiology and the Netherlands Heart Foundation · 2024
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors at 3 institutions in 1 country.

Hanaya RaadImperial Clinical Trials Unit, Imperial College London, Stadium House, 68 Wood Lane, London, W12 7RH, UK.
Victoria CorneliusImperial Clinical Trials Unit, Imperial College London, Stadium House, 68 Wood Lane, London, W12 7RH, UK.
Susan ChanChildren's Allergy, Guy's and St Thomas' NHS Foundation Trust, London, United Kingdom, London, SE1 7EH, UK.
Elizabeth WilliamsonDepartment of Medical Statistics, Faculty of Epidemiology and population health, London School of Hygiene and Tropical Medicine, London, WC1E 7HT, UK.
Suzie CroImperial Clinical Trials Unit, Imperial College London, Stadium House, 68 Wood Lane, London, W12 7RH, UK. s.cro@imperial.ac.uk.
Imperial College London · GBGuy's and St Thomas' NHS Foundation Trust · GBLondon School of Hygiene & Tropical Medicine · GB

Funding

Medical Research Council MC_PC_14136Medical Research Council MR/L004933/2
6 · The paper itself

Abstract

backgroundIt is important to estimate the treatment effect of interest accurately and precisely within the analysis of randomised controlled trials. One way to increase precision in the estimate and thus improve the power for randomised trials with continuous outcomes is through adjustment for pre-specified prognostic baseline covariates. Typically covariate adjustment is conducted using regression analysis, however recently, Inverse Probability of Treatment Weighting (IPTW) using the propensity score has been proposed as an alternative method. For a continuous outcome it has been shown that the IPTW estimator has the same large sample statistical properties as that obtained via analysis of covariance. However the performance of IPTW has not been explored for smaller population trials (< 100 participants), where precise estimation of the treatment effect has potential for greater impact than in larger samples.

methodsIn this paper we explore the performance of the baseline adjusted treatment effect estimated using IPTW in smaller population trial settings. To do so we present a simulation study including a number of different trial scenarios with sample sizes ranging from 40 to 200 and adjustment for up to 6 covariates. We also re-analyse a paediatric eczema trial that includes 60 children.

resultsIn the simulation study the performance of the IPTW variance estimator was sub-optimal with smaller sample sizes. The coverage of 95% CI's was marginally below 95% for sample sizes < 150 and ≥ 100. For sample sizes < 100 the coverage of 95% CI's was always significantly below 95% for all covariate settings. The minimum coverage obtained with IPTW was 89% with n = 40. In comparison, regression adjustment always resulted in 95% coverage. The analysis of the eczema trial confirmed discrepancies between the IPTW and regression estimators in a real life small population setting.

conclusionsThe IPTW variance estimator does not perform so well with small samples. Thus we caution against the use of IPTW in small sample settings when the sample size is less than 150 and particularly when sample size < 100.

Indexed as

Propensity ScoreChildComputer SimulationHumansMonte Carlo MethodProbabilityRandomized Controlled Trials as TopicRegression AnalysisSample SizeCovariate adjustmentInverse probability weightingPropensity scoreRandomised controlled trialSmall populationSmall sample size

Identifiers

PMID32293286
PMCPMC7092449
OpenAlexW3013279983

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.