Evidence map›Paper›PMID 29939268›Full record

ArticleInternational journal of epidemiology2018

Evaluating large-scale propensity score performance through real-world and synthetic data experiments.

Yuxi Tian, Martijn J Schuemie, Marc A Suchard

Abstract read
In one paragraph

Article in International journal of epidemiology, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 113 papers, 7 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
113citing papers in PubMed, 7 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

113 citing papers in PubMed, 7 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Pooled it
  7. Pooled it
  8. Trial
  9. Evaluating large-scale propensity score adjustment when sample size is small.Journal of the American Medical Informatics Association : JAMIA · 2026
    Article
  10. Observational
  11. Article
  12. Observational
  13. Article
  14. Article
  15. Article
  16. Article
  17. Review
  18. Article
  19. Article
  20. Article

53 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Yuxi TianDepartment of Biomathematics, David Geffen School of Medicine at UCLA, University of California, Los Angeles, CA, USA.
Martijn J SchuemieEpidemiology Department, Janssen Research and Development LLC, Titusville, NJ, USA.
Marc A SuchardDepartment of Biomathematics, David Geffen School of Medicine at UCLA, University of California, Los Angeles, CA, USA.

Funding

Large Scale Observational Analytics for Health InformaticsF31LM012636 · NLM · UNIVERSITY OF CALIFORNIA LOS ANGELES · PI TIAN, YUXI · 2017 to 2019
$127k
NLM NIH HHS F31 LM012636
6 · The paper itself

Abstract

Background: Propensity score adjustment is a popular approach for confounding control in observational studies. Reliable frameworks are needed to determine relative propensity score performance in large-scale studies, and to establish optimal propensity score model selection methods. Methods: We detail a propensity score evaluation framework that includes synthetic and real-world data experiments. Our synthetic experimental design extends the 'plasmode' framework and simulates survival data under known effect sizes, and our real-world experiments use a set of negative control outcomes with presumed null effect sizes. In reproductions of two published cohort studies, we compare two propensity score estimation methods that contrast in their model selection approach: L1-regularized regression that conducts a penalized likelihood regression, and the 'high-dimensional propensity score' (hdPS) that employs a univariate covariate screen. We evaluate methods on a range of outcome-dependent and outcome-independent metrics. Results: L1-regularization propensity score methods achieve superior model fit, covariate balance and negative control bias reduction compared with the hdPS. Simulation results are mixed and fluctuate with simulation parameters, revealing a limitation of simulation under the proportional hazards framework. Including regularization with the hdPS reduces commonly reported non-convergence issues but has little effect on propensity score performance. Conclusions: L1-regularization incorporates all covariates simultaneously into the propensity score model and offers propensity score performance superior to the hdPS marginal screen.

Indexed as

Observational Studies as TopicPropensity ScoreResearch DesignAlgorithmsBiasConfounding Factors, EpidemiologicHumansLogistic ModelsSample Size

Identifiers

PMID29939268
PMCPMC6280944

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.