Evidence map›Paper›PMID 38904459›Full record

ArticleAmerican journal of epidemiology2025

Simple graphical rules for assessing selection bias in general-population and selected-sample treatment effects.

Maya B Mathur, Ilya Shpitser

Abstract read
In one paragraph

Article in American journal of epidemiology, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 9 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
9citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

9 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Observational
  4. Article
  5. Article
  6. Revisiting representativeness.International journal of epidemiology · 2025
    Article
  7. Pitfalls of imputing using incomplete auxiliary variables.American journal of epidemiology · 2025
    Article
  8. Article
  9. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

2 authors.

Maya B MathurQuantitative Sciences Unit, Department of Medicine, School of Medicine, Stanford University, Palo Alto, CA 94304, United States.
Ilya ShpitserDepartment of Computer Science, Whiting School of Engineering, Johns Hopkins University, Baltimore, MD 21218, United States.

Funding

Translational Oncology Research Program (Project-005)P30CA124435 · NCI · STANFORD UNIVERSITY · PI MICHAEL KENNEY · 2007 to 2026
$71.4M
Stanford Center for Clinical & Translational Education and Research (Spectrum)UL1TR003142 · NCATS · STANFORD UNIVERSITY · PI O'HARA, RUTH M · 2019 to 2023
$45.0M
Stanford Islet Research CoreP30DK116074 · NIDDK · STANFORD UNIVERSITY · PI Seung K Kim · 2017 to 2026
$19.5M
Statistical Methods for Modern Evidence Syntheses with Multiple BiasesR01LM013866 · NLM · STANFORD UNIVERSITY · PI MATHUR, MAYA · 2021 to 2024
$1.3M
NCATS NIH HHS UL1 TR003142NCI NIH HHS P30 CA124435NIDDK NIH HHS P30 DK116074NIH HHS P30DK116074NLM NIH HHS R01 LM013866
6 · The paper itself

Abstract

When analyzing a selected sample from a general population, selection bias can arise relative to the causal average treatment effect (ATE) for the general population, and also relative to the ATE for the selected sample itself. In this paper, we provide simple graphical rules that indicate (1) whether a selected-sample analysis will be unbiased for each ATE and (2) whether adjusting for certain covariates could eliminate selection bias. The rules can easily be checked in a standard single-world intervention graph. When the treatment could affect selection, a third estimand of potential scientific interest is the "net treatment difference"-namely the net change in outcomes that would occur for the selected sample if all members of the general population were treated versus not treated, including any effects of the treatment on which individuals are in the selected sample. We provide graphical rules for this estimand as well. We decompose bias in a selected-sample analysis relative to the general-population ATE into (1) "internal bias" relative to the net treatment difference and (2) "net-external bias," a discrepancy between the net treatment difference and the general-population ATE. Each bias can be assessed unambiguously via a distinct graphical rule, providing new conceptual insight into the mechanisms by which certain causal structures produce selection bias.

Indexed as

Data Interpretation, StatisticalSelection BiasHumanscausal inferencecollider stratificationeffect-measure modificationgeneralizabilitymissing datasingle-world intervention graphs

Identifiers

PMID38904459
PMCPMC11735978

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.