Evidence map›Paper›PMID 31890846›Full record

ArticleSSM - population health2020

Alternative causal inference methods in population health research: Evaluating tradeoffs and triangulating evidence.

Ellicott C Matthay, Erin Hagan, Laura M Gottlieb, May Lynn Tan, David Vlahov, Nancy E Adler, M Maria Glymour

Abstract read
In one paragraph

Article in SSM - population health, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 39 papers, 4 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
39citing papers in PubMed, 4 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

39 citing papers in PubMed, 4 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Article
  6. Article
  7. Causal Inference in Health Disparities Research.Annual review of public health · 2026
    Review
  8. Review
  9. Article
  10. Toward New Directions in Human Biology: A Roadmap for Anthropological Causal Inference With Observational Data.American journal of human biology : the official journal of the Human Biology Council · 2025
    Article
  11. Evidence triangulation in health research.European journal of epidemiology · 2025
    Article
  12. Observational
  13. Article
  14. Causal Effect of Smoking and Cessation on Tooth Loss.Journal of clinical periodontology · 2025
    Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Ellicott C MatthayCenter for Health and Community, University of California, San Francisco, 3333, California St, Suite, 465, Campus Box 0844, San Francisco, CA, 94143-0844, USA.
Erin HaganCenter for Health and Community, University of California, San Francisco, 3333, California St, Suite, 465, Campus Box 0844, San Francisco, CA, 94143-0844, USA.
Laura M GottliebCenter for Health and Community, University of California, San Francisco, 3333, California St, Suite, 465, Campus Box 0844, San Francisco, CA, 94143-0844, USA.
May Lynn TanCenter for Health and Community, University of California, San Francisco, 3333, California St, Suite, 465, Campus Box 0844, San Francisco, CA, 94143-0844, USA.
David VlahovYale School of Nursing at Yale University, 400 West Campus Drive, Room 32306, Orange, CT, 06477, USA.
Nancy E AdlerCenter for Health and Community, University of California, San Francisco, 3333, California St, Suite, 465, Campus Box 0844, San Francisco, CA, 94143-0844, USA.
M Maria GlymourCenter for Health and Community, University of California, San Francisco, 3333, California St, Suite, 465, Campus Box 0844, San Francisco, CA, 94143-0844, USA.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Population health researchers from different fields often address similar substantive questions but rely on different study designs, reflecting their home disciplines. This is especially true in studies involving causal inference, for which semantic and substantive differences inhibit interdisciplinary dialogue and collaboration. In this paper, we group nonrandomized study designs into two categories: those that use confounder-control (such as regression adjustment or propensity score matching) and those that rely on an instrument (such as instrumental variables, regression discontinuity, or differences-in-differences approaches). Using the Shadish, Cook, and Campbell framework for evaluating threats to validity, we contrast the assumptions, strengths, and limitations of these two approaches and illustrate differences with examples from the literature on education and health. Across disciplines, all methods to test a hypothesized causal relationship involve unverifiable assumptions, and rarely is there clear justification for exclusive reliance on one method. Each method entails trade-offs between statistical power, internal validity, measurement quality, and generalizability. The choice between confounder-control and instrument-based methods should be guided by these tradeoffs and consideration of the most important limitations of previous work in the area. Our goals are to foster common understanding of the methods available for causal inference in population health research and the tradeoffs between them; to encourage researchers to objectively evaluate what can be learned from methods outside one's home discipline; and to facilitate the selection of methods that best answer the investigator's scientific questions.

Indexed as

Causal inferenceEconometricsEpidemiologic methodsInstrumental variableQuasi-experimentThreats to validity

Identifiers

PMID31890846
PMCPMC6926350

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.