Evidence map›Paper›PMID 35092316›Full record

ArticlePharmacoepidemiology and drug safety2022

Transparency of high-dimensional propensity score analyses: Guidance for diagnostics and reporting.

John Tazare, Richard Wyss, Jessica M Franklin, Liam Smeeth, Stephen J W Evans, Shirley V Wang, Sebastian Schneeweiss, Ian J Douglas, Joshua J Gagne, Elizabeth J Williamson

Abstract read
In one paragraph

Article in Pharmacoepidemiology and drug safety, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 16 papers.

0numbers the graph read from it
0cells of the map it votes in
16citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

16 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Observational
  10. Article
  11. Application of High-Dimensional Propensity Score Methods to the National Health and Aging Trends Study.The journals of gerontology. Series A, Biological sciences and medical sciences · 2024
    Article
  12. Article
  13. Article
  14. Article
  15. Review
  16. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

John TazareFaculty of Epidemiology and Population Health, London School of Hygiene and Tropical Medicine, London, UK.ORCID 0000-0002-7194-2615
Richard WyssDivision of Pharmacoepidemiology and Pharmacoeconomics, Brigham and Women's Hospital and Harvard Medical School, Boston, Massachusetts, USA.
Jessica M FranklinDivision of Pharmacoepidemiology and Pharmacoeconomics, Brigham and Women's Hospital and Harvard Medical School, Boston, Massachusetts, USA.ORCID 0000-0002-8941-4116
Liam SmeethFaculty of Epidemiology and Population Health, London School of Hygiene and Tropical Medicine, London, UK.
Stephen J W EvansFaculty of Epidemiology and Population Health, London School of Hygiene and Tropical Medicine, London, UK.
Shirley V WangDivision of Pharmacoepidemiology and Pharmacoeconomics, Brigham and Women's Hospital and Harvard Medical School, Boston, Massachusetts, USA.ORCID 0000-0001-7761-7090
Sebastian SchneeweissDivision of Pharmacoepidemiology and Pharmacoeconomics, Brigham and Women's Hospital and Harvard Medical School, Boston, Massachusetts, USA.ORCID 0000-0003-2575-467X
Ian J DouglasFaculty of Epidemiology and Population Health, London School of Hygiene and Tropical Medicine, London, UK.
Joshua J GagneDivision of Pharmacoepidemiology and Pharmacoeconomics, Brigham and Women's Hospital and Harvard Medical School, Boston, Massachusetts, USA.
Elizabeth J WilliamsonFaculty of Epidemiology and Population Health, London School of Hygiene and Tropical Medicine, London, UK.

Funding

Medical Research Council MR/M013278/1Medical Research Council MR/S01442X/1
6 · The paper itself

Abstract

purposeThe high-dimensional propensity score (HDPS) is a semi-automated procedure for confounder identification, prioritisation and adjustment in large healthcare databases that requires investigators to specify data dimensions, prioritisation strategy and tuning parameters. In practice, reporting of these decisions is inconsistent and this can undermine the transparency, and reproducibility of results obtained. We illustrate reporting tools, graphical displays and sensitivity analyses to increase transparency and facilitate evaluation of the robustness of analyses involving HDPS.

methodsUsing a study from the UK Clinical Practice Research Datalink that implemented HDPS we demonstrate the application of the proposed recommendations.

resultsWe identify seven considerations surrounding the implementation of HDPS, such as the identification of data dimensions, method for code prioritisation and number of variables selected. Graphical diagnostic tools include assessing the balance of key confounders before and after adjusting for empirically selected HDPS covariates and the identification of potentially influential covariates. Sensitivity analyses include varying the number of covariates selected and assessing the impact of covariates behaving empirically as instrumental variables. In our example, results were robust to both the number of covariates selected and the inclusion of potentially influential covariates. Furthermore, our HDPS models achieved good balance in key confounders.

conclusionsThe data-adaptive approach of HDPS and the resulting benefits have led to its popularity as a method for confounder adjustment in pharmacoepidemiological studies. Reporting of HDPS analyses in practice may be improved by the considerations and tools proposed here to increase the transparency and reproducibility of study results.

Indexed as

AlgorithmsPharmacoepidemiologyConfounding Factors, EpidemiologicHumansPropensity ScoreReproducibility of Resultsconfounder adjustmentdatabase researchdiagnosticshigh dimensional propensity scorereporting

Identifiers

PMID35092316
PMCPMC9305520

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.