Evidence map›Paper›PMID 33883971›Full record

ArticleHealth services & outcomes research methodology2021

Methodological Challenges and Proposed Solutions for Evaluating Opioid Policy Effectiveness.

Megan S Schuler, Beth Ann Griffin, Magdalena Cerdá, Emma E McGinty, Elizabeth A Stuart

Abstract read
In one paragraph

Article in Health services & outcomes research methodology, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 31 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
31citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

31 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Review
  7. Article
  8. Improving Policy Evaluations Of The Opioid Crisis.Health affairs (Project Hope) · 2025
    Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Drug-related physician continuing medical education requirements, 2010-2020.Journal of substance use and addiction treatment · 2024
    Article
  15. Article
  16. Article
  17. Article
  18. An integrated abundance model for estimating county-level prevalence of opioid misuse in Ohio.Journal of the Royal Statistical Society. Series A, (Statistics in Society) · 2023
    Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Megan S SchulerRAND Corporation, 20 Park Plaza #920, Boston MA USA 02216.
Beth Ann GriffinRAND Corporation, 1200 S Hayes Street, Arlington VA USA 22202.
Magdalena CerdáDepartment of Population Health, NYU Grossman School of Medicine, 180 Madison Avenue 4-16, New York NY USA 10016.
Emma E McGintyDepartment of Health Policy and Management, Johns Hopkins Bloomberg School of Public Health, 624 N. Broadway, Baltimore MD USA 21205.
Elizabeth A StuartDepartment of Mental Health, Johns Hopkins Bloomberg School of Public Health, 624 N. Broadway, Baltimore MD USA 21205.

Funding

Optimal Methods for Estimating Policy Effect Heterogeneity in Opioid Policy ResearchP50DA046351 · NIDA · RAND CORPORATION · PI BRADLEY D STEIN · 2018 to 2026
$20.8M
Examining the Synergistic Effects of Cannabis and Prescription Opioid Policies on Chronic Pain, Opioid Prescribing, and Opioid OverdoseR01DA045872 · NIDA · NEW YORK UNIVERSITY SCHOOL OF MEDICINE · PI CERDA, MAGDALENA, MARTINS, SILVIA SABOIA · 2019 to 2023
$4.3M
An Evaluation of State Laws Intended to Curb High-Risk Opioid PrescribingR01DA044987 · NIDA · JOHNS HOPKINS UNIVERSITY · PI MCGINTY, EMMA ELIZABETH, RUTKOW, HELAINE · 2017 to 2020
$1.6M
NIDA NIH HHS P50 DA046351NIDA NIH HHS R01 DA044987NIDA NIH HHS R01 DA045872
6 · The paper itself

Abstract

Opioid-related mortality increased by nearly 400% between 2000 and 2018. In response, federal, state, and local governments have enacted a heterogeneous collection of opioid-related policies in an effort to reverse the opioid crisis, producing a policy landscape that is both complex and dynamic. Correspondingly, there has been a rise in opioid-policy related evaluation studies, as policymakers and other stakeholders seek to understand which policies are most effective. In this paper, we provide an overview of methodological challenges facing opioid policy researchers when evaluating the effects of opioid policies using observational data, as well as some potential solutions to those challenges. In particular, we discuss the following key challenges: (1) Obtaining high-quality opioid policy data; (2) Appropriately operationalizing and specifying opioid policies; (3) Obtaining high-quality opioid outcome data; (4) Addressing confounding due to systematic differences between policy and non-policy states; (5) Identifying heterogeneous policy effects across states, population subgroups, and time; (6) Disentangling effects of concurrent policies; and (7) Overcoming limited statistical power to detect policy effects afforded by commonly-used methods. We discuss each of these challenges and propose some ways forward to address them. Increasing the methodological rigor of opioid evaluation studies is imperative to identifying and implementing opioid policies that are most effective at reducing opioid-related harms.

Indexed as

data qualityopioid policyselection biasstatistical methodologytreatment heterogeneity

Identifiers

PMID33883971
PMCPMC8057700

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.