Evidence map›Paper›PMID 35623798›Full record

ArticleThe Lancet. Digital health2022

Developing and validating a machine-learning algorithm to predict opioid overdose in Medicaid beneficiaries in two US states: a prognostic modelling study.

Wei-Hsuan Lo-Ciganic, Julie M Donohue, Qingnan Yang, James L Huang, Ching-Yuan Chang, Jeremy C Weiss, Jingchuan Guo, Hao H Zhang, Gerald Cochran, Adam J Gordon and 5 more

2 registry-linked trialsAbstract read
In one paragraph

Article in The Lancet. Digital health, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to 2 registered trials, which are not on this map. Cited by 39 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
39citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT06806163 narecruitingnot on this mapstarted 2025, after this paper: background citation

Machine-Learning Prediction and Reducing Overdoses With EHR Nudges

TypeinterventionalSponsorUniversity of PittsburghRan2025 to 2027Enrolled1,350ConditionsOpioid Overdose, Opioid Use, Opioid Use Disorder, OpioidsArmsEHR-Embedded Elevated-Risk Flag, EHR-Embedded Elevated-Risk Flag with Behavioral Nudges, Usual Care
NCT06810076 naactive not recruitingnot on this mapstarted 2025, after this paper: background citation

Developing and Evaluating a Machine-Learning Opioid Prediction & Risk-Stratification E-Platform (DEMONSTRATE)

TypeinterventionalSponsorUniversity of PittsburghRan2025 to 2026Enrolled674ConditionsOpiate Overdose, Opioid-Related Disorders, Narcotic-Related Disorders, Substance-related DisordersArmsMachine Learning-Based Clinical Decision Support: Overdose Prevention Alert (OPA) Intervention
3 · Its place in the literature

Who cites it

39 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Article
  4. Article
  5. Opioid Overdose Death Prediction with Graph Neural Networks.medRxiv : the preprint server for health sciences · 2026
    Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Opioid Overdose Death Prediction with Graph Neural Networks.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2026
    Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

15 authors.

Wei-Hsuan Lo-CiganicDepartment of Pharmaceutical Outcomes and Policy, College of Pharmacy, University of Florida, Gainesville, FL, USA; Center for Drug Evaluation and Safety, College of Pharmacy, University of Florida, Gainesville, FL, USA. Electronic address: wlociganic@cop.ufl.edu.
Julie M DonohueDepartment of Health Policy and Management, Graduate School of Public Health, University of Pittsburgh, Pittsburgh, PA, USA; Center for Pharmaceutical Policy and Prescribing, Health Policy Institute, University of Pittsburgh, Pittsburgh, PA, USA.
Qingnan YangCenter for Pharmaceutical Policy and Prescribing, Health Policy Institute, University of Pittsburgh, Pittsburgh, PA, USA.
James L HuangDepartment of Pharmaceutical Outcomes and Policy, College of Pharmacy, University of Florida, Gainesville, FL, USA.
Ching-Yuan ChangDepartment of Pharmaceutical Outcomes and Policy, College of Pharmacy, University of Florida, Gainesville, FL, USA.
Jeremy C WeissHeinz College of Information Systems and Public Policy, Carnegie Mellon University, Pittsburgh, PA, USA.
Jingchuan GuoDepartment of Pharmaceutical Outcomes and Policy, College of Pharmacy, University of Florida, Gainesville, FL, USA; Center for Drug Evaluation and Safety, College of Pharmacy, University of Florida, Gainesville, FL, USA; Center for Pharmaceutical Policy and Prescribing, Health Policy Institute, University of Pittsburgh, Pittsburgh, PA, USA.
Hao H ZhangDepartment of Mathematics, University of Arizona, Tucson, AZ, USA.
Gerald CochranProgram for Addiction Research, Clinical Care, Knowledge, and Advocacy, Division of Epidemiology, Department of Internal Medicine, University of Utah, Salt Lake City, UT, USA.
Adam J GordonProgram for Addiction Research, Clinical Care, Knowledge, and Advocacy, Division of Epidemiology, Department of Internal Medicine, University of Utah, Salt Lake City, UT, USA; Informatics, Decision-Enhancement, and Analytic Sciences Center, Veterans Affairs Salt Lake City Health Care System, Salt Lake City, UT, USA.
Daniel C MaloneDepartment of Pharmacotherapy, College of Pharmacy, University of Utah, Salt Lake City, UT, USA.
Chian K KwohDivision of Rheumatology, Department of Medicine, and the University of Arizona Arthritis Center, University of Arizona, Tucson, AZ, USA.
Debbie L WilsonDepartment of Pharmaceutical Outcomes and Policy, College of Pharmacy, University of Florida, Gainesville, FL, USA.
Courtney C KuzaCenter for Pharmaceutical Policy and Prescribing, Health Policy Institute, University of Pittsburgh, Pittsburgh, PA, USA.
Walid F GelladCenter for Pharmaceutical Policy and Prescribing, Health Policy Institute, University of Pittsburgh, Pittsburgh, PA, USA; Division of General Internal Medicine, School of Medicine, University of Pittsburgh, Pittsburgh, PA, USA; Center for Health Equity Research Promotion, Veterans Affairs Pittsburgh Healthcare System, Pittsburgh, PA, USA.

Funding

Using Machine Learning to Predict Problematic Prescription Opioid Use and Opioid OverdoseR01DA044985 · NIDA · UNIVERSITY OF PITTSBURGH AT PITTSBURGH · PI Walid F. Gellad · 2017 to 2026
$5.4M
Linking VA and non-VA data to study the risk of suicide in chronic pain patients.R01MH121907 · NIMH · WEILL MEDICAL COLL OF CORNELL UNIV · PI OSLIN, DAVID W., PATHAK, JYOTISHMAN · 2020 to 2024
$3.6M
Developing and Evaluating a Machine-Learning Opioid Prediction & Risk-Stratification E-Platform (DEMONSTRATE)R01DA050676 · NIDA · UNIVERSITY OF PITTSBURGH AT PITTSBURGH · PI LO-CIGANIC, WEI-HSUAN JENNY · 2021 to 2025
$3.2M
Using a predicting Risky Opioid-Benzodiazepine Trajectory e-Care Tool (PROTeCT) to identify high-risk regionsR21AG060308 · NIA · UNIVERSITY OF FLORIDA · PI LO-CIGANIC, WEI-HSUAN · 2019 to 2020
$523k
Depression Treatment and Outcomes among Older Adults with Dementia in the United StatesR03MH114503 · NIMH · UNIVERSITY OF ARIZONA · PI BHATTACHARJEE, SANDIPAN · 2017 to 2018
$154k
HSRD VA I01 HX002191NIA NIH HHS R21 AG060308NIDA NIH HHS R01 DA044985NIDA NIH HHS R01 DA050676NIMH NIH HHS R01 MH121907NIMH NIH HHS R03 MH114503
6 · The paper itself

Abstract

backgroundLittle is known about whether machine-learning algorithms developed to predict opioid overdose using earlier years and from a single state will perform as well when applied to other populations. We aimed to develop a machine-learning algorithm to predict 3-month risk of opioid overdose using Pennsylvania Medicaid data and externally validated it in two data sources (ie, later years of Pennsylvania Medicaid data and data from a different state).

methodsThis prognostic modelling study developed and validated a machine-learning algorithm to predict overdose in Medicaid beneficiaries with one or more opioid prescription in Pennsylvania and Arizona, USA. To predict risk of hospital or emergency department visits for overdose in the subsequent 3 months, we measured 284 potential predictors from pharmaceutical and health-care encounter claims data in 3-month periods, starting 3 months before the first opioid prescription and continuing until loss to follow-up or study end. We developed and internally validated a gradient-boosting machine algorithm to predict overdose using 2013-16 Pennsylvania Medicaid data (n=639 693). We externally validated the model using (1) 2017-18 Pennsylvania Medicaid data (n=318 585) and (2) 2015-17 Arizona Medicaid data (n=391 959). We reported several prediction performance metrics (eg, C-statistic, positive predictive value). Beneficiaries were stratified into risk-score subgroups to support clinical use.

findingsA total of 8641 (1·35%) 2013-16 Pennsylvania Medicaid beneficiaries, 2705 (0·85%) 2017-18 Pennsylvania Medicaid beneficiaries, and 2410 (0·61%) 2015-17 Arizona beneficiaries had one or more overdose during the study period. C-statistics for the algorithm predicting 3-month overdoses developed from the 2013-16 Pennsylvania training dataset and validated on the 2013-16 Pennsylvania internal validation dataset, 2017-18 Pennsylvania external validation dataset, and 2015-17 Arizona external validation dataset were 0·841 (95% CI 0·835-0·847), 0·828 (0·822-0·834), and 0·817 (0·807-0·826), respectively. In external validation datasets, 71 361 (22·4%) of 318 585 2017-18 Pennsylvania beneficiaries were in high-risk subgroups (positive predictive value of 0·38-4·08%; capturing 73% of overdoses in the subsequent 3 months) and 40 041 (10%) of 391 959 2015-17 Arizona beneficiaries were in high-risk subgroups (positive predictive value of 0·19-1·97%; capturing 55% of overdoses). Lower risk subgroups in both validation datasets had few individuals (≤0·2%) with an overdose.

interpretationA machine-learning algorithm predicting opioid overdose derived from Pennsylvania Medicaid data performed well in external validation with more recent Pennsylvania data and with Arizona Medicaid data. The algorithm might be valuable for overdose risk prediction and stratification in Medicaid beneficiaries.

fundingNational Institute of Health, National Institute on Drug Abuse, National Institute on Aging.

Indexed as

Drug OverdoseOpiate OverdoseAlgorithmsAnalgesics, OpioidHumansMachine LearningMedicaidPrognosisUnited StatesAnalgesics, Opioid

Identifiers

PMID35623798
PMCPMC9236281

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.