Evidence map›Paper›PMID 37428897›Full record

ArticleJournal of the American Medical Informatics Association : JAMIA2023

A call for better validation of opioid overdose risk algorithms.

Duncan C McElfresh, Lucia Chen, Elizabeth Oliva, Vilija Joyce, Sherri Rose, Suzanne Tamang

Abstract read
In one paragraph

Article in Journal of the American Medical Informatics Association : JAMIA, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 4 papers.

0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

4 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Duncan C McElfreshDepartment of Health Policy, Stanford University, Stanford, California, USA.
Lucia ChenDepartment of Health Policy, Stanford University, Stanford, California, USA.
Elizabeth OlivaProgram Evaluation Resource Center, Office of Mental Health and Suicide Prevention, US Department of Veterans Affairs, Menlo Park, California, USA.
Vilija JoyceProgram Evaluation Resource Center, Office of Mental Health and Suicide Prevention, US Department of Veterans Affairs, Menlo Park, California, USA.
Sherri RoseDepartment of Health Policy, Stanford University, Stanford, California, USA.
Suzanne TamangProgram Evaluation Resource Center, Office of Mental Health and Suicide Prevention, US Department of Veterans Affairs, Menlo Park, California, USA.

Funding

A Framework for the Social Impact of Algorithms in Health CareDP1LM014278 · NLM · STANFORD UNIVERSITY · PI Sherri Rose · 2022 to 2026
$5.4M
Stanford Medicine Center for Longevity and Healthy Aging Research Education CoreP30AG059307 · NIA · STANFORD UNIVERSITY · PI PERIYAKOIL, VYJEYANTHI S, YESAVAGE, JEROME A · 2018 to 2025
$4.9M
NIA NIH HHS P30 AG059307NIH HHS DP1LM014278NLM NIH HHS DP1 LM014278
6 · The paper itself

Abstract

Clinical decision support (CDS) systems powered by predictive models have the potential to improve the accuracy and efficiency of clinical decision-making. However, without sufficient validation, these systems have the potential to mislead clinicians and harm patients. This is especially true for CDS systems used by opioid prescribers and dispensers, where a flawed prediction can directly harm patients. To prevent these harms, regulators and researchers have proposed guidance for validating predictive models and CDS systems. However, this guidance is not universally followed and is not required by law. We call on CDS developers, deployers, and users to hold these systems to higher standards of clinical and technical validation. We provide a case study on two CDS systems deployed on a national scale in the United States for predicting a patient's risk of adverse opioid-related events: the Stratification Tool for Opioid Risk Mitigation (STORM), used by the Veterans Health Administration, and NarxCare, a commercial system.

Indexed as

AlgorithmsAnalgesics, OpioidDecision Support Systems, ClinicalOpiate OverdoseHumansRisk AssessmentUnited StatesUnited States Department of Veterans AffairsAnalgesics, Opioidalgorithmic safetyartificial intelligenceclinical decision supportopioid use disorderpredictive modeling

Identifiers

PMID37428897
PMCPMC10531142

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.