Evidence map›Paper›PMID 31674913›Full record

ArticleJMIR medical informatics2019

Identifying Opioid Use Disorder in the Emergency Department: Multi-System Electronic Health Record-Based Computable Phenotype Derivation and Validation Study.

David Chartash, Hyung Paek, James D Dziura, Bill K Ross, Daniel P Nogee, Eric Boccio, Cory Hines, Aaron M Schott, Molly M Jeffery, Mehul D Patel and 5 more

Abstract read
In one paragraph

Article in JMIR medical informatics, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 33 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
33citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

33 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Trial
  4. Trial
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Effect of emergency department opioid prescribing on health outcomes.CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne · 2025
    Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

15 authors.

David ChartashYale Center for Medical Informatics, Yale University School of Medicine, New Haven, CT, United States.ORCID https://orcid.org/0000-0002-0265-330X
Hyung PaekInformation Technology Services, Yale New Haven Health, New Haven, CT, United States.ORCID https://orcid.org/0000-0001-9523-0930
James D DziuraDepartment of Emergency Medicine, Yale University School of Medicine, New Haven, CT, United States.ORCID https://orcid.org/0000-0001-8953-6183
Bill K RossNorth Carolina Translational and Clinical Sciences Institute, University of North Carolina School of Medicine, Chapel Hill, NC, United States.ORCID https://orcid.org/0000-0002-5804-1249
Daniel P NogeeDepartment of Emergency Medicine, Yale University School of Medicine, New Haven, CT, United States.ORCID https://orcid.org/0000-0003-2708-8092
Eric BoccioDepartment of Emergency Medicine, Yale University School of Medicine, New Haven, CT, United States.ORCID https://orcid.org/0000-0003-1661-9695
Cory HinesDepartment of Emergency Medicine, University of North Carolina School of Medicine, Chapel Hill, NC, United States.ORCID https://orcid.org/0000-0001-9997-5358
Aaron M SchottDepartment of Emergency Medicine, University of North Carolina School of Medicine, Chapel Hill, NC, United States.ORCID https://orcid.org/0000-0002-0365-8022
Molly M JefferyDepartment of Emergency Medicine, Mayo Clinic, Rochester, MN, United States.ORCID https://orcid.org/0000-0003-3854-6810
Mehul D PatelDepartment of Emergency Medicine, University of North Carolina School of Medicine, Chapel Hill, NC, United States.ORCID https://orcid.org/0000-0002-1281-3207
Timothy F Platts-MillsDepartment of Emergency Medicine, University of North Carolina School of Medicine, Chapel Hill, NC, United States.ORCID https://orcid.org/0000-0002-9881-3194
Osama AhmedDepartment of Emergency Medicine, Yale University School of Medicine, New Haven, CT, United States.ORCID https://orcid.org/0000-0003-1492-9868
Cynthia BrandtYale Center for Medical Informatics, Yale University School of Medicine, New Haven, CT, United States.ORCID https://orcid.org/0000-0001-8179-1796
Katherine CouturierDepartment of Emergency Medicine, Yale University School of Medicine, New Haven, CT, United States.ORCID https://orcid.org/0000-0001-9744-3956
Edward MelnickDepartment of Emergency Medicine, Yale University School of Medicine, New Haven, CT, United States.ORCID https://orcid.org/0000-0002-6509-9537

Funding

Yale Clinical and Translational Science Award (U Component)UL1TR001863 · NCATS · YALE UNIVERSITY · PI John H. Krystal, LUCILA OHNO-MACHADO · 2016 to 2026
$102.9M
MEDICAL INFORMATICS RESEARCH TRAINING AT YALET15LM007056 · NLM · YALE UNIVERSITY · PI Mark Bender Gerstein, LUCILA OHNO-MACHADO · 1987 to 2026
$22.2M
NIH Health Care Systems Research Collaboratory-Coordinating Center (U24)U24AT009676 · NCCIH · DUKE UNIVERSITY · PI LESLEY H CURTIS, Adrian Hernandez · 2017 to 2026
$21.5M
EMBED: Pragmatic trial of user-centered clinical decision support to implement EMergency department-initiated BuprenorphinE for opioid use DisorderUH3DA047003 · NIDA · YALE UNIVERSITY · PI D'ONOFRIO, GAIL, MELNICK, EDWARD ROBERT · 2019 to 2022
$7.2M
EMBED: Pragmatic trial of user-centered clinical decision support to implement EMergency department-initiated BuprenorphinE for opioid use DisorderUG3DA047003 · NIDA · YALE UNIVERSITY · PI D'ONOFRIO, GAIL, MELNICK, EDWARD ROBERT · 2018 to 2018
$819k
NCATS NIH HHS UL1 TR001863NCCIH NIH HHS U24 AT009676NIDA NIH HHS UG3 DA047003NIDA NIH HHS UH3 DA047003NLM NIH HHS T15 LM007056
6 · The paper itself

Abstract

backgroundDeploying accurate computable phenotypes in pragmatic trials requires a trade-off between precise and clinically sensical variable selection. In particular, evaluating the medical encounter to assess a pattern leading to clinically significant impairment or distress indicative of disease is a difficult modeling challenge for the emergency department.

objectiveThis study aimed to derive and validate an electronic health record-based computable phenotype to identify emergency department patients with opioid use disorder using physician chart review as a reference standard.

methodsA two-algorithm computable phenotype was developed and evaluated using structured clinical data across 13 emergency departments in two large health care systems. Algorithm 1 combined clinician and billing codes. Algorithm 2 used chief complaint structured data suggestive of opioid use disorder. To evaluate the algorithms in both internal and external validation phases, two emergency medicine physicians, with a third acting as adjudicator, reviewed a pragmatic sample of 231 charts: 125 internal validation (75 positive and 50 negative), 106 external validation (56 positive and 50 negative).

resultsCohen kappa, measuring agreement between reviewers, for the internal and external validation cohorts was 0.95 and 0.93, respectively. In the internal validation phase, Algorithm 1 had a positive predictive value (PPV) of 0.96 (95% CI 0.863-0.995) and a negative predictive value (NPV) of 0.98 (95% CI 0.893-0.999), and Algorithm 2 had a PPV of 0.8 (95% CI 0.593-0.932) and an NPV of 1.0 (one-sided 97.5% CI 0.863-1). In the external validation phase, the phenotype had a PPV of 0.95 (95% CI 0.851-0.989) and an NPV of 0.92 (95% CI 0.807-0.978).

conclusionsThis phenotype detected emergency department patients with opioid use disorder with high predictive values and reliability. Its algorithms were transportable across health care systems and have potential value for both clinical and research purposes.

Indexed as

algorithmselectronic health recordsemergency medicineopioid-related disordersphenotype

Identifiers

PMID31674913
PMCPMC6913746

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.