Evidence map›Paper›PMID 30602031›Full record

Observational studyJournal of the American Medical Informatics Association : JAMIA2019

Natural language processing and machine learning to identify alcohol misuse from the electronic health record in trauma patients: development and internal validation.

Majid Afshar, Andrew Phillips, Niranjan Karnik, Jeanne Mueller, Daniel To, Richard Gonzalez, Ron Price, Richard Cooper, Cara Joyce, Dmitriy Dligach

Registry-linked trialOpen access · bronzeAbstract readObservational Study
In one paragraph

Observational study in Journal of the American Medical Informatics Association : JAMIA, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT03833804 (Data-driven Strategies for Substance Misuse Identification in Hospitalized Patients), which is not on this map. Cited by 52 papers, 6 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
52citing papers in PubMed, 6 pooled it
6.2field-weighted citation impact, top 3% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT03833804 nacompletednot on this mapstarted 2022, after this paper: background citation

Data-driven Strategies for Substance Misuse Identification in Hospitalized Patients

TypeinterventionalSponsorUniversity of Wisconsin, MadisonRan2022 to 2024Enrolled64,996ConditionsSubstance Use, Substance Abuse, Substance-Related DisordersArmsProcessing of clinical notes in the EHR data collected during routine care
3 · Its place in the literature

Who cites it

52 citing papers in PubMed, 6 syntheses or guidelines pooled it, 96 citations in OpenAlex.

  1. Pooled it
  2. Using natural language processing in emergency medicine health service research: A systematic review and meta-analysis.Academic emergency medicine : official journal of the Society for Academic Emergency Medicine · 2024
    Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Pooled it
  7. Article
  8. Review
  9. Review
  10. Article
  11. Article
  12. Article
  13. Article
  14. Review
  15. Article
  16. Review
  17. Article
  18. Article
  19. Article
  20. Observational
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors at 3 institutions in 1 country.

Majid AfsharHealth Sciences Division, Burn and Shock Trauma Research Institute, Stritch School of Medicine, Loyola University, Maywood, Illinois, USA.
Andrew PhillipsDepartment of Computer Science, Loyola University, Chicago, Illinois, USA.
Niranjan KarnikDepartment of Psychiatry, Rush University Medical Center, Chicago, Illinois, USA.
Jeanne MuellerDepartment of Surgery, Loyola University Medical Center, Maywood, Illinois, USA.
Daniel ToHealth Sciences Division, Burn and Shock Trauma Research Institute, Stritch School of Medicine, Loyola University, Maywood, Illinois, USA.
Richard GonzalezDepartment of Surgery, Loyola University Medical Center, Maywood, Illinois, USA.
Ron PriceHealth Sciences Division, Center for Health Outcomes and Informatics Research, Loyola University, Maywood, Illinois, USA.
Richard CooperDepartment of Computer Science, Loyola University, Chicago, Illinois, USA.
Cara JoyceHealth Sciences Division, Center for Health Outcomes and Informatics Research, Loyola University, Maywood, Illinois, USA.
Dmitriy DligachHealth Sciences Division, Center for Health Outcomes and Informatics Research, Loyola University, Maywood, Illinois, USA.
Loyola University Chicago · USLoyola University Medical Center · USRush University Medical Center · US

Funding

The Institute for Translational MedicineUL1TR002389 · NCATS · UNIVERSITY OF CHICAGO · PI Joshua J Jacobs, DAVID O MELTZER · 2017 to 2026
$71.6M
Quantifying How Cocaine Users Respond to Fentanyl Contamination in CocaineUG1DA049467 · NIDA · UNIVERSITY OF ILLINOIS AT CHICAGO · PI Niranjan Subhash Karnik, ANTONIO A MORGAN-LOPEZ · 2019 to 2026
$11.2M
Employing eSBI in a Community-based HIV Testing Environment for At-risk YouthR01DA041071 · NIDA · LURIE CHILDREN'S HOSPITAL OF CHICAGO · PI GAROFALO, ROBERT, KARNIK, NIRANJAN SUBHASH · 2015 to 2019
$3.2M
CHANGE OF GRANTEE INSTITUTION 1 K23 AA024503 Alcohol, Burn-Injury, and Acute Respiratory Distress SyndromeK23AA024503 · NIAAA · UNIVERSITY OF WISCONSIN-MADISON · PI AFSHAR, MAJID · 2016 to 2020
$948k
NCATS NIH HHS UL1 TR002389NIAAA NIH HHS K23 AA024503NIDA NIH HHS R01 DA041071NIDA NIH HHS UG1 DA049467
6 · The paper itself

Abstract

Objective: Alcohol misuse is present in over a quarter of trauma patients. Information in the clinical notes of the electronic health record of trauma patients may be used for phenotyping tasks with natural language processing (NLP) and supervised machine learning. The objective of this study is to train and validate an NLP classifier for identifying patients with alcohol misuse. Materials and Methods: An observational cohort of 1422 adult patients admitted to a trauma center between April 2013 and November 2016. Linguistic processing of clinical notes was performed using the clinical Text Analysis and Knowledge Extraction System. The primary analysis was the binary classification of alcohol misuse. The Alcohol Use Disorders Identification Test served as the reference standard. Results: The data corpus comprised 91 045 electronic health record notes and 16 091 features. In the final machine learning classifier, 16 features were selected from the first 24 hours of notes for identifying alcohol misuse. The classifier's performance in the validation cohort had an area under the receiver-operating characteristic curve of 0.78 (95% confidence interval [CI], 0.72 to 0.85). Sensitivity and specificity were at 56.0% (95% CI, 44.1% to 68.0%) and 88.9% (95% CI, 84.4% to 92.8%). The Hosmer-Lemeshow goodness-of-fit test demonstrates the classifier fits the data well (P = .17). A simpler rule-based keyword approach had a decrease in sensitivity when compared with the NLP classifier from 56.0% to 18.2%. Conclusions: The NLP classifier has adequate predictive validity for identifying alcohol misuse in trauma centers. External validation is needed before its application to augment screening.

Indexed as

Electronic Health RecordsMachine LearningNatural Language ProcessingTrauma CentersAdultAlcoholismCohort StudiesFemaleHumansMaleMiddle AgedROC CurveWounds and Injuries

Identifiers

PMID30602031
PMCPMC6657384
OpenAlexW2908358765

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.