Evidence map›Paper›PMID 39530748›Full record

ArticleJournal of the American Medical Informatics Association : JAMIA2025

Comparison of six natural language processing approaches to assessing firearm access in Veterans Health Administration electronic health records.

Joshua Trujeque, R Adams Dudley, Nathan Mesfin, Nicholas E Ingraham, Isai Ortiz, Ann Bangerter, Anjan Chakraborty, Dalton Schutte, Jeremy Yeung, Ying Liu and 5 more

Abstract readComparative Study
In one paragraph

Article in Journal of the American Medical Informatics Association : JAMIA, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed.

  1. Article
  2. Article
  3. Firearm injury risk detection and prevention.Journal of the American Medical Informatics Association : JAMIA · 2024
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

15 authors.

Joshua TrujequeDivision of Pulmonary, Allergy, Critical Care and Sleep Medicine, Department of Medicine, University of Minnesota Medical School, Minneapolis, MN 55455, United States.ORCID 0000-0003-0882-463X
R Adams DudleyDivision of Pulmonary, Allergy, Critical Care and Sleep Medicine, Department of Medicine, University of Minnesota Medical School, Minneapolis, MN 55455, United States.
Nathan MesfinDivision of Pulmonary, Allergy, Critical Care and Sleep Medicine, Department of Medicine, University of Minnesota Medical School, Minneapolis, MN 55455, United States.
Nicholas E IngrahamDivision of Pulmonary, Allergy, Critical Care and Sleep Medicine, Department of Medicine, University of Minnesota Medical School, Minneapolis, MN 55455, United States.ORCID 0000-0002-0292-0594
Isai OrtizMedical School, University of Minnesota, Minneapolis, MN 55455, United States.ORCID 0009-0005-0407-2559
Ann BangerterCenter for Care Delivery and Outcomes Research (CCDOR), Veterans Affairs (VA) Minneapolis Healthcare System, Minneapolis, MN 55417, United States.
Anjan ChakrabortyCenter for Care Delivery and Outcomes Research (CCDOR), Veterans Affairs (VA) Minneapolis Healthcare System, Minneapolis, MN 55417, United States.
Dalton SchutteDepartment of Surgery, University of Minnesota, Minneapolis, MN 55455, United States.
Jeremy YeungInstitute for Health Informatics, University of Minnesota, Minneapolis, MN 55455, United States.
Ying LiuDepartment of Surgery, University of Minnesota, Minneapolis, MN 55455, United States.
Alicia Woodward-AbelCenter for Care Delivery and Outcomes Research (CCDOR), Veterans Affairs (VA) Minneapolis Healthcare System, Minneapolis, MN 55417, United States.
Emma BromleyCenter for Care Delivery and Outcomes Research (CCDOR), Veterans Affairs (VA) Minneapolis Healthcare System, Minneapolis, MN 55417, United States.
Rui ZhangDepartment of Surgery, University of Minnesota, Minneapolis, MN 55455, United States.ORCID 0000-0001-8258-3585
Lisa A BrennerRocky Mountain Mental Illness Research, Education and Clinical Center for Suicide Prevention, Rocky Mountain Regional VAMC (RMR VAMC), Aurora, CO 80045, United States.
Joseph A SimonettiRocky Mountain Mental Illness Research, Education and Clinical Center for Suicide Prevention, Rocky Mountain Regional VAMC (RMR VAMC), Aurora, CO 80045, United States.

Funding

TRAINING-PULMONARY CELL &MOLECULAR BIOLOGY &PHYSIOLOGYT32HL007741 · NHLBI · UNIVERSITY OF MINNESOTA TWIN CITIES · PI DUDLEY, R. ADAMS, INGBAR, DAVID H · 1994 to 2023
$13.9M
Racial disparities in access to kidney transplantationR01DK115629 · NIDDK · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI R. Adams Dudley, KIRSTEN L. JOHANSEN · 2018 to 2026
$4.5M
Detecting synergistic effects of pharmacological and non-pharmacological interventions for AD/ADRDR01AG078154 · NIA · UNIVERSITY OF MINNESOTA · PI HUA XU, RUI ZHANG · 2022 to 2026
$4.2M
A Translational Informatics Framework to Mine Efficacy and Safety of Dietary SupplementsR01AT009457 · NCCIH · UNIVERSITY OF MINNESOTA · PI RUI ZHANG · 2017 to 2026
$4.1M
SCH: A New Computational Framework for Learning from Imbalanced Biomedical DataR01CA287413 · NCI · UNIVERSITY OF MINNESOTA · PI CUI, YING, SUN, JU · 2023 to 2025
$1.2M
Identifying Areas to Improve ICU Outcomes through Provider VariationK23HL166783 · NHLBI · UNIVERSITY OF MINNESOTA · PI Nicholas E Ingraham · 2023 to 2026
$645k
Mining minority enriched AllofUs data for innovative ethnic specific risk prediction modelingR21MD019134 · NIMHD · UNIVERSITY OF MINNESOTA · PI HOU, JUE, WANG, JINHUA · 2023 to 2024
$436k
AHRQ HHS P30 HS029744AHRQ HHS P30HS029744Career Development #1IK2HX002861-01A2Centers for Disease Control and Prevention Office of Forecasting and AnalysisDepartment of Veterans Affairs Office of Suicide PreventionHealth Services Research and Development ServiceHSRD VA IK2 HX002861NCCIH NIH HHS R01 AT009457NCCIH NIH HHS R01AT009457NCI NIH HHS R01 CA287413NCI NIH HHS R01CA287413NHLBI NIH HHS K23 HL166783NHLBI NIH HHS K23HL166783NHLBI NIH HHS T32 HL007741NHLBI NIH HHS T32 HL07741NIA NIH HHS R01 AG078154NIA NIH HHS R01AG078154NIDDK NIH HHS R01 DK115629NIDDK NIH HHS R01DK115629NIHNIHMD R21MD019134University of Minnesota Medical School and Clinical and Translational Science InstituteU.S. Department of Veterans Affairs Office of Suicide PreventionVAVA HSR&D
6 · The paper itself

Abstract

objectiveAccess to firearms is associated with increased suicide risk. Our aim was to develop a natural language processing approach to characterizing firearm access in clinical records. MATERIALS AND

methodsWe used clinical notes from 36 685 Veterans Health Administration (VHA) patients between April 10, 2023 and April 10, 2024. We expanded preexisting firearm term sets using subject matter experts and generated 250-character snippets around each firearm term appearing in notes. Annotators labeled 3000 snippets into three classes. Using these annotated snippets, we compared four nonneural machine learning models (random forest, bagging, gradient boosting, logistic regression with ridge penalization) and two versions of Bidirectional Encoder Representations from Transformers, or BERT (specifically, BioBERT and Bio-ClinicalBERT) for classifying firearm access as "definite access", "definitely no access", or "other".

resultsFirearm terms were identified in 36 685 patient records (41.3%), 33.7% of snippets were categorized as definite access, 9.0% as definitely no access, and 57.2% as "other". Among models classifying firearm access, five of six had acceptable performance, with BioBERT and Bio-ClinicalBERT performing best, with F1s of 0.876 (95% confidence interval, 0.874-0.879) and 0.896 (95% confidence interval, 0.894-0.899), respectively. DISCUSSION AND

conclusionFirearm-related terminology is common in the clinical records of VHA patients. The ability to use text to identify and characterize patients' firearm access could enhance suicide prevention efforts, and five of our six models could be used to identify patients for clinical interventions.

Indexed as

Electronic Health RecordsFirearmsMachine LearningNatural Language ProcessingUnited States Department of Veterans AffairsFemaleHumansLogistic ModelsMaleMiddle AgedSuicideUnited StatesfirearmgunNLPsuicideveteran

Identifiers

PMID39530748
PMCPMC11648724

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.