Evidence map›Paper›PMID 34351894›Full record

ArticlePLoS medicine2021

Development and validation of the Durham Risk Score for estimating suicide attempt risk: A prospective cohort analysis.

Nathan A Kimbrel, Jean C Beckham, Patrick S Calhoun, Bryann B DeBeer, Terence M Keane, Daniel J Lee, Brian P Marx, Eric C Meyer, Sandra B Morissette, Eric B Elbogen

Open access · goldAbstract readValidation Study
In one paragraph

Article in PLoS medicine, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 6 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
6citing papers in PubMed, 1 pooled it
1.0field-weighted citation impact, top 21% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

6 citing papers in PubMed, 1 synthesis or guideline pooled it, 9 citations in OpenAlex.

  1. Pooled it
  2. Article
  3. Evaluation of the critical warzone experiences scale among Gulf War I-era veterans: Associations with PTSD symptoms, depressive symptoms, and suicidal thoughts and behaviors.Military psychology : the official journal of the Division of Military Psychology, American Psychological Association · 2025
    Article
  4. Article
  5. Article
  6. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors at 5 institutions in 1 country.

Nathan A KimbrelDurham Veterans Affairs (VA) Health Care System, Durham, North Carolina, United States of America.ORCID 0000-0001-7218-1005
Jean C BeckhamDurham Veterans Affairs (VA) Health Care System, Durham, North Carolina, United States of America.
Patrick S CalhounDurham Veterans Affairs (VA) Health Care System, Durham, North Carolina, United States of America.
Bryann B DeBeerRocky Mountain Mental Illness Research, Education, and Clinical Center, Denver, Colorado, United States of America.
Terence M KeaneNational Center for PTSD, Boston, Massachusetts, United States of America.ORCID 0000-0002-0482-3149
Daniel J LeeNational Center for PTSD, Boston, Massachusetts, United States of America.
Brian P MarxNational Center for PTSD, Boston, Massachusetts, United States of America.
Eric C MeyerDepartment of Rehabilitation Science and Technology, University of Pittsburgh, Pittsburgh, Pennsylvania, United States of America.
Sandra B MorissetteDepartment of Psychology, The University of Texas at San Antonio, San Antonio, Texas, United States of America.ORCID 0000-0002-9900-636X
Eric B ElbogenDurham Veterans Affairs (VA) Health Care System, Durham, North Carolina, United States of America.
Duke University · USBoston University · USMental Illness Research, Education and Clinical Centers · USThe University of Texas at San Antonio · USUniversity of Pittsburgh · US

Funding

Assessing and Reducing Post-Deployment Violence RiskR01MH080988 · NIMH · UNIV OF NORTH CAROLINA CHAPEL HILL · PI ELBOGEN, ERIC B. · 2008 to 2011
$1.4M
BLRD VA IK6 BX003777CSRD VA I01 CX001729NIMH NIH HHS R01 MH080988
6 · The paper itself

Abstract

backgroundWorldwide, nearly 800,000 individuals die by suicide each year; however, longitudinal prediction of suicide attempts remains a major challenge within the field of psychiatry. The objective of the present research was to develop and evaluate an evidence-based suicide attempt risk checklist [i.e., the Durham Risk Score (DRS)] to aid clinicians in the identification of individuals at risk for attempting suicide in the future. METHODS AND

findingsThree prospective cohort studies, including a population-based study from the United States [i.e., the National Epidemiologic Survey on Alcohol and Related Conditions (NESARC) study] as well as 2 smaller US veteran cohorts [i.e., the Assessing and Reducing Post-Deployment Violence Risk (REHAB) and the Veterans After-Discharge Longitudinal Registry (VALOR) studies], were used to develop and validate the DRS. From a total sample size of 35,654 participants, 17,630 participants were selected to develop the checklist, whereas the remaining participants (N = 18,024) were used to validate it. The main outcome measure was future suicide attempts (i.e., actual suicide attempts that occurred after the baseline assessment during the 1- to 3-year follow-up period). Measure development began with a review of the extant literature to identify potential variables that had substantial empirical support as longitudinal predictors of suicide attempts and deaths. Next, receiver operating characteristic (ROC) curve analysis was utilized to identify variables from the literature review that uniquely contributed to the longitudinal prediction of suicide attempts in the development cohorts. We observed that the DRS was a robust prospective predictor of future suicide attempts in both the combined development (area under the curve [AUC] = 0.91) and validation (AUC = 0.92) cohorts. A concentration of risk analysis found that across all 35,654 participants, 82% of prospective suicide attempts occurred among individuals in the top 15% of DRS scores, whereas 27% occurred in the top 1%. The DRS also performed well among important subgroups, including women (AUC = 0.91), men (AUC = 0.93), Black (AUC = 0.92), White (AUC = 0.93), Hispanic (AUC = 0.89), veterans (AUC = 0.91), lower-income individuals (AUC = 0.90), younger adults (AUC = 0.88), and lesbian, gay, bisexual, transgender, and queer or questioning (LGBTQ) individuals (AUC = 0.88). The primary limitation of the present study was its its reliance on secondary data analyses to develop and validate the risk score.

conclusionsIn this study, we observed that the DRS was a strong predictor of future suicide attempts in both the combined development (AUC = 0.91) and validation (AUC = 0.92) cohorts. It also demonstrated good utility in many important subgroups, including women, men, Black, White, Hispanic, veterans, lower-income individuals, younger adults, and LGBTQ individuals. We further observed that 82% of prospective suicide attempts occurred among individuals in the top 15% of DRS scores, whereas 27% occurred in the top 1%. Taken together, these findings suggest that the DRS represents a significant advancement in suicide risk prediction over traditional clinical assessment approaches. While more work is needed to independently validate the DRS in prospective studies and to identify the optimal methods to assess the constructs used to calculate the score, our findings suggest that the DRS is a promising new tool that has the potential to significantly enhance clinicians' ability to identify individuals at risk for attempting suicide in the future.

Indexed as

Risk FactorsAdultAgedArea Under CurveFemaleHumansMaleMiddle AgedProspective StudiesRisk AssessmentROC CurveSuicide, AttemptedUnited StatesYoung Adult

Identifiers

PMID34351894
PMCPMC8341885
OpenAlexW3191203130

What OpenQuestion holds

Textmetadata
LicenceCC0
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.