Evidence map›Paper›PMID 36644339›Full record

ArticleJournal of affective disorders reports2022

Portability of natural language processing methods to detect suicidality from clinical text in US and UK electronic health records.

Marika Cusick, Sumithra Velupillai, Johnny Downs, Thomas R Campion, Evan T Sholle, Rina Dutta, Jyotishman Pathak

Abstract read
In one paragraph

Article in Journal of affective disorders reports, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 17 papers.

0numbers the graph read from it
0cells of the map it votes in
17citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

17 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Review
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Enhancing Cross-Domain Generalizability in Social Determinants of Health Extraction with Prompt-Tuning Large Language Models.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2025
    Article
  11. Review
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Marika CusickWeiCornell Medicine, 402 E. 67th St., New York, NY 10065, USA.
Sumithra VelupillaiIoPPN, King's College London, London, UK.
Johnny DownsIoPPN, King's College London, London, UK.
Thomas R CampionWeiCornell Medicine, 402 E. 67th St., New York, NY 10065, USA.
Evan T SholleWeiCornell Medicine, 402 E. 67th St., New York, NY 10065, USA.
Rina DuttaIoPPN, King's College London, London, UK.
Jyotishman PathakWeiCornell Medicine, 402 E. 67th St., New York, NY 10065, USA.

Funding

National Infrastructure for Standardized and Portable EHR Phenotyping AlgorithmsR01GM105688 · NIGMS · WEILL MEDICAL COLL OF CORNELL UNIV · PI LUO, YUAN, PATHAK, JYOTISHMAN · 2013 to 2020
$5.7M
Relief: A Behavioral Intervention for Depression and Chronic Pain for Primary Care PracticesP50MH113838 · NIMH · WEILL MEDICAL COLL OF CORNELL UNIV · PI SIREY, JO ANNE · 2017 to 2020
$5.7M
Linking VA and non-VA data to study the risk of suicide in chronic pain patients.R01MH121907 · NIMH · WEILL MEDICAL COLL OF CORNELL UNIV · PI OSLIN, DAVID W., PATHAK, JYOTISHMAN · 2020 to 2024
$3.6M
Using claims data to study the association between Alzheimer's disease and suicidal behaviorsR01MH119177 · NIMH · WEILL MEDICAL COLL OF CORNELL UNIV · PI PATHAK, JYOTISHMAN · 2019 to 2022
$3.3M
Modeling Social Behavior for Healthcare Utilization in DepressionR01MH105384 · NIMH · WEILL MEDICAL COLL OF CORNELL UNIV · PI PATHAK, JYOTISHMAN, SHETH, AMIT P · 2015 to 2018
$2.1M
4/4: Leveraging EHR-linked biobanks for deep phenotyping, polygenic risk score modeling, and outcomes analysis in psychiatric disordersR01MH121922 · NIMH · WEILL MEDICAL COLL OF CORNELL UNIV · PI PATHAK, JYOTISHMAN · 2019 to 2023
$2.0M
Risk modeling and shared decision making for postpartum depressionR41MH124581 · NIMH · IRIS OB HEALTH INC. · PI LASKOFF, MICHAEL B., PATHAK, JYOTISHMAN · 2021 to 2022
$1.0M
Medical Research Council MR/L017105/1NIGMS NIH HHS R01 GM105688NIMH NIH HHS P50 MH113838NIMH NIH HHS R01 MH105384NIMH NIH HHS R01 MH119177NIMH NIH HHS R01 MH121907NIMH NIH HHS R01 MH121922NIMH NIH HHS R41 MH124581
6 · The paper itself

Abstract

Background: In the global effort to prevent death by suicide, many academic medical institutions are implementing natural language processing (NLP) approaches to detect suicidality from unstructured clinical text in electronic health records (EHRs), with the hope of targeting timely, preventative interventions to individuals most at risk of suicide. Despite the international need, the development of these NLP approaches in EHRs has been largely local and not shared across healthcare systems. Methods: In this study, we developed a process to share NLP approaches that were individually developed at King's College London (KCL), UK and Weill Cornell Medicine (WCM), US - two academic medical centers based in different countries with vastly different healthcare systems. We tested and compared the algorithms' performance on manually annotated clinical notes (KCL: Results: After a successful technical porting of the NLP approaches, our quantitative evaluation determined that independently developed NLP approaches can detect suicidality at another healthcare organization with a different EHR system, clinical documentation processes, and culture, yet do not achieve the same level of success as at the institution where the NLP algorithm was developed (KCL approach: F1-score 0.85 vs. 0.68, WCM approach: F1-score 0.87 vs. 0.72). Limitations: Independent NLP algorithm development and patient cohort selection at the two institutions comprised direct comparability. Conclusions: Shared use of these NLP approaches is a critical step forward towards improving data-driven algorithms for early suicide risk identification and timely prevention.

Indexed as

Electronic health recordsNatural language processingPortabilitySuicide

Identifiers

PMID36644339
PMCPMC9835770

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.