Evidence map›Paper›PMID 30535584›Full record

ArticleEuropean journal of epidemiology2019

Use of natural language processing in electronic medical records to identify pregnant women with suicidal behavior: towards a solution to the complex classification problem.

Qiu-Yue Zhong, Leena P Mittal, Margo D Nathan, Kara M Brown, Deborah Knudson González, Tianrun Cai, Sean Finan, Bizu Gelaye, Paul Avillach, Jordan W Smoller and 3 more

Open access · greenAbstract read
In one paragraph

Article in European journal of epidemiology, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 27 papers, 5 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
27citing papers in PubMed, 5 pooled it
4.4field-weighted citation impact, top 6% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

27 citing papers in PubMed, 5 syntheses or guidelines pooled it, 58 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Artificial Intelligence and Suicide Prevention: A Systematic Review of Machine Learning Investigations.International journal of environmental research and public health · 2020
    Pooled it
  5. Pooled it
  6. Article
  7. Evaluating Machine Learning for Predicting Youth Suicidal Behavior Up to 1 Year After Contact With Mental-Health Specialty Care.Clinical psychological science : a journal of the Association for Psychological Science · 2025
    Article
  8. Article
  9. Detection of suicidality from medical text using privacy-preserving large language models.The British journal of psychiatry : the journal of mental science · 2024
    Review
  10. Review
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Review
  18. Suicide and Maternal Mortality.Current psychiatry reports · 2022
    Review
  19. Exploring Risk Factors in Suicidal Ideation and Attempt Concept Cooccurrence Networks.AMIA ... Annual Symposium proceedings. AMIA Symposium · 2022
    Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

13 authors at 4 institutions in 1 country.

Qiu-Yue ZhongDepartment of Epidemiology, Harvard T.H. Chan School of Public Health, 677 Huntington Avenue, Boston, MA, USA. qyzhong@mail.harvard.edu.ORCID http://orcid.org/0000-0003-1666-8913
Leena P MittalDivision of Women's Mental Health, Department of Psychiatry, Brigham and Women's Hospital, Boston, MA, USA.
Margo D NathanDivision of Women's Mental Health, Department of Psychiatry, Brigham and Women's Hospital, Boston, MA, USA.
Kara M BrownDivision of Women's Mental Health, Department of Psychiatry, Brigham and Women's Hospital, Boston, MA, USA.
Deborah Knudson GonzálezDepartment of Psychiatry and Behavioral Neurosciences, Morsani College of Medicine, University of South Florida, Tampa, FL, USA.
Tianrun CaiDepartment of Medicine, Division of Rheumatology, Immunology and Allergy, Brigham and Women's Hospital, Boston, MA, USA.
Sean FinanChildren's Hospital Informatics Program, Boston Children's Hospital, Boston, MA, USA.
Bizu GelayeDepartment of Epidemiology, Harvard T.H. Chan School of Public Health, 677 Huntington Avenue, Boston, MA, USA.
Paul AvillachDepartment of Epidemiology, Harvard T.H. Chan School of Public Health, 677 Huntington Avenue, Boston, MA, USA.
Jordan W SmollerDepartment of Epidemiology, Harvard T.H. Chan School of Public Health, 677 Huntington Avenue, Boston, MA, USA.
Elizabeth W KarlsonDepartment of Medicine, Division of Rheumatology, Immunology and Allergy, Brigham and Women's Hospital, Boston, MA, USA.
Tianxi CaiDepartment of Biomedical Informatics, Harvard Medical School, Boston, MA, USA.
Michelle A WilliamsDepartment of Epidemiology, Harvard T.H. Chan School of Public Health, 677 Huntington Avenue, Boston, MA, USA.
Brigham and Women's Hospital · USHarvard University · USBoston Children's Hospital · USUniversity of South Florida · US

Funding

Harvard Clinical and Translational Science Center (UL1)UL1TR000170 · NCATS · HARVARD MEDICAL SCHOOL · PI NADLER, LEE MARSHALL · 2012 to 2013
$31.4M
University of Washington MHIRT Training Program GrantT37MD001449 · NIMHD · UNIVERSITY OF WASHINGTON · PI WILLIAMS, MICHELLE A. · 2005 to 2018
$3.5M
National Center for Advancing Translational Sciences 8UL1TR 000170-09National Institute on Minority Health and Health Disparities T37-MD001449NCATS NIH HHS UL1 TR000170NIMHD NIH HHS T37 MD001449
6 · The paper itself

Abstract

We developed algorithms to identify pregnant women with suicidal behavior using information extracted from clinical notes by natural language processing (NLP) in electronic medical records. Using both codified data and NLP applied to unstructured clinical notes, we first screened pregnant women in Partners HealthCare for suicidal behavior. Psychiatrists manually reviewed clinical charts to identify relevant features for suicidal behavior and to obtain gold-standard labels. Using the adaptive elastic net, we developed algorithms to classify suicidal behavior. We then validated algorithms in an independent validation dataset. From 275,843 women with codes related to pregnancy or delivery, 9331 women screened positive for suicidal behavior by either codified data (N = 196) or NLP (N = 9,145). Using expert-curated features, our algorithm achieved an area under the curve of 0.83. By setting a positive predictive value comparable to that of diagnostic codes related to suicidal behavior (0.71), we obtained a sensitivity of 0.34, specificity of 0.96, and negative predictive value of 0.83. The algorithm identified 1423 pregnant women with suicidal behavior among 9331 women screened positive. Mining unstructured clinical notes using NLP resulted in a 11-fold increase in the number of pregnant women identified with suicidal behavior, as compared to solely reliance on diagnostic codes.

Indexed as

Electronic Health RecordsNatural Language ProcessingPregnancy ComplicationsSuicidal IdeationAlgorithmsData MiningFemaleHumansInternational Classification of DiseasesPregnancyClassification algorithmElectronic medicalNatural language processingPregnant womenRecordsSuicidal behavior

Identifiers

PMID30535584
PMCPMC6370493
OpenAlexW2904990534

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.