Evidence map›Paper›PMID 29934287›Full record

ArticleJMIR mental health2018

Using Neural Networks with Routine Health Records to Identify Suicide Risk: Feasibility Study.

Marcos DelPozo-Banos, Ann John, Nicolai Petkov, Damon Mark Berridge, Kate Southern, Keith LLoyd, Caroline Jones, Sarah Spencer, Carlos Manuel Travieso

Open access · goldAbstract read
In one paragraph

Article in JMIR mental health, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 25 papers, 6 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
25citing papers in PubMed, 6 pooled it
7.1field-weighted citation impact, top 3% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

25 citing papers in PubMed, 6 syntheses or guidelines pooled it, 57 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Artificial Intelligence and Suicide Prevention: A Systematic Review of Machine Learning Investigations.International journal of environmental research and public health · 2020
    Pooled it
  7. Review
  8. Article
  9. Article
  10. Article
  11. Review
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Identification of Suicidal Ideation in theFrontiers in artificial intelligence · 2021
    Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors at 4 institutions in 3 countries.

Marcos DelPozo-BanosSwansea University, Swansea University Medical School, Swansea, United Kingdom.ORCID http://orcid.org/0000-0003-1502-389X
Ann JohnSwansea University, Swansea University Medical School, Swansea, United Kingdom.ORCID http://orcid.org/0000-0002-5657-6995
Nicolai PetkovDivision of Intelligent Systems, Department of Computer Science, Bernoulli Institute of Mathematics, Computer Science and Artificial Intelligence, Faculty of Science and Engineering, University of Groningen, Groningen, Netherlands.ORCID http://orcid.org/0000-0003-2163-8647
Damon Mark BerridgeSwansea University, Swansea University Medical School, Swansea, United Kingdom.ORCID http://orcid.org/0000-0002-5442-6686
Kate SouthernCardiff Adult Self Injury Project, Cardiff, United Kingdom.ORCID http://orcid.org/0000-0003-3718-7385
Keith LLoydSwansea University, Swansea University Medical School, Swansea, United Kingdom.ORCID http://orcid.org/0000-0002-1440-4124
Caroline JonesHillary Rodham Clinton School of Law, Swansea University, Swansea, United Kingdom.ORCID http://orcid.org/0000-0001-7632-9468
Sarah SpencerPrincess of Wales Hospital, Bridgend, ABMU Health Board, Swansea, United Kingdom.ORCID http://orcid.org/0000-0002-0487-056X
Carlos Manuel TraviesoSignals and Communications Department, IDeTIC, University of Las Palmas de Gran Canaria, Las Palmas de Gran Canaria, Spain.ORCID http://orcid.org/0000-0002-4621-2768
Swansea University · GBPrincess of Wales Hospital · GBUniversidad de Las Palmas de Gran Canaria · ESUniversity of Groningen · NL

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundEach year, approximately 800,000 people die by suicide worldwide, accounting for 1-2 in every 100 deaths. It is always a tragic event with a huge impact on family, friends, the community and health professionals. Unfortunately, suicide prevention and the development of risk assessment tools have been hindered by the complexity of the underlying mechanisms and the dynamic nature of a person's motivation and intent. Many of those who die by suicide had contact with health services in the preceding year but identifying those most at risk remains a challenge.

objectiveTo explore the feasibility of using artificial neural networks with routinely collected electronic health records to support the identification of those at high risk of suicide when in contact with health services.

methodsUsing the Secure Anonymised Information Linkage Databank UK, we extracted the data of those who died by suicide between 2001 and 2015 and paired controls. Looking at primary (general practice) and secondary (hospital admissions) electronic health records, we built a binary feature vector coding the presence of risk factors at different times prior to death. Risk factors included: general practice contact and hospital admission; diagnosis of mental health issues; injury and poisoning; substance misuse; maltreatment; sleep disorders; and the prescription of opiates and psychotropics. Basic artificial neural networks were trained to differentiate between the suicide cases and paired controls. We interpreted the output score as the estimated suicide risk. System performance was assessed with 10x10-fold repeated cross-validation, and its behavior was studied by representing the distribution of estimated risk across the cases and controls, and the distribution of factors across estimated risks.

resultsWe extracted a total of 2604 suicide cases and 20 paired controls per case. Our best system attained a mean error rate of 26.78% (SD 1.46; 64.57% of sensitivity and 81.86% of specificity). While the distribution of controls was concentrated around estimated risks < 0.5, cases were almost uniformly distributed between 0 and 1. Prescription of psychotropics, depression and anxiety, and self-harm increased the estimated risk by ~0.4. At least 95% of those presenting these factors were identified as suicide cases.

conclusionsDespite the simplicity of the implemented system, the proposed methodology obtained an accuracy like other published methods based on specialized questionnaire generated data. Most of the errors came from the heterogeneity of patterns shown by suicide cases, some of which were identical to those of the paired controls. Prescription of psychotropics, depression and anxiety, and self-harm were strongly linked with higher estimated risk scores, followed by hospital admission and long-term drug and alcohol misuse. Other risk factors like sleep disorders and maltreatment had more complex effects.

Indexed as

artificial neural networkselectronic health recordsmachine learningrisk assessmentroutine datasuicide prevention

Identifiers

PMID29934287
PMCPMC6035342
OpenAlexW2802153593

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.