Evidence map›Paper›PMID 34482951›Full record

ArticleBiological psychiatry2021

Toward Generalizable and Transdiagnostic Tools for Psychosis Prediction: An Independent Validation and Improvement of the NAPLS-2 Risk Calculator in the Multisite PRONIA Cohort.

Nikolaos Koutsouleris, Michelle Worthington, Dominic B Dwyer, Lana Kambeitz-Ilankovic, Rachele Sanfelici, Paolo Fusar-Poli, Marlene Rosen, Stephan Ruhrmann, Alan Anticevic, Jean Addington and 25 more

Abstract read
In one paragraph

Article in Biological psychiatry, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 26 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
26citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

26 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Article
  4. Precision sleep signatures to predict mental health outcomes in youth.Biological psychiatry. Cognitive neuroscience and neuroimaging · 2026
    Review
  5. Article
  6. Article
  7. Article
  8. Article
  9. Increased Brain-Age Gap in Young Adults With Psychotic Experiences.Biological psychiatry global open science · 2026
    Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

35 authors.

Nikolaos KoutsoulerisDepartment of Psychiatry and Psychotherapy, Ludwig-Maximilian University, Munich, Germany; Max-Planck Institute of Psychiatry, Munich, Germany; Institute of Psychiatry, Psychology and Neurosciences, King's College London, London, United Kingdom. Electronic address: nikolaos.koutsouleris@med.uni-muenchen.de.
Michelle WorthingtonDepartment of Psychology, Yale University, New Haven, Connecticut.
Dominic B DwyerDepartment of Psychiatry and Psychotherapy, Ludwig-Maximilian University, Munich, Germany.
Lana Kambeitz-IlankovicDepartment of Psychiatry and Psychotherapy, Ludwig-Maximilian University, Munich, Germany; Department of Psychiatry and Psychotherapy, Faculty of Medicine and University Hospital, University of Cologne, Cologne, Germany.
Rachele SanfeliciDepartment of Psychiatry and Psychotherapy, Ludwig-Maximilian University, Munich, Germany.
Paolo Fusar-PoliDepartment of Brain and Behavioral Sciences, University of Pavia, Pavia, Italy; Institute of Psychiatry, Psychology and Neurosciences, King's College London, London, United Kingdom.
Marlene RosenDepartment of Psychiatry and Psychotherapy, Faculty of Medicine and University Hospital, University of Cologne, Cologne, Germany.
Stephan RuhrmannDepartment of Psychiatry and Psychotherapy, Faculty of Medicine and University Hospital, University of Cologne, Cologne, Germany.
Alan AnticevicDepartment of Psychology, Yale University, New Haven, Connecticut.
Jean AddingtonHotchkiss Brain Institute, Department of Psychiatry, University of Calgary, Calgary, Alberta, Canada.
Diana O PerkinsDepartment of Psychiatry, University of North Carolina, Chapel Hill, North Carolina.
Carrie E BeardenDepartments of Psychiatry and Biobehavioral Sciences and Psychology, Semel Institute for Neuroscience and Human Behavior, University of California, Los Angeles, Los Angeles, California.
Barbara A CornblattZucker Hillside Hospital, Northwell Health, Queens, New York.
Kristin S CadenheadUniversity of California San Diego, San Diego, California.
Daniel H MathalonDepartment of Psychiatry, University of California San Francisco, San Francisco, California; San Francisco VA Medical Center, San Francisco, California.
Thomas McGlashanDepartment of Psychiatry, Yale University, New Haven, Connecticut.
Larry SeidmanDepartment of Psychiatry, Harvard Medical School at Beth Israel Deaconess Medical Center, Boston, Massachusetts.
Ming TsuangUniversity of California San Diego, San Diego, California.
Elaine F WalkerDepartment of Psychology and Psychiatry, Emory University, Atlanta, Georgia.
Scott W WoodsDepartment of Psychiatry, Yale University, New Haven, Connecticut.
Peter FalkaiDepartment of Psychiatry and Psychotherapy, Ludwig-Maximilian University, Munich, Germany.
Rebekka LencerDepartment of Psychiatry and Psychotherapy, University of Münster, Münster, Germany; Department of Psychiatry and Psychotherapy, University of Lübeck, Lübeck, Germany.
Alessandro BertolinoDepartment of Basic Medical Science, Neuroscience and Sense Organs, University of Bari Aldo Moro, Bari, Italy.
Joseph KambeitzDepartment of Psychiatry and Psychotherapy, Faculty of Medicine and University Hospital, University of Cologne, Cologne, Germany.
Frauke Schultze-LutterDepartment of Psychiatry and Psychotherapy, Medical Faculty, Heinrich-Heine-Universität Düsseldorf, Germany.
Eva MeisenzahlDepartment of Psychiatry and Psychotherapy, Medical Faculty, Heinrich-Heine-Universität Düsseldorf, Germany.
Raimo K R SalokangasDepartment of Psychiatry, University of Turku, Turku, Finland.
Jarmo HietalaDepartment of Psychiatry, University of Turku, Turku, Finland.
Paolo BrambillaDepartment of Neurosciences and Mental Health, Fondazione IRCCS Ca' Granda Ospedale Maggiore Policlinico, Milan, Italy; Department of Pathophysiology and Transplantation, University of Milan, Milan, Italy.
Rachel UpthegroveInstitute of Mental Health, University of Birmingham, Birmingham, United Kingdom; School of Psychology, University of Birmingham, Birmingham, United Kingdom.
Stefan BorgwardtDepartment of Psychiatry and Psychotherapy, University of Lübeck, Lübeck, Germany; Department of Psychiatry (Psychiatric University Hospital, UPK), University of Basel, Basel, Switzerland.
Stephen WoodCentre for Youth Mental Health, University of Melbourne, Melbourne, Victoria, Australia; Orygen, National Centre of Excellence for Youth Mental Health, Melbourne, Victoria, Australia.
Raquel E GurDepartment of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania.
Philip McGuireInstitute of Psychiatry, Psychology and Neurosciences, King's College London, London, United Kingdom.
Tyrone D CannonDepartment of Psychology, Yale University, New Haven, Connecticut; Department of Psychiatry, Yale University, New Haven, Connecticut.

Funding

Yale Clinical and Translational Science Award (U Component)UL1TR001863 · NCATS · YALE UNIVERSITY · PI John H. Krystal, LUCILA OHNO-MACHADO · 2016 to 2026
$102.9M
STRESS AND EMOTIONAL REACTIVITYP50MH066286 · NIMH · UNIVERSITY OF CALIFORNIA LOS ANGELES · PI YEE-BRADBURY, CINDY M. · 2003 to 2014
$18.6M
1/9 Predictors and Mechanisms of Conversion to PsychosisU01MH081902 · NIMH · YALE UNIVERSITY · PI CANNON, TYRONE D · 2008 to 2018
$12.4M
Administrative Supplement Harmonization of At Risk Multisite Observational Networks for Youth(HARMONY)U01MH081928 · NIMH · BETH ISRAEL DEACONESS MEDICAL CENTER · PI STONE, WILLIAM SETH · 2008 to 2018
$7.1M
4/9-Predictors and Mechanisms of Conversion to PsychosisU01MH081857 · NIMH · FEINSTEIN INSTITUTE FOR MEDICAL RESEARCH · PI CORNBLATT, BARBARA A. · 2008 to 2018
$6.2M
8/9 Predictors and Mechanisms of Conversion to PsychosisU01MH082022 · NIMH · YALE UNIVERSITY · PI WOODS, SCOTT W · 2008 to 2018
$6.0M
2/9 - Predictors and Mechanisms of Conversion to PsychosisU01MH081988 · NIMH · EMORY UNIVERSITY · PI WALKER, ELAINE FRAN · 2008 to 2018
$5.4M
6/9-Predictors and Mechanisms of Conversion to PsychosisU01MH081944 · NIMH · UNIVERSITY OF CALIFORNIA, SAN DIEGO · PI CADENHEAD, KRISTIN S. · 2008 to 2018
$4.9M
Evolution of Psychosis in Youth: Multimodal Risk and Resilience MarkersR01MH119219 · NIMH · UNIVERSITY OF PENNSYLVANIA · PI GUR, RAQUEL E, GUR, RUBEN C. · 2019 to 2023
$3.8M
Functional Brain Abnormalities in the Schizophrenia ProdromeR01MH076989 · NIMH · YALE UNIVERSITY · PI MATHALON, DANIEL H · 2007 to 2014
$2.3M
Enhancing the Prospective Prediction of PsychosisU01MH066069 · NIMH · UNIV OF NORTH CAROLINA CHAPEL HILL · PI PERKINS, DIANA O. · 2003 to 2007
$1.5M
Enhancing the Prospective Prediction of PsychosisU01MH066134 · NIMH · CENTRE FOR ADDICTION AND MENTAL HEALTH · PI ADDINGTON, JEAN M · 2003 to 2007
$869k
NCATS NIH HHS UL1 TR001863NIMH NIH HHS P50 MH066286NIMH NIH HHS R01 MH076989NIMH NIH HHS R01 MH119219NIMH NIH HHS U01 MH066069NIMH NIH HHS U01 MH066134NIMH NIH HHS U01 MH081857NIMH NIH HHS U01 MH081902NIMH NIH HHS U01 MH081928NIMH NIH HHS U01 MH081944NIMH NIH HHS U01 MH081988NIMH NIH HHS U01 MH082022
6 · The paper itself

Abstract

backgroundTransition to psychosis is among the most adverse outcomes of clinical high-risk (CHR) syndromes encompassing ultra-high risk (UHR) and basic symptom states. Clinical risk calculators may facilitate an early and individualized interception of psychosis, but their real-world implementation requires thorough validation across diverse risk populations, including young patients with depressive syndromes.

methodsWe validated the previously described NAPLS-2 (North American Prodrome Longitudinal Study 2) calculator in 334 patients (26 with transition to psychosis) with CHR or recent-onset depression (ROD) drawn from the multisite European PRONIA (Personalised Prognostic Tools for Early Psychosis Management) study. Patients were categorized into three risk enrichment levels, ranging from UHR, over CHR, to a broad-risk population comprising patients with CHR or ROD (CHR|ROD). We assessed how risk enrichment and different predictive algorithms influenced prognostic performance using reciprocal external validation.

resultsAfter calibration, the NAPLS-2 model predicted psychosis with a balanced accuracy (BAC) (sensitivity, specificity) of 68% (73%, 63%) in the PRONIA-UHR cohort, 67% (74%, 60%) in the CHR cohort, and 70% (73%, 66%) in patients with CHR|ROD. Multiple model derivation in PRONIA-CHR|ROD and validation in NAPLS-2-UHR patients confirmed that broader risk definitions produced more accurate risk calculators (CHR|ROD-based vs. UHR-based performance: 67% [68%, 66%] vs. 58% [61%, 56%]). Support vector machines were superior in CHR|ROD (BAC = 71%), while ridge logistic regression and support vector machines performed similarly in CHR (BAC = 67%) and UHR cohorts (BAC = 65%). Attenuated psychotic symptoms predicted psychosis across risk levels, while younger age and reduced processing speed became increasingly relevant for broader risk cohorts.

conclusionsClinical-neurocognitive machine learning models operating in young patients with affective and CHR syndromes facilitate a more precise and generalizable prediction of psychosis. Future studies should investigate their therapeutic utility in large-scale clinical trials.

Indexed as

Prodromal SymptomsPsychotic DisordersHumansLongitudinal StudiesPrognosisRisk FactorsClinical high-risk statesFirst-episode depressionMachine learningPsychosis predictionReciprocal external validationRisk calculators

Identifiers

PMID34482951
PMCPMC8500930

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.