Evidence map›Paper›PMID 38212349›Full record

ArticleScientific reports2024

Multi-site benchmark classification of major depressive disorder using machine learning on cortical and subcortical measures.

Vladimir Belov, Tracy Erwin-Grabner, Moji Aghajani, Andre Aleman, Alyssa R Amod, Zeynep Basgoze, Francesco Benedetti, Bianca Besteher, Robin Bülow, Christopher R K Ching and 56 more

Abstract read
In one paragraph

Article in Scientific reports, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 14 papers.

0numbers the graph read from it
0cells of the map it votes in
14citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

14 citing papers in PubMed.

  1. Article
  2. Review
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

66 authors.

Vladimir BelovLaboratory of Systems Neuroscience and Imaging in Psychiatry (SNIP-Lab), Department of Psychiatry and Psychotherapy, University Medical Center Göttingen (UMG), Georg-August University, Von-Siebold-Str. 5, 37075, Göttingen, Germany.
Tracy Erwin-GrabnerLaboratory of Systems Neuroscience and Imaging in Psychiatry (SNIP-Lab), Department of Psychiatry and Psychotherapy, University Medical Center Göttingen (UMG), Georg-August University, Von-Siebold-Str. 5, 37075, Göttingen, Germany.
Moji AghajaniDepartment of Psychiatry, Amsterdam UMC, Amsterdam Neuroscience, Amsterdam Public Health Research Institute, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands.
Andre AlemanDepartment of Biomedical Sciences of Cells and Systems, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands.
Alyssa R AmodDepartment of Psychiatry and Mental Health, University of Cape Town, Cape Town, South Africa.
Zeynep BasgozeDepartment of Psychiatry and Behavioral Science, University of Minnesota Medical School, Minneapolis, MN, USA.
Francesco BenedettiDivision of Neuroscience, IRCCS San Raffaele Scientific Institute, Milan, Italy.ORCID 0000-0003-4949-856X
Bianca BesteherDepartment of Psychiatry and Psychotherapy, Jena University Hospital, Jena, Germany.
Robin BülowInstitute for Radiology and Neuroradiology, University Medicine Greifswald, Greifswald, Germany.
Christopher R K ChingImaging Genetics Center, Mark and Mary Stevens Neuroimaging and Informatics Institute, Keck School of Medicine, University of Southern California, Marina del Rey, CA, USA.
Colm G ConnollyDepartment of Biomedical Sciences, Florida State University, Tallahassee, FL, USA.
Kathryn CullenDepartment of Psychiatry and Behavioral Science, University of Minnesota Medical School, Minneapolis, MN, USA.ORCID 0000-0001-9631-3770
Christopher G DaveyMelbourne Neuropsychiatry Centre, Department of Psychiatry, The University of Melbourne, Parkville, VIC, Australia.
Danai DimaDepartment of Psychology, School of Arts and Social Sciences, City, University of London, London, UK.
Annemiek DolsDepartment of Psychiatry, Amsterdam UMC, Amsterdam Neuroscience, Amsterdam Public Health Research Institute, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands.
Jennifer W EvansExperimental Therapeutics and Pathophysiology Branch, National Institute for Mental Health, National Institutes of Health, Bethesda, MD, USA.
Cynthia H Y FuSchool of Psychology, University of East London, London, UK.
Ali Saffet GonulSoCAT Lab, Department of Psychiatry, School of Medicine, Ege University, Izmir, Turkey.
Ian H GotlibDepartment of Psychology, Stanford University, Stanford, CA, USA.ORCID 0000-0002-3622-3199
Hans J GrabeDepartment of Psychiatry and Psychotherapy, University Medicine Greifswald, Greifswald, Germany.
Nynke GroenewoldDepartment of Psychiatry and Mental Health, University of Cape Town, Cape Town, South Africa.
J Paul HamiltonCenter for Social and Affective Neuroscience, Department of Biomedical and Clinical Sciences, Linköping University, Linköping, Sweden.ORCID 0000-0001-7982-4659
Ben J HarrisonMelbourne Neuropsychiatry Centre, Department of Psychiatry, The University of Melbourne, Parkville, VIC, Australia.
Tiffany C HoDepartment of Psychiatry and Behavioral Sciences, Division of Child and Adolescent Psychiatry, Weill Institute for Neurosciences, University of California, San Francisco, San Francisco, CA, USA.
Benson MwangiLouis A. Faillace, MD, Department of Psychiatry and Behavioral Sciences, The University of Texas Health Science Center at Houston, Houston, TX, USA.
Natalia JaworskaDepartment of Psychiatry, McGill University, Montreal, QC, Canada.
Neda JahanshadImaging Genetics Center, Mark and Mary Stevens Neuroimaging and Informatics Institute, Keck School of Medicine, University of Southern California, Marina del Rey, CA, USA.
Bonnie Klimes-DouganDepartment of Psychology, University of Minnesota, Minneapolis, MN, USA.
Sheri-Michelle KoopowitzDepartment of Psychiatry and Mental Health, University of Cape Town, Cape Town, South Africa.
Thomas LancasterCardiff University Brain Research Imaging Center, Cardiff University, Cardiff, UK.ORCID 0000-0003-1322-2449
Meng LiDepartment of Psychiatry and Psychotherapy, Jena University Hospital, Jena, Germany.
David E J LindenCardiff University Brain Research Imaging Center, Cardiff University, Cardiff, UK.ORCID 0000-0002-5638-9292
Frank P MacMasterDepartments of Psychiatry and Pediatrics, University of Calgary, Calgary, AB, Canada.
David M A MehlerCardiff University Brain Research Imaging Center, Cardiff University, Cardiff, UK.
Elisa MelloniDivision of Neuroscience, IRCCS San Raffaele Scientific Institute, Milan, Italy.
Bryon A MuellerDepartment of Psychiatry and Behavioral Science, University of Minnesota Medical School, Minneapolis, MN, USA.ORCID 0000-0003-2429-0391
Amar OjhaCenter for Neuroscience, University of Pittsburgh, Pittsburgh, PA, USA.
Mardien L OudegaDepartment of Psychiatry, Amsterdam UMC, Amsterdam Neuroscience, Amsterdam Public Health Research Institute, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands.
Brenda W J H PenninxDepartment of Psychiatry, Amsterdam UMC, Amsterdam Neuroscience, Amsterdam Public Health Research Institute, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands.
Sara PolettiDivision of Neuroscience, IRCCS San Raffaele Scientific Institute, Milan, Italy.ORCID 0000-0001-9594-0246
Edith Pomarol-ClotetFIDMAG Germanes Hospitalàries Research Foundation, Centro de Investigación Biomédica en Red de Salud Mental (CIBERSAM), Barcelona, Catalonia, Spain.
Maria J PortellaSant Pau Mental Health Research Group, Institut de Recerca de L'Hospital de La Santa Creu I Sant Pau, Barcelona, Catalonia, Spain.
Elena PozziCentre for Youth Mental Health, The University of Melbourne, Parkville, VIC, Australia.
Liesbeth RenemanDepartment of Radiology and Nuclear Medicine, Amsterdam University Medical Centers, Amsterdam, The Netherlands.
Matthew D SacchetMeditation Research Program, Department of Psychiatry, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA.
Philipp G SämannMax Planck Institute of Psychiatry, Munich, Germany.
Anouk SchranteeDepartment of Radiology and Nuclear Medicine, Amsterdam University Medical Centers, Amsterdam, The Netherlands.
Kang SimWest Region, Institute of Mental Health, Singapore, Singapore.ORCID 0000-0003-3209-9626
Jair C SoaresCenter Of Excellence On Mood Disorders, Louis A. Faillace, MD, Department of Psychiatry and Behavioral Sciences at McGovern Medical School, The University of Texas Health Science Center at Houston, Houston, TX, USA.
Dan J SteinSA MRC Research Unit on Risk and Resilience in Mental Disorders, Department of Psychiatry and Neuroscience Institute, University of Cape Town, Cape Town, South Africa.ORCID 0000-0001-7218-7810
Sophia I ThomopoulosImaging Genetics Center, Mark and Mary Stevens Neuroimaging and Informatics Institute, Keck School of Medicine, University of Southern California, Marina del Rey, CA, USA.
Aslihan Uyar-DemirSoCAT Lab, Department of Psychiatry, School of Medicine, Ege University, Izmir, Turkey.
Nic J A van der WeeLeiden Institute for Brain and Cognition, Leiden University Medical Center, Leiden, The Netherlands.
Steven J A van der WerffLeiden Institute for Brain and Cognition, Leiden University Medical Center, Leiden, The Netherlands.
Henry VölzkeInstitute for Community Medicine, University Medicine Greifswald, Greifswald, Germany.
Sarah WhittleMelbourne Neuropsychiatry Centre, Department of Psychiatry, The University of Melbourne and Melbourne Health, Melbourne, VIC, Australia.
Katharina WittfeldDepartment of Psychiatry and Psychotherapy, University Medicine Greifswald, Greifswald, Germany.ORCID 0000-0003-4383-5043
Margaret J WrightQueensland Brain Institute, The University of Queensland, Brisbane, QLD, Australia.
Mon-Ju WuLouis A. Faillace, MD, Department of Psychiatry and Behavioral Sciences, The University of Texas Health Science Center at Houston, Houston, TX, USA.
Tony T YangDepartment of Psychiatry and Behavioral Sciences, Division of Child and Adolescent Psychiatry, Weill Institute for Neurosciences, University of California, San Francisco, San Francisco, CA, USA.
Carlos ZarateSection on the Neurobiology and Treatment of Mood Disorders, National Institute of Mental Health, Bethesda, MD, USA.
Dick J VeltmanDepartment of Psychiatry, Amsterdam UMC, Amsterdam Neuroscience, Amsterdam Public Health Research Institute, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands.
Lianne SchmaalCentre for Youth Mental Health, The University of Melbourne, Parkville, VIC, Australia.ORCID 0000-0001-9822-048X
Paul M ThompsonImaging Genetics Center, Mark and Mary Stevens Neuroimaging and Informatics Institute, Keck School of Medicine, University of Southern California, Marina del Rey, CA, USA.
Roberto Goya-MaldonadoLaboratory of Systems Neuroscience and Imaging in Psychiatry (SNIP-Lab), Department of Psychiatry and Psychotherapy, University Medical Center Göttingen (UMG), Georg-August University, Von-Siebold-Str. 5, 37075, Göttingen, Germany. roberto.goya@med.uni-goettingen.de.
ENIGMA Major Depressive Disorder working group

Funding

Tumor Evolution and Metastasis ProgramP30CA016672 · NCI · UNIVERSITY OF TX MD ANDERSON CAN CTR · PI Fabien Delerue · 1985 to 2026
$290.8M
Glutamatergic Modulators for Rapid & Sustained Antidepressant EffectZIAMH002857 · NIMH · NATIONAL INSTITUTE OF MENTAL HEALTH · PI ZARATE, CARLOS · 2009 to 2025
$55.0M
ZOOMED FUNCT IMAGING IN HUMAN BRAIN AT 7T W/ SIMULT HIGH SPATIAL &TEMPORAL RESP41RR008079 · NCRR · UNIVERSITY OF MINNESOTA TWIN CITIES · PI VAUGHAN, JOHN T · 1993 to 2011
$16.3M
Training U54EB020403 · NIBIB · UNIVERSITY OF SOUTHERN CALIFORNIA · PI THOMPSON, PAUL M · 2014 to 2018
$10.1M
Psychobiological Mechanisms Underlying the Association Between Early Life Stress and Depression Across AdolescenceR37MH101495 · NIMH · STANFORD UNIVERSITY · PI IAN H GOTLIB · 2018 to 2026
$6.6M
Neuroimmune Mechanisms of Recovery from Comorbid Depression and Chronic PainR01NS073939 · NINDS · UNIVERSITY OF TX MD ANDERSON CAN CTR · PI DANTZER, ROBERT, HEIJNEN, COBI J · 2011 to 2020
$4.0M
The Metabolic Basis of Cancer-Related FatigueR01CA193522 · NCI · UNIVERSITY OF TX MD ANDERSON CAN CTR · PI DANTZER, ROBERT · 2015 to 2023
$3.8M
A Cross-Sectional and Longitudinal Functional MRI Study of Adolescent DepressionR01MH085734 · NIMH · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI YANG, TONY TUNG-I · 2010 to 2014
$2.7M
Genetic influences on the brain: A twin imaging studyR01HD050735 · NICHD · QUEENSLAND INSTITUTE OF MEDICAL RESEARCH · PI WRIGHT, MARGARET JANE · 2007 to 2011
$2.6M
ENIGMA-SD: Understanding Sex Differences in Global Mental Health through ENIGMAR01MH116147 · NIMH · UNIVERSITY OF SOUTHERN CALIFORNIA · PI THOMPSON, PAUL M · 2018 to 2021
$2.5M
Neurobiologically-Based Subtyping of Multi-Cohort Samples with MDD and PTSD SymptomsR01MH129832 · NIMH · DUKE UNIVERSITY · PI MOREY, RAJENDRA A, SCHMAAL, LIANNE · 2022 to 2025
$2.3M
A global alliance to unlock brain mechanisms influencing suicidal behaviors through the ENIGMA ConsortiumR01MH117601 · NIMH · UNIVERSITY OF SOUTHERN CALIFORNIA · PI JAHANSHAD, NEDA, SCHMAAL, LIANNE · 2018 to 2021
$1.5M
Intramural NIH HHS ZIA MH002857Medical Research Council G0802594Medical Research Council MR/L010305/1NCI NIH HHS P30 CA016672NCI NIH HHS R01 CA193522NCRR NIH HHS P41 RR008079NIBIB NIH HHS U54 EB020403NICHD NIH HHS R01 HD050735NIMH NIH HHS K01 MH117442NIMH NIH HHS K23 MH090421NIMH NIH HHS R01 MH085734NIMH NIH HHS R01 MH116147NIMH NIH HHS R01 MH117601NIMH NIH HHS R01 MH129832NIMH NIH HHS R37 MH101495NINDS NIH HHS R01 NS073939
6 · The paper itself

Abstract

Machine learning (ML) techniques have gained popularity in the neuroimaging field due to their potential for classifying neuropsychiatric disorders. However, the diagnostic predictive power of the existing algorithms has been limited by small sample sizes, lack of representativeness, data leakage, and/or overfitting. Here, we overcome these limitations with the largest multi-site sample size to date (N = 5365) to provide a generalizable ML classification benchmark of major depressive disorder (MDD) using shallow linear and non-linear models. Leveraging brain measures from standardized ENIGMA analysis pipelines in FreeSurfer, we were able to classify MDD versus healthy controls (HC) with a balanced accuracy of around 62%. But after harmonizing the data, e.g., using ComBat, the balanced accuracy dropped to approximately 52%. Accuracy results close to random chance levels were also observed in stratified groups according to age of onset, antidepressant use, number of episodes and sex. Future studies incorporating higher dimensional brain imaging/phenotype features, and/or using more advanced machine and deep learning methods may yield more encouraging prospects.

Indexed as

Major Depressive DisorderBenchmarkingBrainHumansMachine LearningMagnetic Resonance ImagingNeuroimaging

Identifiers

PMID38212349
PMCPMC10784593

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.