Evidence map›Paper›PMID 36346213›Full record

ArticleHuman brain mapping2023

Benchmarking the generalizability of brain age models: Challenges posed by scanner variance and prediction bias.

Robert J Jirsaraie, Tobias Kaufmann, Vishnu Bashyam, Guray Erus, Joan L Luby, Lars T Westlye, Christos Davatzikos, Deanna M Barch, Aristeidis Sotiras

Abstract read
In one paragraph

Article in Human brain mapping, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 24 papers.

0numbers the graph read from it
0cells of the map it votes in
24citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

24 citing papers in PubMed.

  1. Trial
  2. Increased Brain-Age Gap in Young Adults With Psychotic Experiences.Biological psychiatry global open science · 2026
    Article
  3. Article
  4. When Age Is More Than a Number: Acceleration of Brain Aging in Neurodegenerative Diseases.Journal of nuclear medicine : official publication, Society of Nuclear Medicine · 2025
    Article
  5. Article
  6. Article
  7. Resting-state functional connectivity correlates of brain structural aging in schizophrenia.European archives of psychiatry and clinical neuroscience · 2025
    Article
  8. Temporal autocorrelation is predictive of age-An extensive MEG time-series analysis.Proceedings of the National Academy of Sciences of the United States of America · 2025
    Article
  9. Article
  10. Review
  11. Article
  12. Article
  13. Article
  14. Review
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors.

Robert J JirsaraieDivision of Computational and Data Sciences, Washington University in St. Louis, St. Louis, Missouri, USA.
Tobias KaufmannDepartment of Psychiatry and Psychotherapy, Tübingen Center for Mental Health, University of Tübingen, Tübingen, Germany.
Vishnu BashyamCenter for Biomedical Image Computing and Analytics, Department of Radiology, University of Pennsylvania, Philadelphia, Pennsylvania, USA.
Guray ErusCenter for Biomedical Image Computing and Analytics, Department of Radiology, University of Pennsylvania, Philadelphia, Pennsylvania, USA.
Joan L LubyDepartment of Psychiatry, Washington University in St. Louis, St. Louis, Missouri, USA.
Lars T WestlyeNorwegian Centre for Mental Disorders Research, Division of Mental Health and Addiction, Oslo University Hospital & Institute of Clinical Medicine, University of Oslo, Oslo, Norway.ORCID 0000-0001-8644-956X
Christos DavatzikosCenter for Biomedical Image Computing and Analytics, Department of Radiology, University of Pennsylvania, Philadelphia, Pennsylvania, USA.
Deanna M BarchDepartment of Psychological & Brain Sciences, Washington University in St. Louis, St. Louis, Missouri, USA.
Aristeidis SotirasDepartment of Radiology, Washington University School of Medicine in St. Louis, St. Louis, Missouri, USA.ORCID 0000-0003-0795-8820

Funding

Ultrascale Machine Learning to Empower Discovery in Alzheimers Disease BiobanksU01AG068057 · NIA · UNIVERSITY OF SOUTHERN CALIFORNIA · PI Christos Davatzikos, Heng Huang · 2020 to 2026
$20.7M
Mapping the Human Connectome During Typical DevelopmentU01MH109589 · NIMH · WASHINGTON UNIVERSITY · PI BARCH, DEANNA, BOOKHEIMER, SUSAN Y · 2016 to 2019
$17.1M
Biomedical Image Computing and Informatics ClusterS10OD023495 · OD · UNIVERSITY OF PENNSYLVANIA · PI DAVATZIKOS, CHRISTOS · 2017 to 2017
$1.9M
A High Performance Research Image Repository (RIR) for the Washington University Center of High Performance Computing (CHPC)S10OD030477 · OD · WASHINGTON UNIVERSITY · PI MARCUS, DANIEL SCOTT · 2021 to 2021
$1.9M
Acquisition of a next-generation computing clusterS10OD025200 · OD · WASHINGTON UNIVERSITY · PI TOBIAS, MALCOLM · 2019 to 2019
$597k
NIA NIH HHS U01 AG068057NIH HHS S10 OD023495NIH HHS S10 OD025200NIH HHS S10 OD030477NIMH NIH HHS U01 MH109589
6 · The paper itself

Abstract

Machine learning has been increasingly applied to neuroimaging data to predict age, deriving a personalized biomarker with potential clinical applications. The scientific and clinical value of these models depends on their applicability to independently acquired scans from diverse sources. Accordingly, we evaluated the generalizability of two brain age models that were trained across the lifespan by applying them to three distinct early-life samples with participants aged 8-22 years. These models were chosen based on the size and diversity of their training data, but they also differed greatly in their processing methods and predictive algorithms. Specifically, one brain age model was built by applying gradient tree boosting (GTB) to extracted features of cortical thickness, surface area, and brain volume. The other model applied a 2D convolutional neural network (DBN) to minimally preprocessed slices of T1-weighted scans. Additional model variants were created to understand how generalizability changed when each model was trained with data that became more similar to the test samples in terms of age and acquisition protocols. Our results illustrated numerous trade-offs. The GTB predictions were relatively more accurate overall and yielded more reliable predictions when applied to lower quality scans. In contrast, the DBN displayed the most utility in detecting associations between brain age gaps and cognitive functioning. Broadly speaking, the largest limitations affecting generalizability were acquisition protocol differences and biased brain age estimates. If such confounds could eventually be removed without post-hoc corrections, brain age predictions may have greater utility as personalized biomarkers of healthy aging.

Indexed as

BenchmarkingMagnetic Resonance ImagingBrainHumansLongevityNeuroimagingbrain agebrain developmentcomputational neurosciencegeneralizabilitymachine learning

Identifiers

PMID36346213
PMCPMC9875922

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.