Evidence map›Paper›PMID 36437735›Full record

ArticleHuman brain mapping2023

Multisite test-retest reliability and compatibility of brain metrics derived from FreeSurfer versions 7.1, 6.0, and 5.3.

Elizabeth Haddad, Fabrizio Pizzagalli, Alyssa H Zhu, Ravi R Bhatt, Tasfiya Islam, Iyad Ba Gari, Daniel Dixon, Sophia I Thomopoulos, Paul M Thompson, Neda Jahanshad

Abstract read
In one paragraph

Article in Human brain mapping, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 32 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
32citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

32 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Trial
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Observational
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Challenges in measuring individual differences of brain function.Imaging neuroscience (Cambridge, Mass.) · 2025
    Article
  18. Current best practices and future opportunities for reproducible findings using large-scale neuroimaging in psychiatry.Neuropsychopharmacology : official publication of the American College of Neuropsychopharmacology · 2024
    Review
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

Elizabeth HaddadImaging Genetics Center, Mark and Mary Stevens Neuroimaging and Informatics Institute, Keck School of Medicine, University of Southern California, Marina del Rey, California, USA.ORCID 0000-0002-7622-9085
Fabrizio PizzagalliImaging Genetics Center, Mark and Mary Stevens Neuroimaging and Informatics Institute, Keck School of Medicine, University of Southern California, Marina del Rey, California, USA.ORCID 0000-0003-4582-0224
Alyssa H ZhuImaging Genetics Center, Mark and Mary Stevens Neuroimaging and Informatics Institute, Keck School of Medicine, University of Southern California, Marina del Rey, California, USA.ORCID 0000-0003-0083-5107
Ravi R BhattImaging Genetics Center, Mark and Mary Stevens Neuroimaging and Informatics Institute, Keck School of Medicine, University of Southern California, Marina del Rey, California, USA.ORCID 0000-0003-2498-8888
Tasfiya IslamImaging Genetics Center, Mark and Mary Stevens Neuroimaging and Informatics Institute, Keck School of Medicine, University of Southern California, Marina del Rey, California, USA.ORCID 0000-0002-2354-9237
Iyad Ba GariImaging Genetics Center, Mark and Mary Stevens Neuroimaging and Informatics Institute, Keck School of Medicine, University of Southern California, Marina del Rey, California, USA.ORCID 0000-0003-1443-8786
Daniel DixonImaging Genetics Center, Mark and Mary Stevens Neuroimaging and Informatics Institute, Keck School of Medicine, University of Southern California, Marina del Rey, California, USA.ORCID 0000-0003-3706-5636
Sophia I ThomopoulosImaging Genetics Center, Mark and Mary Stevens Neuroimaging and Informatics Institute, Keck School of Medicine, University of Southern California, Marina del Rey, California, USA.ORCID 0000-0002-0046-4070
Paul M ThompsonImaging Genetics Center, Mark and Mary Stevens Neuroimaging and Informatics Institute, Keck School of Medicine, University of Southern California, Marina del Rey, California, USA.ORCID 0000-0002-4720-8867
Neda JahanshadImaging Genetics Center, Mark and Mary Stevens Neuroimaging and Informatics Institute, Keck School of Medicine, University of Southern California, Marina del Rey, California, USA.ORCID 0000-0003-4401-8950

Funding

Smartphone-Based "Burst" Cognitive AssessmentsP01AG003991 · NIA · WASHINGTON UNIVERSITY · PI JOHN MORRIS · 1985 to 2026
$69.5M
WASHINGTON UNIVERSITY ALZHEIMERS DISEASE RESEARCH CENTERP50AG005681 · NIA · WASHINGTON UNIVERSITY · PI FAGAN, ANNE · 1985 to 2019
$52.1M
The natural history of AB accumulation in preclinical ADP01AG026276 · NIA · WASHINGTON UNIVERSITY · PI MORRIS, JOHN · 2005 to 2025
$49.5M
Mapping the Human Connectome: Structure, Function, and HeritabilityU54MH091657 · NIMH · WASHINGTON UNIVERSITY · PI UGURBIL, KAMIL, VAN ESSEN, DAVID C · 2010 to 2014
$34.7M
Research Education ComponentP30AG066444 · NIA · WASHINGTON UNIVERSITY · PI DAVID M. HOLTZMAN · 2020 to 2026
$28.7M
MORPHOMETRY BIOMEDICAL INFORMATICS RESEARCH NETWORKU24RR021382 · NCRR · MASSACHUSETTS GENERAL HOSPITAL · PI ROSEN, BRUCE R · 2004 to 2008
$24.1M
X-LINKED ADRENOLEUKODYSTROPHYP41RR015241 · NCRR · HUGO W. MOSER RES INST KENNEDY KRIEGER · PI BARKER, PETER B · 2001 to 2011
$18.5M
TR&D3: Intrinsic Surface MappingP41EB015922 · NIBIB · UNIVERSITY OF SOUTHERN CALIFORNIA · PI VAN HORN, JOHN DARRELL · 2012 to 2022
$14.1M
STRUCTURE, FUNCTION AND COGNITION IN SCHIZOPHRENIAP50MH071616 · NIMH · WASHINGTON UNIVERSITY · PI BARCH, DEANNA · 2004 to 2008
$11.2M
ENIGMA-COINSTAC-APOE2 Functional and structural connectome protective mechanisms for Alzheimer’s disease and mood disorders: Request for supplemental funds for NIH R01:1R01MH121246R01MH121246 · NIMH · OHIO STATE UNIVERSITY · PI CALHOUN, VINCE D, TURNER, JESS · 2019 to 2023
$5.0M
ENIGMA World Aging CenterR01AG058854 · NIA · UNIVERSITY OF SOUTHERN CALIFORNIA · PI THOMPSON, PAUL M · 2021 to 2025
$3.3M
High resolution mapping of the genetic risk for disease in the aging brainR01AG059874 · NIA · UNIVERSITY OF SOUTHERN CALIFORNIA · PI JAHANSHAD, NEDA · 2018 to 2022
$3.1M
NCRR NIH HHS P41 RR015241NCRR NIH HHS U24 RR021382NIA NIH HHS P01 AG003991NIA NIH HHS P01 AG026276NIA NIH HHS P30 AG066444NIA NIH HHS P50 AG005681NIA NIH HHS R01 AG021910NIA NIH HHS R01 AG058854NIA NIH HHS R01 AG059874NIBIB NIH HHS P41 EB015922NIMH NIH HHS P50 MH071616NIMH NIH HHS R01 MH117601NIMH NIH HHS R01 MH121246NIMH NIH HHS U54 MH091657NINDS NIH HHS R01 NS056307NINDS NIH HHS R21 NS064534
6 · The paper itself

Abstract

Automatic neuroimaging processing tools provide convenient and systematic methods for extracting features from brain magnetic resonance imaging scans. One tool, FreeSurfer, provides an easy-to-use pipeline to extract cortical and subcortical morphometric measures. There have been over 25 stable releases of FreeSurfer, with different versions used across published works. The reliability and compatibility of regional morphometric metrics derived from the most recent version releases have yet to be empirically assessed. Here, we used test-retest data from three public data sets to determine within-version reliability and between-version compatibility across 42 regional outputs from FreeSurfer versions 7.1, 6.0, and 5.3. Cortical thickness from v7.1 was less compatible with that of older versions, particularly along the cingulate gyrus, where the lowest version compatibility was observed (intraclass correlation coefficient 0.37-0.61). Surface area of the temporal pole, frontal pole, and medial orbitofrontal cortex, also showed low to moderate version compatibility. We confirm low compatibility between v6.0 and v5.3 of pallidum and putamen volumes, while those from v7.1 were compatible with v6.0. Replication in an independent sample showed largely similar results for measures of surface area and subcortical volumes, but had lower overall regional thickness reliability and compatibility. Batch effect correction may adjust for some inter-version effects when most sites are run with one version, but results vary when more sites are run with different versions. Age associations in a quality controlled independent sample (N = 106) revealed version differences in results of downstream statistical analysis. We provide a reference to highlight the regional metrics that may yield recent version-related inconsistencies in published findings. An interactive viewer is provided at http://data.brainescience.org/Freesurfer_Reliability/.

Indexed as

Image Processing, Computer-AssistedSoftwareBrainHumansMagnetic Resonance ImagingReproducibility of ResultsMRIneuroimagingreliabilitysurface areathicknessversion compatibility

Identifiers

PMID36437735
PMCPMC9921222

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.