Evidence map›Paper›PMID 36740029›Full record

SynthesisNeuroImage2023

Deep neural network heatmaps capture Alzheimer's disease patterns reported in a large meta-analysis of neuroimaging studies.

Di Wang, Nicolas Honnorat, Peter T Fox, Kerstin Ritter, Simon B Eickhoff, Sudha Seshadri, Alzheimer’s Disease Neuroimaging Initiative, Mohamad Habes

Abstract readMeta-Analysis
In one paragraph

Synthesis in NeuroImage, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 26 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
26citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

26 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Review
  9. Review
  10. Article
  11. Review
  12. Review
  13. Article
  14. Article
  15. Article
  16. Review
  17. Article
  18. Article
  19. Article
  20. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Di WangNeuroimage Analytics Laboratory and Biggs Institute Neuroimaging Core, Glenn Biggs Institute for Neurodegenerative Disorders, University of Texas Health Science Center at San Antonio, San Antonio, TX, USA.
Nicolas HonnoratNeuroimage Analytics Laboratory and Biggs Institute Neuroimaging Core, Glenn Biggs Institute for Neurodegenerative Disorders, University of Texas Health Science Center at San Antonio, San Antonio, TX, USA.
Peter T FoxBiomedical Image Analytics Division, Research Imaging Institute, University of Texas Health Science Center at San Antonio, San Antonio, TX, USA.
Kerstin RitterDepartment of Psychiatry and Neurosciences, Charite - University of Medicine Berlin and Humboldt-University Berlin, Berlin, Germany.
Simon B EickhoffInstitute of Neuroscience and Medicine, Brain & Behaviour (INM-7), Research Centre Jülich, Jülich, Germany; Institute of Systems Neuroscience, Heinrich-Heine University Düsseldorf, Germany.
Sudha SeshadriNeuroimage Analytics Laboratory and Biggs Institute Neuroimaging Core, Glenn Biggs Institute for Neurodegenerative Disorders, University of Texas Health Science Center at San Antonio, San Antonio, TX, USA.
Alzheimer’s Disease Neuroimaging InitiativeThe brain scans used in the present work were obtained from the Alzheimer's Disease Neuroimaging Initiative (ADNI) database (adni.loni.usc.edu) but ADNI investigators did not participate in the design, the analysis, or the writing of the manuscript. A complete listing of ADNI investigators can be found at http://adni.loni.usc.edu/wp-content/uploads/how_to_apply/ADNI_Acknowledgement_List.pdf.
Mohamad HabesNeuroimage Analytics Laboratory and Biggs Institute Neuroimaging Core, Glenn Biggs Institute for Neurodegenerative Disorders, University of Texas Health Science Center at San Antonio, San Antonio, TX, USA; Biomedical Image Analytics Division, Research Imaging Institute, University of Texas Health Science Center at San Antonio, San Antonio, TX, USA. Electronic address: habes@uthscsa.edu.

Funding

MVP Data Integration into the ADSP Phenotype Harmonization ConsortiumU24AG074855 · NIA · VANDERBILT UNIVERSITY MEDICAL CENTER · PI CUCCARO, MICHAEL L, HOHMAN, TIMOTHY J · 2021 to 2025
$37.5M
South Texas Alzheimer's Disease Research CenterP30AG066546 · NIA · UNIVERSITY OF TEXAS HLTH SCIENCE CENTER · PI Mohamad Habes · 2021 to 2026
$24.0M
Meta-anaylsis in human brain mappingR01MH074457 · NIMH · UNIVERSITY OF TEXAS HLTH SCIENCE CENTER · PI FOX, PETER THORNTON · 2006 to 2024
$10.5M
Atrial fibrillation burden, vascular disease of the brain and cardiac MRI in MESAR01HL127659 · NHLBI · UNIVERSITY OF WASHINGTON · PI HECKBERT, SUSAN R · 2015 to 2018
$7.4M
Multiethnic machine learning brain signatures of ADRDR01AG080821 · NIA · UNIVERSITY OF TEXAS HLTH SCIENCE CENTER · PI HABES, MOHAMAD · 2022 to 2025
$2.9M
NHLBI NIH HHS R01 HL127659NIA NIH HHS P30 AG066546NIA NIH HHS R01 AG080821NIA NIH HHS U24 AG074855NIMH NIH HHS R01 MH074457
6 · The paper itself

Abstract

Deep neural networks currently provide the most advanced and accurate machine learning models to distinguish between structural MRI scans of subjects with Alzheimer's disease and healthy controls. Unfortunately, the subtle brain alterations captured by these models are difficult to interpret because of the complexity of these multi-layer and non-linear models. Several heatmap methods have been proposed to address this issue and analyze the imaging patterns extracted from the deep neural networks, but no quantitative comparison between these methods has been carried out so far. In this work, we explore these questions by deriving heatmaps from Convolutional Neural Networks (CNN) trained using T1 MRI scans of the ADNI data set and by comparing these heatmaps with brain maps corresponding to Support Vector Machine (SVM) activation patterns. Three prominent heatmap methods are studied: Layer-wise Relevance Propagation (LRP), Integrated Gradients (IG), and Guided Grad-CAM (GGC). Contrary to prior studies where the quality of heatmaps was visually or qualitatively assessed, we obtained precise quantitative measures by computing overlap with a ground-truth map from a large meta-analysis that combined 77 voxel-based morphometry (VBM) studies independently from ADNI. Our results indicate that all three heatmap methods were able to capture brain regions covering the meta-analysis map and achieved better results than SVM activation patterns. Among them, IG produced the heatmaps with the best overlap with the independent meta-analysis.

Indexed as

Alzheimer DiseaseBrainHumansMagnetic Resonance ImagingNeural Networks, ComputerNeuroimagingAlzheimer’s diseaseDeep learningExplainable AIMRINeuroimaging

Identifiers

PMID36740029
PMCPMC11155416

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.