Evidence map›Paper›PMID 33961321›Full record

ArticleMagnetic resonance in medicine2021

Three-dimensional self-attention conditional GAN with spectral normalization for multimodal neuroimaging synthesis.

Haoyu Lan, Alzheimer Disease Neuroimaging Initiative, Arthur W Toga, Farshid Sepehrband

Abstract read
In one paragraph

Article in Magnetic resonance in medicine, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 22 papers.

0numbers the graph read from it
0cells of the map it votes in
22citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

22 citing papers in PubMed.

  1. Generating Synthetic MR Spectroscopic Imaging Data with Generative Adversarial Networks to Train Machine Learning Models.Magnetic resonance in medical sciences : MRMS : an official journal of Japan Society of Magnetic Resonance in Medicine · 2025
    Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Turning brain MRI into diagnostic PET:Medical image analysis · 2024
    Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Review
  14. Article
  15. Article
  16. Review
  17. Review
  18. Zeitschrift fur medizinische Physik · 2022
    Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Haoyu LanLaboratory of NeuroImaging, USC Stevens Neuroimaging and Informatics Institute, Keck School of Medicine, University of Southern California, Los Angeles, California, USA.ORCID 0000-0002-4398-9053
Alzheimer Disease Neuroimaging Initiative
Arthur W TogaLaboratory of NeuroImaging, USC Stevens Neuroimaging and Informatics Institute, Keck School of Medicine, University of Southern California, Los Angeles, California, USA.
Farshid SepehrbandLaboratory of NeuroImaging, USC Stevens Neuroimaging and Informatics Institute, Keck School of Medicine, University of Southern California, Los Angeles, California, USA.ORCID 0000-0002-4483-5961

Funding

Alzheimer's Disease Neuroimaging Initiative - SupplementU01AG024904 · NIA · NORTHERN CALIFORNIA INSTITUTE RES &EDUC · PI WEINER, MICHAEL W · 2004 to 2015
$121.0M
VASCULAR RISK AND COGNITIVE STATUS IN A LATINO POPULATIONP50AG005142 · NIA · UNIVERSITY OF SOUTHERN CALIFORNIA · PI BRASKIE, MEREDITH NICOLE · 1985 to 2019
$41.0M
Vascular Contributions to Dementia and Genetic Risk Factors for Alzheimer's DiseaseP01AG052350 · NIA · UNIVERSITY OF SOUTHERN CALIFORNIA · PI Daniel A Nation, ARTHUR W TOGA · 2016 to 2026
$28.4M
TR&D3: Intrinsic Surface MappingP41EB015922 · NIBIB · UNIVERSITY OF SOUTHERN CALIFORNIA · PI VAN HORN, JOHN DARRELL · 2012 to 2022
$14.1M
TrainingU54EB020406 · NIBIB · UNIVERSITY OF SOUTHERN CALIFORNIA · PI TOGA, ARTHUR W · 2014 to 2018
$12.5M
Department of Defense W81XWH-12-2-0012Foundation for the National Institutes of Health 1P01AG052350-01Foundation for the National Institutes of Health 2P41EB015922-21Foundation for the National Institutes of Health U54EB020406Foundation for the National Institutes of Health USC ADRC 5P50AG005142NIA NIH HHS P01 AG052350NIA NIH HHS P50 AG005142NIA NIH HHS U01 AG024904NIBIB NIH HHS P41 EB015922NIBIB NIH HHS U54 EB020406
6 · The paper itself

Abstract

purposeTo develop a new 3D generative adversarial network that is designed and optimized for the application of multimodal 3D neuroimaging synthesis.

methodsWe present a 3D conditional generative adversarial network (GAN) that uses spectral normalization and feature matching to stabilize the training process and ensure optimization convergence (called SC-GAN). A self-attention module was also added to model the relationships between widely separated image voxels. The performance of the network was evaluated on the data set from ADNI-3, in which the proposed network was used to predict PET images, fractional anisotropy, and mean diffusivity maps from multimodal MRI. Then, SC-GAN was applied on a multidimensional diffusion MRI experiment for superresolution application. Experiment results were evaluated by normalized RMS error, peak SNR, and structural similarity.

resultsIn general, SC-GAN outperformed other state-of-the-art GAN networks including 3D conditional GAN in all three tasks across all evaluation metrics. Prediction error of the SC-GAN was 18%, 24% and 29% lower compared to 2D conditional GAN for fractional anisotropy, PET and mean diffusivity tasks, respectively. The ablation experiment showed that the major contributors to the improved performance of SC-GAN are the adversarial learning and the self-attention module, followed by the spectral normalization module. In the superresolution multidimensional diffusion experiment, SC-GAN provided superior predication in comparison to 3D Unet and 3D conditional GAN.

conclusionIn this work, an efficient end-to-end framework for multimodal 3D medical image synthesis (SC-GAN) is presented. The source code is also made available at https://github.com/Haoyulance/SC-GAN.

Indexed as

Image Processing, Computer-AssistedMagnetic Resonance ImagingAttentionImaging, Three-DimensionalNeuroimaging3D GANMRIPETself-attentionspectral normalizationsynthesis

Identifiers

PMID33961321
PMCPMC9070032

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.