Evidence map›Paper›PMID 27347565›Full record

ArticleBiological psychiatry. Cognitive neuroscience and neuroimaging2016

Multimodal fusion of brain imaging data: A key to finding the missing link(s) in complex mental illness.

Vince D Calhoun, Jing Sui

Open access · greenAbstract read
In one paragraph

Article in Biological psychiatry. Cognitive neuroscience and neuroimaging, 2016. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 228 papers, 5 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
228citing papers in PubMed, 5 pooled it
20.3field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

228 citing papers in PubMed, 5 syntheses or guidelines pooled it, 472 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Article
  7. Article
  8. Article
  9. Review
  10. Article
  11. Review
  12. Article
  13. Review
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Review
  20. Article

168 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

2 authors at 2 institutions in 2 countries.

Vince D CalhounThe Mind Research Network & LBERI, Albuquerque, New Mexico.; Dept. of ECE, University of New Mexico, Albuquerque, New Mexico.
Jing SuiThe Mind Research Network & LBERI, Albuquerque, New Mexico.; Brainnetome Center and National Laboratory of Pattern Recognition, Beijing, China; CAS Center for Excellence in Brain Science, Institute of Automation, Chinese Academy of Sciences, Beijing, China.
Mind Research Network · USNational Computer Network Emergency Response Technical Team/Coordination Center of Chinar · CN

Funding

Transcranial Direct Current Stimulation for Treatment of Auditory Verbal HalluciP20GM103472 · NIGMS · THE MIND RESEARCH NETWORK · PI BEDRICK, EDWARD J · 2012 to 2017
$14.3M
Multivariate methods for identifying multitask/multimodal brain imaging biomarkersR01EB006841 · NIBIB · THE MIND RESEARCH NETWORK · PI VINCE D CALHOUN, Sergey Plis · 2007 to 2026
$9.8M
NEURAL MECHANISMS OF SCHIZOPHRENIAP20RR021938 · NCRR · THE MIND RESEARCH NETWORK · PI JUNG, REX · 2008 to 2011
$9.4M
Mining the Genomewide Scan: Genetic Profiles of Structural Loss in Schizophrenia: AD/ADRD supplementR01MH094524 · NIMH · THE MIND RESEARCH NETWORK · PI CALHOUN, VINCE D, TURNER, JESS · 2012 to 2021
$6.3M
Informed Data-Driven Fusion of Behavior, Brain Function, and GenesR01EB005846 · NIBIB · THE MIND RESEARCH NETWORK · PI CALHOUN, VINCE D · 2005 to 2016
$5.5M
Unified multivariate data-driven solutions for static and dynamic brain connectivityR01EB020407 · NIBIB · THE MIND RESEARCH NETWORK · PI ADALI, TULAY, CALHOUN, VINCE D · 2015 to 2018
$2.7M
Integration of brain imaging with genomic and epigenomic dataR01MH104680 · NIMH · TULANE UNIVERSITY OF LOUISIANA · PI CALHOUN, VINCE D, DENG, HONG-WEN · 2014 to 2017
$2.1M
Integration of fMRI imaging, genomics, network and biological knowledgeR01MH107354 · NIMH · TULANE UNIVERSITY OF LOUISIANA · PI WANG, YU-PING · 2015 to 2018
$1.9M
NCRR NIH HHS P20 RR021938NIBIB NIH HHS R01 EB005846NIBIB NIH HHS R01 EB006841NIBIB NIH HHS R01 EB020407NIGMS NIH HHS P20 GM103472NIMH NIH HHS R01 MH094524NIMH NIH HHS R01 MH104680NIMH NIH HHS R01 MH107354
6 · The paper itself

Abstract

It is becoming increasingly clear that combining multi-modal brain imaging data is able to provide more information for individual subjects by exploiting the rich multimodal information that exists. However, the number of studies that do true multimodal fusion (i.e. capitalizing on joint information among modalities) is still remarkably small given the known benefits. In part, this is because multi-modal studies require broader expertise in collecting, analyzing, and interpreting the results than do unimodal studies. In this paper, we start by introducing the basic reasons why multimodal data fusion is important and what it can do, and importantly how it can help us avoid wrong conclusions and help compensate for imperfect brain imaging studies. We also discuss the challenges that need to be confronted for such approaches to be more widely applied by the community. We then provide a review of the diverse studies that have used multimodal data fusion (primarily focused on psychosis) as well as provide an introduction to some of the existing analytic approaches. Finally, we discuss some up-and-coming approaches to multi-modal fusion including deep learning and multimodal classification which show considerable promise. Our conclusion is that multimodal data fusion is rapidly growing, but it is still underutilized. The complexity of the human brain coupled with the incomplete measurement provided by existing imaging technology makes multimodal fusion essential in order to mitigate against misdirection and hopefully provide a key to finding the missing link(s) in complex mental illness.

Indexed as

brain functionconnectivitydata fusionindependent component analysispsychosisschizophrenia

Identifiers

PMID27347565
PMCPMC4917230
OpenAlexW2252433728

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.