Evidence map›Paper›PMID 29705690›Full record

ArticleNeuroImage2018

Transferring and generalizing deep-learning-based neural encoding models across subjects.

Haiguang Wen, Junxing Shi, Wei Chen, Zhongming Liu

Abstract read
In one paragraph

Article in NeuroImage, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 13 papers.

0numbers the graph read from it
0cells of the map it votes in
13citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

13 citing papers in PubMed.

  1. Review
  2. [A deep transfer learning approach for cross-subject recognition of mental tasks based on functional near-infrared spectroscopy].Sheng wu yi xue gong cheng xue za zhi = Journal of biomedical engineering = Shengwu yixue gongchengxue zazhi · 2024
    Article
  3. Article
  4. Review
  5. Article
  6. Article
  7. Integrating Statistical and Machine Learning Approaches for Neural Classification.IEEE access : practical innovations, open solutions · 2022
    Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Haiguang WenSchool of Electrical and Computer Engineering, Purdue University, West Lafayette, IN, USA; Purdue Institute for Integrative Neuroscience, Purdue University, West Lafayette, IN, USA.
Junxing ShiSchool of Electrical and Computer Engineering, Purdue University, West Lafayette, IN, USA; Purdue Institute for Integrative Neuroscience, Purdue University, West Lafayette, IN, USA.
Wei ChenCenter for Magnetic Resonance Research, Department of Radiology, University of Minnesota Medical School, Minneapolis, MN, USA.
Zhongming LiuWeldon School of Biomedical Engineering, Purdue University, West Lafayette, IN, USA; School of Electrical and Computer Engineering, Purdue University, West Lafayette, IN, USA; Purdue Institute for Integrative Neuroscience, Purdue University, West Lafayette, IN, USA. Electronic address: zmliu@purdue.edu.

Funding

Multimodal Hyperspectral Imaging of Brain Activity and ConnectivityR01MH104402 · NIMH · PURDUE UNIVERSITY · PI LIU, ZHONGMING · 2014 to 2018
$2.3M
NIMH NIH HHS R01 MH104402
6 · The paper itself

Abstract

Recent studies have shown the value of using deep learning models for mapping and characterizing how the brain represents and organizes information for natural vision. However, modeling the relationship between deep learning models and the brain (or encoding models), requires measuring cortical responses to large and diverse sets of natural visual stimuli from single subjects. This requirement limits prior studies to few subjects, making it difficult to generalize findings across subjects or for a population. In this study, we developed new methods to transfer and generalize encoding models across subjects. To train encoding models specific to a target subject, the models trained for other subjects were used as the prior models and were refined efficiently using Bayesian inference with a limited amount of data from the target subject. To train encoding models for a population, the models were progressively trained and updated with incremental data from different subjects. For the proof of principle, we applied these methods to functional magnetic resonance imaging (fMRI) data from three subjects watching tens of hours of naturalistic videos, while a deep residual neural network driven by image recognition was used to model visual cortical processing. Results demonstrate that the methods developed herein provide an efficient and effective strategy to establish both subject-specific and population-wide predictive models of cortical representations of high-dimensional and hierarchical visual features.

Indexed as

Deep LearningAdultBayes TheoremBrainBrain MappingFemaleHumansMagnetic Resonance ImagingNeural PathwaysPattern Recognition, VisualReproducibility of ResultsYoung AdultBayesian inferenceDeep learningIncremental learningNatural visionNeural encoding

Identifiers

PMID29705690
PMCPMC5976558

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.