Evidence map›Paper›PMID 34049888›Full record

ArticleScience advances2021

Cortical response to naturalistic stimuli is largely predictable with deep neural networks.

Meenakshi Khosla, Gia H Ngo, Keith Jamison, Amy Kuceyeski, Mert R Sabuncu

Open access · goldAbstract read
In one paragraph

Article in Science advances, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 27 papers.

0numbers the graph read from it
0cells of the map it votes in
27citing papers in PubMed
4.3field-weighted citation impact, top 5% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

27 citing papers in PubMed, 52 citations in OpenAlex.

  1. Making models disagree to learn how brains compute.Nature reviews. Neuroscience · 2026
    Review
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Rapid cortical mapping with cross-participant encoding models.Imaging neuroscience (Cambridge, Mass.) · 2026
    Article
  10. Article
  11. A hierarchy of processing complexity and timescales for natural sounds in the human auditory cortex.Proceedings of the National Academy of Sciences of the United States of America · 2025
    Article
  12. Article
  13. Article
  14. Review
  15. Article
  16. Review
  17. Dissonant music engages early visual processing.Proceedings of the National Academy of Sciences of the United States of America · 2024
    Article
  18. Review
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors at 1 institution in 1 country.

Meenakshi KhoslaSchool of Electrical and Computer Engineering, Cornell University, Ithaca, NY, USA.ORCID 0000-0002-2910-6242
Gia H NgoSchool of Electrical and Computer Engineering, Cornell University, Ithaca, NY, USA.ORCID 0000-0002-2793-2700
Keith JamisonDepartment of Radiology, Weill Cornell Medicine, New York, NY, USA.ORCID 0000-0001-7139-6661
Amy KuceyeskiDepartment of Radiology, Weill Cornell Medicine, New York, NY, USA.ORCID 0000-0002-5050-8342
Mert R SabuncuSchool of Electrical and Computer Engineering, Cornell University, Ithaca, NY, USA. msabuncu@cornell.edu.ORCID 0000-0002-7068-719X
Cornell University · US

Funding

Multi-Modal Imaging of the Mechanisms Underlying Impaired Executive Attention After Traumatic Brain InjuryR01NS102646 · NINDS · WEILL MEDICAL COLL OF CORNELL UNIV · PI KUCEYESKI, AMY FRANCES, SHAH, SUDHIN · 2018 to 2022
$2.8M
Advanced machine learning algorithms that integrate genomewide, longitudinal MRI and demographic data to predict future cognitive decline toward dementiaR01AG053949 · NIA · WEILL MEDICAL COLL OF CORNELL UNIV · PI SABUNCU, MERT RORY · 2017 to 2021
$2.4M
Novel Bioinformatics Strategies to Study Associations Between Genetic Variants and Neuroanatomical ShapeR01LM012719 · NLM · CORNELL UNIVERSITY · PI SABUNCU, MERT RORY · 2017 to 2020
$1.4M
Quantifying the role of the connectome in resiliency to multiple sclerosisR21NS104634 · NINDS · WEILL MEDICAL COLL OF CORNELL UNIV · PI KUCEYESKI, AMY FRANCES · 2017 to 2018
$466k
NIA NIH HHS R01 AG053949NINDS NIH HHS R01 NS102646NINDS NIH HHS R21 NS104634NLM NIH HHS R01 LM012719
6 · The paper itself

Abstract

Naturalistic stimuli, such as movies, activate a substantial portion of the human brain, invoking a response shared across individuals. Encoding models that predict neural responses to arbitrary stimuli can be very useful for studying brain function. However, existing models focus on limited aspects of naturalistic stimuli, ignoring the dynamic interactions of modalities in this inherently context-rich paradigm. Using movie-watching data from the Human Connectome Project, we build group-level models of neural activity that incorporate several inductive biases about neural information processing, including hierarchical processing, temporal assimilation, and auditory-visual interactions. We demonstrate how incorporating these biases leads to remarkable prediction performance across large areas of the cortex, beyond the sensory-specific cortices into multisensory sites and frontal cortex. Furthermore, we illustrate that encoding models learn high-level concepts that generalize to task-bound paradigms. Together, our findings underscore the potential of encoding models as powerful tools for studying brain function in ecologically valid conditions.

Identifiers

PMID34049888
PMCPMC8163078
OpenAlexW3165030117

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.