Evidence map›Paper›PMID 39850351›Full record

ArticleNeurophotonics2025

Multisensory naturalistic decoding with high-density diffuse optical tomography.

Kalyan Tripathy, Zachary E Markow, Morgan Fogarty, Mariel L Schroeder, Alexa M Svoboda, Adam T Eggebrecht, Bradley L Schlaggar, Jason W Trobaugh, Joseph P Culver

Abstract read
In one paragraph

Article in Neurophotonics, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed.

  1. Article
  2. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors.

Kalyan TripathyWashington University in St. Louis, Division of Biological and Biomedical Sciences, St. Louis, Missouri, United States.
Zachary E MarkowWashington University School of Medicine, Mallinckrodt Institute of Radiology, St. Louis, Missouri, United States.ORCID https://orcid.org/0000-0002-2587-6821
Morgan FogartyWashington University School of Medicine, Mallinckrodt Institute of Radiology, St. Louis, Missouri, United States.
Mariel L SchroederWashington University School of Medicine, Mallinckrodt Institute of Radiology, St. Louis, Missouri, United States.ORCID https://orcid.org/0000-0001-6524-2295
Alexa M SvobodaWashington University School of Medicine, Mallinckrodt Institute of Radiology, St. Louis, Missouri, United States.
Adam T EggebrechtWashington University in St. Louis, Division of Biological and Biomedical Sciences, St. Louis, Missouri, United States.ORCID https://orcid.org/0000-0002-6320-2676
Bradley L SchlaggarKennedy Krieger Institute, Baltimore, Maryland, United States.ORCID https://orcid.org/0000-0002-9246-2469
Jason W TrobaughWashington University in St. Louis, Department of Electrical and Systems Engineering, St. Louis, Missouri, United States.ORCID https://orcid.org/0009-0008-5183-3359
Joseph P CulverWashington University School of Medicine, Mallinckrodt Institute of Radiology, St. Louis, Missouri, United States.

Funding

High-Sensitivity DOT for Mapping Human Brain FunctionR01NS090874 · NINDS · WASHINGTON UNIVERSITY · PI CULVER, JOSEPH P · 2014 to 2025
$5.5M
21ST CENTURY IMAGING SCIENCES: GRADUATE STUDENT TRAININGT32EB014855 · NIBIB · WASHINGTON UNIVERSITY · PI JOSEPH P CULVER, JOSEPH A O'SULLIVAN · 2012 to 2026
$3.1M
Wireless High-Density Diffuse Optical Tomography for Decoding Brain ActivityU01EB027005 · NIBIB · WASHINGTON UNIVERSITY · PI CULVER, JOSEPH P · 2018 to 2021
$2.7M
Illuminating development of infant and toddler brainfunction with DOTR01MH122751 · NIMH · WASHINGTON UNIVERSITY · PI EGGEBRECHT, ADAM THOMAS · 2020 to 2024
$2.7M
Naturalistic Brain Mapping in Children with Diffuse Optical TomographyR01EB034919 · NIBIB · WASHINGTON UNIVERSITY · PI JOSEPH P CULVER · 2023 to 2026
$2.2M
Optical Tomography and Decoding for Communication via Brain-Computer InterfaceF31NS110261 · NINDS · WASHINGTON UNIVERSITY · PI MARKOW, ZACHARY E · 2019 to 2021
$75k
NIBIB NIH HHS R01 EB034919NIBIB NIH HHS T32 EB014855NIBIB NIH HHS U01 EB027005NIMH NIH HHS R01 MH122751NINDS NIH HHS F31 NS110261NINDS NIH HHS R01 NS090874
6 · The paper itself

Abstract

Significance: Decoding naturalistic content from brain activity has important neuroscience and clinical implications. Information about visual scenes and intelligible speech has been decoded from cortical activity using functional magnetic resonance imaging (fMRI) and electrocorticography, but widespread applications are limited by the logistics of these technologies. Aim: High-density diffuse optical tomography (HD-DOT) offers image quality approaching that of fMRI but with the silent, open scanning environment afforded by optical methods, thus opening the door to more naturalistic research and applications. Although early visual decoding studies with HD-DOT have been promising, decoding of naturalistic auditory and multisensory stimulus information from HD-DOT data has not been established. Approach: Audiovisual decoding was investigated using HD-DOT data collected from participants who viewed a library of movie clips. A template-matching strategy was used to decode which movie clip a participant viewed based on their HD-DOT data. Factors affecting decoding performance-including trial duration and number of decoding choices-were systematically evaluated. Results: Decoding accuracy was 94.2% for four-way decoding utilizing 4 min of data per trial as a starting point. As parameters were made more stringent, decoding performance remained significantly above chance with strong effect sizes down to 15-s trials and up to 32 choices. Comparable decoding accuracies were obtained when cortical sampling was confined to visual and auditory regions and when participants were presented with purely auditory or visual clips. Conclusions: HD-DOT data sample cortical hemodynamics with sufficient resolution and fidelity to support decoding complex, naturalistic, multisensory stimuli via template matching. These results provide a foundation for future studies on more intricate decoding algorithms to reconstruct diverse features of novel naturalistic stimuli from HD-DOT data.

Indexed as

decodingfunctional near-infrared spectroscopyhigh-density diffuse optical tomographynaturalistic speechnaturalistic viewingneuroimaging

Identifiers

PMID39850351
PMCPMC11755382

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.