Evidence map›Paper›PMID 37212782›Full record

ArticleJournal of vision2023

A brain-inspired object-based attention network for multiobject recognition and visual reasoning.

Hossein Adeli, Seoyoung Ahn, Gregory J Zelinsky

Abstract read
In one paragraph

Article in Journal of vision, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 6 papers.

0numbers the graph read from it
0cells of the map it votes in
6citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

6 citing papers in PubMed.

  1. Review
  2. Article
  3. Article
  4. Article
  5. Self-supervised transformers predict dynamics of object-based attention in humans.Proceedings of the ... Conference on Cognitive Computational Neuroscience · 2023
    Article
  6. Using Generated Object Reconstructions to Study Object-based Attention.Proceedings of the ... Conference on Cognitive Computational Neuroscience · 2023
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Hossein AdeliDepartment of Psychology, Stony Brook University, Stony Brook, NY, USA.
Seoyoung AhnDepartment of Psychology, Stony Brook University, Stony Brook, NY, USA.
Gregory J ZelinskyDepartment of Psychology, Stony Brook University, Stony Brook, NY, USA.

Funding

Saccade Target Selection in Naturalistic Visual SearchR01EY030669 · NEI · STATE COLLEGE OF OPTOMETRY · PI ROBERT M MCPEEK, GREGORY J ZELINSKY · 2019 to 2026
$4.2M
NEI NIH HHS R01 EY030669
6 · The paper itself

Abstract

The visual system uses sequences of selective glimpses to objects to support goal-directed behavior, but how is this attention control learned? Here we present an encoder-decoder model inspired by the interacting bottom-up and top-down visual pathways making up the recognition-attention system in the brain. At every iteration, a new glimpse is taken from the image and is processed through the "what" encoder, a hierarchy of feedforward, recurrent, and capsule layers, to obtain an object-centric (object-file) representation. This representation feeds to the "where" decoder, where the evolving recurrent representation provides top-down attentional modulation to plan subsequent glimpses and impact routing in the encoder. We demonstrate how the attention mechanism significantly improves the accuracy of classifying highly overlapping digits. In a visual reasoning task requiring comparison of two objects, our model achieves near-perfect accuracy and significantly outperforms larger models in generalizing to unseen stimuli. Our work demonstrates the benefits of object-based attention mechanisms taking sequential glimpses of objects.

Indexed as

BrainVisual PerceptionHumansPattern Recognition, VisualPhotic StimulationProblem SolvingRecognition, Psychology

Identifiers

PMID37212782
PMCPMC10210512

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.