Evidence map›Paper›PMID 34164631›Full record

ArticleNeurons, behavior, data analysis, and theory2021

Predicting Goal-directed Attention Control Using Inverse-Reinforcement Learning.

Gregory J Zelinsky, Yupei Chen, Seoyoung Ahn, Hossein Adeli, Zhibo Yang, Lihan Huang, Dimitrios Samaras, Minh Hoai

Abstract read
In one paragraph

Article in Neurons, behavior, data analysis, and theory, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 8 papers.

0numbers the graph read from it
0cells of the map it votes in
8citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

8 citing papers in PubMed.

  1. Article
  2. Look Hear: Gaze Prediction for Speech-directed Human Attention.Computer vision - ECCV ... : ... European Conference on Computer Vision : proceedings. European Conference on Computer Vision · 2025
    Article
  3. Unifying Top-down and Bottom-up Scanpath Prediction Using Transformers.Proceedings. IEEE Computer Society Conference on Computer Vision and Pattern Recognition · 2024
    Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Attention in Psychology, Neuroscience, and Machine Learning.Frontiers in computational neuroscience · 2020
    Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Gregory J ZelinskyDepartment of Psychology, Stony Brook University, Stony Brook, NY, 11794, USA.
Yupei ChenDepartment of Psychology, Stony Brook University, Stony Brook, NY, 11794, USA.
Seoyoung AhnDepartment of Psychology, Stony Brook University, Stony Brook, NY, 11794, USA.
Hossein AdeliDepartment of Psychology, Stony Brook University, Stony Brook, NY, 11794, USA.
Zhibo YangDepartment of Computer Science, Stony Brook University, Stony Brook, NY, 11794, USA.
Lihan HuangDepartment of Computer Science, Stony Brook University, Stony Brook, NY, 11794, USA.
Dimitrios SamarasDepartment of Computer Science, Stony Brook University, Stony Brook, NY, 11794, USA.
Minh HoaiDepartment of Computer Science, Stony Brook University, Stony Brook, NY, 11794, USA.

Funding

Saccade Target Selection in Naturalistic Visual SearchR01EY030669 · NEI · STATE COLLEGE OF OPTOMETRY · PI ROBERT M MCPEEK, GREGORY J ZELINSKY · 2019 to 2026
$4.2M
NEI NIH HHS R01 EY030669
6 · The paper itself

Abstract

Understanding how goals control behavior is a question ripe for interrogation by new methods from machine learning. These methods require large and labeled datasets to train models. To annotate a large-scale image dataset with observed search fixations, we collected 16,184 fixations from people searching for either microwaves or clocks in a dataset of 4,366 images (MS-COCO). We then used this behaviorally-annotated dataset and the machine learning method of inverse-reinforcement learning (IRL) to learn target-specific reward functions and policies for these two target goals. Finally, we used these learned policies to predict the fixations of 60 new behavioral searchers (clock = 30, microwave = 30) in a disjoint test dataset of kitchen scenes depicting both a microwave and a clock (thus controlling for differences in low-level image contrast). We found that the IRL model predicted behavioral search efficiency and fixation-density maps using multiple metrics. Moreover, reward maps from the IRL model revealed target-specific patterns that suggest, not just attention guidance by target features, but also guidance by scene context (e.g., fixations along walls in the search of clocks). Using machine learning and the psychologically meaningful principle of reward, it is possible to learn the visual features used in goal-directed attention control.

Indexed as

attention modelseye behaviorfixation predictionreinforcement learningtop-down attentionvisual search

Identifiers

PMID34164631
PMCPMC8218820

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.