ArticlePsychological research2022
On the reliability of behavioral measures of cognitive control: retest reliability of task-inhibition effect, task-preparation effect, Stroop-like interference, and conflict adaptation effect.
Article in Psychological research, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 16 papers.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
16 citing papers in PubMed.
- Reliability and statistical power: Conceptual background and practical implications.Behavior research methods · 2026Review
- Preview position versus length: Key factors in the time course of parallel processing in multitasking.Memory & cognition · 2026Article
- Conflict adaptation in a confound-minimized face-word Stroop task: exploring the potential settings of an fMRI-related experiment.Frontiers in psychology · 2026Article
- The temporal dynamics of metacognitive experiences track rational adaptations in task performance.Communications psychology · 2025Article
- Article
- The functional neurobiology of negative affective traits across regions, networks, signatures, and a machine learning multiverse.bioRxiv : the preprint server for biology · 2025Article
- Neural Mechanisms Supporting the Relationship between Working Memory Capacity and Proactive Control.bioRxiv : the preprint server for biology · 2025Article
- A shared temporal window of integration across cognitive control and reinforcement learning paradigms: A correlational study.Memory & cognition · 2025Article
- Eye-tracking measurement of attention bias to social threat among youth: A replication and extension study.Journal of mood and anxiety disorders · 2024Article
- Psychometrics in experimental psychology: A case for calibration.Psychonomic bulletin & review · 2024Review
- Reliable affordances: A generative modeling approach for test-retest reliability of the affordances task.Behavior research methods · 2024Article
- Embodied decision biases: individually stable across different tasks?Experimental brain research · 2023Article
- Studying Individual Differences in Language Comprehension: The Challenges of Item-Level Variability and Well-Matched Control Conditions.Journal of cognition · 2023Article
- Brain network mechanism on cognitive control task in the elderly with brain aging: A functional near infrared spectroscopy study.Frontiers in human neuroscience · 2023Article
- Are control processes domain-general? A replication of 'To adapt or not to adapt? The question of domain-general cognitive control' (KanRoyal Society open science · 2022Article
- We need to talk about validity - A commentary on "Six solutions for more reliable infant research" from the viewpoint of an early executive functions researcher.Infant and child developmentArticle
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
4 authors.
Funding
Abstract
This study examined the reliability (retest and split-half) of four common behavioral measures of cognitive control. In Experiment 1 (N = 96), we examined N - 2 task repetition costs as a marker of task-level inhibition, and the cue-stimulus interval (CSI) effect as a marker of time-based task preparation. In Experiment 2 (N = 48), we examined a Stroop-like face-name interference effect as a measure of distractor interference control, and the sequential congruency effect ("conflict adaptation effect") as a measure of conflict-triggered adaptation of cognitive control. In both experiments, the measures were assessed in two sessions on the same day, separated by a 10 min-long unrelated filler task. We observed substantial experimental effects with medium to large effect sizes. At the same time, split-half reliabilities were moderate, and retest reliabilities were poor, for most measures, except for the CSI effect. Retest reliability of the Stroop-like effect was improved when considering only trials preceded by congruent trials. Together, the data suggest that these cognitive control measures are well suited for assessing group-level effects of cognitive control. Yet, except for the CSI effect, these measures do not seem suitable for reliably assessing interindividual differences in the strength of cognitive control, and therefore are not suited for correlational approaches. We discuss possible reasons for the discrepancy between robustness at the group level and reliability at the level of interindividual differences.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.