ReviewBiological psychiatry. Cognitive neuroscience and neuroimaging2023
Improving the Reliability of Cognitive Task Measures: A Narrative Review.
Review in Biological psychiatry. Cognitive neuroscience and neuroimaging, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 55 papers, 2 of them syntheses that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
55 citing papers in PubMed, 2 syntheses or guidelines pooled it.
- Differential Associations of Dopamine and Serotonin With Reward and Punishment Processes in Humans: A Systematic Review and Meta-Analysis.JAMA psychiatry · 2025Pooled it
- Consistency as the Currency in Psychological Measures: A Reliability Generalization Meta-Analysis of Kessler Psychological Distress Scale (K-10 and K-6).Depression and anxiety · 2024Pooled it
- The acute effect of two exercise modalities on neurocognitive responses in postmenopausal women: A randomized controlled trial.Experimental physiology · 2026Trial
- The double-pass correlation: A reliability metric for subjective judgments in developmental research.MethodsX · 2026Article
- Reliability of computational versus noncomputational metrics of working memory and episodic memory in serious mental illness.Journal of psychopathology and clinical science · 2026Article
- Automatic value learning results in counterproductive human behavior.Nature communications · 2026Article
- Diverging influences of punishment motivation and negative affect on cognitive control.Cognitive, affective & behavioral neuroscience · 2026Article
- The recoverability, reliability, and generalizability of reward processing parameters and relation to mental health symptoms.Psychological medicine · 2026Article
- Attention and learning strategies reveal distinct dimensions of psychiatric diseases.Research square · 2026Article
- Subdomains of executive function correlate with accuracy on a change detection task.Psychonomic bulletin & review · 2026Article
- Congruency and distance effects vary across simultaneous and sequential two-digit integer, fraction, and decimal 2AFC tasks.Behavior research methods · 2026Article
- Ventral striatum temporal interference brain stimulation enhances the reward positivity event-related potential and reduces anxiety.Research square · 2026Article
- Test-retest reliability of the gaze index for sign-tracking and goal-tracking.Behavior research methods · 2026Article
- Optimally sequencing semantic search predicts creativity.PloS one · 2026Article
- Associations Between Steep Delay Discounting and Punishment Learning.Computational psychiatry (Cambridge, Mass.) · 2026Article
- Dense Phenotyping of Human Brain Network Organization Using Precision fMRI.Annual review of psychology · 2026Review
- Miyake Revisited: Validating the Factor Structure of an Open-Source Cognitive Control Test Battery.Journal of cognition · 2026Article
- Attenuated learning rates for negative outcomes in substance use disorders: A replication and extension of prior longitudinal computational modeling results.Drug and alcohol dependence · 2026Article
- Assessing the validity evidence for habit measures based on time pressure.Behavior research methods · 2025Article
- Psychometric Considerations in Assessing Fear Generalization as a Predictor of Anxiety.Biological psychiatry global open science · 2025Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
2 authors.
Funding
Abstract
Cognitive tasks are capable of providing researchers with crucial insights into the relationship between cognitive processing and psychiatric phenomena. However, many recent studies have found that task measures exhibit poor reliability, which hampers their usefulness for individual differences research. Here, we provide a narrative review of approaches to improve the reliability of cognitive task measures. Specifically, we introduce a taxonomy of experiment design and analysis strategies for improving task reliability. Where appropriate, we highlight studies that are exemplary for improving the reliability of specific task measures. We hope that this article can serve as a helpful guide for experimenters who wish to design a new task, or improve an existing one, to achieve sufficient reliability for use in individual differences research.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.