Evidence map›Paper›PMID 30117114›Full record

ArticleMemory & cognition2018

Most evidence for the compensation account of cognitive training is unreliable.

Tomasz Smoleń, Jan Jastrzebski, Eduardo Estrada, Adam Chuderski

Abstract read
In one paragraph

Article in Memory & cognition, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 13 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
13citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

13 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Trial
  4. Article
  5. Article
  6. Long-Term Effects of the Multicomponent Program BrainProtectJournal of Alzheimer's disease reports · 2024
    Article
  7. Cognitive Training: A Field in Search of a Phenomenon.Perspectives on psychological science : a journal of the Association for Psychological Science · 2023
    Article
  8. Article
  9. Review
  10. Article
  11. Article
  12. Review
  13. The Influence of Individual Differences in Cognitive Ability on Working Memory Training Gains.Journal of cognitive enhancement : towards the integration of theory and practice · 2019
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Tomasz SmoleńJagiellonian University, ul. Grodzka 52, 31-044, Krakow, Poland. tomasz.smolen@up.krakow.pl.ORCID 0000-0003-1884-4909
Jan JastrzebskiJagiellonian University, ul. Grodzka 52, 31-044, Krakow, Poland.
Eduardo EstradaUniversity of California, Davis, 135 Young Hall, One Shields Avenue, Davis, CA, USA.
Adam ChuderskiJagiellonian University, ul. Grodzka 52, 31-044, Krakow, Poland.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Cognitive training and brain stimulation studies have suggested that human cognition, primarily working memory and attention control processes, can be enhanced. Some authors claim that gains (i.e., post-test minus pretest scores) from such interventions are unevenly distributed among people. The magnification account (expressed by the evangelical "who has will more be given") predicts that the largest gains will be shown by the most cognitively efficient people, who will also be most effective in exploiting interventions. In contrast, the compensation account ("who has will less be given") predicts that such people already perform at ceiling, so interventions will yield the largest gains in the least cognitively efficient people. Evidence for this latter account comes from reported negative correlations between the pretest and the training/stimulation gain. In this paper, with the use of mathematical derivations and simulation methods, we show that such correlations are pure statistical artifacts caused by the widely known methodological error called "regression to the mean". Unfortunately, more advanced methods, such as alternative measures, linear models, and control groups do not guarantee correct assessment of the compensation effect either. The only correct method is to use direct modeling of correlations between latent true measures and gain. As to date no training/stimulation study has correctly used this method to provide evidence in favor of the compensation account, we must conclude that most (if not all) of the evidence should be considered inconclusive.

Indexed as

Models, PsychologicalModels, StatisticalPractice, PsychologicalTask Performance and AnalysisCognitionComputer SimulationHumansCompensation effectRegression to the meanStimulationTraining

Identifiers

PMID30117114
PMCPMC6290662

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.