ArticleJournal of personality and social psychology2011
Must psychologists change the way they analyze their data?
Article in Journal of personality and social psychology, 2011. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 21 papers, 1 of them a synthesis that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
21 citing papers in PubMed, 1 synthesis or guideline pooled it.
- Robust Bayesian meta-analysis: Model-averaging across complementary publication bias adjustment methods.Research synthesis methods · 2023Pooled it
- Article
- Empirical Bayes factors for common hypothesis tests.PloS one · 2024Article
- Raising the value of research studies in psychological science by increasing the credibility of research reports: the transparent Psi project.Royal Society open science · 2023Article
- Why Most Research Findings About Psi Are False: The Replicability Crisis, the Psi Paradox and the Myth of Sisyphus.Frontiers in psychology · 2020Review
- A preregistered multi-lab replication of Maier et al. (2014, Exp. 4) testing retroactive avoidance.PloS one · 2020Article
- Comparing Objective and Subjective Bayes Factors for the Two-Sample Comparison: The Classification Theorem in Action.The American statistician · 2019Article
- Bayesian inference for psychology. Part I: Theoretical advantages and practical ramifications.Psychonomic bulletin & review · 2018Article
- Intentional Observer Effects on Quantum Randomness: A Bayesian Analysis Reveals Evidence Against Micro-Psychokinesis.Frontiers in psychology · 2018Article
- Observation-Oriented Modeling: Going Beyond "Is It All a Matter of Chance"?Educational and psychological measurement · 2017Article
- From Discovery to Justification: Outline of an Ideal Research Program in Empirical Psychology.Frontiers in psychology · 2017Article
- How to quantify the evidence for the absence of a correlation.Behavior research methods · 2016Article
- The Sense of Agency as Tracking Control.PloS one · 2016Article
- Feeling the future: A meta-analysis of 90 experiments on the anomalous anticipation of random future events.F1000Research · 2015Article
- Investigating expectation effects using multiple physiological measures.Frontiers in psychology · 2015Article
- Is the call to abandon p-values the red herring of the replicability crisis?Frontiers in psychology · 2015Article
- We should have seen this coming.Frontiers in human neuroscience · 2014Article
- Feeling the past: the absence of experimental evidence for anomalous retroactive influences on text processing.Memory & cognition · 2012Article
- Too good to be true: publication bias in two prominent studies from experimental psychology.Psychonomic bulletin & review · 2012Article
- Failing the future: three unsuccessful attempts to replicate Bem's 'retroactive facilitation of recall' effect.PloS one · 2012Article
Corrections and comments
- Comment on
Authors and funding
3 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
Wagenmakers, Wetzels, Borsboom, and van der Maas (2011) argued that psychologists should replace the familiar "frequentist" statistical analyses of their data with bayesian analyses. To illustrate their argument, they reanalyzed a set of psi experiments published recently in this journal by Bem (2011), maintaining that, contrary to his conclusion, his data do not yield evidence in favor of the psi hypothesis. We argue that they have incorrectly selected an unrealistic prior distribution for their analysis and that a bayesian analysis using a more reasonable distribution yields strong evidence in favor of the psi hypothesis. More generally, we argue that there are advantages to bayesian analyses that merit their increased use in the future. However, as Wagenmakers et al.'s analysis inadvertently revealed, they contain hidden traps that must be better understood before being more widely substituted for the familiar frequentist analyses currently employed by most research psychologists.
Indexed as
Identifiers
21928916What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.