Evidence map›Paper›PMID 34764461›Full record

ReviewNature human behaviour2021

Seven steps toward more transparency in statistical practice.

Eric-Jan Wagenmakers, Alexandra Sarafoglou, Sil Aarts, Casper Albers, Johannes Algermissen, Štěpán Bahník, Noah van Dongen, Rink Hoekstra, David Moreau, Don van Ravenzwaaij and 4 more

Open access · hybridAbstract readReview
PubMed Publisher
In one paragraph

Review in Nature human behaviour, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 22 papers.

0numbers the graph read from it
0cells of the map it votes in
22citing papers in PubMed
10.4field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

22 citing papers in PubMed, 59 citations in OpenAlex.

  1. Imprecision Can Promote Illusions of Understanding.Computational brain & behavior · 2026
    Article
  2. Article
  3. Article
  4. Article
  5. Improving statistical reporting in psychology.Communications psychology · 2025
    Review
  6. Article
  7. Article
  8. Estimating the extent and sources of model uncertainty in political science.Proceedings of the National Academy of Sciences of the United States of America · 2025
    Article
  9. Article
  10. Article
  11. Review
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

14 authors at 11 institutions in 6 countries.

Eric-Jan WagenmakersDepartment of Psychology, University of Amsterdam, Amsterdam, The Netherlands. ej.wagenmakers@gmail.com.ORCID http://orcid.org/0000-0003-1596-1034
Alexandra SarafoglouDepartment of Psychology, University of Amsterdam, Amsterdam, The Netherlands.ORCID http://orcid.org/0000-0003-0031-685X
Sil AartsSchool for Public Health and Primary Care, Maastricht University, Maastricht, The Netherlands.ORCID http://orcid.org/0000-0002-3121-412X
Casper AlbersHeymans Institute of Psychological Research, University of Groningen, Groningen, The Netherlands.ORCID http://orcid.org/0000-0002-9213-6743
Johannes AlgermissenDonders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands.ORCID http://orcid.org/0000-0002-1694-7069
Štěpán BahníkFaculty of Business Administration, Prague University of Economics, Prague, Czech Republic.ORCID http://orcid.org/0000-0002-0579-6808
Noah van DongenDepartment of Psychology, University of Amsterdam, Amsterdam, The Netherlands.
Rink HoekstraDepartment of Educational Science, University of Groningen, Groningen, The Netherlands.ORCID http://orcid.org/0000-0002-1588-7527
David MoreauSchool of Psychology and Centre for Brain Research, The University of Auckland, Auckland, New Zealand.ORCID http://orcid.org/0000-0002-1957-1941
Don van RavenzwaaijDepartment of Psychology, University of Groningen, Groningen, The Netherlands.ORCID http://orcid.org/0000-0002-5030-4091
Aljaž SlugaRotterdam School of Management, Erasmus University Rotterdam, Rotterdam, The Netherlands.
Franziska StankeDepartment of Psychology, University of Münster, Münster, Germany.ORCID http://orcid.org/0000-0003-3795-6551
Jorge TendeiroDepartment of Psychology, University of Groningen, Groningen, The Netherlands.ORCID http://orcid.org/0000-0003-1660-3642
Balazs AczelInstitute of Psychology, ELTE Eotvos Lorand University, Budapest, Hungary.ORCID http://orcid.org/0000-0001-9364-4988
University of Groningen · NLUniversity of Amsterdam · NLAmsterdam University of Applied Sciences · NLEötvös Loránd University · HUErasmus University Rotterdam · NLHiroshima University · JPMaastricht University · NLPrague University of Economics and Business · CZRadboud University Nijmegen · NLUniversity of Auckland · NZUniversity of Münster · DE

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

We argue that statistical practice in the social and behavioural sciences benefits from transparency, a fair acknowledgement of uncertainty and openness to alternative interpretations. Here, to promote such a practice, we recommend seven concrete statistical procedures: (1) visualizing data; (2) quantifying inferential uncertainty; (3) assessing data preprocessing choices; (4) reporting multiple models; (5) involving multiple analysts; (6) interpreting results modestly; and (7) sharing data and code. We discuss their benefits and limitations, and provide guidelines for adoption. Each of the seven procedures finds inspiration in Merton's ethos of science as reflected in the norms of communalism, universalism, disinterestedness and organized scepticism. We believe that these ethical considerations-as well as their statistical consequences-establish common ground among data analysts, despite continuing disagreements about the foundations of statistical inference.

Indexed as

Statistics as TopicData Interpretation, StatisticalHumansInformation DisseminationModels, StatisticalResearch DesignUncertainty

Identifiers

PMID34764461
OpenAlexW3211729281

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.