Evidence map›Paper›PMID 29531091›Full record

ArticleProceedings of the National Academy of Sciences of the United States of America2018

The preregistration revolution.

Brian A Nosek, Charles R Ebersole, Alexander C DeHaven, David T Mellor

Open access · bronzeAbstract read
In one paragraph

Article in Proceedings of the National Academy of Sciences of the United States of America, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 458 papers, 14 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
458citing papers in PubMed, 14 pooled it
174.4field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

458 citing papers in PubMed, 14 syntheses or guidelines pooled it, 1,847 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Pooled it
  7. Pooled it
  8. Pooled it
  9. Pooled it
  10. Pooled it
  11. Pooled it
  12. Pooled it
  13. Pooled it
  14. Pooled it
  15. No evidence that same-language subtitles improve children's reading fluency.British journal of psychology (London, England : 1953) · 2026
    Trial
  16. Trial
  17. Investigating the effects of single-dose intranasal testosterone on economic preferences in a large randomized trial of men.Proceedings of the National Academy of Sciences of the United States of America · 2025
    Trial
  18. Review
  19. Review
  20. Article

398 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

4 authors at 2 institutions in 1 country.

Brian A NosekCenter for Open Science, Charlottesville, VA 22903; nosek@virginia.edu.ORCID 0000-0001-6797-5476
Charles R EbersoleDepartment of Psychology, University of Virginia, Charlottesville, VA 22904.ORCID 0000-0002-8607-2579
Alexander C DeHavenCenter for Open Science, Charlottesville, VA 22903.ORCID 0000-0002-2241-7259
David T MellorCenter for Open Science, Charlottesville, VA 22903.ORCID 0000-0002-3125-5888
Center for Open Science · USUniversity of Virginia · US

Funding

Community developing and supporting practices to increase replicability of scientific researchR24AG048124 · NIA · CENTER FOR OPEN SCIENCE · PI NOSEK, BRIAN A · 2014 to 2020
$1.4M
NIA NIH HHS R24 AG048124
6 · The paper itself

Abstract

Progress in science relies in part on generating hypotheses with existing observations and testing hypotheses with new observations. This distinction between postdiction and prediction is appreciated conceptually but is not respected in practice. Mistaking generation of postdictions with testing of predictions reduces the credibility of research findings. However, ordinary biases in human reasoning, such as hindsight bias, make it hard to avoid this mistake. An effective solution is to define the research questions and analysis plan before observing the research outcomes-a process called preregistration. Preregistration distinguishes analyses and outcomes that result from predictions from those that result from postdictions. A variety of practical strategies are available to make the best possible use of preregistration in circumstances that fall short of the ideal application, such as when the data are preexisting. Services are now available for preregistration across all disciplines, facilitating a rapid increase in the practice. Widespread adoption of preregistration will increase distinctiveness between hypothesis generation and hypothesis testing and will improve the credibility of research findings.

Indexed as

HumansLaboratory PersonnelPredictive Value of TestsResearchScienceWorkforceconfirmatory analysisexploratory analysismethodologyopen sciencepreregistration

Identifiers

PMID29531091
PMCPMC5856500
OpenAlexW2779812635

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.