ArticleNature communications2020
Low replicability can support robust and efficient science.
Article in Nature communications, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. An erratum has been issued. Cited by 26 papers, 2 of them syntheses that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
26 citing papers in PubMed, 2 syntheses or guidelines pooled it.
- Naturalistic assessments across the lifespan: Systematic review of inhibition measures in ecological settings.Neuroscience and biobehavioral reviews · 2024Pooled it
- A systematic review of human odometry.Psychological research · 2024Pooled it
- What is critical metascience and why is it important?Frontiers in psychology · 2026Review
- How can we make sound replication decisions?Proceedings of the National Academy of Sciences of the United States of America · 2025Article
- The misalignment of incentives in academic publishing and implications for journal reform.Proceedings of the National Academy of Sciences of the United States of America · 2025Article
- Gaming expertise induces meso‑scale brain plasticity and efficiency mechanisms as revealed by whole-brain modeling.NeuroImage · 2024Article
- Viscous dynamics associated with hypoexcitation and structural disintegration in neurodegeneration via generative whole-brain modeling.Alzheimer's & dementia : the journal of the Alzheimer's Association · 2024Article
- Consensus definitions of perception-action-integration in action control.Communications psychology · 2024Article
- Gaming expertise induces meso-scale brain plasticity and efficiency mechanisms as revealed by whole-brain modeling Gaming expertise, neuroplasticity and functional dynamics.bioRxiv : the preprint server for biology · 2023Article
- Is N-Hacking Ever OK? The consequences of collecting more data in pursuit of statistical significance.PLoS biology · 2023Article
- The replication crisis has led to positive structural, procedural, and community changes.Communications psychology · 2023Review
- Functional magnetic resonance imaging of headache: Issues, best-practices, and new directions, a narrative review.Headache · 2023Review
- Must-have Qualities of Clinical Research on Artificial Intelligence and Machine LearningBalkan medical journal · 2023Review
- Addressing the "Replication Crisis" in the Field of Parkinson's Disease.Journal of Parkinson's disease · 2023Article
- Dream Recall Frequency, Lucid Dream Frequency, and Personality During the Covid-19 Pandemic.Imagination, cognition and personality · 2022Article
- Theoretical false positive psychology.Psychonomic bulletin & review · 2022Review
- Subdimensions of social-communication behavior in autism-A replication study.JCPP advances · 2022Article
- Ensconcing a biostatistics clinic in tertiary care research institute of India: A descriptive study.Journal of family medicine and primary care · 2022Article
- Long-term repeatability of cognitive performance.Royal Society open science · 2022Article
- Regional Radiomics Similarity Networks Reveal Distinct Subtypes and Abnormality Patterns in Mild Cognitive Impairment.Advanced science (Weinheim, Baden-Wurttemberg, Germany) · 2022Article
Corrections and comments
- Erratum issued
Authors and funding
2 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
There is a broad agreement that psychology is facing a replication crisis. Even some seemingly well-established findings have failed to replicate. Numerous causes of the crisis have been identified, such as underpowered studies, publication bias, imprecise theories, and inadequate statistical procedures. The replication crisis is real, but it is less clear how it should be resolved. Here we examine potential solutions by modeling a scientific community under various different replication regimes. In one regime, all findings are replicated before publication to guard against subsequent replication failures. In an alternative regime, individual studies are published and are replicated after publication, but only if they attract the community's interest. We find that the publication of potentially non-replicable studies minimizes cost and maximizes efficiency of knowledge gain for the scientific community under a variety of assumptions. Provided it is properly managed, our findings suggest that low replicability can support robust and efficient science.
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.