Evidence map›Paper›PMID 34933997›Full record

ArticleProceedings of the National Academy of Sciences of the United States of America2021

Reporting all results efficiently: A RARE proposal to open up the file drawer.

David D Laitin, Edward Miguel, Ala' Alrababa'h, Aleksandar Bogdanoski, Sean Grant, Katherine Hoeberling, Cecilia Hyunjung Mo, Don A Moore, Simine Vazire, Jeremy Weinstein and 1 more

Abstract read
In one paragraph

Article in Proceedings of the National Academy of Sciences of the United States of America, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 9 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
9citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

9 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Inverse Association Between Betel Quid Use and Diabetes in Rural Bangladesh.American journal of human biology : the official journal of the Human Biology Council · 2026
    Article
  3. Article
  4. Article
  5. Article
  6. Review
  7. Article
  8. Article
  9. Reporting all results efficiently: A RARE proposal to open up the file drawer.Proceedings of the National Academy of Sciences of the United States of America · 2021
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors.

David D LaitinDepartment of Political Science, Stanford University, Stanford, CA 94305; dlaitin@stanford.edu.ORCID 0000-0002-7911-7089
Edward MiguelDepartment of Economics, University of California, Berkeley, CA 94720.ORCID 0000-0001-6927-709X
Ala' Alrababa'hImmigration Policy Laboratory, ETH Zurich, 8092 Zurich, Switzerland.ORCID 0000-0001-5762-8892
Aleksandar BogdanoskiCenter for Effective Global Action, University of California, Berkeley, CA 94720.ORCID 0000-0001-8935-2173
Sean GrantRichard M. Fairbanks School of Public Health, Indiana University, Indianapolis, IN 46202.ORCID 0000-0002-7775-3022
Katherine HoeberlingCenter for Effective Global Action, University of California, Berkeley, CA 94720.ORCID 0000-0001-7730-9741
Cecilia Hyunjung MoCenter for Effective Global Action, University of California, Berkeley, CA 94720.
Don A MooreHaas School of Business, University of California, Berkeley, CA 94720.
Simine VazireMelbourne School of Psychological Sciences, University of Melbourne, Melbourne, VIC 3010, Australia.ORCID 0000-0002-3933-9752
Jeremy WeinsteinDepartment of Political Science, Stanford University, Stanford, CA 94305.
Scott WilliamsonDepartment of Social and Political Sciences, Bocconi University, 20100 Milano, Italy.ORCID 0000-0003-0769-6197

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

While the social sciences have made impressive progress in adopting transparent research practices that facilitate verification, replication, and reuse of materials, the problem of publication bias persists. Bias on the part of peer reviewers and journal editors, as well as the use of outdated research practices by authors, continues to skew literature toward statistically significant effects, many of which may be false positives. To mitigate this bias, we propose a framework to enable authors to report all results efficiently (RARE), with an initial focus on experimental and other prospective empirical social science research that utilizes public study registries. This framework depicts an integrated system that leverages the capacities of existing infrastructure in the form of public registries, institutional review boards, journals, and granting agencies, as well as investigators themselves, to efficiently incentivize full reporting and thereby, improve confidence in social science findings. In addition to increasing access to the results of scientific endeavors, a well-coordinated research ecosystem can prevent scholars from wasting time investigating the same questions in ways that have not worked in the past and reduce wasted funds on the part of granting agencies.

Indexed as

file drawer problemnull findingspublication biasregistriesresearch transparency

Identifiers

PMID34933997
PMCPMC8719896

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.