ArticlePerspectives on psychological science : a journal of the Association for Psychological Science2022
Estimating the Prevalence of Transparency and Reproducibility-Related Research Practices in Psychology (2014-2017).
Article in Perspectives on psychological science : a journal of the Association for Psychological Science, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 45 papers, 3 of them syntheses that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
45 citing papers in PubMed, 3 syntheses or guidelines pooled it.
- Variability in Preprocessing and Analysis of the Error-Related Negativity in Adult Response-Conflict Studies: A Systematic Review.Psychophysiology · 2026Pooled it
- Estimating the prevalence of discrepancies between study registrations and publications: a systematic review and meta-analyses.BMJ open · 2023Pooled it
- Prevalence and predictors of data and code sharing in the medical and health sciences: systematic review with meta-analysis of individual participant data.BMJ (Clinical research ed.) · 2023Pooled it
- How methodological cues shape trust in psychological research and legal judgements: a vignette study.Royal Society open science · 2026Article
- "It makes sense to me": Examining data file column names in the visual cognitive literature.Behavior research methods · 2026Article
- Self-reported availability of research data in American Psychological Association journal articles: a cross-sectional investigation.Research integrity and peer review · 2026Article
- Accuracy in parameter estimation and simulation approaches for sample-size planning accounting for item effects.Behavior research methods · 2026Article
- Assessing Questionable and Responsible Research Practices in Psychology Master's Theses.Behavioral sciences (Basel, Switzerland) · 2026Article
- Interpretations of reproducibility crisis in medical education research: a qualitative study.Scientific reports · 2026Article
- Measurement reliability, construct validity, and transparent reporting in original and replication psychological research.PloS one · 2026Article
- Risk of bias and low reproducibility in meta-analytic evidence from fast-tracked publications during the coronavirus disease 2019 pandemic.PNAS nexus · 2025Article
- A sharing practices review of the visual search and eye movements literature reveals recommendations for our field and others.Behavior research methods · 2025Review
- Transparency in epidemiological analyses of cohort data a case study of the Norwegian mother, father, and child cohort study (MoBa).BMC medical research methodology · 2025Article
- Tools of the data detective: A review of statistical methods to detect data and result anomalies in psychology.Theory & psychology · 2025Article
- Poor hypotheses and research waste in biology: learning from a theory crisis in psychology.BMC biology · 2025Review
- Social impact of happiness on transformational leadership in students from Colombian universities.Frontiers in psychology · 2025Article
- Novelty, Consistency, Transparency: The Trilemma of Psychological Sciences and its Consequences on Open Science Practices.International review of social psychology · 2025Article
- Examining the availability/findability of stimuli employed in social media and body image research.PloS one · 2025Article
- Data sharing in circadian rhythm and mental health research: current status, challenges, recommendations and future directions.BMJ mental health · 2024Article
- Biomedical researchers' perspectives on the reproducibility of research.PLoS biology · 2024Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
6 authors.
Funding
Abstract
Psychologists are navigating an unprecedented period of introspection about the credibility and utility of their discipline. Reform initiatives emphasize the benefits of transparency and reproducibility-related research practices; however, adoption across the psychology literature is unknown. Estimating the prevalence of such practices will help to gauge the collective impact of reform initiatives, track progress over time, and calibrate future efforts. To this end, we manually examined a random sample of 250 psychology articles published between 2014 and 2017. Over half of the articles were publicly available (154/237, 65%, 95% confidence interval [CI] = [59%, 71%]); however, sharing of research materials (26/183; 14%, 95% CI = [10%, 19%]), study protocols (0/188; 0%, 95% CI = [0%, 1%]), raw data (4/188; 2%, 95% CI = [1%, 4%]), and analysis scripts (1/188; 1%, 95% CI = [0%, 1%]) was rare. Preregistration was also uncommon (5/188; 3%, 95% CI = [1%, 5%]). Many articles included a funding disclosure statement (142/228; 62%, 95% CI = [56%, 69%]), but conflict-of-interest statements were less common (88/228; 39%, 95% CI = [32%, 45%]). Replication studies were rare (10/188; 5%, 95% CI = [3%, 8%]), and few studies were included in systematic reviews (21/183; 11%, 95% CI = [8%, 16%]) or meta-analyses (12/183; 7%, 95% CI = [4%, 10%]). Overall, the results suggest that transparency and reproducibility-related research practices were far from routine. These findings establish baseline prevalence estimates against which future progress toward increasing the credibility and utility of psychology research can be compared.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.