Evidence map›Paper›PMID 36756055›Full record

ArticleRoyal Society open science2023

Raising the value of research studies in psychological science by increasing the credibility of research reports: the transparent Psi project.

Zoltan Kekecs, Bence Palfi, Barnabas Szaszi, Peter Szecsi, Mark Zrubka, Marton Kovacs, Bence E Bakos, Denis Cousineau, Patrizio Tressoldi, Kathleen Schmidt and 20 more

Erratum issuedOpen access · goldAbstract read
In one paragraph

Article in Royal Society open science, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. An erratum has been issued. Cited by 11 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
11citing papers in PubMed, 2 pooled it
11.0field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

11 citing papers in PubMed, 2 syntheses or guidelines pooled it, 34 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Article
  4. Article
  5. Concerns About Replicability Across Two Crises in Social Psychology.International review of social psychology · 2025
    Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Review
  11. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

30 authors at 15 institutions in 13 countries.

Zoltan KekecsInstitute of Psychology, ELTE, Eotvos Lorand University, Izabella u 46. 1064, Budapest, Hungary.ORCID 0000-0001-9247-9781
Bence PalfiDepartment of Surgery and Cancer, Imperial College London, London, UK.
Barnabas SzasziInstitute of Psychology, ELTE, Eotvos Lorand University, Izabella u 46. 1064, Budapest, Hungary.
Peter SzecsiInstitute of Psychology, ELTE, Eotvos Lorand University, Izabella u 46. 1064, Budapest, Hungary.
Mark ZrubkaDepartment of Psychology, University of Amsterdam, P.O. Box 19268, 1000 GG Amsterdam, The Netherlands.
Marton KovacsInstitute of Psychology, ELTE, Eotvos Lorand University, Izabella u 46. 1064, Budapest, Hungary.
Bence E BakosInstitute of Psychology, ELTE, Eotvos Lorand University, Izabella u 46. 1064, Budapest, Hungary.
Denis CousineauÉcole de psychologie, University of Ottawa, 136, Jean-Jacques Lussier, Ontario, Canada, K1N 6N5.
Patrizio TressoldiStudium Patavinum, Università di Padova via Venezia 8, 35131 Padova, Italy.ORCID 0000-0002-6404-0058
Kathleen SchmidtDepartment of Psychology, Ashland University, Ashland, OH 44805, USA.ORCID 0000-0002-9946-5953
Massimo GrassiDipartimento di Psicologia Generale, Università di Padova via Venezia 8, 35131 Padova, Italy.
Thomas Rhys EvansSchool of Human Sciences, University of Greenwich, UK.
Yuki YamadaFaculty of Arts and Science, Kyushu University, 744 Motooka, Nishi-ku, Fukuoka 819-0395, Japan.
Jeremy K MillerDepartment of Psychology, Willamette University, 900 State Street, Salem, OR 97301, USA.
Huanxu LiuGraduate School of Human-Environment Studies, Kyushu University, 744 Motooka, Nishi-ku, Fukuoka 819-0395, Japan.ORCID 0000-0001-7078-5956
Fumiya YonemitsuFaculty of Letters, Chuo University, Hachioji, Tokyo 192-0393, Japan.ORCID 0000-0001-8774-4499
Dmitrii DubrovNational Research University Higher School of Economics, Russian Federation.ORCID 0000-0001-8146-4197
Jan Philipp RöerDepartment of Psychology and Psychotherapy, Witten/Herdecke University, Witten, Germany.
Marvin BeckerDepartment of Psychology and Psychotherapy, Witten/Herdecke University, Witten, Germany.
Roxane SchnepperDepartment of Psychology and Psychotherapy, Witten/Herdecke University, Witten, Germany.
Atsunori ArigaFaculty of Letters, Chuo University, Hachioji, Tokyo 192-0393, Japan.
Patrícia ArriagaIscte-University Institute of Lisbon, CIS_Iscte, Av. das Forças Armadas, 1649-026, Lisbon, Portugal.ORCID 0000-0001-5766-0489
Raquel OliveiraIscte-University Institute of Lisbon, CIS_Iscte, Av. das Forças Armadas, 1649-026, Lisbon, Portugal.
Nele PõldverUniversity of Tartu Institute of Psychology, Estonia.ORCID 0000-0001-7307-544X
Kairi KreegipuuUniversity of Tartu Institute of Psychology, Estonia.
Braeden HallSchool of Psychological & Behavioral Sciences, Southern Illinois University, Carbondale, USA.
Sera WiechertUniversity of Amsterdam, Amsterdam, The Netherlands.
Bruno VerschuereUniversity of Amsterdam, Amsterdam, The Netherlands.
Kyra GiránInstitute of Psychology, ELTE, Eotvos Lorand University, Izabella u 46. 1064, Budapest, Hungary.
Balazs AczelInstitute of Psychology, ELTE, Eotvos Lorand University, Izabella u 46. 1064, Budapest, Hungary.ORCID 0000-0001-9364-4988
Eötvös Loránd University · HUWitten/Herdecke University · DEChuo University · JPIscte – Instituto Universitário de Lisboa · PTKyushu University · JPSouthern Illinois University Carbondale · USUniversity of Amsterdam · NLUniversity of Padua · ITUniversity of Tartu · EEHebrew University of Jerusalem · ILImperial College London · GBNational Research University Higher School of Economics · RUUniversity of Greenwich · GBUniversity of Ottawa · CAWillamette University · US

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

The low reproducibility rate in social sciences has produced hesitation among researchers in accepting published findings at their face value. Despite the advent of initiatives to increase transparency in research reporting, the field is still lacking tools to verify the credibility of research reports. In the present paper, we describe methodologies that let researchers craft highly credible research and allow their peers to verify this credibility. We demonstrate the application of these methods in a multi-laboratory replication of Bem's Experiment 1 (Bem 2011

Indexed as

credibilitymetasciencereal-time proceduresreplicationresearch methodstransparency

Identifiers

PMID36756055
PMCPMC9890107
OpenAlexW4319657189

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.