Evidence map›Paper›PMID 37994903›Full record

ArticleeLife2023

Eleven strategies for making reproducible research and open science training the norm at research institutions.

Friederike E Kohrs, Susann Auer, Alexandra Bannach-Brown, Susann Fiedler, Tamarinde Laura Haven, Verena Heise, Constance Holman, Flavio Azevedo, René Bernard, Arnim Bleier and 42 more

Abstract read
In one paragraph

Article in eLife, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 19 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
19citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

19 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Review
  3. Article
  4. Article
  5. Review
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. From lab to life: challenges and perspectives of fNIRS for haemodynamic-based neurofeedback in real-world environments.Philosophical transactions of the Royal Society of London. Series B, Biological sciences · 2024
    Review
  17. Article
  18. Reporting checklists in neuroimaging: promoting transparency, replicability, and reproducibility.Neuropsychopharmacology : official publication of the American College of Neuropsychopharmacology · 2024
    Review
  19. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

52 authors.

Friederike E KohrsQUEST Center for Responsible Research, Berlin Institute of Health at Charité - Universitätsmedizin Berlin, Berlin, Germany.ORCID 0009-0004-5696-9459
Susann AuerDepartment of Plant Physiology, Faculty of Biology, Technische Universität Dresden, Dresden, Germany.ORCID 0000-0001-6566-5060
Alexandra Bannach-BrownQUEST Center for Responsible Research, Berlin Institute of Health at Charité - Universitätsmedizin Berlin, Berlin, Germany.ORCID 0000-0002-3161-1395
Susann FiedlerDepartment Strategy & Innovation, Vienna University of Economics and Business, Vienna, Austria.ORCID 0000-0001-9337-2142
Tamarinde Laura HavenDanish Centre for Studies in Research & Research Policy, Department of Political Science, Aarhus University, Aarhus, Denmark.ORCID 0000-0002-4702-2472
Verena HeiseFreelance researcher, Gladbeck, Germany.ORCID 0000-0002-5625-4128
Constance HolmanQUEST Center for Responsible Research, Berlin Institute of Health at Charité - Universitätsmedizin Berlin, Berlin, Germany.ORCID 0000-0002-8075-2821
Flavio AzevedoSaxony Center for Criminological Research, Chemnitz, Germany.ORCID 0000-0001-9000-8513
René BernardNeuroCure Cluster of Excellence, Charité - Universitätsmedizin Berlin, Berlin, Germany.ORCID 0000-0003-3265-2372
Arnim BleierDepartment for Computational Social Sciences, GESIS - Leibniz Institute for the Social Sciences, Cologne, Germany.
Nicole BösselDepartment of Psychiatry and Psychotherapy, University Medicine Greifswald, Greifswald, Germany.ORCID 0000-0002-2578-6447
Brian Patrick CahillLeibniz Information Centre for Science and Technology, Hannover, Germany.ORCID 0000-0002-7325-5114
Leyla Jael CastroZB MED Information Centre for Life Sciences, Cologne, Germany.ORCID 0000-0003-3986-0510
Adrian EhrenhoferInstitute of Solid Mechanics & Dresden Center for Intelligent Materials, Technische Universität Dresden, Dresden, Germany.ORCID 0000-0002-2370-8381
Kristina EichelDepartment of Education and Psychology, Freie Universität Berlin, Berlin, Germany.ORCID 0000-0002-3013-1920
Maximillian FrankDepartment Psychology, LMU Munich, Munich, Germany.ORCID 0000-0002-8140-3519
Claudia FrickInstitute of Information Science, Technische Hochschule Köln, Köln, Germany.ORCID 0000-0002-5291-4301
Malte FrieseDepartment of Psychology, Saarland University, Saarbrücken, Germany.ORCID 0000-0003-0055-513X
Anne GärtnerDepartment of Psychology, Technische Universität Dresden, Dresden, Germany.ORCID 0000-0003-4296-963X
Kerstin GierendDepartment of Biomedical Informatics at the Center for Preventive Medicine and Digital Health, Medical Faculty Mannheim, Heidelberg University, Heidelberg, Germany.ORCID 0000-0003-0417-3454
David Joachim GrüningDepartment of Psychology, Heidelberg University, Heidelberg, Germany.ORCID 0000-0002-9274-5477
Lena HahnDepartment of Social Psychology, Universität Trier, Trier, Germany.ORCID 0000-0001-5989-5396
Maren HülsemannQUEST Center for Responsible Research, Berlin Institute of Health at Charité - Universitätsmedizin Berlin, Berlin, Germany.ORCID 0000-0002-9344-0800
Malika IhleLMU Open Science Center, Department of Psychology, LMU Munich, Munich, Germany.ORCID 0000-0002-3242-5981
Sabrina IlliusICAN Institute for Cognitive and Affective Neuroscience, Department of Psychology, Faculty of Human Sciences, Medical School Hamburg, Hamburg, Germany.ORCID 0000-0002-7736-0149
Laura KönigFaculty of Life Sciences: Food, Nutrition and Health, University of Bayreuth, Bayreuth, Germany.ORCID 0000-0003-3655-8842
Matthias KönigInstitute for Biology, Institute for Theoretical Biology, Humboldt-University Berlin, Berlin, Germany.ORCID 0000-0003-1725-179X
Louisa KulkeDevelopmental Psychology with Educational Psychology, University of Bremen, Bremen, Germany.ORCID 0000-0002-9696-8619
Anton KutlinMax Planck Institute for the Physics of Complex Systems, Dresden, Germany.ORCID 0000-0002-9389-3324
Fritjof LammersDivision of Regulatory Genomics and Cancer Evolution, German Cancer Research Center (DKFZ), Heidelberg, Germany.ORCID 0000-0002-3110-8220
David M A MehlerDepartment of Psychiatry, Psychotherapy and Psychosomatics, Medical School, RWTH Aachen University, Aachen, Germany.ORCID 0000-0001-6587-2617
Christoph MiehlComputation in Neural Circuits, Max Planck Institute for Brain Research, Frankfurt, Germany.ORCID 0000-0001-9094-2760
Anett Müller-AlcazarICAN Institute for Cognitive and Affective Neuroscience, Department of Psychology, Faculty of Human Sciences, Medical School Hamburg, Hamburg, Germany.
Claudia NeuendorfHector-Institute for Education Sciences and Psychology, Eberhard Karls, University of Tübingen, Tübingen, Germany.ORCID 0000-0002-3024-0000
Helen NiemeyerDepartment of Education and Psychology, Freie Universität Berlin, Berlin, Germany.ORCID 0000-0002-7616-1885
Florian PargentDepartment Psychology, LMU Munich, Munich, Germany.ORCID 0000-0002-2388-553X
Aaron PeikertCenter for Lifespan Psychology, Max Planck Institute for Human Development, Berlin, Germany.ORCID 0000-0001-7813-818X
Christina U PfeufferDepartment of Psychology, Catholic University of Eichstätt-Ingolstadt, Eichstätt, Germany.ORCID 0000-0001-9394-8316
Robert ReineckeInstitute of Geography, Johannes Gutenberg-University Mainz, Mainz, Germany.ORCID 0000-0001-5699-8584
Jan Philipp RöerDepartment of Psychology and Psychotherapy, Witten/Herdecke University, Witten, Germany.ORCID 0000-0001-7774-3433
Jessica L RohmannScientific Directorate, Max Delbrück Center for Molecular Medicine in the Helmholtz Association (MDC), Berlin, Germany.ORCID 0000-0003-2420-5716
Alfredo Sánchez-TójarDepartment of Evolutionary Biology, Bielefeld University, Bielefeld, Germany.ORCID 0000-0002-2886-0649
Stefan ScherbaumDepartment of Psychology, Technische Universität Dresden, Dresden, Germany.ORCID 0000-0002-4408-6016
Elena SixtusEmpirical Childhood Research, University of Potsdam, Potsdam, Germany.ORCID 0000-0003-1307-1484
Lisa SpitzerLeibniz Institute for Psychology, Trier, Germany.
Vera Maren StraßburgerDepartment of Psychology, Medical School Hamburg, Hamburg, Germany.ORCID 0000-0002-4238-7480
Marcel WeberDepartment of Psychology, Saarland University, Saarbrücken, Germany.ORCID 0000-0002-0507-0070
Clarissa J WhitmireMax Delbrück Center for Molecular Medicine in the Helmholtz Association, Berlin, Germany.ORCID 0000-0001-5789-4293
Josephine ZernaDepartment of Psychology, Technische Universität Dresden, Dresden, Germany.ORCID 0000-0003-2892-884X
Dilara ZorbekInternational Graduate Program Medical Neurosciences, Charité - Universitätsmedizin Berlin, Berlin, Germany.ORCID 0000-0002-8270-4436
Philipp ZumsteinOpen Science Office, University of Mannheim, Mannheim, Germany.ORCID 0000-0002-6485-9434
Tracey L WeissgerberQUEST Center for Responsible Research, Berlin Institute of Health at Charité - Universitätsmedizin Berlin, Berlin, Germany.ORCID 0000-0002-7490-2600

Funding

Wellcome TrustWellcome Trust 218358Wellcome Trust SPOKES SubprojectWellcome Trust Translational Partnership with Charité Universitätsmedizin Berlin
6 · The paper itself

Abstract

Reproducible research and open science practices have the potential to accelerate scientific progress by allowing others to reuse research outputs, and by promoting rigorous research that is more likely to yield trustworthy results. However, these practices are uncommon in many fields, so there is a clear need for training that helps and encourages researchers to integrate reproducible research and open science practices into their daily work. Here, we outline eleven strategies for making training in these practices the norm at research institutions. The strategies, which emerged from a virtual brainstorming event organized in collaboration with the German Reproducibility Network, are concentrated in three areas: (i) adapting research assessment criteria and program requirements; (ii) training; (iii) building communities. We provide a brief overview of each strategy, offer tips for implementation, and provide links to resources. We also highlight the importance of allocating resources and monitoring impact. Our goal is to encourage researchers - in their roles as scientists, supervisors, mentors, instructors, and members of curriculum, hiring or evaluation committees - to think creatively about the many ways they can promote reproducible research and open science practices in their institutions.

Indexed as

MentorsPhysiciansHumansPersonnel SelectionReproducibility of ResultsResearch Personnelcurriculum designhigher educationmedicineopen sciencereproducible researchscientific rigortransparency

Identifiers

PMID37994903
PMCPMC10666927

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.