Evidence map›Paper›PMID 39036539›Full record

ArticleOpen research Europe2023

Scoping review and evidence mapping of interventions aimed at improving reproducible and replicable science: Protocol.

Leonie A Dudda, Magdalena Kozula, Tony Ross-Hellauer, Eva Kormann, René Spijker, Nicholas DeVito, Gowri Gopalakrishna, Veerle Van den Eynden, Patrick Onghena, Florian Naudet and 6 more

Abstract read
In one paragraph

Article in Open research Europe, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 4 papers.

0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

4 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

16 authors.

Leonie A DuddaDepartment of Otorhinolaryngology, Head and Neck Surgery, University Medical Center Utrecht, Utrecht, The Netherlands.ORCID https://orcid.org/0009-0000-0759-7354
Magdalena KozulaFaculty of Psychology and Educational Sciences, Methodology of Educational Sciences Research Group, KU Leuven, Leuven, Flanders, Belgium.ORCID https://orcid.org/0000-0003-0333-4279
Tony Ross-HellauerInstitute of Interactive Systems and Data Science, Technische Universitat Graz, Graz, Styria, Austria.
Eva KormannInstitute of Interactive Systems and Data Science, Technische Universitat Graz, Graz, Styria, Austria.ORCID https://orcid.org/0009-0005-5680-3659
René SpijkerCochrane Netherlands, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht, The Netherlands.
Nicholas DeVitoBennett Institute for Applied Data Science, Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, England, UK.ORCID https://orcid.org/0000-0001-8286-1995
Gowri GopalakrishnaDepartment of Epidemiology and Data Science, Amsterdam UMC, Amsterdam, The Netherlands.
Veerle Van den EyndenResearch Coordination Office & RDM Competence Centre, KU Leuven, Leuven, Flanders, Belgium.ORCID https://orcid.org/0000-0003-2542-2747
Patrick OnghenaFaculty of Psychology and Educational Sciences, Methodology of Educational Sciences Research Group, KU Leuven, Leuven, Flanders, Belgium.ORCID https://orcid.org/0000-0002-3986-8312
Florian NaudetCHU Rennes, Inserm, Irset (Institut de recherche en santé, environnement et travail)-UMRS 1085, CIC 1414 [(Centre d'Investigation Clinique de Rennes)], Universite de Rennes, Rennes, Brittany, France.ORCID https://orcid.org/0000-0003-3760-3801
Rita BanziIstituto di Ricerche Farmacologiche Mario Negri IRCCS, Milan, Italy.
Maddalena FratelliIstituto di Ricerche Farmacologiche Mario Negri IRCCS, Milan, Italy.
Monika VargaInstitute of Animal Sciences, Hungarian University of Agriculture and Life Sciences, Kaposvar, Hungary.ORCID https://orcid.org/0000-0002-6886-5751
Yuri Andrei GelsleichterDepartment of Soil Science, Institute of Environmental Sciences, Hungarian University of Agriculture and Life Sciences, Gödöllő, Hungary.
Inge StegemanDepartment of Otorhinolaryngology, Head and Neck Surgery, University Medical Center Utrecht, Utrecht, The Netherlands.ORCID https://orcid.org/0000-0001-5154-7178
Mariska M LeeflangDepartment of Epidemiology and Data Science, Amsterdam UMC, Amsterdam, The Netherlands.ORCID https://orcid.org/0000-0001-5960-0471

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Background: Many interventions, especially those linked to open science, have been proposed to improve reproducibility in science. To what extent these propositions are based on scientific evidence from empirical evaluations is not clear. Aims: The primary objective is to identify Open Science interventions that have been formally investigated regarding their influence on reproducibility and replicability. A secondary objective is to list any facilitators or barriers reported and to identify gaps in the evidence. Methods: We will search broadly by using electronic bibliographic databases, broad internet search, and contacting experts in the field of reproducibility, replicability, and open science. Any study investigating interventions for their influence on the reproducibility and replicability of research will be selected, including those studies additionally investigating drivers and barriers to the implementation and effectiveness of interventions. Studies will first be selected by title and abstract (if available) and then by reading the full text by at least two independent reviewers. We will analyze existing scientific evidence using scoping review and evidence gap mapping methodologies. Results: The results will be presented in interactive evidence maps, summarized in a narrative synthesis, and serve as input for subsequent research. Review registration: This protocol has been pre-registered on OSF under doi https://doi.org/10.17605/OSF.IO/D65YS.

Indexed as

Open ScienceReplicabilityReproducibilityReviewTransparency

Identifiers

PMID39036539
PMCPMC11258544

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.