Evidence map›Paper›PMID 42524203›Full record

ArticleCochrane evidence synthesis and methods2026

Rating Down for Publication Bias is Rare in Cochrane Reviews: A Descriptive Study.

Markus Toews, Silvia Minozzi, Bernardine H Stegeman, Michela Cinquini, Joerg J Meerpohl, Kenneth Färnqvist, Matteo Bruschettini, Ingrid Toews

Abstract read
In one paragraph

Article in Cochrane evidence synthesis and methods, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Markus ToewsInstitute for Evidence in Medicine, Medical Center-University of Freiburg, Faculty of Medicine University of Freiburg Freiburg Germany.
Silvia MinozziLaboratory of Methodology of Systematic Reviews and Guidelines Production Istituto di Ricerche Farmacologiche Mario Negri IRCCS Milan Italy.
Bernardine H StegemanKnowledge Institute of the Dutch Association of Medical Specialists Utrecht the Netherlands.
Michela CinquiniLaboratory of Methodology of Systematic Reviews and Guidelines Production Istituto di Ricerche Farmacologiche Mario Negri IRCCS Milan Italy.
Joerg J MeerpohlInstitute for Evidence in Medicine, Medical Center-University of Freiburg, Faculty of Medicine University of Freiburg Freiburg Germany.
Kenneth FärnqvistDepartment of Molecular Medicine and Surgery Karolinska Institute Solna Sweden.ORCID https://orcid.org/0000-0002-3529-565X
Matteo BruschettiniCochrane Sweden, Department of Research, Development, Education and Innovation, Skåne University Hospital Lund University Lund Sweden.
Ingrid ToewsInstitute for Evidence in Medicine, Medical Center-University of Freiburg, Faculty of Medicine University of Freiburg Freiburg Germany.ORCID https://orcid.org/0000-0001-6955-9695

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Background: Publication bias impacts the direction and magnitude of summary effect estimates in systematic reviews and the confidence in the review findings. It remains unclear to what degree publication bias is considered in the certainty assessments in systematic reviews. Our research aims are to generate an overview of and estimate how frequent rating down occurs for the GRADE domain "publication bias" across Cochrane reviews. Study Design and Setting: This is a descriptive study. We included Cochrane reviews published between January 2021 and October 2023 that included at least one outcome for which the certainty of evidence was rated down for publication bias. We collected data from the reviews' full text, analyses, and figures. We analyzed data with descriptive statistical analysis. We used a deductive qualitative approach for analyzing qualitative data. Results: We identified 81 reviews. These reviews included between 1 and 328 individual studies. All but three reviews included randomized-controlled trials only. Data from less than 10 studies supported the summary of findings of 106 outcomes. The most commonly used methods for detecting publication bias were funnel plots. 220 outcomes were rated down by one level for publication bias. Four outcomes were rated down by two levels. The most commonly reported reasons were indications of publication bias in funnel plots. Conclusions: Rating down for publication bias was rare in Cochrane reviews despite the high prevalence of publication bias in original research. Guidance might not suffice to inform assessments of publication bias in reviews with less than 10 studies.

Indexed as

dissemination biasGRADEmeta‐researchpublication biasresearch on researchsystematic reviews

Identifiers

PMID42524203
PMCPMC13410555

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.