Evidence map›Paper›PMID 28988181›Full record

SynthesisBMJ open2017

Search for unpublished data by systematic reviewers: an audit.

Hedyeh Ziai, Rujun Zhang, An-Wen Chan, Nav Persaud

Abstract readSystematic Review
In one paragraph

Synthesis in BMJ open, 2017. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 15 papers, 5 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
15citing papers in PubMed, 5 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

15 citing papers in PubMed, 5 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Article
  7. Article
  8. Review
  9. Article
  10. Article
  11. Review
  12. Article
  13. Review
  14. Article
  15. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Hedyeh ZiaiKeenan Research Centre, Li Ka Shing Knowledge Institute, St Michael's Hospital, Toronto, Canada.
Rujun ZhangKeenan Research Centre, Li Ka Shing Knowledge Institute, St Michael's Hospital, Toronto, Canada.
An-Wen ChanWomen's College Research Institute, Women's College Hospital, Toronto, Canada.
Nav PersaudDepartment of Family and Community Medicine, University of Toronto, Canada.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectivesWe audited a selection of systematic reviews published in 2013 and reported on the proportion of reviews that researched for unpublished data, included unpublished data in analysis and assessed for publication bias.

designAudit of systematic reviews. DATA SOURCES: We searched PubMed and Ovid MEDLINE In-Process & Other Non-Indexed Citations between 1 January 2013 and 31 December 2013 for the following journals: ELIGIBILITY CRITERIA: Systematic reviews published in 2013 in the selected journals were included. Methodological reviews were excluded. DATA EXTRACTION AND SYNTHESIS: Two reviewers independently reviewed each included systematic review. The following data were extracted: whether the review searched for grey literature or unpublished data, the sources searched, whether unpublished data were included in analysis, whether publication bias was assessed and whether there was evidence of publication bias. MAIN

findings203 reviews were included for analysis. 36% (73/203) of studies did not describe any attempt to obtain unpublished studies or to search grey literature. 89% (116/130) of studies that sought unpublished data found them. 33% (68/203) of studies included an assessment of publication bias, and 40% (27/68) of these found evidence of publication bias.

conclusionA significant fraction of systematic reviews included in our study did not search for unpublished data. Publication bias may be present in almost half the published systematic reviews that assessed for it. Exclusion of unpublished data may lead to biased estimates of efficacy or safety in systematic reviews.

Indexed as

BibliometricsPublication BiasReview Literature as TopicData CollectionHumansResearch DesignReviewSystematic Publication Bias Unpublished Data

Identifiers

PMID28988181
PMCPMC5640073

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.