Evidence map›Paper›PMID 27160255›Full record

ReviewSystematic reviews2016

Quality of conduct and reporting in rapid reviews: an exploration of compliance with PRISMA and AMSTAR guidelines.

Shannon E Kelly, David Moher, Tammy J Clifford

Abstract readReview
In one paragraph

Review in Systematic reviews, 2016. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 39 papers, 6 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
39citing papers in PubMed, 6 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

39 citing papers in PubMed, 6 syntheses or guidelines pooled it.

  1. Pooled it
  2. Paper 2: Performing rapid reviews.Systematic reviews · 2022
    Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Pooled it
  7. Review
  8. Article
  9. Article
  10. Article
  11. Article
  12. Review
  13. Review
  14. Review
  15. Review
  16. Toward an inclusive digital health system for sexual and gender minorities in Canada.Journal of the American Medical Informatics Association : JAMIA · 2022
    Article
  17. Review
  18. Article
  19. A rapid review of gender, sex, and sexual orientation documentation in electronic health records.Journal of the American Medical Informatics Association : JAMIA · 2020
    Review
  20. Planning for Mental Health Needs During COVID-19.Current psychiatry reports · 2020
    Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Shannon E KellySchool of Epidemiology, Public Health and Preventive Medicine, University of Ottawa, H2267A - 40 Ruskin Street, Ottawa, Ontario, Canada. skelly@ottawaheart.ca.
David MoherSchool of Epidemiology, Public Health and Preventive Medicine, University of Ottawa, H2267A - 40 Ruskin Street, Ottawa, Ontario, Canada.
Tammy J CliffordSchool of Epidemiology, Public Health and Preventive Medicine, University of Ottawa, H2267A - 40 Ruskin Street, Ottawa, Ontario, Canada.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundRapid reviews are an accelerated evidence synthesis approach intended to meet the timely needs of decision-makers in healthcare settings. Quality of conduct and reporting has been described in the rapid review literature; however, no formal assessment has been carried out using available instruments. The objective of this study was to explore compliance with conduct and reporting guidelines in rapid reviews published or posted online during 2013 and 2014.

methodsWe performed a comprehensive literature search for rapid reviews using multiple bibliographic databases (e.g. PubMed, MEDLINE, EMBASE, the Cochrane Library) through December 31, 2014. Grey literature was searched thoroughly, and health technology assessment agencies were surveyed to identify additional rapid review products. Candidate reviews were assessed for inclusion using pre-specified eligibility criteria. Detailed data was collected from the included reviews on study and reporting characteristics and variables significant to rapid reviews (e.g. nomenclature, definition). We evaluated the quality of conduct and reporting of included rapid reviews using the A Measurement Tool to Assess Systematic Reviews (AMSTAR) and Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) checklists. Compliance with each checklist item was examined, and the sum of adequately reported items was used to describe overall compliance. Rapid reviews were stratified to explore differences in compliance related to publication status. The association between compliance and time to completion or length of publication was explored through univariate regression.

resultsSixty-six rapid reviews were included. There were heterogeneous nomenclature, research questions and approaches to rapid reviews. Compliance with AMSTAR and PRISMA checklists was poor. Published rapid reviews were compliant with individual PRISMA items more often than unpublished reviews, but no difference was seen in AMSTAR item compliance overall. There was evidence of an association between length of publication and time to completion and the number of adequately reported PRISMA or AMSTAR items.

conclusionsTransparency and inadequate reporting are significant limitations of rapid reviews. Scientific editors, authors and producing agencies should ensure that the reporting of conduct and findings is accurate and complete. Further research may be warranted to explore reporting and conduct guidelines specific to rapid reviews and how these guidelines may be applied across the spectrum of rapid review approaches.

Indexed as

Guideline AdherenceGuidelines as TopicReview Literature as TopicEvidence-Based MedicineHumansRegression AnalysisResearch ReportAccelerated methodsConductDecision-makingEvidence synthesisMethodologyQualityRapid reviewReportingResearch transparencyTime factors

Identifiers

PMID27160255
PMCPMC4862155

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.