Evidence map›Paper›PMID 30089508›Full record

ReviewSystematic reviews2018

The use of clinical study reports to enhance the quality of systematic reviews: a survey of systematic review authors.

Alex Hodkinson, Kristina Charlotte Dietz, Carol Lefebvre, Su Golder, Mark Jones, Peter Doshi, Carl Heneghan, Tom Jefferson, Isabelle Boutron, Lesley Stewart

Abstract readReview
In one paragraph

Review in Systematic reviews, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 21 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
21citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

21 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Review
  12. CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne · 2021
    Article
  13. Optimizing the data available via Health Canada's clinical information portal.CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne · 2021
    Article
  14. Review
  15. Article
  16. Article
  17. Article
  18. Article
  19. Review
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

Alex HodkinsonLCentre for Primary Care, Division of Population Health, Health Services Research & Primary Care, Williamson Building, Oxford Road, Manchester, M13 9PL, UK. alexander.hodkinson@manchester.ac.uk.
Kristina Charlotte DietzCentre for Reviews and Dissemination, A/B Block, Alcuin College, University of York, York, YO10 5DD, UK.
Carol LefebvreLefebvre Associates Ltd, Oxford, UK.
Su GolderDepartment of Health Sciences, University of York, York, UK.
Mark JonesSchool of Public Health, University of Queensland, Brisbane, Australia.
Peter DoshiDepartment of Pharmaceutical Health Services Research, University of Maryland School of Pharmacy, Baltimore, MD, USA.
Carl HeneghanCentre for Evidence Based Medicine, Nuffield Department of Primary Care Health Sciences, Primary Sciences Division, University of Oxford, Oxford, UK.
Tom JeffersonCentre for Evidence Based Medicine, Nuffield Department of Primary Care Health Sciences, Primary Sciences Division, University of Oxford, Oxford, UK.
Isabelle BoutronMETHODs Team, Centre of Research in Epidemiology and Statistics Sorbonne Paris Cité, INSERM UMR, University Paris Descartes, Paris, France.
Lesley StewartCentre for Reviews and Dissemination, A/B Block, Alcuin College, University of York, York, YO10 5DD, UK.

Funding

Cochrane methods innovation fund N/A
6 · The paper itself

Abstract

backgroundClinical study reports (CSRs) are produced for marketing authorisation applications. They often contain considerably more information about, and data from, clinical trials than corresponding journal publications. Use of data from CSRs might help circumvent reporting bias, but many researchers appear to be unaware of their existence or potential value. Our survey aimed to gain insight into the level of familiarity, understanding and use of CSRs, and to raise awareness of their potential within the systematic review community. We also aimed to explore the potential barriers faced when obtaining and using CSRs in systematic reviews.

methodsOnline survey of systematic reviewers who (i) had requested or used CSRs, (ii) had considered but not used CSRs and (iii) had not considered using CSRs was conducted. Cochrane reviewers were contacted twice via the Cochrane monthly digest. Non-Cochrane reviewers were reached via journal and other website postings.

resultsOne hundred sixty respondents answered an open invitation and completed the questionnaire; 20/160 (13%) had previously requested or used CSRs and other regulatory documents, 7/160 (4%) had considered but not used CSRs and 133/160 (83%) had never considered this data source. Survey respondents mainly sought data from the European Medicines Agency (EMA) and/or the Food and Drug Administration (FDA). Motivation for using CSRs stemmed mainly from concerns about reporting bias 11/20 (55%), specifically outcome reporting bias 11/20 (55%) and publication bias 5/20 (25%). The barriers to using CSRs noted by all types of respondents included current limited access to these documents (43 respondents), the time and resources needed to obtain and include these data in evidence syntheses (n = 25) and lack of guidance about how to use these sources in systematic reviews (n = 26).

conclusionsMost respondents (irrespective of whether they had previously used them) agreed that access to CSRs is important, and suggest that further guidance on how to use and include these data would help to promote their use in future systematic reviews. Most respondents who received CSRs considered them to be valuable in their systematic review and/or meta-analysis.

Indexed as

AuthorshipPublication BiasSystematic Reviews as TopicHumansResearch ReportSurveys and Questionnaires

Identifiers

PMID30089508
PMCPMC6083614

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.