Evidence map›Paper›PMID 24028376›Full record

ArticleSystematic reviews2013

Bibliometrics of systematic reviews: analysis of citation rates and journal impact factors.

Pamela Royle, Ngianga-Bakwin Kandala, Katharine Barnard, Norman Waugh

Open access · goldAbstract read
In one paragraph

Article in Systematic reviews, 2013. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 25 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
25citing papers in PubMed, 1 pooled it
6.0field-weighted citation impact, top 3% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

25 citing papers in PubMed, 1 synthesis or guideline pooled it, 119 citations in OpenAlex.

  1. Pooled it
  2. Review
  3. Article
  4. Review
  5. Article
  6. Mapping out the bibliometric characteristics ofJournal of dental sciences · 2023
    Article
  7. Review
  8. Article
  9. Article
  10. Review
  11. Review
  12. Article
  13. Article
  14. International archives of otorhinolaryngology · 2020
    Article
  15. Knowledge Domain and Emerging Trends on Echinococcosis Research: A Scientometric Analysis.International journal of environmental research and public health · 2019
    Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors at 3 institutions in 2 countries.

Pamela RoyleDivision of Health Sciences, Warwick Medical School, University of Warwick, CV4 7AL, Coventry, UK. p.l.royle@warwick.ac.uk.
Ngianga-Bakwin Kandala
Katharine Barnard
Norman Waugh
University of Warwick · GBKenya Medical Research Institute · KEUniversity of Southampton · GB

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundSystematic reviews are important for informing clinical practice and health policy. The aim of this study was to examine the bibliometrics of systematic reviews and to determine the amount of variance in citations predicted by the journal impact factor (JIF) alone and combined with several other characteristics.

methodsWe conducted a bibliometric analysis of 1,261 systematic reviews published in 2008 and the citations to them in the Scopus database from 2008 to June 2012. Potential predictors of the citation impact of the reviews were examined using descriptive, univariate and multiple regression analysis.

resultsThe mean number of citations per review over four years was 26.5 (SD ± 29.9) or 6.6 citations per review per year. The mean JIF of the journals in which the reviews were published was 4.3 (SD ± 4.2). We found that 17% of the reviews accounted for 50% of the total citations and 1.6% of the reviews were not cited. The number of authors was correlated with the number of citations (r = 0.215, P < 0.001). Higher numbers of citations were associated with the following characteristics: first author from the United States (36.5 citations), an ICD-10 chapter heading of Neoplasms (31.8 citations), type of intervention classified as Investigation, Diagnostics or Screening (34.7 citations) and having an international collaboration (32.1 citations). The JIF alone explained more than half of the variation in citations (R(2) = 0.59) in univariate analysis. Adjusting for both JIF and type of intervention increased the R2 value to 0.81. Fourteen percent of reviews published in the top quartile of JIFs (≥ 5.16) received citations in the bottom quartile (eight or fewer), whereas 9% of reviews published in the lowest JIF quartile (≤ 2.06) received citations in the top quartile (34 or more). Six percent of reviews in journals with no JIF were also in the first quartile of citations.

conclusionsThe JIF predicted over half of the variation in citations to the systematic reviews. However, the distribution of citations was markedly skewed. Some reviews in journals with low JIFs were well-cited and others in higher JIF journals received relatively few citations; hence the JIF did not accurately represent the number of citations to individual systematic reviews.

Indexed as

Biomedical ResearchJournal Impact FactorReview Literature as TopicAuthorshipHumansPeriodicals as Topic

Identifiers

PMID24028376
PMCPMC3847500
OpenAlexW2162247560

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.