Evidence map›Paper›PMID 28350849›Full record

ArticlePloS one2017

Science deserves to be judged by its contents, not by its wrapping: Revisiting Seglen's work on journal impact and research evaluation.

Lin Zhang, Ronald Rousseau, Gunnar Sivertsen

Abstract read
In one paragraph

Article in PloS one, 2017. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 8 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
8citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

8 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Beyond Citations: Assessing the Online Impact ofJournal of Indian Association of Pediatric Surgeons
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Lin ZhangDept. Management and Economics, North China University of Water Resources and Electric Power, Zhengzhou, China.ORCID http://orcid.org/0000-0003-0526-9677
Ronald RousseauDept. Mathematics, KU Leuven & Fac. of Social Sciences, University of Antwerp, Belgium.
Gunnar SivertsenNordic Institute for Studies in Innovation, Research and Education, Oslo, Norway.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

The scientific foundation for the criticism on the use of the Journal Impact Factor (JIF) in evaluations of individual researchers and their publications was laid between 1989 and 1997 in a series of articles by Per O. Seglen. His basic work has since influenced initiatives such as the San Francisco Declaration on Research Assessment (DORA), the Leiden Manifesto for research metrics, and The Metric Tide review on the role of metrics in research assessment and management. Seglen studied the publications of only 16 senior biomedical scientists. We investigate whether Seglen's main findings still hold when using the same methods for a much larger group of Norwegian biomedical scientists with more than 18,000 publications. Our results support and add new insights to Seglen's basic work.

Indexed as

Journal Impact FactorBibliometricsBiomedical ResearchDatabases, BibliographicHumansPublishingReproducibility of ResultsResearchResearch PersonnelScience

Identifiers

PMID28350849
PMCPMC5369779

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.