Evidence map›Paper›PMID 32586791›Full record

ArticleBMJ (Clinical research ed.)2020

Academic criteria for promotion and tenure in biomedical sciences faculties: cross sectional analysis of international sample of universities.

Danielle B Rice, Hana Raffoul, John P A Ioannidis, David Moher

Open access · hybridAbstract read
In one paragraph

Article in BMJ (Clinical research ed.), 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 93 papers.

0numbers the graph read from it
0cells of the map it votes in
93citing papers in PubMed
26.9field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

93 citing papers in PubMed, 245 citations in OpenAlex.

  1. Article
  2. Surgical paradox: PenWorld journal of methodology · 2026
    Review
  3. Article
  4. Article
  5. Article
  6. Review
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Review
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article

33 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

4 authors at 4 institutions in 2 countries.

Danielle B RiceDepartment of Psychology, McGill University, Montreal, QC, Canada.
Hana RaffoulOttawa Hospital Research Institute, Ottawa, ON, Canada.
John P A IoannidisDepartment of Medicine, Stanford University, Stanford, CA, USA.
David MoherCentre for Journalology, Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, ON, Canada dmoher@ohri.ca.ORCID 0000-0003-2434-4206
Ottawa Hospital · CAStanford University · USUniversity of Ottawa · CAUniversity of Waterloo · CA

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectiveTo determine the presence of a set of pre-specified traditional and non-traditional criteria used to assess scientists for promotion and tenure in faculties of biomedical sciences among universities worldwide.

designCross sectional study.

settingInternational sample of universities.

participants170 randomly selected universities from the Leiden ranking of world universities list.

main outcome measurePresence of five traditional (for example, number of publications) and seven non-traditional (for example, data sharing) criteria in guidelines for assessing assistant professors, associate professors, and professors and the granting of tenure in institutions with biomedical faculties.

resultsA total of 146 institutions had faculties of biomedical sciences, and 92 had eligible guidelines available for review. Traditional criteria of peer reviewed publications, authorship order, journal impact factor, grant funding, and national or international reputation were mentioned in 95% (n=87), 37% (34), 28% (26), 67% (62), and 48% (44) of the guidelines, respectively. Conversely, among non-traditional criteria, only citations (any mention in 26%; n=24) and accommodations for employment leave (37%; 34) were relatively commonly mentioned. Mention of alternative metrics for sharing research (3%; n=3) and data sharing (1%; 1) was rare, and three criteria (publishing in open access mediums, registering research, and adhering to reporting guidelines) were not found in any guidelines reviewed. Among guidelines for assessing promotion to full professor, traditional criteria were more commonly reported than non-traditional criteria (traditional criteria 54.2%, non-traditional items 9.5%; mean difference 44.8%, 95% confidence interval 39.6% to 50.0%; P=0.001). Notable differences were observed across continents in whether guidelines were accessible (Australia 100% (6/6), North America 97% (28/29), Europe 50% (27/54), Asia 58% (29/50), South America 17% (1/6)), with more subtle differences in the use of specific criteria.

conclusionsThis study shows that the evaluation of scientists emphasises traditional criteria as opposed to non-traditional criteria. This may reinforce research practices that are known to be problematic while insufficiently supporting the conduct of better quality research and open science. Institutions should consider incentivising non-traditional criteria. STUDY REGISTRATION: Open Science Framework (https://osf.io/26ucp/?view_only=b80d2bc7416543639f577c1b8f756e44).

Indexed as

Biomedical ResearchUniversitiesAuthorshipCareer MobilityCross-Sectional StudiesData CollectionFacultyHumansOrganizational PolicyPublishing

Identifiers

PMID32586791
PMCPMC7315647
OpenAlexW3037442288

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.