Evidence map›Paper›PMID 36856858›Full record

ArticleInternational orthopaedics2023

Peer review practices in academic medicine: how the example of orthopaedic surgery may help shift the paradigm?

George D Chloros, Christos I Konstantinidis, Anastasia Vasilopoulou, Peter V Giannoudis

Abstract read
In one paragraph

Article in International orthopaedics, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed.

  1. Equity in Orthopaedic Knowledge, Open-Access Trends Among the Top 1,000 Cited Articles in Orthopaedic Surgery.Journal of the American Academy of Orthopaedic Surgeons. Global research & reviews · 2026
    Article
  2. Review
  3. Review
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

4 authors.

George D ChlorosAcademic Department of Trauma and Orthopaedic Surgery, School of Medicine, University of Leeds, Leeds General Infirmary, Clarendon Wing, Floor D, Great George Street, Leeds, LS1 3EX, UK.ORCID http://orcid.org/0000-0002-0342-9510
Christos I KonstantinidisOrthopedic Surgery Working Group, Society for Junior Doctors, Athens, Greece.ORCID http://orcid.org/0000-0002-0079-6577
Anastasia VasilopoulouOrthopedic Surgery Working Group, Society for Junior Doctors, Athens, Greece.ORCID http://orcid.org/0000-0001-9623-5784
Peter V GiannoudisAcademic Department of Trauma and Orthopaedic Surgery, School of Medicine, University of Leeds, Leeds General Infirmary, Clarendon Wing, Floor D, Great George Street, Leeds, LS1 3EX, UK. pgiannoudi@aol.com.ORCID http://orcid.org/0000-0002-5205-7696

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

purposeTo establish the current peer-reviewed practices in the discipline of orthopaedic surgery and correlate these to the journal's impact factor. Unfortunately, this is not receiving much attention and a critical literature gap in various disciplines; thus, determining the current practices in the discipline of orthopaedic surgery could provide valid insight that may be potentially applicable to other academic medicine disciplines as well.

methodsOrthopaedic surgery journals belonging to the Journal Citation Reports were queried, and the following was extracted: impact factor (IF) and blinding practices: single (SBPR), double (DBPR), triple (TBPR), quadruple (QBPR), and open (OPR) blinding review process and possibility of author-suggested reviewer (ASR) and non-preferred reviewer (NPR) options.

resultsOf the 82 journals, four were excluded as they allowed submission by invitation only. In the remaining, blinding was as follows: SBPR nine (11.5%), DBPR 52 (66.7%), TBPR two (2.6%), QBPR zero (0%), and OPR three (3.8%), and in 12 (15.4%), this was unclear. ASR and NPR options were offered by 34 (43.6%) and 27 (34.6%) journals respectively, whereas ASR was mandatory in eight (10.2%). No correlation between IF and any other parameter was found.

conclusionThe rules of the "game" are unclear/not disclosed in a significant number of cases, and the SBPR system, along with the ASR (mandatory sometimes) and NPR, is still extensively used with questionable integrity and fairness. Several recommendations are provided to mitigate potentially compromising practices, along with future directions to address the scarcity of research in this critical aspect of science.

Indexed as

Orthopedic ProceduresOrthopedicsHumansPeer ReviewAcademic medicineFairnessManuscript blindingOrthopedic surgeryPeer review practices

Identifiers

PMID36856858
PMCPMC10079738

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.