Evidence map›Paper›PMID 38454514›Full record

ArticleResearch integrity and peer review2024

A structured, journal-led peer-review mentoring program enhances peer review training.

Ariel Maia Lyons-Warren, Whitley W Aamodt, Kathleen M Pieper, Roy E Strowd

Open access · goldAbstract read
In one paragraph

Article in Research integrity and peer review, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 8 papers.

0numbers the graph read from it
0cells of the map it votes in
8citing papers in PubMed
72.5field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

8 citing papers in PubMed, 12 citations in OpenAlex.

  1. Article
  2. Review
  3. The CUAJ trainee peer-reviewer training program Pilot evaluation of a structured peer review curriculum for Canadian urology residents and fellows.Canadian Urological Association journal = Journal de l'Association des urologues du Canada · 2026
    Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors at 4 institutions in 1 country.

Ariel Maia Lyons-WarrenDepartment of Pediatrics, Section of Neurology; Clinical Care Center, Baylor College of Medicine, Houston, USA. lyonswar@bcm.edu.ORCID http://orcid.org/0000-0002-8584-5525
Whitley W AamodtDepartment of Neurology, University of Pennsylvania Perelman School of Medicine, Philadelphia, USA.
Kathleen M PieperAmerican Academy of Neurology, Minneapolis, USA.
Roy E StrowdDepartments of Neurology and Internal Medicine, Wake Forest University School of Medicine, Winston-Salem, USA.
American Academy of Neurology · USBaylor College of Medicine · USUniversity of Pennsylvania · USWake Forest University · US

Funding

Neurologic Clinical Epidemiology Training ProgramT32NS061779 · NINDS · UNIVERSITY OF PENNSYLVANIA · PI Andrea Lauren Christman Schneider, Allison Willis · 2008 to 2026
$4.6M
NINDS NIH HHS T32 NS061779
6 · The paper itself

Abstract

backgroundPeer review is essential to the advancement of knowledge. However, training on how to conduct peer review is limited, unorganized, and not well studied. Thus, we sought to determine if a structured mentored peer-review program improved peer review training as measured by multiple quantitative and qualitative assessments.

methodsThis pre-post intervention study enrolled 55 mentees across 5 cohorts from 2020 to 2023. Each cohort completed pre-program evaluations, participated in 2 mentored reviews, and completed post-program evaluations over 6 months. Mentors and mentees completed pre-program demographic and review experience questionnaires. Outcome measures included (1) total and sub-scores on the modified Review Quality Index (mRQI) applied to the same pre-selected research manuscript reviewed by mentees both pre and post intervention, (2) mentee self-perceived comfort with and understanding of the review process using a custom questionnaire, and (3) mentor satisfaction surveys. Pre- and post-program measures were compared using the Wilcoxon signed-rank test.

resultsPost-program total modified RQI score (median (IQR) = 31 (26.3-35.8)) was higher than pre-program total score (26.6 (19.7-29.7)) for the 42 mentees who completed both pre- and post-program reviews. Mentees reported improved perception of review (median (IQR) pre = 4 (3-4), post = 5 (4-5)) and editorial processes (pre = 3 (2-4), post = 4 (4-5)) as well as self-perceived confidence in completing an independent review of both scientific (median (IQR) pre = 2 (2-3), post = 4 (4-4)) and non-scientific (pre = 3 (2-4), post = 4 (4-5)) manuscripts following program participation. p < 0.0001 for all scores noted. Mentors reported high scores for enjoyment (median (range) 5/5 (3-5)) and interest in repeat participation (5/5 (2-5)).

conclusionsA 6-month structured mentored-review program including 2 mentored reviews improves peer review training as measured by the modified RQI as well as participant self-perceived understanding of publication science with high mentor satisfaction.

Indexed as

JournalologyMentorshipPeer reviewResearchSurveys and QuestionnairesTraining

Identifiers

PMID38454514
PMCPMC10921741
OpenAlexW4392756964

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.