Evidence map›Paper›PMID 33439120›Full record

ArticleeLife2021

A retrospective analysis of the peer review of more than 75,000 Marie Curie proposals between 2007 and 2018.

David G Pina, Ivan Buljan, Darko Hren, Ana Marušić

Abstract read
In one paragraph

Article in eLife, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 8 papers.

0numbers the graph read from it
0cells of the map it votes in
8citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

8 citing papers in PubMed.

  1. Article
  2. Article
  3. A new approach to grant review assessments: score, then rank.Research integrity and peer review · 2023
    Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

4 authors.

David G Pina *Research Executive Agency, European Commission, Brussels, Belgium.ORCID 0000-0002-4930-748X
Ivan Buljan *Department for Research in Biomedicine and Health, University of Split School of Medicine, Split, Croatia.ORCID 0000-0002-8719-7277
Darko HrenDepartment of Psychology, University of Split School of Humanities and Social Sciences, Split, Croatia.ORCID 0000-0001-6465-6568
Ana MarušićDepartment for Research in Biomedicine and Health, University of Split School of Medicine, Split, Croatia.ORCID 0000-0001-6272-0917

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Most funding agencies rely on peer review to evaluate grant applications and proposals, but research into the use of this process by funding agencies has been limited. Here we explore if two changes to the organization of peer review for proposals submitted to various funding actions by the European Union has an influence on the outcome of the peer review process. Based on an analysis of more than 75,000 applications to three actions of the Marie Curie programme over a period of 12 years, we find that the changes - a reduction in the number of evaluation criteria used by reviewers and a move from in-person to virtual meetings - had little impact on the outcome of the peer review process. Our results indicate that other factors, such as the type of grant or area of research, have a larger impact on the outcome.

Indexed as

Peer Review, ResearchEuropean UnionFinancing, OrganizedRetrospective Studiesgrant evaluationMarie Skłodowska-Curie Actionsmeta-researchnonepeer reviewresearch fundingreviewer agreement

Identifiers

PMID33439120
PMCPMC7806263

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.