Evidence map›Paper›PMID 33960637›Full record

ArticleBiological reviews of the Cambridge Philosophical Society2021

Preferred reporting items for systematic reviews and meta-analyses in ecology and evolutionary biology: a PRISMA extension.

Rose E O'Dea, Malgorzata Lagisz, Michael D Jennions, Julia Koricheva, Daniel W A Noble, Timothy H Parker, Jessica Gurevitch, Matthew J Page, Gavin Stewart, David Moher and 1 more

Abstract read
In one paragraph

Article in Biological reviews of the Cambridge Philosophical Society, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 185 papers, 84 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
185citing papers in PubMed, 84 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

185 citing papers in PubMed, 84 syntheses or guidelines pooled it.

  1. Pooled it
  2. The evidence base for ranger patrol effectiveness in conservation and how to improve it.Biological reviews of the Cambridge Philosophical Society · 2026
    Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Pooled it
  7. Pooled it
  8. Pooled it
  9. Pooled it
  10. Pooled it
  11. Pooled it
  12. Pooled it
  13. Pooled it
  14. Pooled it
  15. Pooled it
  16. Pooled it
  17. Pooled it
  18. Pooled it
  19. Pooled it
  20. Pooled it

125 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors.

Rose E O'DeaEvolution & Ecology Research Centre and School of Biological and Environmental Sciences, University of New South Wales, Sydney, NSW, 2052, Australia.ORCID 0000-0001-8177-5075
Malgorzata LagiszEvolution & Ecology Research Centre and School of Biological and Environmental Sciences, University of New South Wales, Sydney, NSW, 2052, Australia.ORCID 0000-0002-3993-6127
Michael D JennionsResearch School of Biology, Australian National University, 46 Sullivans Creek Road, Canberra, 2600, Australia.ORCID 0000-0001-9221-2788
Julia KorichevaDepartment of Biological Sciences, Royal Holloway University of London, Egham, Surrey, TW20 0EX, U.K.ORCID 0000-0002-9033-0171
Daniel W A NobleEvolution & Ecology Research Centre and School of Biological and Environmental Sciences, University of New South Wales, Sydney, NSW, 2052, Australia.ORCID 0000-0001-9460-8743
Timothy H ParkerDepartment of Biology, Whitman College, Walla Walla, WA, 99362, U.S.A.ORCID 0000-0003-2995-5284
Jessica GurevitchDepartment of Ecology and Evolution, Stony Brook University, Stony Brook, NY, 11794-5245, U.S.A.ORCID 0000-0003-0157-4332
Matthew J PageSchool of Public Health and Preventative Medicine, Monash University, Melbourne, VIC, 3004, Australia.ORCID 0000-0002-4242-7526
Gavin StewartSchool of Natural and Environmental Sciences, Newcastle University, Newcastle upon Tyne, NE1 7RU, U.K.ORCID 0000-0001-5684-1544
David MoherCentre for Journalology, Clinical Epidemiology Program, Ottawa Hospital Research Institute, General Campus, 501 Smyth Road, Room L1288, Ottawa, ON, K1H 8L6, Canada.ORCID 0000-0003-2434-4206
Shinichi NakagawaEvolution & Ecology Research Centre and School of Biological and Environmental Sciences, University of New South Wales, Sydney, NSW, 2052, Australia.ORCID 0000-0002-7765-5182

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Since the early 1990s, ecologists and evolutionary biologists have aggregated primary research using meta-analytic methods to understand ecological and evolutionary phenomena. Meta-analyses can resolve long-standing disputes, dispel spurious claims, and generate new research questions. At their worst, however, meta-analysis publications are wolves in sheep's clothing: subjective with biased conclusions, hidden under coats of objective authority. Conclusions can be rendered unreliable by inappropriate statistical methods, problems with the methods used to select primary research, or problems within the primary research itself. Because of these risks, meta-analyses are increasingly conducted as part of systematic reviews, which use structured, transparent, and reproducible methods to collate and summarise evidence. For readers to determine whether the conclusions from a systematic review or meta-analysis should be trusted - and to be able to build upon the review - authors need to report what they did, why they did it, and what they found. Complete, transparent, and reproducible reporting is measured by 'reporting quality'. To assess perceptions and standards of reporting quality of systematic reviews and meta-analyses published in ecology and evolutionary biology, we surveyed 208 researchers with relevant experience (as authors, reviewers, or editors), and conducted detailed evaluations of 102 systematic review and meta-analysis papers published between 2010 and 2019. Reporting quality was far below optimal and approximately normally distributed. Measured reporting quality was lower than what the community perceived, particularly for the systematic review methods required to measure trustworthiness. The minority of assessed papers that referenced a guideline (~16%) showed substantially higher reporting quality than average, and surveyed researchers showed interest in using a reporting guideline to improve reporting quality. The leading guideline for improving reporting quality of systematic reviews is the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) statement. Here we unveil an extension of PRISMA to serve the meta-analysis community in ecology and evolutionary biology: PRISMA-EcoEvo (version 1.0). PRISMA-EcoEvo is a checklist of 27 main items that, when applicable, should be reported in systematic review and meta-analysis publications summarising primary research in ecology and evolutionary biology. In this explanation and elaboration document, we provide guidance for authors, reviewers, and editors, with explanations for each item on the checklist, including supplementary examples from published papers. Authors can consult this PRISMA-EcoEvo guideline both in the planning and writing stages of a systematic review and meta-analysis, to increase reporting quality of submitted manuscripts. Reviewers and editors can use the checklist to assess reporting quality in the manuscripts they review. Overall, PRISMA-EcoEvo is a resource for the ecology and evolutionary biology community to facilitate transparent and comprehensively reported systematic reviews and meta-analyses.

Indexed as

ChecklistMeta-Analysis as TopicSystematic Reviews as TopicBiological EvolutionEcologycomparative analysiscritical appraisalevidence synthesisnon-independenceopen sciencepre-registrationregistrationstudy quality

Identifiers

PMID33960637
PMCPMC8518748

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.