Evidence map›Paper›PMID 32724519›Full record

ArticleEcology and evolution2020

Ignoring non-English-language studies may bias ecological meta-analyses.

Ko Konno, Munemitsu Akasaka, Chieko Koshida, Naoki Katayama, Noriyuki Osada, Rebecca Spake, Tatsuya Amano

Abstract read
In one paragraph

Article in Ecology and evolution, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 56 papers, 12 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
56citing papers in PubMed, 12 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

56 citing papers in PubMed, 12 syntheses or guidelines pooled it.

  1. The evidence base for ranger patrol effectiveness in conservation and how to improve it.Biological reviews of the Cambridge Philosophical Society · 2026
    Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. The use of Language ENvironment Analysis in autism research: A systematic review.Autism : the international journal of research and practice · 2025
    Pooled it
  7. Pooled it
  8. Pooled it
  9. Pooled it
  10. Pooled it
  11. Pooled it
  12. Pooled it
  13. Biases in butterfly survey effort and patterns of protocol used across biogeographic regions.Ecological applications : a publication of the Ecological Society of America · 2026
    Review
  14. Article
  15. Article
  16. Review
  17. Enabling conditions for conservation on Indigenous and community lands.Conservation biology : the journal of the Society for Conservation Biology · 2026
    Review
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Ko KonnoSchool of Natural Sciences Bangor University Gwynedd UK.ORCID https://orcid.org/0000-0002-5319-9178
Munemitsu AkasakaInstitute of Agriculture Tokyo University of Agriculture and Technology Fuchu Japan.ORCID https://orcid.org/0000-0002-0143-0841
Chieko KoshidaPlant Chemical Ecology Technische Universität Darmstadt Darmstadt Germany.ORCID https://orcid.org/0000-0002-2143-4137
Naoki KatayamaBiodiversity Division Institute for Agro-Environmental Sciences NARO Tsukuba-shi Japan.ORCID https://orcid.org/0000-0002-1136-442X
Noriyuki OsadaLaboratory of Plant Conservation Science, Faculty of Agriculture Meijo University Nagoya Japan.ORCID https://orcid.org/0000-0002-7767-0446
Rebecca SpakeSchool of Geography and Environmental Science University of Southampton Southampton UK.ORCID https://orcid.org/0000-0003-4671-2225
Tatsuya AmanoInstitute of Global Innovation Research Tokyo University of Agriculture and Technology Fuchu Japan.ORCID https://orcid.org/0000-0001-6576-3410

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Meta-analysis plays a crucial role in syntheses of quantitative evidence in ecology and biodiversity conservation. The reliability of estimates in meta-analyses strongly depends on unbiased sampling of primary studies. Although earlier studies have explored potential biases in ecological meta-analyses, biases in reported statistical results and associated study characteristics published in different languages have never been tested in environmental sciences. We address this knowledge gap by systematically searching published meta-analyses and comparing effect-size estimates between English- and Japanese-language studies included in existing meta-analyses. Of the 40 published ecological meta-analysis articles authored by those affiliated to Japanese institutions, we find that three meta-analysis articles searched for studies in the two languages and involved sufficient numbers of English- and Japanese-language studies, resulting in four eligible meta-analyses (i.e., four meta-analyses conducted in the three meta-analysis articles). In two of the four, effect sizes differ significantly between the English- and Japanese-language studies included in the meta-analyses, causing considerable changes in overall mean effect sizes and even their direction when Japanese-language studies are excluded. The observed differences in effect sizes are likely attributable to systematic differences in reported statistical results and associated study characteristics, particularly taxa and ecosystems, between English- and Japanese-language studies. Despite being based on a small sample size, our findings suggest that ignoring non-English-language studies may bias outcomes of ecological meta-analyses, due to systematic differences in study characteristics and effect-size estimates between English- and non-English languages. We provide a list of actions that meta-analysts could take in the future to reduce the risk of language bias.

Indexed as

language barrierspublication biasreporting biasesrisk of biassystematic review

Identifiers

PMID32724519
PMCPMC7381574

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.