Evidence map›Paper›PMID 34126999›Full record

ArticleBMC medicine2021

Utilization of the evidence from studies with no events in meta-analyses of adverse events: an empirical investigation.

Chang Xu, Xiaoqin Zhou, Liliane Zorzela, Ke Ju, Luis Furuya-Kanamori, Lifeng Lin, Cuncun Lu, Omran A H Musa, Sunita Vohra

Abstract read
In one paragraph

Article in BMC medicine, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 21 papers, 4 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
21citing papers in PubMed, 4 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

21 citing papers in PubMed, 4 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Article
  6. Article
  7. Comparative Genomic Analysis of Livestock-DerivedJournal of microbiology and biotechnology · 2025
    Article
  8. Article
  9. Article
  10. Article
  11. Review
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors.

Chang XuDepartment of Population Medicine, College of Medicine, Qatar University, Al Jamiaa Street, P. O. Box, 2713, Doha, Qatar. xuchang2016@runbox.com.ORCID 0000-0002-2627-1250
Xiaoqin ZhouDepartment of Clinical Research Management, West China Hospital, Sichuan University, Chengdu, China.
Liliane ZorzelaDepartment of Pediatrics, Faculty of Medicine & Dentistry, University of Alberta, Edmonton, Alberta, Canada.
Ke JuWest China School of Public Health and West China Fourth Hospital, Sichuan University, Chengdu, China.
Luis Furuya-KanamoriUQ Centre for Clinical Research, Faculty of Medicine, University of Queensland, Brisbane, Australia.
Lifeng LinDepartment of Statistics, Florida State University, Tallahassee, FL, USA.
Cuncun LuEvidence-Based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou, China.
Omran A H MusaDepartment of Population Medicine, College of Medicine, Qatar University, Al Jamiaa Street, P. O. Box, 2713, Doha, Qatar.
Sunita VohraDepartment of Pediatrics, Faculty of Medicine & Dentistry, University of Alberta, Edmonton, Alberta, Canada.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundsZero-events studies frequently occur in systematic reviews of adverse events, which consist of an important source of evidence. We aimed to examine how evidence of zero-events studies was utilized in the meta-analyses of systematic reviews of adverse events.

methodsWe conducted a survey of systematic reviews published in two periods: January 1, 2015, to January 1, 2020, and January 1, 2008, to April 25, 2011. Databases were searched for systematic reviews that conducted at least one meta-analysis of any healthcare intervention and used adverse events as the exclusive outcome. An adverse event was defined as any untoward medical occurrence in a patient or subject in healthcare practice. We summarized the frequency of occurrence of zero-events studies in eligible systematic reviews and how these studies were dealt with in the meta-analyses of these systematic reviews.

resultsWe included 640 eligible systematic reviews. There were 406 (63.45%) systematic reviews involving zero-events studies in their meta-analyses, among which 389 (95.11%) involved single-arm-zero-events studies and 223 (54.93%) involved double-arm-zero-events studies. The majority (98.71%) of these systematic reviews incorporated single-arm-zero-events studies into the meta-analyses. On the other hand, the majority (76.23%) of them excluded double-arm-zero-events studies from the meta-analyses, of which the majority (87.06%) did not discuss the potential impact of excluding such studies. Systematic reviews published at present (2015-2020) tended to incorporate zero-events studies in meta-analyses than those published in the past (2008-2011), but the difference was not significant (proportion difference=-0.09, 95% CI -0.21 to 0.03, p = 0.12).

conclusionSystematic review authors routinely treated studies with zero-events in both arms as "non-informative" carriers and excluded them from their reviews. Whether studies with no events are "informative" or not largely depends on the methods and assumptions applied, thus sensitivity analyses using different methods should be considered in future meta-analyses.

Indexed as

Systematic Reviews as TopicDatabases, FactualHumansMeta-Analysis as TopicAdverse eventsMeta-analysisSystematic reviewZero-events studies

Identifiers

PMID34126999
PMCPMC8204528

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.