Evidence map›Paper›PMID 33879485›Full record

SynthesisBMJ open2021

Testing for non-inferior mortality: a systematic review of non-inferiority margin sizes and trial characteristics.

Sandra Pong, Martin Urner, Robert A Fowler, Nicholas Mitsakakis, Winnie Seto, James S Hutchison, Michelle Science, Nick Daneman

Open access · goldAbstract readSystematic Review
In one paragraph

Synthesis in BMJ open, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 21 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
21citing papers in PubMed, 1 pooled it
4.3field-weighted citation impact, top 5% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

21 citing papers in PubMed, 1 synthesis or guideline pooled it, 33 citations in OpenAlex.

  1. Pooled it
  2. Trial
  3. Trial
  4. Trial
  5. Trial
  6. Trial
  7. Article
  8. Article
  9. Article
  10. ADJUVANT Randomized Controlled Trial: Rationale and Design.Journal of the American Heart Association · 2026
    Article
  11. Article
  12. Clinical equivalence and non-inferiority within health technology assessment.The European journal of health economics : HEPAC : health economics in prevention and care · 2026
    Article
  13. Review
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Tocilizumab versus baricitinib in hospitalized patients with severe COVID-19: an open label, randomized controlled trial.Clinical microbiology and infection : the official publication of the European Society of Clinical Microbiology and Infectious Diseases · 2023
    Article
  20. Noninferiority Margin Size and Acceptance of Trial Results: Contingent Valuation Survey of Clinician Preferences for Noninferior Mortality.Medical decision making : an international journal of the Society for Medical Decision Making · 2022
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors at 4 institutions in 2 countries.

Sandra PongDepartment of Pharmacy, The Hospital for Sick Children, Toronto, Ontario, Canada sandra.pong@sickkids.ca.ORCID 0000-0003-2963-9601
Martin UrnerInterdepartmental Division of Critical Care Medicine, University of Toronto, Toronto, Ontario, Canada.
Robert A FowlerInterdepartmental Division of Critical Care Medicine, University of Toronto, Toronto, Ontario, Canada.
Nicholas MitsakakisDalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada.
Winnie SetoDepartment of Pharmacy, The Hospital for Sick Children, Toronto, Ontario, Canada.
James S HutchisonDepartment of Critical Care Medicine, The Hospital for Sick Children, Toronto, Ontario, Canada.
Michelle ScienceDivision of Infectious Diseases, The Hospital for Sick Children, Toronto, Ontario, Canada.
Nick DanemanDivision of Infectious Diseases, Department of Medicine, Sunnybrook Health Sciences Centre, Toronto, Ontario, Canada.ORCID 0000-0001-8827-3764
Hospital for Sick Children · CASunnybrook Health Science Centre · CAUniversity of Toronto · CA3M (United States) · US

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectiveTo describe the size and variability of non-inferiority margins used in non-inferiority trials of medications with primary outcomes involving mortality, and to examine the association between trial characteristics and non-inferiority margin size.

designSystematic review. DATA SOURCES: Medline, Medline In Process, Medline Epub Ahead of Print and Embase Classic+Embase databases from January 1989 to December 2019. ELIGIBILITY CRITERIA: Prospective non-inferiority randomised controlled trials comparing pharmacological therapies, with primary analyses for non-inferiority and primary outcomes involving mortality alone or as part of a composite outcome. Trials had to prespecify non-inferiority margins as absolute risk differences or relative to risks of outcome and provide a baseline risk of primary outcome in the control intervention.

results3992 records were screened, 195 articles were selected for full text review and 111 articles were included for analyses. 82% of trials were conducted in thrombosis, infectious diseases or oncology. Mortality was the sole primary outcome in 23 (21%) trials, and part of a composite primary outcome in 88 (79%) trials. The overall median non-inferiority margin was an absolute risk difference of 9% (IQR 4.2%-10%). When non-inferiority margins were expressed relative to the baseline risk of primary outcome in control groups, the median relative non-inferiority margin was 1.5 (IQR 1.3-1.7). In multivariable regression analyses examining the association between trial characteristics (medical specialty, inclusion of paediatric patients, mortality as a sole or part of a composite primary outcome, presence of industry funding) and non-inferiority margin size, only medical specialty was significantly associated with non-inferiority margin size.

conclusionAbsolute and relative non-inferiority margins used in published trials comparing medications are large, allowing conclusions of non-inferiority in the context of large differences in mortality. Accepting the potential for large increases in outcomes involving mortality while declaring non-inferiority is a challenging methodological issue in the conduct of non-inferiority trials.

Indexed as

Prospective StudiesChildHumansclinical trialsepidemiologystatistics & research methods

Identifiers

PMID33879485
PMCPMC8061825
OpenAlexW3156132131

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.