Evidence map›Paper›PMID 37827064›Full record

ArticleEuropean journal of cancer (Oxford, England : 1990)2023

Prevalence and implications of significance testing for baseline covariate imbalance in randomised cancer clinical trials: The Table 1 Fallacy.

Alexander D Sherry, Pavlos Msaouel, Zachary R McCaw, Joseph Abi Jaoude, Eric J Hsu, Ramez Kouzy, Roshal Patel, Yumeng Yang, Timothy A Lin, Cullen M Taniguchi and 8 more

Abstract read
In one paragraph

Article in European journal of cancer (Oxford, England : 1990), 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 7 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
7citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

7 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Trial
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

18 authors.

Alexander D SherryDepartment of Radiation Oncology, Division of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA.
Pavlos MsaouelDepartment of Genitourinary Medical Oncology, Division of Cancer Medicine, The University of Texas MD Anderson Cancer Center, Houston, TX, USA; Department of Translational Molecular Pathology, Division of Pathology/Lab Medicine, The University of Texas MD Anderson Cancer Center, Houston, TX, USA.
Zachary R McCawInsitro, South San Francisco, CA, USA; Department of Biostatistics, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA.
Joseph Abi JaoudeDepartment of Radiation Oncology, Division of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA; Department of Radiation Oncology, Stanford University, Stanford, CA, USA.
Eric J HsuDepartment of Radiation Oncology, University of Texas Southwestern Medical Center, Dallas, TX, USA.
Ramez KouzyDepartment of Radiation Oncology, Division of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA.
Roshal PatelDepartment of Radiation Oncology, Division of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA; Department of Radiation Oncology, Memorial Sloan-Kettering Cancer Center, New York, NY, USA.
Yumeng YangDepartment of Biomedical Informatics, The University of Texas Health Science Center at Houston, Houston, TX, USA.
Timothy A LinDepartment of Radiation Oncology and Molecular Radiation Sciences, Johns Hopkins University School of Medicine, Baltimore, MD, USA.
Cullen M TaniguchiDepartment of Gastrointestinal Radiation Oncology, Division of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA; Department of Experimental Radiation Oncology, Division of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA.
Claus RödelDepartment of Radiotherapy and Oncology, University of Frankfurt, Frankfurt, Germany; Frankfurt Cancer Institute, Frankfurt, Germany; German Cancer Research Center (DKFZ), Heidelberg, German Cancer Consortium (DKTK), Partner Site Frankfurt am Main, Frankfurt, Germany.
Emmanouil FokasDepartment of Radiotherapy and Oncology, University of Frankfurt, Frankfurt, Germany; Frankfurt Cancer Institute, Frankfurt, Germany; German Cancer Research Center (DKFZ), Heidelberg, German Cancer Consortium (DKTK), Partner Site Frankfurt am Main, Frankfurt, Germany.
Chad TangDepartment of Translational Molecular Pathology, Division of Pathology/Lab Medicine, The University of Texas MD Anderson Cancer Center, Houston, TX, USA; Department of Genitourinary Radiation Oncology, Division of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA.
Clifton David FullerDepartment of Radiation Oncology, Division of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA.
Bruce MinskyDepartment of Gastrointestinal Radiation Oncology, Division of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA.
Tomer MeirsonDavidoff Cancer Center, Rabin Medical Center, Petach Tikva, Israel.
Ryan SunDepartment of Biostatistics, The University of Texas MD Anderson Cancer Center, Houston, TX, USA.
Ethan B LudmirDepartment of Gastrointestinal Radiation Oncology, Division of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA; Department of Biostatistics, The University of Texas MD Anderson Cancer Center, Houston, TX, USA. Electronic address: ebludmir@mdanderson.org.

Funding

X-RAY CRYSTALLOGRAPHYP30CA008748 · NCI · SLOAN-KETTERING INSTITUTE FOR CANCER RES · PI Hongbiao Carl Lekaye · 1985 to 2026
$347.4M
Tumor Evolution and Metastasis ProgramP30CA016672 · NCI · UNIVERSITY OF TX MD ANDERSON CAN CTR · PI Fabien Delerue · 1985 to 2026
$290.8M
Development of functional magnetic resonance imaging-guided adaptive radiotherapy for head and neck cancer patients using novel MR-Linac deviceR01DE028290 · NIDCR · UNIVERSITY OF TX MD ANDERSON CAN CTR · PI CHRISTODOULEAS, JOHN PAUL, FULLER, CLIFTON DAVID · 2019 to 2023
$4.3M
Longitudinal Spatial-Nonspatial Decision Support for Competing Outcomes in Head and Neck Cancer TherapyR01CA258827 · NCI · UNIVERSITY OF ILLINOIS AT CHICAGO · PI CANAHUATE, GUADALUPE, FULLER, CLIFTON DAVID · 2021 to 2025
$2.9M
Fellow and Resident Radiation Oncology iNtensive Training in Imaging and Informatics to Empower Research Careers (FRONTI2ER)R25EB025787 · NIBIB · UNIVERSITY OF TX MD ANDERSON CAN CTR · PI DAS, PRAJNAN, FULLER, CLIFTON DAVID · 2018 to 2022
$535k
NCI NIH HHS P30 CA008748NCI NIH HHS P30 CA016672NCI NIH HHS R01 CA258827NIBIB NIH HHS R25 EB025787NIDCR NIH HHS R01 DE028290
6 · The paper itself

Abstract

backgroundThe 'Table 1 Fallacy' refers to the unsound use of significance testing for comparing the distributions of baseline variables between randomised groups to draw erroneous conclusions about balance or imbalance. We performed a cross-sectional study of the Table 1 Fallacy in phase III oncology trials.

methodsFrom ClinicalTrials.gov, 1877 randomised trials were screened. Multivariable logistic regressions evaluated predictors of the Table 1 Fallacy.

resultsA total of 765 randomised controlled trials involving 553,405 patients were analysed. The Table 1 Fallacy was observed in 25% of trials (188 of 765), with 3% of comparisons deemed significant (59 of 2353), approximating the typical 5% type I error assertion probability. Application of trial-level multiplicity corrections reduced the rate of significant findings to 0.3% (six of 2345 tests). Factors associated with lower odds of the Table 1 Fallacy included industry sponsorship (adjusted odds ratio [aOR] 0.29, 95% confidence interval [CI] 0.18-0.47; multiplicity-corrected P < 0.0001), larger trial size (≥795 versus <280 patients; aOR 0.32, 95% CI 0.19-0.53; multiplicity-corrected P = 0.0008), and publication in a European versus American journal (aOR 0.06, 95% CI 0.03-0.13; multiplicity-corrected P < 0.0001).

conclusionsThis study highlights the persistence of the Table 1 Fallacy in contemporary oncology randomised controlled trials, with one of every four trials testing for baseline differences after randomisation. Significance testing is a suboptimal method for identifying unsound randomisation procedures and may encourage misleading inferences. Journal-level enforcement is a possible strategy to help mitigate this fallacy.

Indexed as

NeoplasmsCross-Sectional StudiesHumansPrevalenceRandomized Controlled Trials as TopicCovariate imbalanceOncologyPhase IIIRandomised controlled trialsSignificance testing for baseline characteristicsTable 1 FallacyTesting for baseline differences

Identifiers

PMID37827064
PMCPMC11512581

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.