ArticleStatistics in medicine2021
Selection of variables for multivariable models: Opportunities and limitations in quantifying model stability by resampling.
Article in Statistics in medicine, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 27 papers.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
27 citing papers in PubMed.
- Urinary CXCL9 Across the Spectrum of Kidney Allograft Inflammation.Kidney international reports · 2026Article
- Letter to the Editor on "Clinical Characteristics and Mortality Risk Factors ofAnnals of laboratory medicine · 2026Article
- Resident Participation in Operative Fixation of Distal Radius Fractures: A Comparison of Outcomes.Journal of hand surgery global online · 2026Article
- Methodological Concerns Regarding the Validation of the CHARM Score for Cord Blood TransplantationTurkish journal of haematology : official journal of Turkish Society of Haematology · 2026Article
- The DeepJoint Algorithm: An Innovative Approach for Studying the Longitudinal Evolution of Quantitative Mammographic Density and Its Association With Screen-Detected Breast Cancer Risk.Biometrical journal. Biometrische Zeitschrift · 2026Article
- Serum calcium levels are independently associated with severe coronary artery stenosis combined with severe cerebral artery stenosis.BMC neurology · 2026Article
- A commentary on "Assessing kidney outcomes in childhood-onset lupus nephritis: role of National Institutes of Health-modified histological indices".Clinical and experimental pediatrics · 2026Article
- Authors' reply: a commentary on "Assessing kidney outcomes in childhood-onset lupus nephritis: role of National Institutes of Health-modified histological indices".Clinical and experimental pediatrics · 2026Article
- Letter to: identifying influencing factors and constructing a prediction model for long COVID-19 in hemodialysis patients.International urology and nephrology · 2026Article
- Enhancing feature selection for ordinal outcomes using resampling-based sparse linear discriminant analysis.Bioinformatics advances · 2026Article
- Letter to ''Clinical characteristics and risk factors analysis of abdominal symptoms in IgA vasculitis patients: a retrospective cohort study'.Clinical rheumatology · 2025Article
- Predicting neurological complications post clipping surgery in unruptured intracranial aneurysms using the NEURO score: a multi-center retrospective cohort study.Korean journal of anesthesiology · 2025Observational
- Development and validation of a prognostic staging system for primary plasma cell leukemia.Journal of hematology & oncology · 2025Article
- Prediction Modeling With Many Correlated and Zero-Inflated Predictors: Assessing the Nonnegative Garrote Approach.Statistics in medicine · 2025Article
- Variable selection methods for descriptive modeling.PloS one · 2025Article
- Socioeconomic determinants of low birth weight and its association with peripubertal obesity in Brazil.Frontiers in public health · 2025Article
- Circulating Metabolite Profiles and Risk of Coronary Heart Disease Among Racially and Geographically Diverse Populations.Circulation. Genomic and precision medicine · 2024Article
- Altered serum metabolome as an indicator of paraneoplasia or concomitant cancer in patients with rheumatic disease.Annals of the rheumatic diseases · 2024Article
- Predicting survival in patients with myelodysplastic/myeloproliferative neoplasms with SF3B1 mutation and thrombocytosis.Leukemia · 2024Article
- What question are we trying to answer? Embracing causal inference.Frontiers in veterinary science · 2024Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
5 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
Statistical models are often fitted to obtain a concise description of the association of an outcome variable with some covariates. Even if background knowledge is available to guide preselection of covariates, stepwise variable selection is commonly applied to remove irrelevant ones. This practice may introduce additional variability and selection is rarely certain. However, these issues are often ignored and model stability is not questioned. Several resampling-based measures were proposed to describe model stability, including variable inclusion frequencies (VIFs), model selection frequencies, relative conditional bias (RCB), and root mean squared difference ratio (RMSDR). The latter two were recently proposed to assess bias and variance inflation induced by variable selection. Here, we study the consistency and accuracy of resampling estimates of these measures and the optimal choice of the resampling technique. In particular, we compare subsampling and bootstrapping for assessing stability of linear, logistic, and Cox models obtained by backward elimination in a simulation study. Moreover, we exemplify the estimation and interpretation of all suggested measures in a study on cardiovascular risk. The VIF and the model selection frequency are only consistently estimated in the subsampling approach. By contrast, the bootstrap is advantageous in terms of bias and precision for estimating the RCB as well as the RMSDR. Though, unbiased estimation of the latter quantity requires independence of covariates, which is rarely encountered in practice. Our study stresses the importance of addressing model stability after variable selection and shows how to cope with it.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.