Evidence map›Paper›PMID 29887230›Full record

ArticleInternational journal of medical informatics2018

Comparison of variable selection methods for clinical predictive modeling.

L Nelson Sanchez-Pinto, Laura Ruth Venable, John Fahrenbach, Matthew M Churpek

Abstract readComparative Study
In one paragraph

Article in International journal of medical informatics, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 117 papers, 4 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
117citing papers in PubMed, 4 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

117 citing papers in PubMed, 4 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Trial
  6. Trial
  7. Trial
  8. Article
  9. [Development and validation of a machine learning-based prediction model for fatty liver in Wilson disease].Nan fang yi ke da xue xue bao = Journal of Southern Medical University · 2026
    Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Assessing Stress Level Scores Against Wearables-Driven Physiological Measurements.Stress and health : journal of the International Society for the Investigation of Stress · 2025
    Article
  20. Article

57 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

L Nelson Sanchez-PintoAnn & Robert H. Lurie Children's Hospital of Chicago, Northwestern University Feinberg School of Medicine, Chicago, IL, USA.
Laura Ruth VenableRollins School of Public Health, Emory University, Atlanta, GA, USA.
John FahrenbachThe Center for Healthcare Delivery Science and Innovation, The University of Chicago, Chicago, IL, USA.
Matthew M ChurpekDepartment of Medicine, The University of Chicago, Chicago, IL, USA. Electronic address: matthew.churpek@uchospitals.edu.

Funding

Sepsis Early Prediction and Subphenotype Illumination Study (SEPSIS)R01GM123193 · NIGMS · UNIVERSITY OF WISCONSIN-MADISON · PI CHURPEK, MATTHEW MICHAEL · 2017 to 2021
$1.9M
Predicting In-hospital Cardiac Arrest Using Electronic Health Record DataK08HL121080 · NHLBI · UNIVERSITY OF CHICAGO · PI CHURPEK, MATTHEW MICHAEL · 2014 to 2018
$751k
NHLBI NIH HHS K08 HL121080NIGMS NIH HHS R01 GM123193
6 · The paper itself

Abstract

objectiveModern machine learning-based modeling methods are increasingly applied to clinical problems. One such application is in variable selection methods for predictive modeling. However, there is limited research comparing the performance of classic and modern for variable selection in clinical datasets. MATERIALS AND

methodsWe analyzed the performance of eight different variable selection methods: four regression-based methods (stepwise backward selection using p-value and AIC, Least Absolute Shrinkage and Selection Operator, and Elastic Net) and four tree-based methods (Variable Selection Using Random Forest, Regularized Random Forests, Boruta, and Gradient Boosted Feature Selection). We used two clinical datasets of different sizes, a multicenter adult clinical deterioration cohort and a single center pediatric acute kidney injury cohort. Method evaluation included measures of parsimony, variable importance, and discrimination.

resultsIn the large, multicenter dataset, the modern tree-based Variable Selection Using Random Forest and the Gradient Boosted Feature Selection methods achieved the best parsimony. In the smaller, single-center dataset, the classic regression-based stepwise backward selection using p-value and AIC methods achieved the best parsimony. In both datasets, variable selection tended to decrease the accuracy of the random forest models and increase the accuracy of logistic regression models.

conclusionsThe performance of classic regression-based and modern tree-based variable selection methods is associated with the size of the clinical dataset used. Classic regression-based variable selection methods seem to achieve better parsimony in clinical prediction problems in smaller datasets while modern tree-based methods perform better in larger datasets.

Indexed as

Machine LearningAdultChildCohort StudiesHumansLogistic ModelsData interpretationElectronic health recordsMachine learningModelsRegression analysisStatisticalVariable selection

Identifiers

PMID29887230
PMCPMC6003624

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.