Evidence map›Paper›PMID 33043428›Full record

ArticleBiometrics2021

Nonparametric variable importance assessment using machine learning techniques.

Brian D Williamson, Peter B Gilbert, Marco Carone, Noah Simon

Abstract read
In one paragraph

Article in Biometrics, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 33 papers.

0numbers the graph read from it
0cells of the map it votes in
33citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

33 citing papers in PubMed.

  1. AICO: Feature significance tests for supervised learning.Proceedings of the National Academy of Sciences of the United States of America · 2026
    Article
  2. Article
  3. Simplifying debiased inference via automatic differentiation and probabilistic programming.Journal of the Royal Statistical Society. Series B, Statistical methodology · 2026
    Article
  4. Article
  5. Article
  6. Article
  7. Review
  8. Article
  9. Article
  10. Article
  11. Article
  12. Observational
  13. Using comparative extinction risk analysis to prioritize the IUCN Red List reassessments of amphibians.Conservation biology : the journal of the Society for Conservation Biology · 2024
    Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Estimating the Efficiency Gain of Covariate-Adjusted Analyses in Future Clinical Trials Using External Data.Journal of the Royal Statistical Society. Series B, Statistical methodology · 2023
    Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

4 authors.

Brian D WilliamsonDepartment of Biostatistics, University of Washington, Seattle, Washington, USA.ORCID 0000-0002-7024-548X
Peter B GilbertDepartment of Biostatistics, University of Washington, Seattle, Washington, USA.
Marco CaroneDepartment of Biostatistics, University of Washington, Seattle, Washington, USA.ORCID 0000-0003-2106-0953
Noah SimonDepartment of Biostatistics, University of Washington, Seattle, Washington, USA.

Funding

SDMC: HIV Vaccine Trials NetworkUM1AI068635 · NIAID · FRED HUTCHINSON CANCER RESEARCH CENTER · PI Peter B. Gilbert, Yunda Huang · 2011 to 2026
$385.9M
STATISTICAL ISSUES IN AIDS RESEARCHR37AI029168 · NIAID · UNIVERSITY OF WASHINGTON · PI JAMES P HUGHES · 1999 to 2026
$9.8M
Statistical Methods in HIV Vaccine Efficacy TrialsR37AI054165 · NIAID · FRED HUTCHINSON CANCER RESEARCH CENTER · PI Peter B. Gilbert · 2010 to 2026
$6.7M
STATISTICAL ISSUES IN AIDS RESEARCHR01AI029168 · NIAID · UNIVERSITY OF WASHINGTON · PI HUGHES, JAMES P · 1989 to 2018
$5.3M
Statistical Methods for Incorporating Machine Learning Tools in Inference and Large-Scale Surveillance using Electronic Medical Records DataR01HL137808 · NHLBI · UNIVERSITY OF WASHINGTON · PI CARONE, MARCO · 2019 to 2023
$2.4M
Data-Driven Statistical Learning with Applications to GenomicsDP5OD019820 · OD · UNIVERSITY OF WASHINGTON · PI SIMON, NOAH · 2014 to 2018
$1.7M
Evaluating predictors of HIV vaccine efficacy: Statistical methods for estimation, testing, and inferenceF31AI140836 · NIAID · UNIVERSITY OF WASHINGTON · PI WILLIAMSON, BRIAN DAVID · 2018 to 2019
$65k
NHLBI NIH HHS R01 HL137808NIAID NIH HHS F31 AI140836NIAID NIH HHS R01 AI029168NIAID NIH HHS R37 AI029168NIAID NIH HHS R37 AI054165NIAID NIH HHS UM1 AI068635NIH HHS DP5 OD019820
6 · The paper itself

Abstract

In a regression setting, it is often of interest to quantify the importance of various features in predicting the response. Commonly, the variable importance measure used is determined by the regression technique employed. For this reason, practitioners often only resort to one of a few regression techniques for which a variable importance measure is naturally defined. Unfortunately, these regression techniques are often suboptimal for predicting the response. Additionally, because the variable importance measures native to different regression techniques generally have a different interpretation, comparisons across techniques can be difficult. In this work, we study a variable importance measure that can be used with any regression technique, and whose interpretation is agnostic to the technique used. This measure is a property of the true data-generating mechanism. Specifically, we discuss a generalization of the analysis of variance variable importance measure and discuss how it facilitates the use of machine learning techniques to flexibly estimate the variable importance of a single feature or group of features. The importance of each feature or group of features in the data can then be described individually, using this measure. We describe how to construct an efficient estimator of this measure as well as a valid confidence interval. Through simulations, we show that our proposal has good practical operating characteristics, and we illustrate its use with data from a study of risk factors for cardiovascular disease in South Africa.

Indexed as

Cardiovascular DiseasesMachine LearningHumansRegression AnalysisRisk Factorsmachine learningnonparametric R2statistical inferencetargeted learningvariable importance

Identifiers

PMID33043428
PMCPMC7946807

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.