Evidence map›Paper›PMID 33517416›Full record

ArticleAmerican journal of epidemiology2021

Addressing Measurement Error in Random Forests Using Quantitative Bias Analysis.

Tammy Jiang, Jaimie L Gradus, Timothy L Lash, Matthew P Fox

Abstract read
In one paragraph

Article in American journal of epidemiology, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 14 papers.

0numbers the graph read from it
0cells of the map it votes in
14citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

14 citing papers in PubMed.

  1. Article
  2. Identifying potential action points for reducing kinesiophobia among atrial fibrillation patients: a network and DAG analysis.Quality of life research : an international journal of quality of life aspects of treatment, care and rehabilitation · 2025
    Article
  3. Article
  4. Article
  5. Article
  6. Deep Survival Analysis With Clinical Variables for COVID-19.IEEE journal of translational engineering in health and medicine · 2023
    Article
  7. Article
  8. Article
  9. Review
  10. Article
  11. Article
  12. Jiang et al. Respond to "Quantitative Bias Analysis".American journal of epidemiology · 2021
    Article
  13. Article
  14. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

4 authors.

Tammy Jiang
Jaimie L Gradus
Timothy L Lash
Matthew P Fox

Funding

Risk Profiles for Suicidal Behavior in the General PopulationR01MH109507 · NIMH · BOSTON UNIVERSITY MEDICAL CAMPUS · PI GRADUS, JAIMIE L. · 2016 to 2019
$1.3M
Characterizing Trauma Outcomes: From Pre-trauma Risk to Post-trauma SequelaeR01MH110453 · NIMH · BOSTON UNIVERSITY MEDICAL CAMPUS · PI GRADUS, JAIMIE L. · 2017 to 2020
$1.3M
Improving Reproducibility by Incorporating UncertaintyR01LM013049 · NLM · EMORY UNIVERSITY · PI LASH, TIMOTHY L. · 2019 to 2022
$1.1M
NIMH NIH HHS R01 MH109507NIMH NIH HHS R01 MH110453NLM NIH HHS R01 LM013049
6 · The paper itself

Abstract

Although variables are often measured with error, the impact of measurement error on machine-learning predictions is seldom quantified. The purpose of this study was to assess the impact of measurement error on the performance of random-forest models and variable importance. First, we assessed the impact of misclassification (i.e., measurement error of categorical variables) of predictors on random-forest model performance (e.g., accuracy, sensitivity) and variable importance (mean decrease in accuracy) using data from the National Comorbidity Survey Replication (2001-2003). Second, we created simulated data sets in which we knew the true model performance and variable importance measures and could verify that quantitative bias analysis was recovering the truth in misclassified versions of the data sets. Our findings showed that measurement error in the data used to construct random forests can distort model performance and variable importance measures and that bias analysis can recover the correct results. This study highlights the utility of applying quantitative bias analysis in machine learning to quantify the impact of measurement error on study results.

Indexed as

BiasComputer SimulationDatasets as TopicHumansMachine LearningProbabilityScientific Experimental ErrorSuicide, Attemptedmachine learningmeasurement errormisclassificationnoisequantitative bias analysisrandom forests

Identifiers

PMID33517416
PMCPMC8408353

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.