Evidence map›Paper›PMID 30016950›Full record

ArticleBMC bioinformatics2018

Random forest versus logistic regression: a large-scale benchmark experiment.

Raphael Couronné, Philipp Probst, Anne-Laure Boulesteix

Registry-linked trialAbstract read
In one paragraph

Article in BMC bioinformatics, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT05810636 (Hyperactivity Assessment in Children With Attention-deficit Hyperactivity Disorder), which is not on this map. Cited by 284 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
284citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT05810636 enrolling by invitationnot on this mapstarted 2022, after this paper: background citation

Hyperactivity Assessment in Children With Attention-deficit Hyperactivity Disorder

Typeobservational_patient_registrySponsorNational Taiwan University HospitalRan2022 to 2026Enrolled200ConditionsAttention Deficit Disorder With HyperactivityArmsGarmin Vivosmart wearable device
3 · Its place in the literature

Who cites it

284 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Trial
  3. Trial
  4. Trial
  5. Trial
  6. Article
  7. Article
  8. Article
  9. Performance of Statistical and Machine Learning Risk Prediction Models for Advanced Breast Cancer.Cancer epidemiology, biomarkers & prevention : a publication of the American Association for Cancer Research, cosponsored by the American Society of Preventive Oncology · 2026
    Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Behavioral and Functional Profiling ofbioRxiv : the preprint server for biology · 2026
    Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article

224 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Raphael CouronnéDepartment of Medical Information Processing, Biometry and Epidemiology, LMU Munich, Marchioninistr. 15, Munich, 81377, Germany. raphael.couronne@gmail.com.
Philipp ProbstDepartment of Medical Information Processing, Biometry and Epidemiology, LMU Munich, Marchioninistr. 15, Munich, 81377, Germany.
Anne-Laure BoulesteixDepartment of Medical Information Processing, Biometry and Epidemiology, LMU Munich, Marchioninistr. 15, Munich, 81377, Germany.

Funding

Deutsche Forschungsgemeinschaft BO3139/2-3Deutsche Forschungsgemeinschaft BO3139/6-1
6 · The paper itself

Abstract

background and goalThe Random Forest (RF) algorithm for regression and classification has considerably gained popularity since its introduction in 2001. Meanwhile, it has grown to a standard classification approach competing with logistic regression in many innovation-friendly scientific fields.

resultsIn this context, we present a large scale benchmarking experiment based on 243 real datasets comparing the prediction performance of the original version of RF with default parameters and LR as binary classification tools. Most importantly, the design of our benchmark experiment is inspired from clinical trial methodology, thus avoiding common pitfalls and major sources of biases.

conclusionRF performed better than LR according to the considered accuracy measured in approximately 69% of the datasets. The mean difference between RF and LR was 0.029 (95%-CI =[0.022,0.038]) for the accuracy, 0.041 (95%-CI =[0.031,0.053]) for the Area Under the Curve, and - 0.027 (95%-CI =[-0.034,-0.021]) for the Brier score, all measures thus suggesting a significantly better performance of RF. As a side-result of our benchmarking experiment, we observed that the results were noticeably dependent on the inclusion criteria used to select the example datasets, thus emphasizing the importance of clear statements regarding this dataset selection process. We also stress that neutral studies similar to ours, based on a high number of datasets and carefully designed, will be necessary in the future to evaluate further variants, implementations or parameters of random forests which may yield improved accuracy compared to the original version with default values.

Indexed as

AlgorithmsBenchmarkingComputer SimulationDatabases as TopicHumansLogistic ModelsClassificationComparison studyLogistic regressionPrediction

Identifiers

PMID30016950
PMCPMC6050737

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.