Evidence map›Paper›PMID 31985777›Full record

ArticleBioinformatics (Oxford, England)2020

Consensus features nested cross-validation.

Saeid Parvandeh, Hung-Wen Yeh, Martin P Paulus, Brett A McKinney

Abstract read
In one paragraph

Article in Bioinformatics (Oxford, England), 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 110 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
110citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

110 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Trial
  3. Observational
  4. Article
  5. Article
  6. A Brainstem Radiomics Framework to Distinguish Progressive Supranuclear Palsy from Parkinson's Disease.Movement disorders : official journal of the Movement Disorder Society · 2026
    Article
  7. Review
  8. Article
  9. Article
  10. Article
  11. Macroscale Gradient-Informed Neural Oscillation Topography in Parkinson's Disease.Movement disorders : official journal of the Movement Disorder Society · 2026
    Article
  12. Article
  13. Article
  14. Article
  15. Review
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article

50 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Saeid ParvandehTandy School of Computer Science, University of Tulsa, Tulsa, OK, USA.
Hung-Wen YehHealth Services and Outcomes Research, Children's Mercy Hospital, Kansas City, MO, USA.
Martin P PaulusLaureate Institute for Brain Research, Tulsa, OK, USA.
Brett A McKinneyTandy School of Computer Science, University of Tulsa, Tulsa, OK, USA.

Funding

Molecular Mechanisms and Genetics of AutoimmunityP20GM103456 · NIGMS · OKLAHOMA MEDICAL RESEARCH FOUNDATION · PI GAFFNEY, PATRICK M · 2012 to 2013
$4.8M
NIGMS NIH HHS P20 GM103456
6 · The paper itself

Abstract

summaryFeature selection can improve the accuracy of machine-learning models, but appropriate steps must be taken to avoid overfitting. Nested cross-validation (nCV) is a common approach that chooses the classification model and features to represent a given outer fold based on features that give the maximum inner-fold accuracy. Differential privacy is a related technique to avoid overfitting that uses a privacy-preserving noise mechanism to identify features that are stable between training and holdout sets.We develop consensus nested cross-validation (cnCV) that combines the idea of feature stability from differential privacy with nCV. Feature selection is applied in each inner fold and the consensus of top features across folds is used as a measure of feature stability or reliability instead of classification accuracy, which is used in standard nCV. We use simulated data with main effects, correlation and interactions to compare the classification accuracy and feature selection performance of the new cnCV with standard nCV, Elastic Net optimized by cross-validation, differential privacy and private evaporative cooling (pEC). We also compare these methods using real RNA-seq data from a study of major depressive disorder.The cnCV method has similar training and validation accuracy to nCV, but cnCV has much shorter run times because it does not construct classifiers in the inner folds. The cnCV method chooses a more parsimonious set of features with fewer false positives than nCV. The cnCV method has similar accuracy to pEC and cnCV selects stable features between folds without the need to specify a privacy threshold. We show that cnCV is an effective and efficient approach for combining feature selection with classification. AVAILABILITY AND IMPLEMENTATION: Code available at https://github.com/insilico/cncv. SUPPLEMENTARY INFORMATION: Supplementary data are available at Bioinformatics online.

Indexed as

Major Depressive DisorderConsensusHumansMachine LearningReproducibility of ResultsResearch Design

Identifiers

PMID31985777
PMCPMC7776094

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.