Evidence map›Paper›PMID 35426912›Full record

ArticleGigaScience2022

Benchmarking missing-values approaches for predictive models on health databases.

Alexandre Perez-Lebel, Gaël Varoquaux, Marine Le Morvan, Julie Josse, Jean-Baptiste Poline

Abstract read
In one paragraph

Article in GigaScience, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 23 papers.

0numbers the graph read from it
0cells of the map it votes in
23citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

23 citing papers in PubMed.

  1. Observational
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Review
  15. Article
  16. Article
  17. Rescuing missing data in connectome-based predictive modeling.Imaging neuroscience (Cambridge, Mass.) · 2024
    Article
  18. Review
  19. Article
  20. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Alexandre Perez-LebelMcConnell Brain Imaging Centre, The Neuro (Montreal Neurological Institute-Hospital), Faculty of Medicine, McGill University, 3801 University Street, Montreal, QC H3A 2B4, Canada.ORCID 0000-0003-0556-0763
Gaël VaroquauxMcConnell Brain Imaging Centre, The Neuro (Montreal Neurological Institute-Hospital), Faculty of Medicine, McGill University, 3801 University Street, Montreal, QC H3A 2B4, Canada.ORCID 0000-0003-1076-5122
Marine Le MorvanInria Saclay - Île-de-France, Parietal team, 1 Rue Honoré d'Estienne d'Orves, 91120 Palaiseau, France.ORCID 0000-0001-9899-221X
Julie JosseInria Montpellier, Bâtiment 5, 860 Rue de St-Priest, 34090 Montpellier, France.ORCID 0000-0001-9547-891X
Jean-Baptiste PolineMcConnell Brain Imaging Centre, The Neuro (Montreal Neurological Institute-Hospital), Faculty of Medicine, McGill University, 3801 University Street, Montreal, QC H3A 2B4, Canada.ORCID 0000-0002-9794-749X

Funding

Resource DiscoveryP41EB019936 · NIBIB · UNIV OF MASSACHUSETTS MED SCH WORCESTER · PI David Nelson Kennedy · 2016 to 2026
$15.2M
Exposing the Deep Content of the Publication: Knowledge Extraction for Neuroimaging in Child PsychiatryR01MH083320 · NIMH · UNIV OF MASSACHUSETTS MED SCH WORCESTER · PI FRAZIER, JEAN A, KENNEDY, DAVID NELSON · 2009 to 2020
$6.3M
NIBIB NIH HHS P41 EB019936NIMH NIH HHS R01 MH083320
6 · The paper itself

Abstract

backgroundAs databases grow larger, it becomes harder to fully control their collection, and they frequently come with missing values. These large databases are well suited to train machine learning models, e.g., for forecasting or to extract biomarkers in biomedical settings. Such predictive approaches can use discriminative-rather than generative-modeling and thus open the door to new missing-values strategies. Yet existing empirical evaluations of strategies to handle missing values have focused on inferential statistics.

resultsHere we conduct a systematic benchmark of missing-values strategies in predictive models with a focus on large health databases: 4 electronic health record datasets, 1 population brain imaging database, 1 health survey, and 2 intensive care surveys. Using gradient-boosted trees, we compare native support for missing values with simple and state-of-the-art imputation prior to learning. We investigate prediction accuracy and computational time. For prediction after imputation, we find that adding an indicator to express which values have been imputed is important, suggesting that the data are missing not at random. Elaborate missing-values imputation can improve prediction compared to simple strategies but requires longer computational time on large data. Learning trees that model missing values-with missing incorporated attribute-leads to robust, fast, and well-performing predictive modeling.

conclusionsNative support for missing values in supervised machine learning predicts better than state-of-the-art imputation with much less computational cost. When using imputation, it is important to add indicator columns expressing which values have been imputed.

Indexed as

Machine LearningDatabases, FactualData CollectionElectronic Health Recordsbaggingbenchmarkimputationmachine learningmissing valuesmultiple imputationsupervised learning

Identifiers

PMID35426912
PMCPMC9012100

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.