Evidence map›Paper›PMID 36324086›Full record

ArticleBMC medical research methodology2022

Dementia risk prediction in individuals with mild cognitive impairment: a comparison of Cox regression and machine learning models.

Meng Wang, Matthew Greenberg, Nils D Forkert, Thierry Chekouo, Gabriel Afriyie, Zahinoor Ismail, Eric E Smith, Tolulope T Sajobi

Abstract read
In one paragraph

Article in BMC medical research methodology, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 17 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
17citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

17 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Mild cognitive impairment-to-Alzheimer's dementia progression risk: the contribution of the Interceptor project.Alzheimer's & dementia : the journal of the Alzheimer's Association · 2026
    Article
  3. Article
  4. Article
  5. Article
  6. Real-world prediction of early-onset dementia by health record data: A multi-center machine learning study.Alzheimer's & dementia : the journal of the Alzheimer's Association · 2025
    Article
  7. Article
  8. Interpretable Machine Learning for Cross-Cohort Prediction of Motor Fluctuations in Parkinson's Disease.Movement disorders : official journal of the Movement Disorder Society · 2025
    Article
  9. Article
  10. Article
  11. Article
  12. Review
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Meng WangDepartment of Community Health Sciences, Cumming School of Medicine, University of Calgary, 3280 Hospital Drive NW, T2N 4Z6 AB, Calgary, Canada.
Matthew GreenbergDepartment of Mathematics and Statistics, University of Calgary, Calgary, Canada.
Nils D ForkertDepartment of Clinical Neurosciences & Hotchkiss Brain Institute, Cumming School of Medicine, University of Calgary, Calgary, AB, Canada.
Thierry ChekouoDivision of Biostatistics, School of Public Health, University of Minnesota, Minneapolis, US.
Gabriel AfriyieDepartment of Community Health Sciences, Cumming School of Medicine, University of Calgary, 3280 Hospital Drive NW, T2N 4Z6 AB, Calgary, Canada.
Zahinoor IsmailDepartment of Clinical Neurosciences & Hotchkiss Brain Institute, Cumming School of Medicine, University of Calgary, Calgary, AB, Canada.
Eric E SmithDepartment of Clinical Neurosciences & Hotchkiss Brain Institute, Cumming School of Medicine, University of Calgary, Calgary, AB, Canada.
Tolulope T SajobiDepartment of Community Health Sciences, Cumming School of Medicine, University of Calgary, 3280 Hospital Drive NW, T2N 4Z6 AB, Calgary, Canada. ttsajobi@ucalgary.ca.

Funding

NATIONAL ALZHEIMERS COORDINATING CENTER (NACC)U01AG016976 · NIA · UNIVERSITY OF WASHINGTON · PI KUKULL, WALTER ANTHONY · 1999 to 2020
$72.8M
THERAPEUTIC EFFECTS OF INTRA-NASAL INSULIN DETEMIRP50AG005136 · NIA · UNIVERSITY OF WASHINGTON · PI GRABOWSKI, THOMAS J. · 1985 to 2019
$57.2M
VIRUS-INDUCED BRAIN PATHOLOGYP50AG005131 · NIA · UNIVERSITY OF CALIFORNIA, SAN DIEGO · PI BREWER, JAMES B · 1985 to 2018
$55.4M
WASHINGTON UNIVERSITY ALZHEIMERS DISEASE RESEARCH CENTERP50AG005681 · NIA · WASHINGTON UNIVERSITY · PI FAGAN, ANNE · 1985 to 2019
$52.1M
SUPPLEMENT TO RUSH ALZHEIMERS DISEASE CENTER COREP30AG010161 · NIA · RUSH UNIVERSITY MEDICAL CENTER · PI LEURGANS, SUE E. · 1991 to 2020
$49.1M
Satellite Diagnostic and Treatment Clinic CoreP50AG008702 · NIA · COLUMBIA UNIV NEW YORK MORNINGSIDE · PI DE JAGER, PHILIP L · 1989 to 2019
$46.3M
TREATMENT OF DEPRESSION IN ALZHEIMER'S DISEASEP50AG005133 · NIA · UNIVERSITY OF PITTSBURGH AT PITTSBURGH · PI KAMBOH, M. ILYAS · 1985 to 2019
$43.0M
THE ROLE OF ADVANCED CAA IN ALZHEIMER'S DEMENTIAP50AG005134 · NIA · MASSACHUSETTS GENERAL HOSPITAL · PI HYMAN, BRADLEY T. · 1985 to 2018
$42.1M
VASCULAR RISK AND COGNITIVE STATUS IN A LATINO POPULATIONP50AG005142 · NIA · UNIVERSITY OF SOUTHERN CALIFORNIA · PI BRASKIE, MEREDITH NICOLE · 1985 to 2019
$41.0M
VESICULAR LOCALIZATION AND FUNCTION OF PRESENILIN 1 FRAGMENTP50AG005138 · NIA · MOUNT SINAI SCHOOL OF MEDICINE OF NYU · PI GROSSMAN, HILLEL · 1985 to 2019
$37.9M
'T V ASSESSMENT - MEMORY DISORDERED PATIENTS'P50AG005146 · NIA · JOHNS HOPKINS UNIVERSITY · PI ALBERT, MARILYN S. · 1985 to 2019
$37.6M
Research Education ComponentP30AG010133 · NIA · INDIANA UNIV-PURDUE UNIV AT INDIANAPOLIS · PI SAYKIN, ANDREW J · 1991 to 2020
$37.3M
NIA NIH HHS P30 AG008017NIA NIH HHS P30 AG008051NIA NIH HHS P30 AG010124NIA NIH HHS P30 AG010129NIA NIH HHS P30 AG010133NIA NIH HHS P30 AG010161NIA NIH HHS P30 AG012300NIA NIH HHS P30 AG013846NIA NIH HHS P30 AG013854NIA NIH HHS P30 AG019610NIA NIH HHS P30 AG028383NIA NIH HHS P30 AG035982NIA NIH HHS P30 AG049638NIA NIH HHS P30 AG053760NIA NIH HHS P30 AG062422NIA NIH HHS P30 AG066518NIA NIH HHS P30 AG072947NIA NIH HHS P50 AG005131NIA NIH HHS P50 AG005133NIA NIH HHS P50 AG005134NIA NIH HHS P50 AG005136NIA NIH HHS P50 AG005138NIA NIH HHS P50 AG005142NIA NIH HHS P50 AG005146NIA NIH HHS P50 AG005681NIA NIH HHS P50 AG008702NIA NIH HHS P50 AG016573NIA NIH HHS P50 AG016574NIA NIH HHS P50 AG023501NIA NIH HHS P50 AG025688NIA NIH HHS P50 AG033514NIA NIH HHS P50 AG047266NIA NIH HHS P50 AG047270NIA NIH HHS P50 AG047366NIA NIH HHS U01 AG016976
6 · The paper itself

Abstract

backgroundCox proportional hazards regression models and machine learning models are widely used for predicting the risk of dementia. Existing comparisons of these models have mostly been based on empirical datasets and have yielded mixed results. This study examines the accuracy of various machine learning and of the Cox regression models for predicting time-to-event outcomes using Monte Carlo simulation in people with mild cognitive impairment (MCI).

methodsThe predictive accuracy of nine time-to-event regression and machine learning models were investigated. These models include Cox regression, penalized Cox regression (with Ridge, LASSO, and elastic net penalties), survival trees, random survival forests, survival support vector machines, artificial neural networks, and extreme gradient boosting. Simulation data were generated using study design and data characteristics of a clinical registry and a large community-based registry of patients with MCI. The predictive performance of these models was evaluated based on three-fold cross-validation via Harrell's concordance index (c-index), integrated calibration index (ICI), and integrated brier score (IBS).

resultsCox regression and machine learning model had comparable predictive accuracy across three different performance metrics and data-analytic conditions. The estimated c-index values for Cox regression, random survival forests, and extreme gradient boosting were 0.70, 0.69 and 0.70, respectively, when the data were generated from a Cox regression model in a large sample-size conditions. In contrast, the estimated c-index values for these models were 0.64, 0.64, and 0.65 when the data were generated from a random survival forest in a large sample size conditions. Both Cox regression and random survival forest had the lowest ICI values (0.12 for a large sample size and 0.18 for a small sample size) among all the investigated models regardless of sample size and data generating model.

conclusionCox regression models have comparable, and sometimes better predictive performance, than more complex machine learning models. We recommend that the choice among these models should be guided by important considerations for research hypotheses, model interpretability, and type of data.

Indexed as

Cognitive DysfunctionDementiaHumansMachine LearningNeural Networks, ComputerSupport Vector MachineCox regressionDementiaMachine learningRisk predictionTime-to-event outcomes

Identifiers

PMID36324086
PMCPMC9628121

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.