Evidence map›Paper›PMID 37491248›Full record

ArticleBMC medical informatics and decision making2023

XGBoost-SHAP-based interpretable diagnostic framework for alzheimer's disease.

Fuliang Yi, Hui Yang, Durong Chen, Yao Qin, Hongjuan Han, Jing Cui, Wenlin Bai, Yifei Ma, Rong Zhang, Hongmei Yu

Abstract read
In one paragraph

Article in BMC medical informatics and decision making, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 80 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
80citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

80 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Review
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article

20 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

Fuliang Yi *Department of Health Statistics, School of Public Health, Shanxi Medical University, 56 South XinJian Road, Taiyuan, 030001, P.R. China.
Hui Yang *Department of Health Statistics, School of Public Health, Shanxi Medical University, 56 South XinJian Road, Taiyuan, 030001, P.R. China.
Durong ChenDepartment of Health Statistics, School of Public Health, Shanxi Medical University, 56 South XinJian Road, Taiyuan, 030001, P.R. China.
Yao QinDepartment of Health Statistics, School of Public Health, Shanxi Medical University, 56 South XinJian Road, Taiyuan, 030001, P.R. China.
Hongjuan HanDepartment of Health Statistics, School of Public Health, Shanxi Medical University, 56 South XinJian Road, Taiyuan, 030001, P.R. China.
Jing CuiDepartment of Health Statistics, School of Public Health, Shanxi Medical University, 56 South XinJian Road, Taiyuan, 030001, P.R. China.
Wenlin BaiDepartment of Health Statistics, School of Public Health, Shanxi Medical University, 56 South XinJian Road, Taiyuan, 030001, P.R. China.
Yifei MaDepartment of Health Statistics, School of Public Health, Shanxi Medical University, 56 South XinJian Road, Taiyuan, 030001, P.R. China.
Rong ZhangDepartment of Health Statistics, School of Public Health, Shanxi Medical University, 56 South XinJian Road, Taiyuan, 030001, P.R. China.
Hongmei YuDepartment of Health Statistics, School of Public Health, Shanxi Medical University, 56 South XinJian Road, Taiyuan, 030001, P.R. China. yu@sxmu.edu.cn.

Funding

THERAPEUTIC EFFECTS OF INTRA-NASAL INSULIN DETEMIRP50AG005136 · NIA · UNIVERSITY OF WASHINGTON · PI JAYADEY, SUMAN · 1985 to 2019
$57.2M
VIRUS-INDUCED BRAIN PATHOLOGYP50AG005131 · NIA · UNIVERSITY OF CALIFORNIA, SAN DIEGO · PI BREWER, JAMES B · 1985 to 2018
$55.4M
WASHINGTON UNIVERSITY ALZHEIMERS DISEASE RESEARCH CENTERP50AG005681 · NIA · WASHINGTON UNIVERSITY · PI MORRIS, JOHN · 1985 to 2019
$52.1M
SUPPLEMENT TO RUSH ALZHEIMERS DISEASE CENTER COREP30AG010161 · NIA · RUSH UNIVERSITY MEDICAL CENTER · PI BENNETT, DAVID ALAN · 1991 to 2020
$49.1M
Satellite Diagnostic and Treatment Clinic CoreP50AG008702 · NIA · COLUMBIA UNIV NEW YORK MORNINGSIDE · PI DE JAGER, PHILIP L · 1989 to 2019
$46.3M
National Alzheimer's Coordinating CenterU24AG072122 · NIA · UNIVERSITY OF WASHINGTON · PI STEPHENS, KARI A · 2021 to 2025
$45.8M
TREATMENT OF DEPRESSION IN ALZHEIMER'S DISEASEP50AG005133 · NIA · UNIVERSITY OF PITTSBURGH AT PITTSBURGH · PI BECKER, JAMES T. · 1985 to 2019
$43.0M
THE ROLE OF ADVANCED CAA IN ALZHEIMER'S DEMENTIAP50AG005134 · NIA · MASSACHUSETTS GENERAL HOSPITAL · PI HYMAN, BRADLEY T. · 1985 to 2018
$42.1M
VASCULAR RISK AND COGNITIVE STATUS IN A LATINO POPULATIONP50AG005142 · NIA · UNIVERSITY OF SOUTHERN CALIFORNIA · PI ARANDA, MARIA P. · 1985 to 2019
$41.0M
VESICULAR LOCALIZATION AND FUNCTION OF PRESENILIN 1 FRAGMENTP50AG005138 · NIA · MOUNT SINAI SCHOOL OF MEDICINE OF NYU · PI SCHIMMING, CORBETT · 1985 to 2019
$37.9M
'T V ASSESSMENT - MEMORY DISORDERED PATIENTS'P50AG005146 · NIA · JOHNS HOPKINS UNIVERSITY · PI HUGANIR, RICHARD L · 1985 to 2019
$37.6M
Research Education ComponentP30AG010133 · NIA · INDIANA UNIV-PURDUE UNIV AT INDIANAPOLIS · PI SAYKIN, ANDREW J · 1991 to 2020
$37.3M
NIA NIH HHS P20 AG068024NIA NIH HHS P20 AG068053NIA NIH HHS P20 AG068077NIA NIH HHS P20 AG068082NIA NIH HHS P30 AG008017NIA NIH HHS P30 AG008051NIA NIH HHS P30 AG010124NIA NIH HHS P30 AG010129NIA NIH HHS P30 AG010133NIA NIH HHS P30 AG010161NIA NIH HHS P30 AG012300NIA NIH HHS P30 AG013846NIA NIH HHS P30 AG013854NIA NIH HHS P30 AG019610NIA NIH HHS P30 AG028383NIA NIH HHS P30 AG035982NIA NIH HHS P30 AG049638NIA NIH HHS P30 AG053760NIA NIH HHS P30 AG066546NIA NIH HHS P30 AG072947NIA NIH HHS P30 AG072958NIA NIH HHS P30 AG072959NIA NIH HHS P30 AG072977NIA NIH HHS P50 AG005131NIA NIH HHS P50 AG005133NIA NIH HHS P50 AG005134NIA NIH HHS P50 AG005136NIA NIH HHS P50 AG005138NIA NIH HHS P50 AG005142NIA NIH HHS P50 AG005146NIA NIH HHS P50 AG005681NIA NIH HHS P50 AG008702NIA NIH HHS P50 AG016573NIA NIH HHS P50 AG016574NIA NIH HHS P50 AG023501NIA NIH HHS P50 AG025688NIA NIH HHS P50 AG033514NIA NIH HHS P50 AG047266NIA NIH HHS P50 AG047270NIA NIH HHS P50 AG047366NIA NIH HHS U24 AG072122
6 · The paper itself

Abstract

backgroundDue to the class imbalance issue faced when Alzheimer's disease (AD) develops from normal cognition (NC) to mild cognitive impairment (MCI), present clinical practice is met with challenges regarding the auxiliary diagnosis of AD using machine learning (ML). This leads to low diagnosis performance. We aimed to construct an interpretable framework, extreme gradient boosting-Shapley additive explanations (XGBoost-SHAP), to handle the imbalance among different AD progression statuses at the algorithmic level. We also sought to achieve multiclassification of NC, MCI, and AD.

methodsWe obtained patient data from the Alzheimer's Disease Neuroimaging Initiative (ADNI) database, including clinical information, neuropsychological test results, neuroimaging-derived biomarkers, and APOE-ε4 gene statuses. First, three feature selection algorithms were applied, and they were then included in the XGBoost algorithm. Due to the imbalance among the three classes, we changed the sample weight distribution to achieve multiclassification of NC, MCI, and AD. Then, the SHAP method was linked to XGBoost to form an interpretable framework. This framework utilized attribution ideas that quantified the impacts of model predictions into numerical values and analysed them based on their directions and sizes. Subsequently, the top 10 features (optimal subset) were used to simplify the clinical decision-making process, and their performance was compared with that of a random forest (RF), Bagging, AdaBoost, and a naive Bayes (NB) classifier. Finally, the National Alzheimer's Coordinating Center (NACC) dataset was employed to assess the impact path consistency of the features within the optimal subset.

resultsCompared to the RF, Bagging, AdaBoost, NB and XGBoost (unweighted), the interpretable framework had higher classification performance with accuracy improvements of 0.74%, 0.74%, 1.46%, 13.18%, and 0.83%, respectively. The framework achieved high sensitivity (81.21%/74.85%), specificity (92.18%/89.86%), accuracy (87.57%/80.52%), area under the receiver operating characteristic curve (AUC) (0.91/0.88), positive clinical utility index (0.71/0.56), and negative clinical utility index (0.75/0.68) on the ADNI and NACC datasets, respectively. In the ADNI dataset, the top 10 features were found to have varying associations with the risk of AD onset based on their SHAP values. Specifically, the higher SHAP values of CDRSB, ADAS13, ADAS11, ventricle volume, ADASQ4, and FAQ were associated with higher risks of AD onset. Conversely, the higher SHAP values of LDELTOTAL, mPACCdigit, RAVLT_immediate, and MMSE were associated with lower risks of AD onset. Similar results were found for the NACC dataset.

conclusionsThe proposed interpretable framework contributes to achieving excellent performance in imbalanced AD multiclassification tasks and provides scientific guidance (optimal subset) for clinical decision-making, thereby facilitating disease management and offering new research ideas for optimizing AD prevention and treatment programs.

Indexed as

Alzheimer DiseaseCognitive DysfunctionBayes TheoremCognitionHumansMachine LearningMagnetic Resonance ImagingAlzheimer’s diseaseImbalanced classesInterpretable frameworkMachine learningMulticlassificationXGBoost-SHAP

Identifiers

PMID37491248
PMCPMC10369804

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.