Evidence map›Paper›PMID 33579858›Full record

ArticleJournal of Alzheimer's disease : JAD2021

Blinded Clinical Evaluation for Dementia of Alzheimer's Type Classification Using FDG-PET: A Comparison Between Feature-Engineered and Non-Feature-Engineered Machine Learning Methods.

Da Ma, Evangeline Yee, Jane K Stocks, Lisanne M Jenkins, Karteek Popuri, Guillaume Chausse, Lei Wang, Stephan Probst, Mirza Faisal Beg

Open access · greenAbstract readComparative Study
In one paragraph

Article in Journal of Alzheimer's disease : JAD, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 10 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
10citing papers in PubMed, 1 pooled it
2.1field-weighted citation impact, top 13% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

10 citing papers in PubMed, 1 synthesis or guideline pooled it, 15 citations in OpenAlex.

  1. Pooled it
  2. Article
  3. Review
  4. Article
  5. Article
  6. Article
  7. Review
  8. Article
  9. 3D hemisphere-based convolutional neural network for whole-brain MRI segmentation.Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society · 2022
    Article
  10. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors at 3 institutions in 2 countries.

Da MaSchool of Engineering Science, Simon Fraser University, Burnaby, Canada.
Evangeline YeeSchool of Engineering Science, Simon Fraser University, Burnaby, Canada.
Jane K StocksDepartment of Psychiatry and Behavioral Sciences, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA.
Lisanne M JenkinsDepartment of Psychiatry and Behavioral Sciences, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA.
Karteek PopuriSchool of Engineering Science, Simon Fraser University, Burnaby, Canada.
Guillaume ChausseJewish General Hospital, Montreal, Canada.
Lei WangDepartment of Psychiatry and Behavioral Sciences, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA.
Stephan ProbstJewish General Hospital, Montreal, Canada.
Mirza Faisal BegSchool of Engineering Science, Simon Fraser University, Burnaby, Canada.
Simon Fraser University · CANorthwestern University · USJewish General Hospital · CA

Funding

TDP-43 Loss-of-Function: Biology to BiomarkersP01AG019724 · NIA · UNIVERSITY OF PENNSYLVANIA · PI Jennifer Merrilees · 2002 to 2026
$67.2M
PREDICT-ADFTD: Multimodal Imaging Prediction of AD/FTD and Differential DiagnosisR01AG055121 · NIA · OHIO STATE UNIVERSITY · PI ROSEN, HOWARD J, WANG, LEI · 2017 to 2020
$2.8M
NIA NIH HHS P01 AG019724NIA NIH HHS R01 AG055121
6 · The paper itself

Abstract

backgroundAdvanced machine learning methods can aid in the identification of dementia risk using neuroimaging-derived features including FDG-PET. However, to enable the translation of these methods and test their usefulness in clinical practice, it is crucial to conduct independent validation on real clinical samples, which has yet to be properly delineated in the current literature.

objectiveIn this paper, we present our efforts to enable such clinical translational through the evaluation and comparison of two machine-learning methods for discrimination between dementia of Alzheimer's type (DAT) and Non-DAT controls.

methodsFDG-PET-based dementia scores were generated on an independent clinical sample whose clinical diagnosis was blinded to the algorithm designers. A feature-engineered approach (multi-kernel probability classifier) and a non-feature-engineered approach (3D convolutional neural network) were analyzed. Both classifiers were pre-trained on cognitively normal subjects as well as subjects with DAT. These two methods provided a probabilistic dementia score for this previously unseen clinical data. Performance of the algorithms were compared against ground-truth dementia rating assessed by experienced nuclear physicians.

resultsBlinded clinical evaluation on both classifiers showed good separation between the cognitively normal subjects and the patients diagnosed with DAT. The non-feature-engineered dementia score showed higher sensitivity among subjects whose diagnosis was in agreement between the machine-learning models, while the feature-engineered approach showed higher specificity in non-consensus cases.

conclusionIn this study, we demonstrated blinded evaluation using data from an independent clinical sample for assessing the performance in DAT classification models in a clinical setting. Our results showed good generalizability for two machine-learning approaches, marking an important step for the translation of pre-trained machine-learning models into clinical practice.

Indexed as

Machine LearningNeural Networks, ComputerAlzheimer DiseaseBrainCognitive DysfunctionDementiaFluorodeoxyglucose F18HumansNeuroimagingPositron-Emission TomographyRadiopharmaceuticalsFluorodeoxyglucose F18RadiopharmaceuticalsAlzheimer’s diseaseblinded clinical evaluationdementia of Alzheimer’s typeFDG-PETfeature-engineered classificationnon-feature-engineered classification

Identifiers

PMID33579858
PMCPMC8978589
OpenAlexW3126363240

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.