Evidence map›Paper›PMID 34458723›Full record

ArticleFrontiers in artificial intelligence2021

Ordinal SuStaIn: Subtype and Stage Inference for Clinical Scores, Visual Ratings, and Other Ordinal Data.

Alexandra L Young, Jacob W Vogel, Leon M Aksman, Peter A Wijeratne, Arman Eshaghi, Neil P Oxtoby, Steven C R Williams, Daniel C Alexander, Alzheimer’s Disease Neuroimaging Initiative

Open access · goldAbstract read
In one paragraph

Article in Frontiers in artificial intelligence, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 29 papers.

0numbers the graph read from it
0cells of the map it votes in
29citing papers in PubMed
4.3field-weighted citation impact, top 5% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

29 citing papers in PubMed, 47 citations in OpenAlex.

  1. Spatiotemporal Progression Patterns of Striatal Dopamine Depletion and Cerebral Hypoperfusion in Parkinson's Disease.Movement disorders : official journal of the Movement Disorder Society · 2026
    Article
  2. Article
  3. Article
  4. Biological classification of memory clinic patients.Brain : a journal of neurology · 2026
    Article
  5. Article
  6. Visuospatial dysfunction indicates an increased risk of rapid dementia conversion in Parkinson's disease.Alzheimer's & dementia : the journal of the Alzheimer's Association · 2026
    Article
  7. Article
  8. Article
  9. Review
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. The spectrum of behavioral disorders in amyotrophic lateral sclerosis: current view.Journal of neural transmission (Vienna, Austria : 1996) · 2025
    Review
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors at 5 institutions in 2 countries.

Alexandra L YoungDepartment of Neuroimaging, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, United Kingdom.
Jacob W VogelDepartment of Psychiatry, University of Pennsylvania, Philadelphia, PA, Unites States.
Leon M AksmanStevens Neuroimaging and Informatics Institute, Keck School of Medicine, University of Southern California, Los Angeles, CA, Unites States.
Peter A WijeratneCentre for Medical Image Computing, University College London, London, United Kingdom.
Arman EshaghiDepartment of Computer Science, University College London, London, United Kingdom.
Neil P OxtobyCentre for Medical Image Computing, University College London, London, United Kingdom.
Steven C R WilliamsDepartment of Neuroimaging, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, United Kingdom.
Daniel C AlexanderCentre for Medical Image Computing, University College London, London, United Kingdom.
Alzheimer’s Disease Neuroimaging Initiative
University College London · GBKing's College London · GBQueen Mary University of London · GBUniversity of Pennsylvania · USUniversity of Southern California · US

Funding

Medical Research Council MR/S03546X/1Medical Research Council MR/T027770/1Medical Research Council MR/T027800/1
6 · The paper itself

Abstract

Subtype and Stage Inference (SuStaIn) is an unsupervised learning algorithm that uniquely enables the identification of subgroups of individuals with distinct pseudo-temporal disease progression patterns from cross-sectional datasets. SuStaIn has been used to identify data-driven subgroups and perform patient stratification in neurodegenerative diseases and in lung diseases from continuous biomarker measurements predominantly obtained from imaging. However, the SuStaIn algorithm is not currently applicable to discrete ordinal data, such as visual ratings of images, neuropathological ratings, and clinical and neuropsychological test scores, restricting the applicability of SuStaIn to a narrower range of settings. Here we propose 'Ordinal SuStaIn', an ordinal version of the SuStaIn algorithm that uses a scored events model of disease progression to enable the application of SuStaIn to ordinal data. We demonstrate the validity of Ordinal SuStaIn by benchmarking the performance of the algorithm on simulated data. We further demonstrate that Ordinal SuStaIn out-performs the existing continuous version of SuStaIn (Z-score SuStaIn) on discrete scored data, providing much more accurate subtype progression patterns, better subtyping and staging of individuals, and accurate uncertainty estimates. We then apply Ordinal SuStaIn to six different sub-scales of the Clinical Dementia Rating scale (CDR) using data from the Alzheimer's disease Neuroimaging Initiative (ADNI) study to identify individuals with distinct patterns of functional decline. Using data from 819 ADNI1 participants we identified three distinct CDR subtype progression patterns, which were independently verified using data from 790 ADNI2 participants. Our results provide insight into patterns of decline in daily activities in Alzheimer's disease and a mechanism for stratifying individuals into groups with difficulties in different domains. Ordinal SuStaIn is broadly applicable across different types of ratings data, including visual ratings from imaging, neuropathological ratings and clinical or behavioural ratings data.

Indexed as

Alzheimer’s diseasedisease progression modellingordinal datastagingsubtyping

Identifiers

PMID34458723
PMCPMC8387598
OpenAlexW3198249985

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.