Evidence map›Paper›PMID 34340101›Full record

ArticleMedical image analysis2021

Quantifying Parkinson's disease motor severity under uncertainty using MDS-UPDRS videos.

Mandy Lu, Qingyu Zhao, Kathleen L Poston, Edith V Sullivan, Adolf Pfefferbaum, Marian Shahid, Maya Katz, Leila Montaser-Kouhsari, Kevin Schulman, Arnold Milstein and 5 more

Registry-linked trialOpen access · greenAbstract read
In one paragraph

Article in Medical image analysis, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT05366114 (Assessing the Feasibility of a Smartphone-based, Machine Learning Visual Imaging Application for Assessment of Hyperextensibility of Peripheral Joints in Ehlers Danlos Syndrome), which is not on this map. Cited by 36 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
36citing papers in PubMed, 1 pooled it
9.6field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT05366114 unknown statusnot on this mapstarted 2022, after this paper: background citation

Assessing the Feasibility of a Smartphone-based, Machine Learning Visual Imaging Application for Assessment of Hyperextensibility of Peripheral Joints in Ehlers Danlos Syndrome

TypeobservationalSponsorUniversity Health Network, TorontoRan2022 to 2024Enrolled225ConditionsEhlers-Danlos SyndromeArmsNo intervention, additional video data collection only
3 · Its place in the literature

Who cites it

36 citing papers in PubMed, 1 synthesis or guideline pooled it, 84 citations in OpenAlex.

  1. Pooled it
  2. Review
  3. Article
  4. Article
  5. Article
  6. Review
  7. Article
  8. Article
  9. Video-Based Data-Driven Models for Diagnosing Movement Disorders: Review and Future Directions.Movement disorders : official journal of the Movement Disorder Society · 2025
    Review
  10. Article
  11. [Research progress in motor assessment of neurodegenerative diseases driven by motion capture data].Sheng wu yi xue gong cheng xue za zhi = Journal of biomedical engineering = Shengwu yixue gongchengxue zazhi · 2025
    Review
  12. Review
  13. Article
  14. GAMMA-PD: Graph-based Analysis of Multi-Modal Motor Impairment Assessments in Parkinson's Disease.Graphs in biomedical image analysis : 6th International Workshop, GRAIL 2024, held in conjunction with MICCAI 2024, Marrakesh, Morocco, October 6, 2024, Proceedings. GRAIL (Workshop) (6th : 2024 : Marrakesh, Morocco) · 2025
    Article
  15. Article
  16. Article
  17. Article
  18. Review
  19. Pose-based tremor type and level analysis for Parkinson's disease from video.International journal of computer assisted radiology and surgery · 2024
    Article
  20. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

15 authors at 2 institutions in 1 country.

Mandy LuDepartment of Computer Science, Stanford University, Stanford CA 94305, USA.
Qingyu ZhaoDepartment of Psychiatry & Behavioral Sciences, Stanford University, Stanford CA 94305, USA.
Kathleen L PostonDepartment of Neurology & Neurological Sciences, Stanford University, Stanford CA 94305, USA.
Edith V SullivanDepartment of Psychiatry & Behavioral Sciences, Stanford University, Stanford CA 94305, USA.
Adolf PfefferbaumDepartment of Psychiatry & Behavioral Sciences, Stanford University, Stanford CA 94305, USA; Center for Health Sciences, SRI International, Menlo Park CA 94025, USA.
Marian ShahidDepartment of Neurology & Neurological Sciences, Stanford University, Stanford CA 94305, USA.
Maya KatzDepartment of Neurology & Neurological Sciences, Stanford University, Stanford CA 94305, USA.
Leila Montaser-KouhsariDepartment of Neurology & Neurological Sciences, Stanford University, Stanford CA 94305, USA.
Kevin SchulmanDepartment of Medicine, Stanford University, Stanford CA 94305, USA.
Arnold MilsteinDepartment of Medicine, Stanford University, Stanford CA 94305, USA.
Juan Carlos NieblesDepartment of Computer Science, Stanford University, Stanford CA 94305, USA.
Victor W HendersonDepartment of Epidemiology & Population Health, Stanford University, Stanford CA 94305, USA; Department of Neurology & Neurological Sciences, Stanford University, Stanford CA 94305, USA.
Li Fei-FeiDepartment of Computer Science, Stanford University, Stanford CA 94305, USA.
Kilian M PohlDepartment of Psychiatry & Behavioral Sciences, Stanford University, Stanford CA 94305, USA; Center for Health Sciences, SRI International, Menlo Park CA 94025, USA.
Ehsan AdeliDepartment of Computer Science, Stanford University, Stanford CA 94305, USA; Department of Psychiatry & Behavioral Sciences, Stanford University, Stanford CA 94305, USA. Electronic address: eadeli@stanford.edu.
Stanford University · USSRI International · US

Funding

Stanford Alzheimer's Disease Research CenterAdmin Supp: Developing iPSC models for AD and PDP30AG066515 · NIA · STANFORD UNIVERSITY · PI ELIZABETH MORMINO · 2020 to 2026
$29.0M
TRACKING HIV INFECTION AND ALCOHOL ABUSE CNS COMORBIDITY WITH NEUROIMAGINGU01AA017347 · NIAAA · SRI INTERNATIONAL · PI PFEFFERBAUM, ADOLF, SULLIVAN, EDITH VIONI · 2007 to 2021
$16.0M
CEREBELLAR STRUCTURE AND FUNCTION IN ALCOHOLISMR01AA010723 · NIAAA · STANFORD UNIVERSITY · PI SULLIVAN, EDITH VIONI, ZAHR, NATALIE M · 1996 to 2025
$8.3M
Working Memory in Parkinson Disease: A Cognitive & Systems Neuroscience ApproachP50AG047366 · NIA · STANFORD UNIVERSITY · PI GREICIUS, MICHAEL D · 2015 to 2019
$7.9M
Cerebellar Structure and Function in AlcoholismR37AA010723 · NIAAA · STANFORD UNIVERSITY · PI SULLIVAN, EDITH VIONI · 2010 to 2019
$5.4M
Tracking HIV Infection & Alcohol Abuse CNS Comorbidity with NeuroimagingR01AA017347 · NIAAA · SRI INTERNATIONAL · PI Adolf Pfefferbaum · 2022 to 2026
$5.2M
NIAAA NIH HHS R01 AA010723NIAAA NIH HHS R01 AA017347NIAAA NIH HHS R37 AA010723NIAAA NIH HHS U01 AA017347NIA NIH HHS P30 AG066515NIA NIH HHS P50 AG047366
6 · The paper itself

Abstract

Parkinson's disease (PD) is a brain disorder that primarily affects motor function, leading to slow movement, tremor, and stiffness, as well as postural instability and difficulty with walking/balance. The severity of PD motor impairments is clinically assessed by part III of the Movement Disorder Society Unified Parkinson's Disease Rating Scale (MDS-UPDRS), a universally-accepted rating scale. However, experts often disagree on the exact scoring of individuals. In the presence of label noise, training a machine learning model using only scores from a single rater may introduce bias, while training models with multiple noisy ratings is a challenging task due to the inter-rater variabilities. In this paper, we introduce an ordinal focal neural network to estimate the MDS-UPDRS scores from input videos, to leverage the ordinal nature of MDS-UPDRS scores and combat class imbalance. To handle multiple noisy labels per exam, the training of the network is regularized via rater confusion estimation (RCE), which encodes the rating habits and skills of raters via a confusion matrix. We apply our pipeline to estimate MDS-UPDRS test scores from their video recordings including gait (with multiple Raters, R=3) and finger tapping scores (single rater). On a sizable clinical dataset for the gait test (N=55), we obtained a classification accuracy of 72% with majority vote as ground-truth, and an accuracy of ∼84% of our model predicting at least one of the raters' scores. Our work demonstrates how computer-assisted technologies can be used to track patients and their motor impairments, even when there is uncertainty in the clinical ratings. The latest version of the code will be available at https://github.com/mlu355/PD-Motor-Severity-Estimation.

Indexed as

Parkinson DiseaseHumansMental Status and Dementia TestsMovementSeverity of Illness IndexUncertaintyComputer visionFinger tappingGait analysisMovement disorder society Unified Parkinsons Disease Rating ScaleUncertainty

Identifiers

PMID34340101
PMCPMC8453121
OpenAlexW3192252093

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.