Evidence map›Paper›PMID 39039594›Full record

ArticleJournal of neuroengineering and rehabilitation2024

Machine learning for automating subjective clinical assessment of gait impairment in people with acquired brain injury - a comparison of an image extraction and classification system to expert scoring.

Ashleigh Mobbs, Michelle Kahn, Gavin Williams, Benjamin F Mentiplay, Yong-Hao Pua, Ross A Clark

Abstract readComparative StudyEvaluation StudyComparative Study
In one paragraph

Article in Journal of neuroengineering and rehabilitation, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 4 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

4 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Ashleigh MobbsSchool of Health, University of the Sunshine Coast, Sippy Downs, QLD, Australia.
Michelle KahnDepartment of Physiotherapy, Epworth Healthcare, Richmond, VIC, Australia.
Gavin WilliamsDepartment of Physiotherapy, Epworth Healthcare, Richmond, VIC, Australia.
Benjamin F MentiplaySchool of Allied Health, Human Services and Sport, La Trobe University, Bundoora, VIC, Australia.
Yong-Hao PuaDepartment of Physiotherapy, Singapore General Hospital, Singapore, Singapore.
Ross A ClarkSchool of Health, University of the Sunshine Coast, Sippy Downs, QLD, Australia. rclark@usc.edu.au.

Funding

Physiotherapy Research Fund PRFRoyal Automobile Club of Victoria RACV
6 · The paper itself

Abstract

backgroundWalking impairment is a common disability post acquired brain injury (ABI), with visually evident arm movement abnormality identified as negatively impacting a multitude of psychological factors. The International Classification of Functioning, Disability and Health (ICF) qualifiers scale has been used to subjectively assess arm movement abnormality, showing strong intra-rater and test-retest reliability, however, only moderate inter-rater reliability. This impacts clinical utility, limiting its use as a measurement tool. To both automate the analysis and overcome these errors, the primary aim of this study was to evaluate the ability of a novel two-level machine learning model to assess arm movement abnormality during walking in people with ABI.

methodsFrontal plane gait videos were used to train four networks with 50%, 75%, 90%, and 100% of participants (ABI: n = 42, healthy controls: n = 34) to automatically identify anatomical landmarks using DeepLabCut

resultsThe machine learning predictions have similar agreement to experienced human assessors, with no statistically significant (p < 0.05) difference for any match contingency. There was no statistically significant difference between the predictions from the four networks (F = 0.119; p = 0.949). The four networks did however under-predict scores with small effect sizes (p range = 0.007 to 0.040; Cohen's d range = 0.156 to 0.217).

conclusionsThis study demonstrated that machine learning can perform similarly to experienced clinicians when subjectively assessing arm movement abnormality in people with ABI. The relatively small sample size may have resulted in under-prediction of some scores, albeit with small effect sizes. Studies with larger sample sizes that objectively and automatically assess dynamic movement in both local and telerehabilitation assessments, for example using smartphones and edge-based machine learning, to reduce measurement error and healthcare access inequality are needed.

Indexed as

Brain Injuries, TraumaticDiagnosis, Computer-AssistedGait Disorders, NeurologicMachine LearningRandom ForestStrokeAdultAgedAged, 80 and overArmCross-Sectional StudiesFemaleGaitGait AnalysisHumansMale

Identifiers

PMID39039594
PMCPMC11264460

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.