Evidence map›Paper›PMID 36262771›Full record

ArticleDigital biomarkers2022

Reliability of Automatic Computer Vision-Based Assessment of Orofacial Kinematics for Telehealth Applications.

Leif Simmatis, Carolina Barnett, Reeman Marzouqah, Babak Taati, Mark Boulos, Yana Yunusova

Abstract read
In one paragraph

Article in Digital biomarkers, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 4 papers.

0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

4 citing papers in PubMed.

  1. Article
  2. Article
  3. Mayo Clinic proceedings. Digital health · 2023
    Review
  4. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Leif SimmatisDepartment of Speech-Language Pathology, University of Toronto, Toronto, Ontario, Canada.
Carolina BarnettInstitute of Health Policy Management and Evaluation, University of Toronto, Toronto, Ontario, Canada.
Reeman MarzouqahDepartment of Speech-Language Pathology, University of Toronto, Toronto, Ontario, Canada.
Babak TaatiKITE-Toronto Rehabilitation Institute, University Health Network, Toronto, Ontario, Canada.
Mark BoulosDivision of Neurology, Department of Medicine, University of Toronto, Toronto, Ontario, Canada.
Yana YunusovaDepartment of Speech-Language Pathology, University of Toronto, Toronto, Ontario, Canada.

Funding

The development and validation of a novel tool for the assessment of bulbar dysfunction in ALSR01DC017291 · NIDCD · SUNNYBROOK RESEARCH INSTITUTE · PI JORDAN R GREEN, Yana Yunusova · 2018 to 2026
$3.6M
NIDCD NIH HHS R01 DC017291
6 · The paper itself

Abstract

Introduction: Telehealth/remote assessment using readily available 2D mobile cameras and deep learning-based analyses is rapidly becoming a viable option for detecting orofacial and speech impairments associated with neurological and neurodegenerative disease during telehealth practice. However, the psychometric properties (e.g., internal consistency and reliability) of kinematics obtained from these systems have not been established, which is a crucial next step before their clinical usability is established. Methods: Participants were assessed in lab using a 3 dimensional (3D)-capable camera and at home using a readily-available 2D camera in a tablet. Orofacial kinematics was estimated from videos using a deep facial landmark tracking model. Kinematic features quantified the clinically relevant constructs of velocity, range of motion, and lateralization. In lab, all participants performed the same oromotor task. At home, participants were split into two groups that each performed a variant of the in-lab task. We quantified within-assessment consistency (Cronbach's α), reliability (intraclass correlation coefficient [ICC]), and fitted linear mixed-effects models to at-home data to capture individual-/task-dependent longitudinal trajectories. Results: Both in lab and at home, Cronbach's α was typically high (>0.80) and ICCs were often good (>0.70). The linear mixed-effect models that best fit the longitudinal data were those that accounted for individual- or task-dependent effects. Discussion: Remotely gathered orofacial kinematics were as internally consistent and reliable as those gathered in a controlled laboratory setting using a high-performance 3D-capable camera and could additionally capture individual- or task-dependent changes over time. These results highlight the potential of remote assessment tools as digital biomarkers of disease status and progression and demonstrate their suitability for novel telehealth applications.

Indexed as

Digital biomarkersDigital devicesMobile technology

Identifiers

PMID36262771
PMCPMC9574208

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.