Evidence map›Paper›PMID 39238945›Full record

ArticleExpert systems with applications2024

MC-ViViT: Multi-branch Classifier-ViViT to Detect Mild Cognitive Impairment in Older Adults Using Facial Videos.

Jian Sun, Hiroko H Dodge, Mohammad H Mahoor

Abstract read
In one paragraph

Article in Expert systems with applications, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 9 papers.

0numbers the graph read from it
0cells of the map it votes in
9citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

9 citing papers in PubMed.

  1. Article
  2. Review
  3. Article
  4. Facial Expressions as a Nexus for Health Assessment.Bioengineering (Basel, Switzerland) · 2026
    Review
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Jian SunDepartment Of Computer Science, University of Denver, 2155 E Wesley Ave, Denver, Colorado, 80210, United States of America.ORCID 0000-0002-9367-0892
Hiroko H DodgeDepartment Of Neurology at Harvard Medical School, Harvard University, Massachusetts General Hospital, 55 Fruit St, Boston, Massachusetts, 02114, United States of America.ORCID 0000-0001-7290-8307
Mohammad H MahoorDepartment Of Computer Engineering, University of Denver, 2155 E Wesley Ave, Denver, Colorado, 80210, United States of America.ORCID 0000-0001-8923-4660

Funding

Conversational Engagement as a Means to Delay Onset AD: Phase II Administrative SupplementR01AG051628 · NIA · OREGON HEALTH & SCIENCE UNIVERSITY · PI DODGE, HIROKO HAYAMA · 2016 to 2020
$4.8M
Web-enabled social interaction to delay cognitive decline among seniors with MCI: Phase I Administrative SupplementR01AG056102 · NIA · OREGON HEALTH & SCIENCE UNIVERSITY · PI DODGE, HIROKO HAYAMA · 2017 to 2021
$4.6M
Identification of Mild Cognitive Impairment using Machine Learning from Language and Behavior MarkersRF1AG072449 · NIA · MICHIGAN STATE UNIVERSITY · PI DODGE, HIROKO HAYAMA, WANG, FEI · 2021 to 2023
$2.6M
Web-enabled social interaction to delay cognitive decline among seniors with MCI: Phase IR56AG056102 · NIA · OREGON HEALTH & SCIENCE UNIVERSITY · PI DODGE, HIROKO HAYAMA · 2016 to 2016
$581k
NIA NIH HHS R01 AG051628NIA NIH HHS R01 AG056102NIA NIH HHS R56 AG056102NIA NIH HHS RF1 AG072449
6 · The paper itself

Abstract

Deep machine learning models including Convolutional Neural Networks (CNN) have been successful in the detection of Mild Cognitive Impairment (MCI) using medical images, questionnaires, and videos. This paper proposes a novel Multi-branch Classifier-Video Vision Transformer (MC-ViViT) model to distinguish MCI from those with normal cognition by analyzing facial features. The data comes from the I-CONECT, a behavioral intervention trial aimed at improving cognitive function by providing frequent video chats. MC-ViViT extracts spatiotemporal features of videos in one branch and augments representations by the MC module. The I-CONECT dataset is challenging as the dataset is imbalanced containing Hard-Easy and Positive-Negative samples, which impedes the performance of MC-ViViT. We propose a loss function for Hard-Easy and Positive-Negative Samples (HP Loss) by combining Focal loss and AD-CORRE loss to address the imbalanced problem. Our experimental results on the I-CONECT dataset show the great potential of MC-ViViT in predicting MCI with a high accuracy of 90.63% accuracy on some of the interview videos.

Indexed as

Deep LearningFacial Expression FeaturesInter- and Intra-class imbalanceMild Cognitive ImpairmentMulti-branch ClassifierTransformerViViT

Identifiers

PMID39238945
PMCPMC11375964

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.