Evidence map›Paper›PMID 39715540›Full record

ArticleJMIR formative research2024

Building a Human Digital Twin (HDTwin) Using Large Language Models for Cognitive Diagnosis: Algorithm Development and Validation.

Gina Sprint, Maureen Schmitter-Edgecombe, Diane Cook

Abstract read
In one paragraph

Article in JMIR formative research, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed.

  1. Review
  2. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Gina Sprint *Department of Computer Science, Gonzaga University, Spokane, WA, United States.ORCID 0000-0001-9935-9950
Maureen Schmitter-EdgecombeSchool of Electrical Engineering and Computer Science, Washington State University, Pullman, WA, United States.ORCID 0000-0002-5304-2146
Diane Cook *School of Electrical Engineering and Computer Science, Washington State University, Pullman, WA, United States.ORCID 0000-0002-4441-7508

Funding

Creating adaptive, wearable technologies to assess and intervene for individuals with ADRDsR35AG071451 · NIA · WASHINGTON STATE UNIVERSITY · PI COOK, DIANE JOYCE, SCHMITTER-EDGECOMBE, MAUREEN · 2021 to 2025
$4.4M
Multidisciplinary undergraduate training program in Health-assistive Smart EnvironmentsR25AG046114 · NIA · WASHINGTON STATE UNIVERSITY · PI COOK, DIANE JOYCE, MINOR, BRYAN · 2014 to 2025
$3.4M
Multi-modal functional health assessment and intervention for individuals experiencing cognitive declineR01AG065218 · NIA · WASHINGTON STATE UNIVERSITY · PI COOK, DIANE JOYCE, SCHMITTER-EDGECOMBE, MAUREEN · 2020 to 2024
$3.3M
Automated Health Assessment through Mobile Sensing and Machine Learning of Daily ActivitiesR41EB029774 · NIBIB · ADAPTELLIGENCE, LLC · PI COOK, DIANE JOYCE, HOLDER, LAWRENCE · 2019 to 2019
$348k
NIA NIH HHS R01 AG065218NIA NIH HHS R25 AG046114NIA NIH HHS R35 AG071451NIBIB NIH HHS R41 EB029774
6 · The paper itself

Abstract

backgroundHuman digital twins have the potential to change the practice of personalizing cognitive health diagnosis because these systems can integrate multiple sources of health information and influence into a unified model. Cognitive health is multifaceted, yet researchers and clinical professionals struggle to align diverse sources of information into a single model.

objectiveThis study aims to introduce a method called HDTwin, for unifying heterogeneous data using large language models. HDTwin is designed to predict cognitive diagnoses and offer explanations for its inferences.

methodsHDTwin integrates cognitive health data from multiple sources, including demographic, behavioral, ecological momentary assessment, n-back test, speech, and baseline experimenter testing session markers. Data are converted into text prompts for a large language model. The system then combines these inputs with relevant external knowledge from scientific literature to construct a predictive model. The model's performance is validated using data from 3 studies involving 124 participants, comparing its diagnostic accuracy with baseline machine learning classifiers.

resultsHDTwin achieves a peak accuracy of 0.81 based on the automated selection of markers, significantly outperforming baseline classifiers. On average, HDTwin yielded accuracy=0.77, precision=0.88, recall=0.63, and Matthews correlation coefficient=0.57. In comparison, the baseline classifiers yielded average accuracy=0.65, precision=0.86, recall=0.35, and Matthews correlation coefficient=0.36. The experiments also reveal that HDTwin yields superior predictive accuracy when information sources are fused compared to single sources. HDTwin's chatbot interface provides interactive dialogues, aiding in diagnosis interpretation and allowing further exploration of patient data.

conclusionsHDTwin integrates diverse cognitive health data, enhancing the accuracy and explainability of cognitive diagnoses. This approach outperforms traditional models and provides an interface for navigating patient information. The approach shows promise for improving early detection and intervention strategies in cognitive health.

Indexed as

AlgorithmsCognitionFemaleHumansMaleartificial intelligencechatbotcognitive diagnosiscognitive healthdigital behavior markerdigital twinhealth informationhuman digital twininterview markerlarge language modelsmachine learningsmartwatch

Identifiers

PMID39715540
PMCPMC11704625

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.