Evidence map›Paper›PMID 34907842›Full record

ArticleJournal of clinical and experimental neuropsychology2021

The TestMyBrain Digital Neuropsychology Toolkit: Development and Psychometric Characteristics.

Shifali Singh, Roger W Strong, Laneé Jung, Frances Haofei Li, Liz Grinspoon, Luke S Scheuer, Eliza J Passell, Paolo Martini, Naomi Chaytor, Jason R Soble and 1 more

Abstract read
In one paragraph

Article in Journal of clinical and experimental neuropsychology, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 43 papers.

0numbers the graph read from it
0cells of the map it votes in
43citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

43 citing papers in PubMed.

  1. Trial
  2. A digital intervention for cognitive deficits following COVID-19: a randomized clinical trial.Neuropsychopharmacology : official publication of the American College of Neuropsychopharmacology · 2024
    Trial
  3. Article
  4. Review
  5. Intact Visual Correlation Detection in Autistic Adults.Autism research : official journal of the International Society for Autism Research · 2026
    Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors.

Shifali SinghInstitute for Technology in Psychiatry, McLean Hospital, Belmont, MA, USA.
Roger W StrongInstitute for Technology in Psychiatry, McLean Hospital, Belmont, MA, USA.
Laneé JungInstitute for Technology in Psychiatry, McLean Hospital, Belmont, MA, USA.
Frances Haofei LiInstitute for Technology in Psychiatry, McLean Hospital, Belmont, MA, USA.
Liz GrinspoonInstitute for Technology in Psychiatry, McLean Hospital, Belmont, MA, USA.
Luke S ScheuerInstitute for Technology in Psychiatry, McLean Hospital, Belmont, MA, USA.
Eliza J PassellInstitute for Technology in Psychiatry, McLean Hospital, Belmont, MA, USA.
Paolo MartiniInstitute for Technology in Psychiatry, McLean Hospital, Belmont, MA, USA.
Naomi ChaytorElson S. Floyd College of Medicine, Washington State University, Spokane, WA, USA.
Jason R SobleDepartment of Psychiatry, University of Illinois College of Medicine, Chicago, IL, USA.ORCID 0000-0003-3348-8762
Laura GermineInstitute for Technology in Psychiatry, McLean Hospital, Belmont, MA, USA.

Funding

Ambulatory Methods for Measuring Cognitive ChangeU2CAG060408 · NIA · PENNSYLVANIA STATE UNIVERSITY, THE · PI CHINCHILLI, VERNON M · 2018 to 2022
$14.9M
Mobile Measures of Threat Sensitivity for Cross-sectional and Longitudinal AssessmentR01MH121617 · NIMH · MCLEAN HOSPITAL · PI GERMINE, LAURA THI · 2020 to 2025
$3.9M
Glycemic Variability and Fluctuations in Cognitive Status in Adults with Type 1 DiabetesR01DK121240 · NIDDK · MCLEAN HOSPITAL · PI CHAYTOR, NAOMI SAGE, GERMINE, LAURA THI · 2019 to 2022
$3.1M
NIA NIH HHS U2C AG060408NIDDK NIH HHS R01 DK121240NIMH NIH HHS R01 MH121617
6 · The paper itself

Abstract

introductionTo allow continued administration of neuropsychological evaluations remotely during the pandemic, tests from the not-for-profit platform, TestMyBrain.org (TMB), were used to develop the TMB Digital Neuropsychology Toolkit (DNT). This study details the psychometric characteristics of the DNT, as well as the infrastructure and development of the DNT.

methodThe DNT was primarily distributed for clinical use, with (72.8%) of individuals requesting access for clinical purposes. To assess reliability and validity of the DNT, anonymous data from DNT test administrations were analyzed and compared to a large, non-clinical normative sample from TMB.

resultsDNT test scores showed acceptable to very good split-half reliability (.68-.99). Factor analysis revealed three latent factors, corresponding to processing speed, working memory, and a broader general cognitive ability factor that included perceptual reasoning and episodic memory. Average test scores were slightly poorer for the DNT sample than for the TMB comparison sample, as expected given the clinical use of the DNT.

conclusionsInitial estimates of reliability and validity of DNT tests support their use as digital measures of neuropsychological functioning. Tests within cognitive domains correlated highly with each other and demonstrated good reliability and validity. Future work will seek to validate DNT tests in specific clinical populations and determine best practices for using DNT outcome measures to assess engagement and psychological symptomatology.

Indexed as

Cognition DisordersNeuropsychologyHumansNeuropsychological TestsPsychometricsReproducibility of ResultsassessmentcognitionDigital neuropsychologypsychometricsremote testingteleneuropsychology

Identifiers

PMID34907842
PMCPMC8922997

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.