Evidence map›Paper›PMID 38414411›Full record

ArticleArchives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists2024

Development and Validation of a Vocabulary Measure in the Mobile Toolbox.

Stephanie Ruth Young, Elizabeth M Dworak, Aaron J Kaat, Hubert Adam, Miriam A Novack, Jerry Slotkin, Jordan Stoeger, Cindy J Nowinski, Zahra Hosseinian, Saki Amagai and 11 more

Abstract readValidation Study
In one paragraph

Article in Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed.

  1. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

21 authors.

Stephanie Ruth YoungDepartment of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA.ORCID 0000-0002-8205-9297
Elizabeth M DworakDepartment of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA.
Aaron J KaatDepartment of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA.
Hubert AdamDepartment of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA.
Miriam A NovackDepartment of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA.
Jerry SlotkinCenter for Health Assessment Research and Translation, University of Delaware, Newark, DE, USA.
Jordan StoegerData Recognition Corporation, Maple Grove, MN, USA.
Cindy J NowinskiDepartment of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA.
Zahra HosseinianDepartment of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA.
Saki AmagaiDepartment of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA.
Sarah PilaDepartment of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA.
Maria Varela DiazDepartment of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA.
Anyelo Almonte CorreaDepartment of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA.
Keith AlperinHelium Foot Software, Inc, Chicago, IL, USA.
Larsson OmbergSage Bionetworks, Seattle, WA, USA.
Michael KellenSage Bionetworks, Seattle, WA, USA.
Monica R CamachoUniversity of California San Francisco, San Francisco CA, USA.
Bernard LandavazoUniversity of California San Francisco, San Francisco CA, USA.
Rachel L NoshenyUniversity of California San Francisco, San Francisco CA, USA.
Michael W WeinerUniversity of California San Francisco, San Francisco CA, USA.
Richard M GershonDepartment of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA.

Funding

The MobileToolbox for Monitoring Cognitive Function - Technical CoreU2CAG060426 · NIA · NORTHWESTERN UNIVERSITY AT CHICAGO · PI RICHARD GERSHON · 2018 to 2026
$35.0M
The Brain Health Registry for facilitating interdisciplinary aging researchR33AG062867 · NIA · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI NOSHENY, RACHEL LAUREN · 2020 to 2024
$3.2M
National Institute of Health award Mobile Toolbox for Monitoring Cognitive Function U2CAG060426NIA NIH HHS R33 AG062867NIA NIH HHS U2C AG060426
6 · The paper itself

Abstract

objectiveWe describe the development of a new computer adaptive vocabulary test, Mobile Toolbox (MTB) Word Meaning, and validity evidence from 3 studies.

methodWord Meaning was designed to be a multiple-choice synonym test optimized for self-administration on a personal smartphone. The items were first calibrated online in a sample of 7,525 participants to create the computer-adaptive test algorithm for the Word Meaning measure within the MTB app. In Study 1, 92 participants self-administered Word Meaning on study-provided smartphones in the lab and were administered external measures by trained examiners. In Study 2, 1,021 participants completed the external measures in the lab and Word Meaning was self-administered remotely on their personal smartphones. In Study 3, 141 participants self-administered Word Meaning remotely twice with a 2-week delay on personal iPhones.

resultsThe final bank included 1363 items. Internal consistency was adequate to good across samples (ρxx = 0.78 to 0.81, p < .001). Test-retest reliability was good (ICC = 0.65, p < .001), and the mean theta score was not significantly different upon the second administration. Correlations were moderate to large with measures of similar constructs (ρ = 0.67-0.75, p < .001) and non-significant with measures of dissimilar constructs. Scores demonstrated small to moderate correlations with age (ρ = 0.35 to 0.45, p < .001) and education (ρ = 0.26, p < .001).

conclusionThe MTB Word Meaning measure demonstrated evidence of reliability and validity in three samples. Further validation studies in clinical samples are necessary.

Indexed as

Mobile ApplicationsVocabularyAdolescentAdultAgedFemaleHumansLanguage TestsMaleMiddle AgedPsychometricsReproducibility of ResultsSmartphoneYoung AdultCognitive agingCognitive testingmHealthValidation studyVocabulary tests

Identifiers

PMID38414411
PMCPMC12097899

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.