Evidence map›Paper›PMID 37476964›Full record

ArticleJournal of the International Neuropsychological Society : JINS2024

Computerized adaptive test strategies for the matrix reasoning subtest of the Wechsler Adult Intelligence Scale, 4th Edition (WAIS-IV).

Steven P Reise, Emily Wong, Jared Block, Keith F Widaman, Joseph M Gullett, Russell M Bauer, Daniel L Drane, David W Loring, Laura Glass Umfleet, Dustin Wahlstrom and 4 more

Open access · hybridAbstract read
PubMed Full text at PMC Publisher
In one paragraph

Article in Journal of the International Neuropsychological Society : JINS, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
0.8field-weighted citation impact, top 27% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed, 3 citations in OpenAlex.

  1. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

14 authors at 5 institutions in 1 country.

Steven P ReiseDepartment of Psychology, College of Letters & Science, UCLA, Los Angeles, CA, USA.ORCID 0000-0002-5408-6992
Emily WongDepartment of Psychology, College of Letters & Science, UCLA, Los Angeles, CA, USA.ORCID 0000-0003-1819-9129
Jared BlockDepartment of Psychology, College of Letters & Science, UCLA, Los Angeles, CA, USA.ORCID 0000-0001-5741-9185
Keith F WidamanUniversity of California, Riverside, Riverside, CA, USA.ORCID 0000-0002-6424-3998
Joseph M GullettUniversity of Florida, Gainesville, FL, USA.ORCID 0000-0002-8184-7187
Russell M BauerUniversity of Florida, Gainesville, FL, USA.ORCID 0000-0001-6807-2535
Daniel L DraneDepartments of Neurology and Pediatrics, Emory University School of Medicine, Atlanta, GA, USA.ORCID 0000-0001-8747-672X
David W LoringDepartments of Neurology and Pediatrics, Emory University School of Medicine, Atlanta, GA, USA.ORCID 0000-0003-2497-1074
Laura Glass UmfleetMedical College of Wisconsin, Milwaukee, WI, USA.ORCID 0000-0001-7943-0406
Dustin WahlstromPearson Clinical Assessment, San Antonio, TX, USA.
Kristen EnriquezDepartment of Psychiatry & Biobehavioral Sciences, UCLA David Geffen School of Medicine, and Jane & Terry Semel Institute for Neuroscience and Human Behavior, Los Angeles, CA, USA.
Fiona WhelanDepartment of Psychiatry & Biobehavioral Sciences, UCLA David Geffen School of Medicine, and Jane & Terry Semel Institute for Neuroscience and Human Behavior, Los Angeles, CA, USA.
Stone ShihDepartment of Psychiatry & Biobehavioral Sciences, UCLA David Geffen School of Medicine, and Jane & Terry Semel Institute for Neuroscience and Human Behavior, Los Angeles, CA, USA.
Robert M BilderDepartment of Psychology, College of Letters & Science, UCLA, Los Angeles, CA, USA.ORCID 0000-0001-5085-7852
Emory University · USUniversity of Florida · USMedical College of Wisconsin · USPearson (United States) · USUniversity of California, Riverside · US

Funding

National Neuropsychological Network (NNN)R01MH118514 · NIMH · UNIVERSITY OF CALIFORNIA LOS ANGELES · PI DANIEL L DRANE, David W. Loring · 2019 to 2026
$9.4M
Using Artificial Intelligence to Predict Cognitive Training Response in Amnestic Mild Cognitive ImpairmentK23AG080127 · NIA · UNIVERSITY OF FLORIDA · PI JOSEPH M GULLETT · 2023 to 2026
$640k
NIA NIH HHS K23 AG080127NIMH NIH HHS R01 MH118514
6 · The paper itself

Abstract

objectiveMost neuropsychological tests were developed without the benefit of modern psychometric theory. We used item response theory (IRT) methods to determine whether a widely used test - the 26-item Matrix Reasoning subtest of the WAIS-IV - might be used more efficiently if it were administered using computerized adaptive testing (CAT).

methodData on the Matrix Reasoning subtest from 2197 participants enrolled in the National Neuropsychology Network (NNN) were analyzed using a two-parameter logistic (2PL) IRT model. Simulated CAT results were generated to examine optimal short forms using fixed-length CATs of 3, 6, and 12 items and scores were compared to the original full subtest score. CAT models further explored how many items were needed to achieve a selected precision of measurement (standard error ≤ .40).

resultsThe fixed-length CATs of 3, 6, and 12 items correlated well with full-length test results (with

conclusionsThis proof-of-concept investigation suggests that the widely used Matrix Reasoning subtest of the WAIS-IV might be shortened by more than 70% in most examinees while maintaining acceptable measurement precision. If similar savings could be realized in other tests, the accessibility of neuropsychological assessment might be markedly enhanced, and more efficient time use could lead to broader subdomain assessment.

Indexed as

IntelligenceProblem SolvingAdultHumansIntelligence TestsNeuropsychological TestsReproducibility of ResultsAptitude testsIntelligence testsPsychological testsPsychometricsWechsler Intelligence ScalesWechsler Memory Scale

Identifiers

PMID37476964
PMCPMC10878120
OpenAlexW4384923700

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.