Evidence map›Paper›PMID 33308027›Full record

ArticleCognitive neuropsychiatry2021

When CAT is not an option: complementary methods of test abbreviation for neurocognitive batteries.

Tyler M Moore, Ellyn R Butler, J Cobb Scott, Allison M Port, Kosha Ruparel, Lucky J Njokweni, Raquel E Gur, Ruben C Gur

Abstract read
In one paragraph

Article in Cognitive neuropsychiatry, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Tyler M MooreDepartment of Psychiatry, Brain Behavior Laboratory, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA.
Ellyn R ButlerDepartment of Psychiatry, Brain Behavior Laboratory, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA.
J Cobb ScottDepartment of Psychiatry, Brain Behavior Laboratory, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA.
Allison M PortDepartment of Psychiatry, Brain Behavior Laboratory, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA.
Kosha RuparelDepartment of Psychiatry, Brain Behavior Laboratory, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA.
Lucky J NjokweniDepartment of Psychiatry, Brain Behavior Laboratory, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA.
Raquel E GurDepartment of Psychiatry, Brain Behavior Laboratory, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA.
Ruben C GurDepartment of Psychiatry, Brain Behavior Laboratory, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA.

Funding

Neurodevelopmental Genomics: Trajectories of Complex PhenotypesRC2MH089983 · NIMH · UNIVERSITY OF PENNSYLVANIA · PI GUR, RAQUEL E · 2009 to 2011
$14.3M
NMDA Receptor Hypofunction in the Amygdala of Schizophrenia PatientsP50MH096891 · NIMH · UNIVERSITY OF PENNSYLVANIA · PI BILKER, WARREN B. · 2012 to 2016
$10.6M
Creating an adaptive screening tool for detecting neurocognitive deficits and psychopathology across the lifespanR01MH117014 · NIMH · UNIVERSITY OF PENNSYLVANIA · PI GUR, RUBEN C. · 2019 to 2022
$2.9M
A Computerized Neurocognitive Battery for Use in Youth Affected by HIV in Resource-limited SettingsR01HD095278 · NICHD · CHILDREN'S HOSP OF PHILADELPHIA · PI LOWENTHAL, ELIZABETH DAWN, SCOTT, JAMES COBB · 2018 to 2021
$1.6M
NICHD NIH HHS R01 HD095278NIMH NIH HHS P50 MH096891NIMH NIH HHS R01 MH117014NIMH NIH HHS RC2 MH089983
6 · The paper itself

Abstract

introductionThere is an obvious need for efficient measurement of neuropsychiatric phenomena. A proven method-computerized adaptive testing (CAT)-is not feasible for all tests, necessitating alternatives for increasing test efficiency.

methodsWe combined/compared two methods for abbreviating rapid tests using two tests unamenable to CAT (a Continuous Performance Test [CPT] and n-back test [NBACK]). N=9,498 (mean age 14.2 years; 52% female) were administered the tests, and abbreviation was accomplished using methods answering two questions: what happens to measurement error as items are removed, and what happens to correlations with validity criteria as items are removed. The first was investigated using quasi-CAT simulation, while the second was investigated using bootstrapped confidence intervals around full-form-short-form comparisons.

resultsResults for the two methods overlapped, suggesting that the CPT could be abbreviated to 57% of original and NBACK could be abbreviated to 87% of original with the max-acceptable loss of precision and min-acceptable relationships with validity criteria.

conclusionsThis method combination shows promise for use in other test types, and the divergent results for the CPT/NBACK demonstrate the methods' abilities to detect when a test should not be shortened. The methods should be used in combination because they emphasize complementary measurement qualities: precision/validity..

Indexed as

Reproducibility of ResultsFemaleHumansMalePsychometricsCAT simulationCognitive testitem response theorytest abbreviationvalidity

Identifiers

PMID33308027
PMCPMC7855518

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.