ArticleJournal of the International Neuropsychological Society : JINS2023
Development and application of novel performance validity metrics for computerized neurocognitive batteries.
Article in Journal of the International Neuropsychological Society : JINS, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 7 papers.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
7 citing papers in PubMed, 8 citations in OpenAlex.
- Schizophrenia Spectrum Biomarkers Consortium: Establishment of a Biorepository for the Discovery of Quantitative Fluid Biomarkers.Schizophrenia bulletin · 2026Article
- Measuring Cognitive Impairments Associated With Schizophrenia in Clinical Practice: Overview of Current Challenges and Future Opportunities.Schizophrenia bulletin · 2025Review
- Remote assessment of the Penn computerised neurocognitive battery in individuals with 22q11.2 deletion syndrome.Journal of intellectual disability research : JIDR · 2024Article
- Validation of the cognitive section of the Penn computerized adaptive test for neurocognitive and clinical psychopathology assessment (CAT-CCNB).Brain and cognition · 2024Article
- Performance validity testing: the need for digital technology and where to go from here.Frontiers in psychology · 2024Article
- Construction of a computerized adaptive test (CAT-CCNB) for efficient neurocognitive and clinical psychopathology assessment.Journal of neuroscience methods · 2023Article
- Test-Retest Reliability of a Computerized Neurocognitive Battery in School-Age Children with HIV in Botswana.Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists · 2023Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
13 authors at 4 institutions in 1 country.
Funding
Abstract
objectivesData from neurocognitive assessments may not be accurate in the context of factors impacting validity, such as disengagement, unmotivated responding, or intentional underperformance. Performance validity tests (PVTs) were developed to address these phenomena and assess underperformance on neurocognitive tests. However, PVTs can be burdensome, rely on cutoff scores that reduce information, do not examine potential variations in task engagement across a battery, and are typically not well-suited to acquisition of large cognitive datasets. Here we describe the development of novel performance validity measures that could address some of these limitations by leveraging psychometric concepts using data embedded within the Penn Computerized Neurocognitive Battery (PennCNB).
methodsWe first developed these validity measures using simulations of invalid response patterns with parameters drawn from real data. Next, we examined their application in two large, independent samples: 1) children and adolescents from the Philadelphia Neurodevelopmental Cohort (
resultsOur performance validity metrics detected patterns of invalid responding in simulated data, even at subtle levels. Furthermore, a combination of these metrics significantly predicted previously established validity rules for these tests in both developmental and adult datasets. Moreover, most clinical diagnostic groups did not show reduced validity estimates.
conclusionsThese results provide proof-of-concept evidence for multivariate, data-driven performance validity metrics. These metrics offer a novel method for determining the performance validity for individual neurocognitive tests that is scalable, applicable across different tests, less burdensome, and dimensional. However, more research is needed into their application.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.