Evidence map›Paper›PMID 36040610›Full record

SynthesisNeuropsychology review2023

Psychometric Properties of Computerized Cognitive Tools and Standard Neuropsychological Tests Used to Assess Sport Concussion: A Systematic Review.

Kristin Wilmoth, Benjamin L Brett, Natalie A Emmert, Carolyn M Cook, Jeffrey Schaffert, Todd Caze, Thomas Kotsonis, Margaret Cusick, Gary Solomon, Jacob E Resch and 3 more

Abstract readSystematic Review
PubMed Publisher
In one paragraph

Synthesis in Neuropsychology review, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 6 papers.

0numbers the graph read from it
0cells of the map it votes in
6citing papers in PubMed
1.9field-weighted citation impact, top 14% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

6 citing papers in PubMed, 14 citations in OpenAlex.

  1. Article
  2. A Guide to the Interpretation and Reliability of Annual Collegiate ImPACT Baselines by Sex.Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists · 2026
    Article
  3. Article
  4. Initial Validation of a Behavioral Phenotyping Model for Substance Use Disorder.International journal of environmental research and public health · 2023
    Article
  5. The California Cognitive Assessment Battery (CCAB).Frontiers in human neuroscience · 2023
    Article
  6. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

13 authors at 6 institutions in 1 country.

Kristin WilmothDepartments of Psychiatry and Physical Medicine & Rehabilitation, UT Southwestern Medical Center, 5323 Harry Hines Blvd., Dallas, TX, 75390-9055, USA. Kristin.Wilmoth@UTSouthwestern.edu.ORCID 0000-0003-4192-8756
Benjamin L BrettDepartments of Neurosurgery and Neurology, Medical College of Wisconsin, Milwaukee, WI, USA.
Natalie A EmmertDepartment of Neurology, University at Buffalo, State University of New York, Buffalo, NY, USA.
Carolyn M CookDepartment of Neurology, Medical College of Wisconsin, Milwaukee, WI, USA.
Jeffrey SchaffertDepartment of Psychiatry, UT Southwestern Medical Center, Dallas, TX, USA.
Todd CazeDepartment of Psychiatry, UT Southwestern Medical Center, Dallas, TX, USA.
Thomas KotsonisDepartment of Neurology, Medical College of Wisconsin, Milwaukee, WI, USA.
Margaret CusickDepartment of Neurology, Medical College of Wisconsin, Milwaukee, WI, USA.
Gary SolomonPlayer Health and Safety Department, National Football League and Department of Neurosurgery, Vanderbilt University School of Medicine, Nashville, TN, USA.
Jacob E ReschDepartment of Kinesiology, University of Virginia, Charlottesville, VA, USA.
C Munro CullumDepartments of Psychiatry, Neurology, and Neurological Surgery, UT Southwestern Medical Center, Dallas, TX, USA.
Lindsay D NelsonDepartments of Neurosurgery and Neurology, Medical College of Wisconsin, Milwaukee, WI, USA.
Michael McCreaDepartments of Neurosurgery and Neurology, Medical College of Wisconsin, Milwaukee, WI, USA.
Medical College of Wisconsin · USSouthwestern Medical Center · USNeurological Surgery · USUniversity at Buffalo, State University of New York · USUniversity of Virginia · USVanderbilt University · US

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Athletic programs are more frequently turning to computerized cognitive tools in order to increase efficiencies in concussion assessment. However, assessment using a traditional neuropsychological test battery may provide a more comprehensive and individualized evaluation. Our goal was to inform sport clinicians of the best practices for concussion assessment through a systematic literature review describing the psychometric properties of standard neuropsychological tests and computerized tools. We conducted our search in relevant databases including Ovid Medline, Web of Science, PsycINFO, and Scopus. Journal articles were included if they evaluated psychometric properties (e.g., reliability, sensitivity) of a cognitive assessment within pure athlete samples (up to 30 days post-injury). Searches yielded 4,758 unique results. Ultimately, 103 articles met inclusion criteria, all of which focused on adolescent or young adult participants. Test-retest reliability estimates ranged from .14 to .93 for computerized tools and .02 to .95 for standard neuropsychological tests, with strongest correlations on processing speed tasks for both modalities, although processing speed tasks were most susceptible to practice effects. Reliability was improved with a 2-factor model (processing speed and memory) and by aggregating multiple baseline exams, yet remained below acceptable limits for some studies. Sensitivity to decreased cognitive performance within 72 h of injury ranged from 45%-93% for computerized tools and 18%-80% for standard neuropsychological test batteries. The method for classifying cognitive decline (normative comparison, reliable change indices, regression-based methods) affected sensitivity estimates. Combining computerized tools and standard neuropsychological tests with the strongest psychometric performance provides the greatest value in clinical assessment. To this end, future studies should evaluate the efficacy of hybrid test batteries comprised of top-performing measures from both modalities.

Indexed as

Athletic InjuriesBrain ConcussionSportsAdolescentCognitionHumansNeuropsychological TestsPsychometricsReproducibility of ResultsYoung AdultComputerized neurocognitive testsNeuropsychological assessmentReliabilitySensitivitySport concussionValidity

Identifiers

PMID36040610
OpenAlexW4293548268

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.