Evidence map›Paper›PMID 33556349›Full record

ArticleArchives of physical medicine and rehabilitation2022

Challenges in Measuring Applied Cognition: Measurement Properties and Equivalence of the Functional Assessment in Acute Care Multidimensional Computerized Adaptive Test (FAMCAT) Applied Cognition Item Bank.

Jeanne A Teresi, Katja Ocepek-Welikson, Marjorie Kleinman, Andrea Cheville, Mildred Ramirez

Abstract read
In one paragraph

Article in Archives of physical medicine and rehabilitation, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Jeanne A TeresiColumbia University Stroud Center, New York, NY; New York State Psychiatric Institute, New York, NY; Division of Geriatrics and Palliative Medicine, Weill Cornell Medical Center, New York, NY; Research Division, Hebrew Home at Riverdale, RiverSpring Health, Bronx, NY. Electronic address: jat61@cumc.columbia.edu.
Katja Ocepek-WeliksonResearch Division, Hebrew Home at Riverdale, RiverSpring Health, Bronx, NY.
Marjorie KleinmanNew York State Psychiatric Institute, New York, NY.
Andrea ChevilleDepartment of Physical Medicine and Rehabilitation and Cardiovascular Research, Mayo Clinic, Rochester, MN.
Mildred RamirezDivision of Geriatrics and Palliative Medicine, Weill Cornell Medical Center, New York, NY; Research Division, Hebrew Home at Riverdale, RiverSpring Health, Bronx, NY.

Funding

Residing in the Community with Dementia at the End of Life: Understanding Hospice Use and Residential SettingP30AG028741 · NIA · ICAHN SCHOOL OF MEDICINE AT MOUNT SINAI · PI ORNA INTRATOR · 2010 to 2026
$21.9M
Pilot CoreP30AG022845 · NIA · WEILL MEDICAL COLL OF CORNELL UNIV · PI Manney Carrington Reid, ELAINE WETHINGTON · 2003 to 2026
$15.2M
Research Education CoreP30AG059303 · NIA · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI ADAM M BRICKMAN, Jennifer Jaie Manly · 2018 to 2026
$6.0M
Computerized Adaptive Testing to Direct Delivery of Hospital-Based RehabilitationR01HD079439 · NICHD · MAYO CLINIC ROCHESTER · PI CHEVILLE, ANDREA LYNNE · 2015 to 2019
$3.7M
NIA NIH HHS P30 AG022845NIA NIH HHS P30 AG028741NIA NIH HHS P30 AG059303NICHD NIH HHS R01 HD079439
6 · The paper itself

Abstract

objectiveTo present challenges in assessment of applied cognition and the results of differential item functioning (DIF) analyses used to inform the development of a computerized adaptive test (CAT).

designMeasurement evaluation cohort study. DIF analyses of 107 items were conducted across educational, age, and sex groups. DIF hypotheses informed the evaluation of the results.

settingHospital-based rehabilitation from a single hospital system.

participantsA total of 2216 hospitalized patients (N=2216).

interventionsNot applicable.

main outcome measuresApplied cognition item pool from multiple sources.

resultsMany items were hypothesized to show DIF, particularly for age. Information was moderately high in the lower (cognitive disability) tail of the distribution, but some items were not informative. Reliability estimates were high (>0.89) across all studied groups, regardless of estimation method. There were 35 items with DIF of high magnitude and 19 with accompanying supportive hypotheses.

conclusionsA key clinical tool in inpatient rehabilitation medicine is assessment of applied functional cognitive ability to inform patient-centered rehabilitation strategies to improve function. This was the first study to evaluate measurement equivalence of the applied cognition item pool across large samples of hospitalized patients. Although about one-third of the item pool evidenced DIF or low discrimination, results supported placement of most items into the bank and its use across groups differing in education, age, and sex. Six items were classified with salient DIF, defined as consistent DIF of high magnitude and or impact, with confirmatory directional DIF hypotheses, generated by content experts. These were recommended for adjustment or removal from the bank; 4 were deleted from the bank and 2 had lowered CAT exposure (administration frequency) rates. Many items hypothesized to show DIF contained content measuring constructs other than applied cognition such as physical frailty, perceptual difficulties, or skills reflective of greater educational attainment. Challenges in measurement of this construct are discussed.

Indexed as

Activities of Daily LivingCognitionCohort StudiesHumansPsychometricsReproducibility of ResultsEducationPatient outcomesPatient reported outcome measures, and assessmentRehabilitation

Identifiers

PMID33556349
PMCPMC8344387

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.