Evidence map›Paper›PMID 36879431›Full record

ArticleThe journals of gerontology. Series B, Psychological sciences and social sciences2023

Using Item Response Times in Online Questionnaires to Detect Mild Cognitive Impairment.

Stefan Schneider, Doertes U Junghaenel, Erik Meijer, Arthur A Stone, Bart Orriens, Haomiao Jin, Elizabeth M Zelinski, Pey-Jiuan Lee, Raymond Hernandez, Arie Kapteyn

Abstract read
In one paragraph

Article in The journals of gerontology. Series B, Psychological sciences and social sciences, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 9 papers.

0numbers the graph read from it
0cells of the map it votes in
9citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

9 citing papers in PubMed.

  1. Article
  2. Examination of Total Hours of Volunteering or Informal Helping Among Older Adults and Risk of Future Functional Disability Using Data From a Large Panel Study.The American journal of occupational therapy : official publication of the American Occupational Therapy Association · 2026
    Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Visual-Motor Integration (VMI) Is Also Relevant for Computer, Smartphone, and Tablet Use by Adults: Introducing the Brief Box Clicking Test.The American journal of occupational therapy : official publication of the American Occupational Therapy Association · 2024
    Article
  9. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

Stefan SchneiderCenter for Self-Report Science & Center for Economic and Social Research, University of Southern California, CA, USA.
Doertes U JunghaenelCenter for Self-Report Science & Center for Economic and Social Research, University of Southern California, CA, USA.
Erik MeijerCenter for Economic and Social Research, University of Southern California, CA, USA.
Arthur A StoneCenter for Self-Report Science & Center for Economic and Social Research, University of Southern California, CA, USA.
Bart OrriensCenter for Economic and Social Research, University of Southern California, CA, USA.
Haomiao JinCenter for Economic and Social Research, University of Southern California, CA, USA.
Elizabeth M ZelinskiLeonard Davis School of Gerontology, University of Southern California, CA, USA.
Pey-Jiuan LeeCenter for Self-Report Science & Center for Economic and Social Research, University of Southern California, CA, USA.
Raymond HernandezCenter for Self-Report Science & Center for Economic and Social Research, University of Southern California, CA, USA.
Arie KapteynCenter for Economic and Social Research, University of Southern California, CA, USA.

Funding

Enhancing engagement and participation of marginalized community residents in the UASU01AG077280 · NIA · UNIVERSITY OF SOUTHERN CALIFORNIA · PI Arie Kapteyn · 2023 to 2026
$50.9M
Toward Next Generation Data on Health and Life Changes at Older Ages: Administrative Supplement to track the effects of the COVID-19 pandemic on American familiesU01AG054580 · NIA · UNIVERSITY OF SOUTHERN CALIFORNIA · PI KAPTEYN, ARIE · 2017 to 2022
$27.3M
Testing early markers of cognitive decline and dementia derived from survey response behaviorsR01AG068190 · NIA · UNIVERSITY OF SOUTHERN CALIFORNIA · PI Doerte Ulrike Junghaenel, Stefan Schneider · 2020 to 2026
$4.8M
NIA NIH HHS R01 AG068190NIA NIH HHS U01 AG054580NIA NIH HHS U01 AG077280
6 · The paper itself

Abstract

objectivesWith the increase in web-based data collection, response times (RTs) for survey items have become a readily available byproduct in most online studies. We examined whether RTs in online questionnaires can prospectively discriminate between cognitively normal respondents and those with cognitive impairment, no dementia (CIND).

methodParticipants were 943 members of a nationally representative internet panel, aged 50 and older. We analyzed RTs that were passively recorded as paradata for 37 surveys (1,053 items) administered online over 6.5 years. A multilevel location-scale model derived 3 RT parameters for each survey: (1) a respondent's average RT and 2 components of intraindividual RT variability addressing (2) systematic RT adjustments and (3) unsystematic RT fluctuations. CIND status was determined at the end of the 6.5-year period.

resultsAll 3 RT parameters were significantly associated with CIND, with a combined predictive accuracy of area under the receiver-operating characteristic curve = 0.74. Slower average RTs, smaller systematic RT adjustments, and greater unsystematic RT fluctuations prospectively predicted a greater likelihood of CIND over periods of up to 6.5, 4.5, and 1.5 years, respectively. DISCUSSION: RTs for survey items are a potential early indicator of CIND, which may enhance analyses of predictors, correlates, and consequences of cognitive impairment in online survey research.

Indexed as

Cognition DisordersCognitive DysfunctionAgedHumansMiddle AgedReaction TimeSurveys and QuestionnairesCognitive functionCognitive testingInternetSurveys

Identifiers

PMID36879431
PMCPMC10394989

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.