Evidence map›Paper›PMID 36662133›Full record

ArticleJournal of Intelligence2022

Inferring Cognitive Abilities from Response Times to Web-Administered Survey Items in a Population-Representative Sample.

Doerte U Junghaenel, Stefan Schneider, Bart Orriens, Haomiao Jin, Pey-Jiuan Lee, Arie Kapteyn, Erik Meijer, Elizabeth Zelinski, Raymond Hernandez, Arthur A Stone

Abstract read
In one paragraph

Article in Journal of Intelligence, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 6 papers.

0numbers the graph read from it
0cells of the map it votes in
6citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

6 citing papers in PubMed.

  1. Article
  2. Examination of Total Hours of Volunteering or Informal Helping Among Older Adults and Risk of Future Functional Disability Using Data From a Large Panel Study.The American journal of occupational therapy : official publication of the American Occupational Therapy Association · 2026
    Article
  3. Article
  4. Article
  5. Visual-Motor Integration (VMI) Is Also Relevant for Computer, Smartphone, and Tablet Use by Adults: Introducing the Brief Box Clicking Test.The American journal of occupational therapy : official publication of the American Occupational Therapy Association · 2024
    Article
  6. Using Item Response Times in Online Questionnaires to Detect Mild Cognitive Impairment.The journals of gerontology. Series B, Psychological sciences and social sciences · 2023
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

Doerte U JunghaenelDepartment of Psychology, University of Southern California, Los Angeles, CA 90089, USA.
Stefan SchneiderDepartment of Psychology, University of Southern California, Los Angeles, CA 90089, USA.
Bart OrriensCenter for Economic and Social Research, University of Southern California, Los Angeles, CA 90089, USA.
Haomiao JinSchool of Health Sciences, University of Surrey, Guildford GU2 7YH, UK.
Pey-Jiuan LeeCenter for Economic and Social Research, University of Southern California, Los Angeles, CA 90089, USA.
Arie KapteynCenter for Economic and Social Research, University of Southern California, Los Angeles, CA 90089, USA.
Erik MeijerCenter for Economic and Social Research, University of Southern California, Los Angeles, CA 90089, USA.
Elizabeth ZelinskiLeonard Davis School of Gerontology, University of Southern California, Los Angeles, CA 90089, USA.
Raymond HernandezCenter for Economic and Social Research, University of Southern California, Los Angeles, CA 90089, USA.ORCID 0000-0002-6761-9276
Arthur A StoneDepartment of Psychology, University of Southern California, Los Angeles, CA 90089, USA.

Funding

Enhancing engagement and participation of marginalized community residents in the UASU01AG077280 · NIA · UNIVERSITY OF SOUTHERN CALIFORNIA · PI Arie Kapteyn · 2023 to 2026
$50.9M
Toward Next Generation Data on Health and Life Changes at Older Ages: Administrative Supplement to track the effects of the COVID-19 pandemic on American familiesU01AG054580 · NIA · UNIVERSITY OF SOUTHERN CALIFORNIA · PI KAPTEYN, ARIE · 2017 to 2022
$27.3M
Testing early markers of cognitive decline and dementia derived from survey response behaviorsR01AG068190 · NIA · UNIVERSITY OF SOUTHERN CALIFORNIA · PI Doerte Ulrike Junghaenel, Stefan Schneider · 2020 to 2026
$4.8M
NIA NIH HHS R01 AG068190NIA NIH HHS U01 AG054580NIA NIH HHS U01 AG077280
6 · The paper itself

Abstract

Monitoring of cognitive abilities in large-scale survey research is receiving increasing attention. Conventional cognitive testing, however, is often impractical on a population level highlighting the need for alternative means of cognitive assessment. We evaluated whether response times (RTs) to online survey items could be useful to infer cognitive abilities. We analyzed >5 million survey item RTs from >6000 individuals administered over 6.5 years in an internet panel together with cognitive tests (numerical reasoning, verbal reasoning, task switching/inhibitory control). We derived measures of mean RT and intraindividual RT variability from a multilevel location-scale model as well as an expanded version that separated intraindividual RT variability into systematic RT adjustments (variation of RTs with item time intensities) and residual intraindividual RT variability (residual error in RTs). RT measures from the location-scale model showed weak associations with cognitive test scores. However, RT measures from the expanded model explained 22−26% of the variance in cognitive scores and had prospective associations with cognitive assessments over lag-periods of at least 6.5 years (mean RTs), 4.5 years (systematic RT adjustments) and 1 year (residual RT variability). Our findings suggest that RTs in online surveys may be useful for gaining information about cognitive abilities in large-scale survey research.

Indexed as

cognitive abilitiesinductive reasoning skillsonline surveyspopulation researchresponse timesresponse time variabilityself-reportsurvey researchtask switching/inhibitory control

Identifiers

PMID36662133
PMCPMC9864969

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.