ArticleBehavior research methods2024
Comparing data quality from an online and in-person lab sample on dynamic theory of mind tasks.
Article in Behavior research methods, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 7 papers.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
7 citing papers in PubMed.
- Identifying the neural mechanisms associated with older adults' dynamic theory of mind judgments during a movie-watching task.Social neuroscience · 2026Article
- Disentangling the role of executive function and episodic memory in older adults' performance on dynamic theory of mind tasks.Neuropsychology, development, and cognition. Section B, Aging, neuropsychology and cognition · 2025Article
- Functional reconfiguration between rest and movie watching relates to theory-of-mind performance among young and older adults.Cerebral cortex (New York, N.Y. : 1991) · 2025Article
- Mindsets over matter: priming theory of mind improves older adults' mental state attributions about naturalistic social interactions.Aging & mental health · 2025Observational
- Resilience Through Social Connectedness and Cognition: Is Theory of Mind a Form of Enrichment for Older adults?The journals of gerontology. Series B, Psychological sciences and social sciences · 2025Article
- Establishing construct validity for dynamic measures of behavior using naturalistic study designs.Behavior research methods · 2024Article
- Social and general cognition are uniquely associated with social connectedness in later life.Psychology and aging · 2024Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
3 authors.
Funding
Abstract
Nearly half the published research in psychology is conducted with online samples, but the preponderance of these studies rely primarily on self-report measures. The current study validated data quality from an online sample on a novel, dynamic task by comparing performance between an in-lab and online sample on two dynamic measures of theory of mind-the ability to infer others' mental states. Theory of mind is a cognitively complex construct that has been widely studied across multiple domains of psychology. One task was based on the show The Office®, and has been previously validated by the authors with in-lab samples. The second was a novel task based on the show Nathan for You®, which was selected to account for familiarity effects associated with The Office. Both tasks measured various dimensions of theory of mind (inferring beliefs, understanding motivations, detecting deception, identifying faux pas, and understanding emotions). The in-person lab samples (N = 144 and 177, respectively) completed the tasks between-subject, whereas the online sample (N = 347 from Prolific Academic) completed them within-subject, with order counterbalanced. The online sample's performance across both tasks was reliable (Cronbach's α = .66). For The Office, the in-person sample outperformed the online sample on some types of theory of mind, but this was driven by their greater familiarity with the show. Indeed, for the relatively unfamiliar show Nathan for You, performance did not differ between the two samples. Together, these results suggest that crowdsourcing platforms elicit reliable performance on novel, dynamic, complex tasks.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.