ArticleEducational and psychological measurement2020
Methods of Detecting Insufficient Effort Responding: Comparisons and Practical Recommendations.
Article in Educational and psychological measurement, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 27 papers.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
27 citing papers in PubMed, 94 citations in OpenAlex.
- Understanding when mixture models effectively identify careless responding: Simulation and validity evidence.Behavior research methods · 2026Article
- Simulating insufficient effort responding with large language models: A persona-based prompt engineering approach.Behavior research methods · 2026Article
- A unified framework for characterizing response quality in surveys with multi-item scales.Communications psychology · 2026Review
- Investigating the Barriers Faced by Biomedical Science Undergraduates in Completing a Placement Year.British journal of biomedical science · 2026Article
- An Experimental Study on the Impact of Survey Stakes on Response Inconsistency in Mixed-Worded Scales.Educational and psychological measurement · 2025Article
- A modified hidden Markov model for detecting insufficient effort responses in questionnaires.Behavior research methods · 2025Article
- A cognitive diagnosis model for disengaged behaviors.Behavior research methods · 2025Article
- A new person-fit statistic for the detection of aberrant responses in polytomous cognitive diagnostic models.Behavior research methods · 2025Article
- Robust estimation of the latent trait in graded response models.Behavior research methods · 2025Article
- A comparison of conventional and resampled personal reliability in detecting careless responding.Behavior research methods · 2024Article
- The Impact of Insufficient Effort Responses on the Order of Category Thresholds in the Polytomous Rasch Model.Educational and psychological measurement · 2024Article
- Careless responding detection revisited: Accuracy of direct and indirect measures.Behavior research methods · 2024Article
- Burden and Inattentive Responding in a 12-Month Intensive Longitudinal Study: Interview Study Among Young Adults.JMIR formative research · 2024Article
- Model-agnostic unsupervised detection of bots in a Likert-type questionnaire.Behavior research methods · 2024Article
- Detecting non-content-based response styles in survey data: An application of mixture factor analysis.Behavior research methods · 2024Article
- Modeling insufficient effort responses in mixed-worded scales.Behavior research methods · 2024Article
- The effects of careless responding on the fit of confirmatory factor analysis and item response theory models.Behavior research methods · 2024Article
- Linking belief in a just world and psychological capital to psychological basic needs satisfaction and mental health of young adults living with HIV: A comparative analysis.PLOS mental health · 2024Article
- Cross-cultural adaptation, reliability and validity of the Spanish version of the long-term quality of life questionnaire.Frontiers in oncology · 2024Article
- When there is no justice, we need an old HERO. The trickle-down effect of psychological capital: the moderating role of organizational justice and leaders' age.Frontiers in psychology · 2024Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
3 authors at 2 institutions in 1 country.
Funding
No grant is acknowledged in the PubMed record.
Abstract
Insufficient effort responding (IER) affects many forms of assessment in both educational and psychological contexts. Much research has examined different types of IER, IER's impact on the psychometric properties of test scores, and preprocessing procedures used to detect IER. However, there is a gap in the literature in terms of practical advice for applied researchers and psychometricians when evaluating multiple sources of IER evidence, including the best strategy or combination of strategies when preprocessing data. In this study, we demonstrate how the use of different IER detection methods may affect psychometric properties such as predictive validity and reliability. Moreover, we evaluate how different data cleansing procedures can detect different types of IER. We provide evidence via simulation studies and applied analysis using the ACT's Engage assessment as a motivating example. Based on the findings of the study, we provide recommendations and future research directions for those who suspect their data may contain responses reflecting careless, random, or biased responding.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.