ArticleQuality of life research : an international journal of quality of life aspects of treatment, care and rehabilitation2018
Careless responding in internet-based quality of life assessments.
Article in Quality of life research : an international journal of quality of life aspects of treatment, care and rehabilitation, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 27 papers, 2 of them syntheses that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
27 citing papers in PubMed, 2 syntheses or guidelines pooled it.
- Cognitive Functioning and the Quality of Survey Responses: An Individual Participant Data Meta-Analysis of 10 Epidemiological Studies of Aging.The journals of gerontology. Series B, Psychological sciences and social sciences · 2024Pooled it
- What Affects the Completion of Ecological Momentary Assessments in Chronic Pain Research? An Individual Patient Data Meta-Analysis.Journal of medical Internet research · 2019Pooled it
- Simulating insufficient effort responding with large language models: A persona-based prompt engineering approach.Behavior research methods · 2026Article
- Estimation of Sexual and Gender Diversity Among People Aged 15 Years and Older in Japan: A Descriptive Epidemiological Study Using a Nationwide Cross-Sectional Internet Survey.Archives of sexual behavior · 2026Observational
- Health literacy of vocational and university students in the allied health professions in Germany-a cross-sectional study.Frontiers in public health · 2025Article
- The Understanding America Study (UAS).BMJ open · 2024Article
- Detecting non-content-based response styles in survey data: An application of mixture factor analysis.Behavior research methods · 2024Article
- Acceptability and concerns about innovative wearable health sensors in persons with and without chronic disease diagnosis.Internet interventions · 2024Article
- The effects of careless responding on the fit of confirmatory factor analysis and item response theory models.Behavior research methods · 2024Article
- Response times in Ecological Momentary Assessment (EMA): shedding light on the response process with a drift diffusion model.Current psychology (New Brunswick, N.J.) · 2024Article
- Using Mokken scaling techniques to explore carelessness in survey research.Behavior research methods · 2023Article
- Comparing Person-Fit and Traditional Indices Across Careless Response Patterns in Surveys.Applied psychological measurement · 2023Article
- Using Item Response Times in Online Questionnaires to Detect Mild Cognitive Impairment.The journals of gerontology. Series B, Psychological sciences and social sciences · 2023Article
- Evaluation of Pressing Issues in Ecological Momentary Assessment.Annual review of clinical psychology · 2023Review
- Using Attributes of Survey Items to Predict Response Times May Benefit Survey Research.Field methods · 2023Article
- Inferring Cognitive Abilities from Response Times to Web-Administered Survey Items in a Population-Representative Sample.Journal of Intelligence · 2022Article
- Item selection, scaling and construct validation of the Patient-Reported Inventory of Self-Management of Chronic Conditions (PRISM-CC) measurement tool in adults.Quality of life research : an international journal of quality of life aspects of treatment, care and rehabilitation · 2022Article
- Effects of Anonymity versus Examinee Name on a Measure of Depressive Symptoms in Adolescents.Children (Basel, Switzerland) · 2022Article
- Self-administered Web-Based Tests of Executive Functioning and Perceptual Speed: Measurement Development Study With a Large Probability-Based Survey Panel.Journal of medical Internet research · 2022Article
- Quality of Survey Responses at Older Ages Predicts Cognitive Decline and Mortality Risk.Innovation in aging · 2022Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
3 authors.
Funding
Abstract
purposeQuality of life (QoL) measurement relies upon participants providing meaningful responses, but not all respondents may pay sufficient attention when completing self-reported QoL measures. This study examined the impact of careless responding on the reliability and validity of Internet-based QoL assessments.
methodsInternet panelists (n = 2000) completed Patient-Reported Outcomes Measurement Information System (PROMIS®) short-forms (depression, fatigue, pain impact, applied cognitive abilities) and single-item QoL measures (global health, pain intensity) as part of a larger survey that included multiple checks of whether participants paid attention to the items. Latent class analysis was used to identify groups of non-careless and careless responders from the attentiveness checks. Analyses compared psychometric properties of the QoL measures (reliability of PROMIS short-forms, correlations among QoL scores, "known-groups" validity) between non-careless and careless responder groups. Whether person-fit statistics derived from PROMIS measures accurately discriminated careless and non-careless responders was also examined.
resultsAbout 7.4% of participants were classified as careless responders. No substantial differences in the reliability of PROMIS measures between non-careless and careless responder groups were observed. However, careless responding meaningfully and significantly affected the correlations among QoL domains, as well as the magnitude of differences in QoL between medical and disability groups (presence or absence of disability, depression diagnosis, chronic pain diagnosis). Person-fit statistics significantly and moderately distinguished between non-careless and careless responders.
conclusionsThe results support the importance of identifying and screening out careless responders to ensure high-quality self-report data in Internet-based QoL research.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.