ArticleThe International journal of eating disorders2022
Food for thought: Commentary on Burnette et al. (2021) "Concerns and recommendations for using Amazon MTurk for eating disorder research".
Article in The International journal of eating disorders, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 9 papers.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
9 citing papers in PubMed, 34 citations in OpenAlex.
- Parental Overvaluation of Child Weight/Shape Is Associated With Disordered Eating in Children Beyond Associations With Parental Internalized Weight Bias.Journal of the Academy of Nutrition and Dietetics · 2025Article
- Disgust memory enhancement extends to more accurate memory but not more false memories.Memory & cognition · 2025Article
- Article
- The role of stress in the association among food insecurity, eating disorder pathology, and binge eating-related appetitive traits.Eating behaviors · 2023Article
- Methodological Challenges in Web-Based Qualitative Research With Medically Underserved Populations.Journal of medical Internet research · 2023Article
- Night eating syndrome subtypes: differences in binge eating and food addiction symptoms.Eating and weight disorders : EWD · 2023Article
- Balancing data integrity concerns with ethical considerations in online research.The International journal of eating disorders · 2022Article
- Intuitive eating in Greek-Cypriot adults: Influence of gender and body mass.Frontiers in psychology · 2022Article
- The Real Ideal: Misestimation of Body Mass Index.Frontiers in global women's health · 2022Article
Corrections and comments
- Commented on by
- Comment on
Authors and funding
3 authors at 2 institutions in 1 country.
Funding
No grant is acknowledged in the PubMed record.
Abstract
Burnette et al. aimed to validate two eating disorder symptom measures among transgender adults recruited from Mechanical Turk (MTurk). After identifying several data quality issues, Burnette et al. abandoned this aim and instead documented the issues they faced (e.g., demographic misrepresentation, repeat submissions, inconsistent responses across similar questions, failed attention checks). Consequently, Burnette et al. raised concerns about the use of MTurk for psychological research, particularly in an eating disorder context. However, we believe these claims are overstated because they arise from a single study not designed to test MTurk data quality. Further, despite claiming to go "above and beyond" current recommendations, Burnette et al. missed key screening procedures. In particular, they missed procedures known to prevent participants who use commercial data centers (i.e., server farms) to hide their true IP address and complete multiple surveys for financial gain. In this commentary, we outline key screening procedures that allow researchers to obtain quality MTurk data. We also highlight the importance of balancing efforts to increase data quality with efforts to maintain sample diversity. With appropriate screening procedures, which should be preregistered, MTurk remains a viable participant source that requires further validation in an eating disorder context.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.