Evidence map›Paper›PMID 36893179›Full record

ArticlePloS one2023

Shedding light on participant selection bias in Ecological Momentary Assessment (EMA) studies: Findings from an internet panel study.

Arthur A Stone, Stefan Schneider, Joshua M Smyth, Doerte U Junghaenel, Cheng Wen, Mick P Couper, Sarah Goldstein

Open access · goldAbstract read
In one paragraph

Article in PloS one, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 15 papers.

0numbers the graph read from it
0cells of the map it votes in
15citing papers in PubMed
6.4field-weighted citation impact, top 3% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

15 citing papers in PubMed, 25 citations in OpenAlex.

  1. Article
  2. Observational
  3. Article
  4. Article
  5. Article
  6. Review
  7. Development and validation of the mobility in middle-age questionnaire.The journals of gerontology. Series A, Biological sciences and medical sciences · 2025
    Article
  8. Article
  9. Change points for dynamic biomarkers in the Alzheimer's disease pathological cascade: A 30-year cohort study.Alzheimer's & dementia : the journal of the Alzheimer's Association · 2025
    Article
  10. Article
  11. Article
  12. Article
  13. Whole Day Workload: Evaluation of a New Outcome Measure in Occupational Therapy for Adults With Type 1 Diabetes.The American journal of occupational therapy : official publication of the American Occupational Therapy Association · 2024
    Article
  14. Recruitment and retention of adolescents for an ecological momentary assessment measurement burst mental health study: The MHIM engagement strategy.Health expectations : an international journal of public participation in health care and health policy · 2024
    Article
  15. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors at 3 institutions in 1 country.

Arthur A StoneDepartment of Psychology, University of Southern California, Los Angeles, CA, United States of America.ORCID 0000-0001-7490-1758
Stefan SchneiderDepartment of Psychology, University of Southern California, Los Angeles, CA, United States of America.ORCID 0000-0002-4562-0524
Joshua M SmythDepartment of Biobehavioral Health, The Pennsylvania State University, State College, PA, United States of America.
Doerte U JunghaenelDepartment of Psychology, University of Southern California, Los Angeles, CA, United States of America.
Cheng WenDornsife Center for Self-Report Science, University of Southern California, Los Angeles, CA, United States of America.ORCID 0000-0002-2538-0439
Mick P CouperInstitute for Social Research, University of Michigan, Ann Arbor, MI, United States of America.
Sarah GoldsteinDornsife Center for Self-Report Science, University of Southern California, Los Angeles, CA, United States of America.
University of Southern California · USPennsylvania State University · USUniversity of Michigan · US

Funding

Advancing the Science and Practice of Ecological Momentary AssessmentR37AG057685 · NIA · UNIVERSITY OF SOUTHERN CALIFORNIA · PI Arthur A Stone · 2018 to 2026
$9.4M
NIA NIH HHS R37 AG057685
6 · The paper itself

Abstract

Although the potential for participant selection bias is readily acknowledged in the momentary data collection literature, very little is known about uptake rates in these studies or about differences in the people that participate versus those who do not. This study analyzed data from an existing Internet panel of older people (age 50 and greater) who were offered participation into a momentary study (n = 3,169), which made it possible to compute uptake and to compare many characteristics of participation status. Momentary studies present participants with brief surveys multiple times a day over several days; these surveys ask about immediate or recent experiences. A 29.1% uptake rate was observed when all respondents were considered, whereas a 39.2% uptake rate was found when individuals who did not have eligible smartphones (necessary for ambulatory data collection) were eliminated from the analyses. Taking into account the participation rate for being in this Internet panel, we estimate uptake rates for the general population to be about 5%. A consistent pattern of differences emerged between those who accepted the invitation to participate versus those who did not (in univariate analyses): participants were more likely to be female, younger, have higher income, have higher levels of education, rate their health as better, be employed, not be retired, not be disabled, have better self-rated computer skills, and to have participated in more prior Internet surveys (all p < .0026). Many variables were not associated with uptake including race, big five personality scores, and subjective well-being. For several of the predictors, the magnitude of the effects on uptake was substantial. These results indicate the possibility that, depending upon the associations being investigated, person selection bias could be present in momentary data collection studies.

Indexed as

Ecological Momentary AssessmentResearch DesignAgedFemaleHumansMaleMiddle AgedSelection BiasSmartphoneSurveys and Questionnaires

Identifiers

PMID36893179
PMCPMC9997985
OpenAlexW4323652193

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.