Evidence map›Paper›PMID 37856188›Full record

Trial reportJournal of medical Internet research2023

Evaluating the Effects of Rewards and Schedule Length on Response Rates to Ecological Momentary Assessment Surveys: Randomized Controlled Trials.

Sarah Edney, Claire Marie Goh, Xin Hui Chua, Alicia Low, Janelle Chia, Daphne S Koek, Karen Cheong, Rob van Dam, Chuen Seng Tan, Falk Müller-Riemenschneider

Registry-linked trialAbstract readRandomized Controlled Trial
In one paragraph

Trial report in Journal of medical Internet research, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT05154227 (Health@NUS - Studying Health Behaviours and Well-being During the Student-to-Work Life Transition Using mHealth), which is not on this map. Cited by 8 papers.

0numbers the graph read from it
0cells of the map it votes in
8citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT05154227 unknown statusnot on this map

Health@NUS - Studying Health Behaviours and Well-being During the Student-to-Work Life Transition Using mHealth

TypeobservationalSponsorNational University of SingaporeRan2020 to 2023Enrolled1,300ConditionsHealthy
3 · Its place in the literature

Who cites it

8 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Review
  5. Article
  6. Article
  7. Article
  8. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

Sarah EdneyPhysical Activity and Nutrition Determinants in Asia Programme, Saw Swee Hock School of Public Health, National University of Singapore and National University Health System, Singapore, Singapore.ORCID 0000-0002-3925-517X
Claire Marie GohPhysical Activity and Nutrition Determinants in Asia Programme, Saw Swee Hock School of Public Health, National University of Singapore and National University Health System, Singapore, Singapore.ORCID 0000-0003-0122-9942
Xin Hui ChuaPhysical Activity and Nutrition Determinants in Asia Programme, Saw Swee Hock School of Public Health, National University of Singapore and National University Health System, Singapore, Singapore.ORCID 0000-0001-7313-4681
Alicia LowSingapore Health Promotion Board, Singapore Government, Singapore, Singapore.ORCID 0009-0008-8930-5893
Janelle ChiaSingapore Health Promotion Board, Singapore Government, Singapore, Singapore.ORCID 0009-0006-7819-4572
Daphne S KoekSingapore Health Promotion Board, Singapore Government, Singapore, Singapore.ORCID 0009-0008-7480-5334
Karen CheongSingapore Health Promotion Board, Singapore Government, Singapore, Singapore.ORCID 0000-0002-6982-4070
Rob van DamPhysical Activity and Nutrition Determinants in Asia Programme, Saw Swee Hock School of Public Health, National University of Singapore and National University Health System, Singapore, Singapore.ORCID 0000-0002-7354-8734
Chuen Seng TanSaw Swee Hock School of Public Health, National University of Singapore and National University Health System, Singapore, Singapore.ORCID 0000-0002-6513-2309
Falk Müller-RiemenschneiderPhysical Activity and Nutrition Determinants in Asia Programme, Saw Swee Hock School of Public Health, National University of Singapore and National University Health System, Singapore, Singapore.ORCID 0000-0003-1402-7477

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundEcological momentary assessments (EMAs) are short, repeated surveys designed to collect information on experiences in real-time, real-life contexts. Embedding periodic bursts of EMAs within cohort studies enables the study of experiences on multiple timescales and could greatly enhance the accuracy of self-reported information. However, the burden on participants may be high and should be minimized to optimize EMA response rates.

objectiveWe aimed to evaluate the effects of study design features on EMA response rates.

methodsEmbedded within an ongoing cohort study (Health@NUS), 3 bursts of EMAs were implemented over a 7-month period (April to October 2021). The response rate (percentage of completed EMA surveys from all sent EMA surveys; 30-42 individual EMA surveys sent/burst) for each burst was examined. Following a low response rate in burst 1, changes were made to the subsequent implementation strategy (SMS text message announcements instead of emails). In addition, 2 consecutive randomized controlled trials were conducted to evaluate the efficacy of 4 different reward structures (with fixed and bonus components) and 2 different schedule lengths (7 or 14 d) on changes to the EMA response rate. Analyses were conducted from 2021 to 2022 using ANOVA and analysis of covariance to examine group differences and mixed models to assess changes across all 3 bursts.

resultsParticipants (N=384) were university students (n=232, 60.4% female; mean age 23, SD 1.3 y) in Singapore. Changing the reward structure did not significantly change the response rate (F

conclusionsSmall changes to the implementation strategy (SMS text messages instead of emails) may have contributed to increasing the response rate over time. Changing the available rewards did not lead to a significant difference in the response rate, whereas changing the schedule length did lead to a significant difference in the response rate. Our study provides novel insights on how to implement EMA surveys in ongoing cohort studies. This knowledge is essential for conducting high-quality studies using EMA surveys.

trial registrationClinicalTrials.gov NCT05154227; https://clinicaltrials.gov/ct2/show/NCT05154227.

Indexed as

Ecological Momentary AssessmentCohort StudiesFemaleHumansMaleSelf ReportSurveys and QuestionnairesYoung Adultambulatory assessmentcomplianceexperience samplingmobile phone

Identifiers

PMID37856188
PMCPMC10623229

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.