Evidence map›Paper›PMID 21087922›Full record

Trial reportJournal of medical Internet research2010

Engagement and retention: measuring breadth and depth of participant use of an online intervention.

Mick P Couper, Gwen L Alexander, Nanhua Zhang, Roderick J A Little, Noel Maddy, Michael A Nowak, Jennifer B McClure, Josephine J Calvi, Sharon J Rolnick, Melanie A Stopponi and 1 more

Registry-linked trialAbstract readRandomized Controlled Trial
In one paragraph

Trial report in Journal of medical Internet research, 2010. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT00169312 (The HMO Cancer Research Network), which is not on this map. Cited by 143 papers, 8 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
143citing papers in PubMed, 8 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT00169312 naunknown statusnot on this map

The HMO Cancer Research Network (CRN) - Making Effective Nutritional Choices for Cancer Prevention: The MENU Study

TypeinterventionalSponsorJosephine Ford Cancer CenterRan2005 to 2007Enrolled2,619ConditionsUnspecified Adult Solid Tumor, Protocol SpecificArmsbehavioral dietary intervention, dietary intervention, educational intervention, internet-based intervention, preventative dietary intervention
3 · Its place in the literature

Who cites it

143 citing papers in PubMed, 8 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Pooled it
  7. Pooled it
  8. Pooled it
  9. Trial
  10. Trial
  11. Trial
  12. Trial
  13. Predictors of initial engagement with an asynchronous cognitive behavioral stress management website among older women with nonmetastatic breast cancer.Supportive care in cancer : official journal of the Multinational Association of Supportive Care in Cancer · 2023
    Trial
  14. Trial
  15. Trial
  16. Trial
  17. Trial
  18. Trial
  19. Trial
  20. Trial

83 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors.

Mick P CouperUniversity of Michigan, Survey Research Center, Ann Arbor, 48106, USA. mcouper@umich.edu
Gwen L Alexander
Nanhua Zhang
Roderick J A Little
Noel Maddy
Michael A Nowak
Jennifer B McClure
Josephine J Calvi
Sharon J Rolnick
Melanie A Stopponi
Christine Cole Johnson

Funding

The HMO Cancer Research Network (CRN)U19CA079689 · NCI · KAISER FOUNDATION HEALTH PLAN OF WASHINGTON · PI WAGNER, EDWARD H · 1999 to 2011
$62.6M
Training / Career DevelopmentP50CA101451 · NCI · UNIVERSITY OF MICHIGAN AT ANN ARBOR · PI STRECHER, VICTOR J · 2003 to 2012
$18.2M
NCI NIH HHS P50 CA101451NCI NIH HHS P50-CA101451NCI NIH HHS U19 CA079689NCI NIH HHS U19-CA079689
6 · The paper itself

Abstract

backgroundThe Internet provides us with tools (user metrics or paradata) to evaluate how users interact with online interventions. Analysis of these paradata can lead to design improvements.

objectiveThe objective was to explore the qualities of online participant engagement in an online intervention. We analyzed the paradata in a randomized controlled trial of alternative versions of an online intervention designed to promote consumption of fruit and vegetables.

methodsVolunteers were randomized to 1 of 3 study arms involving several online sessions. We created 2 indirect measures of breadth and depth to measure different dimensions and dynamics of program engagement based on factor analysis of paradata measures of Web pages visited and time spent online with the intervention materials. Multiple regression was used to assess influence of engagement on retention and change in dietary intake.

resultsBaseline surveys were completed by 2513 enrolled participants. Of these, 86.3% (n = 2168) completed the follow-up surveys at 3 months, 79.6% (n = 2027) at 6 months, and 79.4% (n = 1995) at 12 months. The 2 tailored intervention arms exhibited significantly more engagement than the untailored arm (P < .01). Breadth and depth measures of engagement were significantly associated with completion of follow-up surveys (odds ratios [OR] = 4.11 and 2.12, respectively, both P values < .001). The breadth measure of engagement was also significantly positively associated with a key study outcome, the mean increase in fruit and vegetable consumption (P < .001).

conclusionsBy exploring participants' exposures to online interventions, paradata are valuable in explaining the effects of tailoring in increasing participant engagement in the intervention. Controlling for intervention arm, greater engagement is also associated with retention of participants and positive change in a key outcome of the intervention, dietary change. This paper demonstrates the utility of paradata capture and analysis for evaluating online health interventions.

trial registrationNCT00169312; http://clinicaltrials.gov/ct2/show/NCT00169312 (Archived by WebCite at http://www.webcitation.org/5u8sSr0Ty).

Indexed as

AdultCommunity ParticipationCounselingFeeding BehaviorFemaleFruitGuideline AdherenceHealth PromotionHumansInternetMaleMiddle AgedRetention, PsychologySelf CareSurveys and QuestionnairesTherapy, Computer-Assisted

Identifiers

PMID21087922
PMCPMC3056524

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.