Evidence map›Paper›PMID 36083626›Full record

ArticleJournal of medical Internet research2022

Enrollment and Retention of Participants in Remote Digital Health Studies: Scoping Review and Framework Proposal.

Paola Daniore, Vasileios Nittas, Viktor von Wyl

Open access · goldAbstract readScoping Review
In one paragraph

Article in Journal of medical Internet research, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 39 papers, 3 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
39citing papers in PubMed, 3 pooled it
13.4field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

39 citing papers in PubMed, 3 syntheses or guidelines pooled it, 53 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Trial
  5. Trial
  6. Trial
  7. Article
  8. Article
  9. Observational
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. The Impact of Financial Incentives on Completion of a No Money No Time 6-Week Culinary Nutrition eHealth Challenge.Journal of human nutrition and dietetics : the official journal of the British Dietetic Association · 2025
    Article
  16. Observational
  17. Article
  18. Article
  19. Article
  20. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors at 1 institution in 1 country.

Paola DanioreInstitute for Implementation Science in Healthcare, University of Zurich, Zurich, Switzerland.ORCID 0000-0003-3319-1125
Vasileios NittasEpidemiology, Biostatistics and Prevention Institute, University of Zurich, Zurich, Switzerland.ORCID 0000-0002-6685-8275
Viktor von WylInstitute for Implementation Science in Healthcare, University of Zurich, Zurich, Switzerland.ORCID 0000-0002-8754-9797
University of Zurich · CH

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundDigital technologies are increasingly used in health research to collect real-world data from wider populations. A new wave of digital health studies relies primarily on digital technologies to conduct research entirely remotely. Remote digital health studies hold promise to significant cost and time advantages over traditional, in-person studies. However, such studies have been reported to typically suffer from participant attrition, the sources for which are still largely understudied.

objectiveTo contribute to future remote digital health study planning, we present a conceptual framework and hypotheses for study enrollment and completion. The framework introduces 3 participation criteria that impact remote digital health study outcomes: (1) participant motivation profile and incentives or nudges, (2) participant task complexity, and (3) scientific requirements. The goal of this study is to inform the planning and implementation of remote digital health studies from a person-centered perspective.

methodsWe conducted a scoping review to collect information on participation in remote digital health studies, focusing on methodological aspects that impact participant enrollment and retention. Comprehensive searches were conducted on the PubMed, CINAHL, and Web of Science databases, and additional sources were included in our study from citation searching. We included digital health studies that were fully conducted remotely, included information on at least one of the framework criteria during recruitment, onboarding or retention phases of the studies, and included study enrollment or completion outcomes. Qualitative analyses were performed to synthesize the findings from the included studies.

resultsWe report qualitative findings from 37 included studies that reveal high values of achieved median participant enrollment based on target sample size calculations, 128% (IQR 100%-234%), and median study completion, 48% (IQR 35%-76%). Increased median study completion is observed for studies that provided incentives or nudges to extrinsically motivated participants (62%, IQR 43%-78%). Reducing task complexity for participants in the absence of incentives or nudges did not improve median study enrollment (103%, IQR 102%-370%) or completion (43%, IQR 22%-60%) in observational studies, in comparison to interventional studies that provided more incentives or nudges (median study completion rate of 55%, IQR 38%-79%). Furthermore, there were inconsistencies in measures of completion across the assessed remote digital health studies, where only around half of the studies with completion measures (14/27, 52%) were based on participant retention throughout the study period.

conclusionsFew studies reported on participatory factors and study outcomes in a consistent manner, which may have limited the evidence base for our study. Our assessment may also have suffered from publication bias or unrepresentative study samples due to an observed preference for participants with digital literacy skills in digital health studies. Nevertheless, we find that future remote digital health study planning can benefit from targeting specific participant profiles, providing incentives and nudges, and reducing study complexity to improve study outcomes.

Indexed as

Sample SizeHumansconceptual frameworkdigital epidemiologydigital healthhealth outcomeinterventional studyparticipant recruitmentpopulation-based digital healthremote clinical trialsremote cohortsremote digital health studiesuser-centered design

Identifiers

PMID36083626
PMCPMC9508669
OpenAlexW4289049152

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.