Evidence map›Paper›PMID 39700488›Full record

ArticleJournal of medical Internet research2024

Methodological Challenges in Randomized Controlled Trials of mHealth Interventions: Cross-Sectional Survey Study and Consensus-Based Recommendations.

Jesus Lopez-Alcalde, L Susan Wieland, Yuqian Yan, Jürgen Barth, Mohammad Reza Khami, Siddharudha Shivalli, Cynthia Lokker, Harleen Kaur Rai, Paul Macharia, Sergi Yun and 5 more

Abstract readConsensus Statement
In one paragraph

Article in Journal of medical Internet research, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 6 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
6citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

6 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Trial
  3. Trial
  4. Article
  5. Review
  6. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

15 authors.

Jesus Lopez-AlcaldeInstitute for Complementary and Integrative Medicine, University Hospital Zurich, Zurich, Switzerland.ORCID 0000-0002-1598-8790
L Susan WielandInstitute for Complementary and Integrative Medicine, University Hospital Zurich, Zurich, Switzerland.ORCID 0000-0003-2157-0603
Yuqian YanInstitute for Complementary and Integrative Medicine, University Hospital Zurich, Zurich, Switzerland.ORCID 0000-0003-1904-5906
Jürgen BarthInstitute for Complementary and Integrative Medicine, University Hospital Zurich, Zurich, Switzerland.ORCID 0000-0001-7096-7178
Mohammad Reza KhamiResearch Center for Caries Prevention, Dentistry Research Institute, Tehran University of Medical Sciences, Tehran, Iran.ORCID 0000-0002-4810-9537
Siddharudha ShivalliDepartment of Medical Statistics, Faculty of Epidemiology and Public Health, London School of Hygiene & Tropical Medicine, London, United Kingdom.ORCID 0000-0003-1454-7114
Cynthia LokkerDepartment of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, ON, Canada.ORCID 0000-0003-2436-4290
Harleen Kaur RaiDigital Health and Wellness Research Group, Department of Computer and Information Sciences, University of Strathclyde, Glasgow, United Kingdom.ORCID 0000-0002-8121-6094
Paul MachariaDepartment of Research and Programmes, Kenyatta National Hospital, Nairobi, Kenya.ORCID 0000-0002-3564-8873
Sergi YunBio-Heart Cardiovascular Diseases Research Group, Bellvitge Biomedical Research Institute, L'Hospitalet de Llobregat, Barcelona, Spain.ORCID 0000-0003-4858-9566
Elvira LangHypnalgesics, Comfort Talk, Brookline, MA, United States.ORCID 0000-0002-4348-5138
Agnes Bwanika NaggirinyaInfectious Diseases Institute, College of Health Sciences, Makerere University, Kampala, Uganda.ORCID 0000-0001-8722-4135
Concepción Campos-AsensioBiblioteca Médica, Hospital Universitario de Móstoles, Móstoles, Spain.ORCID 0000-0003-2724-2563
Leila AhmadianFakher Mechatronic Research Center, Kerman University of Medical Sciences, Kerman, Iran.ORCID 0000-0002-6487-2209
Claudia M WittInstitute for Complementary and Integrative Medicine, University of Zurich, Zurich, Switzerland.ORCID 0000-0002-5440-7805

Funding

Research Mentoring and Building Capacity of underrepresented Minority Research Scientists in India.D43TW010540 · FIC · YALE UNIVERSITY · PI MICHELE BARRY, Eva Harris · 2017 to 2026
$15.5M
Cochrane Complementary Medicine Field: Resource for ResearchR24AT001293 · NCCIH · UNIVERSITY OF MARYLAND BALTIMORE · PI BERMAN, BRIAN M, WIELAND, LISA SUSAN · 2003 to 2022
$9.4M
FIC NIH HHS D43 TW010540NCCIH NIH HHS R24 AT001293
6 · The paper itself

Abstract

backgroundMobile health (mHealth) refers to using mobile communication devices such as smartphones to support health, health care, and public health. mHealth interventions have their own nature and characteristics that distinguish them from traditional health care interventions, including drug interventions. Thus, randomized controlled trials (RCTs) of mHealth interventions present specific methodological challenges. Identifying and overcoming those challenges is essential to determine whether mHealth interventions improve health outcomes.

objectiveWe aimed to identify specific methodological challenges in RCTs testing mHealth interventions' effects and develop consensus-based recommendations to address selected challenges.

methodsA 2-phase participatory research project was conducted. First, we sent a web-based survey to authors of mHealth RCTs. Survey respondents rated on a 5-point scale how challenging they found 21 methodological aspects in mHealth RCTs compared to non-mHealth RCTs. Nonsystematic searches until June 2022 informed the selection of the methodological challenges listed in the survey. Second, a subset of survey respondents participated in an online workshop to discuss recommendations to address selected methodological aspects identified in the survey. Finally, consensus-based recommendations were developed based on the workshop discussion and email interaction.

resultsWe contacted 1535 authors of mHealth intervention RCTs, of whom 80 (5.21%) completed the survey. Most respondents (74/80, 92%) identified at least one methodological aspect as more or much more challenging in mHealth RCTs. The aspects most frequently reported as more or much more challenging were those related to mHealth intervention integrity, that is, the degree to which the study intervention was implemented as intended, in particular managing low adherence to the mHealth intervention (43/77, 56%), defining adherence (39/79, 49%), measuring adherence (33/78, 42%), and determining which mHealth intervention components are used or received by the participant (31/75, 41%). Other challenges were also frequent, such as analyzing passive data (eg, data collected from smartphone sensors; 24/58, 41%) and verifying the participants' identity during recruitment (28/68, 41%). In total, 11 survey respondents participated in the subsequent workshop (n=8, 73% had been involved in at least 2 mHealth RCTs). We developed 17 consensus-based recommendations related to the following four categories: (1) how to measure adherence to the mHealth intervention (7 recommendations), (2) defining adequate adherence (2 recommendations), (3) dealing with low adherence rates (3 recommendations), and (4) addressing mHealth intervention components (5 recommendations).

conclusionsRCTs of mHealth interventions have specific methodological challenges compared to those of non-mHealth interventions, particularly those related to intervention integrity. Following our recommendations for addressing these challenges can lead to more reliable assessments of the effects of mHealth interventions on health outcomes.

Indexed as

Randomized Controlled Trials as TopicTelemedicineCross-Sectional StudiesHumansSurveys and Questionnairesadherenceconsensusdigital healtheHealthintervention integritymHealthmobile healthmobile phonerandomized controlled trialrecommendationssurvey

Identifiers

PMID39700488
PMCPMC11695959

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.