Evidence map›Paper›PMID 29254914›Full record

ArticleJMIR mHealth and uHealth2017

Methods for Evaluating the Content, Usability, and Efficacy of Commercial Mobile Health Apps.

Danielle E Jake-Schoffman, Valerie J Silfee, Molly E Waring, Edwin D Boudreaux, Rajani S Sadasivam, Sean P Mullen, Jennifer L Carey, Rashelle B Hayes, Eric Y Ding, Gary G Bennett and 1 more

Abstract read
In one paragraph

Article in JMIR mHealth and uHealth, 2017. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 73 papers, 4 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
73citing papers in PubMed, 4 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

73 citing papers in PubMed, 4 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Trial
  6. Trial
  7. Article
  8. The FemTech revolution: Unlocking the potential of new technology for optimizing pregnancy outcomes in low- and middle-income countries and remote areas.International journal of gynaecology and obstetrics: the official organ of the International Federation of Gynaecology and Obstetrics · 2026
    Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article

13 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors.

Danielle E Jake-SchoffmanDivision of Preventive and Behavioral Medicine, University of Massachusetts Medical School, Worcester, MA, United States.ORCID http://orcid.org/0000-0001-6381-7323
Valerie J SilfeeDivision of Preventive and Behavioral Medicine, University of Massachusetts Medical School, Worcester, MA, United States.ORCID http://orcid.org/0000-0001-8505-4726
Molly E WaringDepartment of Allied Health Sciences, University of Connecticut, Storrs, CT, United States.ORCID http://orcid.org/0000-0002-9884-9824
Edwin D BoudreauxDepartment of Quantitative Health Sciences, University of Massachusetts Medical School, Worcester, MA, United States.ORCID http://orcid.org/0000-0002-3223-6371
Rajani S SadasivamDivision of Health Informatics and Implementation Science, Department of Quantitative Health Sciences, University of Massachusetts Medical School, Worcester, MA, United States.ORCID http://orcid.org/0000-0001-8406-6207
Sean P MullenDepartment of Kinesiology & Community Health, University of Illinois at Urbana-Champaign, Urbana, IL, United States.ORCID http://orcid.org/0000-0002-8200-4026
Jennifer L CareyDepartment of Emergency Medicine, University of Massachusetts Medical School, Worcester, MA, United States.ORCID http://orcid.org/0000-0002-0758-565X
Rashelle B HayesDivision of Consultation/Liaison Psychiatry and Psychology, Department of Psychiatry, Virginia Commonwealth University, Richmond, VA, United States.ORCID http://orcid.org/0000-0002-2590-3404
Eric Y DingDepartment of Quantitative Health Sciences, University of Massachusetts Medical School, Worcester, MA, United States.ORCID http://orcid.org/0000-0002-6904-8534
Gary G BennettDepartment of Psychology & Neuroscience, Duke University, Durham, NC, United States.ORCID http://orcid.org/0000-0002-4740-9175
Sherry L PagotoDepartment of Allied Health Sciences, University of Connecticut, Storrs, CT, United States.ORCID http://orcid.org/0000-0002-2462-8797

Funding

Transdisciplinary Training In Cardiovascular ResearchT32HL120823 · NHLBI · UNIV OF MASSACHUSETTS MED SCH WORCESTER · PI DONAHUE, J KEVIN, KIEFE, CATARINA I. · 2014 to 2025
$3.9M
Cognitive Regulation Training and Exercise (CORTEX)-II with Middle-aged AdultsR01AG052707 · NIA · UNIVERSITY OF ILLINOIS AT URBANA-CHAMPAIGN · PI MULLEN, SEAN P · 2016 to 2020
$2.7M
Implementation Research Training Program in Cancer Prevention and ControlR25CA172009 · NCI · UNIV OF MASSACHUSETTS MED SCH WORCESTER · PI HOUSTON, THOMAS K, LEMON, STEPHENIE C. · 2014 to 2018
$1.9M
Mentoring in mHealth and Social Networking Interventions for CVD Risk ReductionK24HL124366 · NHLBI · UNIV OF MASSACHUSETTS MED SCH WORCESTER · PI PAGOTO, SHERRY L. · 2015 to 2024
$1.1M
Developing Smokers for Smoker (S4S): A Collective Intelligence tailoring systemK07CA172677 · NCI · UNIV OF MASSACHUSETTS MED SCH WORCESTER · PI SADASIVAM, RAJANI · 2013 to 2017
$702k
NCI NIH HHS K07 CA172677NCI NIH HHS R25 CA172009NHLBI NIH HHS K24 HL124366NHLBI NIH HHS T32 HL120823NIA NIH HHS R01 AG052707
6 · The paper itself

Abstract

Commercial mobile apps for health behavior change are flourishing in the marketplace, but little evidence exists to support their use. This paper summarizes methods for evaluating the content, usability, and efficacy of commercially available health apps. Content analyses can be used to compare app features with clinical guidelines, evidence-based protocols, and behavior change techniques. Usability testing can establish how well an app functions and serves its intended purpose for a target population. Observational studies can explore the association between use and clinical and behavioral outcomes. Finally, efficacy testing can establish whether a commercial app impacts an outcome of interest via a variety of study designs, including randomized trials, multiphase optimization studies, and N-of-1 studies. Evidence in all these forms would increase adoption of commercial apps in clinical practice, inform the development of the next generation of apps, and ultimately increase the impact of commercial apps.

Indexed as

behavioral medicinechronic diseasemHealthmobile applicationsmobile healthtelemedicine/methodstreatment efficacy

Identifiers

PMID29254914
PMCPMC5748471

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.