ArticleJournal of the American Medical Informatics Association : JAMIA2021
Scoping review: Development and assessment of evaluation frameworks of mobile health apps for recommendations to consumers.
Article in Journal of the American Medical Informatics Association : JAMIA, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 31 papers, 3 of them syntheses that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
31 citing papers in PubMed, 3 syntheses or guidelines pooled it.
- Which criteria are important in usability evaluation of mHealth applications: an umbrella review.BMC medical informatics and decision making · 2024Pooled it
- Quality Assessment of Digital Health Apps: Umbrella Review.Journal of medical Internet research · 2024Pooled it
- Consumers' Willingness to Pay for eHealth and Its Influencing Factors: Systematic Review and Meta-analysis.Journal of medical Internet research · 2022Pooled it
- Mobile Health Interventions to Support Patients With Dementia During the COVID-19 Pandemic: A Systematic Review.Health science reports · 2026Review
- Sustainable assessment in digital health interventions for primary care: A scoping review.Journal of public health research · 2026Article
- Implementation of mobile health interventions in hypertension management and outcomes: A scoping review protocol.PloS one · 2026Article
- Health economic evaluations of digital health technologies-a rapid review of applied methods.Frontiers in digital health · 2026Review
- A Brief Video-Based Intervention to Improve Digital Health Literacy for Individuals With Bipolar Disorder: Intervention Development and Results of a Single-Arm Quantitative Pilot Study.Journal of participatory medicine · 2025Article
- Developing a standardized framework for evaluating health apps using natural language processing.Scientific reports · 2025Article
- The psychometric assessment of the provider version of mHealth App Usability Questionnaire (MAUQ) in persian language.BMC medical informatics and decision making · 2024Article
- An evaluation and refinement of the "Hep B Story" app, tailored to meet the community's cultural needs.BMC health services research · 2024Article
- Don't judge a book or health app by its cover: User ratings and downloads are not linked to quality.PloS one · 2024Article
- Quality of Digital Health Interventions Across Different Health Care Domains: Secondary Data Analysis Study.JMIR mHealth and uHealth · 2023Article
- Rigorous and rapid evidence assessment in digital health with the evidence DEFINED framework.NPJ digital medicine · 2023Review
- Framework for Guiding the Development of High-Quality Conversational Agents in Healthcare.Healthcare (Basel, Switzerland) · 2023Article
- Clinical Considerations for Digital Resources in Care for Patients With Suicidal Ideation.Focus (American Psychiatric Publishing) · 2023Article
- A Web-Based Stratified Stepped Care Platform for Mental Well-being (TourHeart+): User-Centered Research and Design.JMIR formative research · 2023Article
- Adaptation and Utilization of a Postmarket Evaluation Model for Digital Contact Tracing Mobile Health Tools in the United States: Observational Cross-sectional Study.JMIR public health and surveillance · 2023Observational
- Current challenges for evaluating mobile health applications.Journal of the American Medical Informatics Association : JAMIA · 2023Article
- International practices in health technology assessment and public financing of digital health technologies: recommendations for Hungary.Frontiers in public health · 2023Review
Corrections and comments
- Commented on by
- Commented on by
Authors and funding
8 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
objectiveThe study sought to review the different assessment items that have been used within existing health app evaluation frameworks aimed at individual, clinician, or organizational users, and to analyze the scoring and evaluation methods used in these frameworks. MATERIALS AND
methodsWe searched multiple bibliographic databases and conducted backward searches of reference lists, using search terms that were synonyms of "health apps," "evaluation," and "frameworks." The review covered publications from 2011 to April 2020. Studies on health app evaluation frameworks and studies that elaborated on the scaling and scoring mechanisms applied in such frameworks were included.
resultsTen common domains were identified across general health app evaluation frameworks. A list of 430 assessment criteria was compiled across 97 identified studies. The most frequently used scaling mechanism was a 5-point Likert scale. Most studies have adopted summary statistics to generate the total scoring of each app, and the most popular approach taken was the calculation of mean or average scores. Other frameworks did not use any scaling or scoring mechanism and adopted criteria-based, pictorial, or descriptive approaches, or "threshold" filter. DISCUSSION: There is wide variance in the approaches to evaluating health apps within published frameworks, and this variance leads to ongoing uncertainty in how to evaluate health apps.
conclusionsA new evaluation framework is needed that can integrate the full range of evaluative criteria within one structure, and provide summative guidance on health app rating, to support individual app users, clinicians, and health organizations in choosing or recommending the best health app.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.