Evidence map›Paper›PMID 34636737›Full record

ReviewJMIR mHealth and uHealth2021

Identification and Evaluation of Methodologies to Assess the Quality of Mobile Health Apps in High-, Low-, and Middle-Income Countries: Rapid Review.

Fionn Woulfe, Kayode Philip Fadahunsi, Simon Smith, Griphin Baxter Chirambo, Emma Larsson, Patrick Henn, Mala Mawkin, John O' Donoghue

Abstract readReview
In one paragraph

Review in JMIR mHealth and uHealth, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 16 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
16citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

16 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Quality Assessment of Digital Health Apps: Umbrella Review.Journal of medical Internet research · 2024
    Pooled it
  2. Article
  3. Development of S-IMCICA_V.2: A User-Centered Educational and Decision-Support mHealth App for Early Detection of Childhood Cancer.Journal of cancer education : the official journal of the American Association for Cancer Education · 2026
    Article
  4. Article
  5. Article
  6. Article
  7. Review
  8. Article
  9. Review
  10. Article
  11. Article
  12. Article
  13. Review
  14. Article
  15. Article
  16. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Fionn WoulfeSchool of Medicine, University College Cork, Cork, Ireland.ORCID 0000-0002-5581-3426
Kayode Philip FadahunsiDepartment of Primary Care and Public Health, Imperial College London, London, United Kingdom.ORCID 0000-0003-1470-5493
Simon SmithSchool of Medicine, University College Cork, Cork, Ireland.ORCID 0000-0002-9623-640X
Griphin Baxter ChiramboFaculty of Health Sciences, Mzuzu University, Mzuzu, Malawi.ORCID 0000-0001-6067-1840
Emma LarssonAshford and St Peter's Hospitals NHS Trust, Chertsey, United Kingdom.ORCID 0000-0003-2722-1869
Patrick HennAssert Centre, College of Medicine & Health, University College Cork, Cork, Ireland.ORCID 0000-0001-5958-6163
Mala MawkinSchool of Medicine, Imperial College London, London, United Kingdom.ORCID 0000-0003-0711-6156
John O' DonoghueMalawi eHealth Research Centre, University College Cork, College Road, Cork, Ireland.ORCID 0000-0001-6056-8640

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundIn recent years, there has been rapid growth in the availability and use of mobile health (mHealth) apps around the world. A consensus regarding an accepted standard to assess the quality of such apps has yet to be reached. A factor that exacerbates the challenge of mHealth app quality assessment is variations in the interpretation of quality and its subdimensions. Consequently, it has become increasingly difficult for health care professionals worldwide to distinguish apps of high quality from those of lower quality. This exposes both patients and health care professionals to unnecessary risks. Despite progress, limited understanding of the contributions of researchers in low- and middle-income countries (LMICs) exists on this topic. Furthermore, the applicability of quality assessment methodologies in LMIC settings remains relatively unexplored.

objectiveThis rapid review aims to identify current methodologies in the literature to assess the quality of mHealth apps, understand what aspects of quality these methodologies address, determine what input has been made by authors from LMICs, and examine the applicability of such methodologies in LMICs.

methodsThis review was registered with PROSPERO (International Prospective Register of Systematic Reviews). A search of PubMed, EMBASE, Web of Science, and Scopus was performed for papers related to mHealth app quality assessment methodologies, which were published in English between 2005 and 2020. By taking a rapid review approach, a thematic and descriptive analysis of the papers was performed.

resultsElectronic database searches identified 841 papers. After the screening process, 52 papers remained for inclusion. Of the 52 papers, 5 (10%) proposed novel methodologies that could be used to evaluate mHealth apps of diverse medical areas of interest, 8 (15%) proposed methodologies that could be used to assess apps concerned with a specific medical focus, and 39 (75%) used methodologies developed by other published authors to evaluate the quality of various groups of mHealth apps. The authors in 6% (3/52) of papers were solely affiliated to institutes in LMICs. A further 15% (8/52) of papers had at least one coauthor affiliated to an institute in an LMIC.

conclusionsQuality assessment of mHealth apps is complex in nature and at times subjective. Despite growing research on this topic, to date, an all-encompassing appropriate means for evaluating the quality of mHealth apps does not exist. There has been engagement with authors affiliated to institutes across LMICs; however, limited consideration of current generic methodologies for application in LMIC settings has been identified.

trial registrationPROSPERO CRD42020205149; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=205149.

Indexed as

Mobile ApplicationsTelemedicineDeveloping CountriesHumansSystematic Reviews as Topichealth apphealth websitehigh-income countryLMIClow-income countrymethodologymHealth appmiddle-income countrymobile healthmobile phonequalityquality assessment

Identifiers

PMID34636737
PMCPMC8548973

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.