Evidence map›Paper›PMID 40699949›Full record

ArticleJMIR mHealth and uHealth2025

Grouping Digital Health Apps Based on Their Quality and User Ratings Using K-Medoids Clustering: Cross-Sectional Study.

Maciej Marek Zych, Raymond Bond, Maurice Mulvenna, Lu Bai, Jorge Martinez-Carracedo, Simon Leigh

Abstract read
In one paragraph

Article in JMIR mHealth and uHealth, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Maciej Marek ZychSchool of Computing, Ulster University, 2-24 York Street, Belfast, BT15 1AP, United Kingdom, 44 7526852505.ORCID 0000-0003-0791-8976
Raymond BondSchool of Computing, Ulster University, 2-24 York Street, Belfast, BT15 1AP, United Kingdom, 44 7526852505.ORCID 0000-0002-1078-2232
Maurice MulvennaSchool of Computing, Ulster University, 2-24 York Street, Belfast, BT15 1AP, United Kingdom, 44 7526852505.ORCID 0000-0002-1554-0785
Lu BaiSchool of Electronics, Electrical Engineering and Computer Science, Queen's University, Belfast, United Kingdom.ORCID 0000-0003-1242-5412
Jorge Martinez-CarracedoSchool of Computing, Ulster University, 2-24 York Street, Belfast, BT15 1AP, United Kingdom, 44 7526852505.ORCID 0000-0001-8017-2598
Simon LeighOrganisation for the Review of Care and Health Apps (ORCHA), Daresbury, United Kingdom.ORCID 0000-0002-6843-6447

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Background: Digital health apps allow for proactive rather than reactive health care and have the potential to take the pressure off health care providers. With over 350,000 digital health apps available on the app stores today, those apps need to be of sufficient quality to be safe to use. Discovering the typology of digital health apps regarding professional and clinical assurance (PCA), user experience (UX), data privacy (DP), and user ratings may help in determining the areas where digital health apps can improve. Objective: This study has two objectives: (1) discover the types (clusters) of digital health apps with regards to their quality (scores) across 3 domains (their PCA, UX, and DP) and user ratings and (2) determine whether the National Institute for Health and Care Excellence (NICE) Evidence Standard Framework's (ESF's) tier, target users of the digital health apps, categories, or features have any association with this typology. Methods: Data were obtained from 1402 digital health app assessments conducted using the Organisation for the Review of Care and Health Apps Baseline Review (OBR), evaluating PCA, UX, and DP. K-medoids clustering identified app typologies, with the optimal number of clusters determined using the elbow method. The Shapiro-Wilk test assessed normality of user ratings and OBR scores. Nonparametric Wilcoxon rank sum tests compared cluster differences in these metrics. Post hoc analysis examined the distribution of NICE ESF tiers, target users, categories, and features across clusters, using Fisher exact test with Bonferroni correction. Effect sizes were calculated using Cohen w. Results: A total of four distinct app clusters emerged: (1) apps with poor user ratings (220/1402, 15.7%), (2) apps with poor PCA and DP scores (252/1402, 18%), (3) apps with poor PCA scores (415/1402, 29.6%), and (4) higher quality apps with high user ratings and OBR scores (515/1402, 36.7%). While some statistically significant associations were found between clusters and NICE ESF tiers (2/3), target users (0/14), categories (4/33), and features (6/19), all had small effect sizes (Cohen w<0.3). The strongest associations were for the "Service Signposting" feature (Cohen w=0.24) and NICE ESF tier B (Cohen w=0.19). Conclusions: The largest cluster comprised high-quality apps with strong user ratings and OBR scores (515/1402, 36.7%). A significant proportion (415/1402, 29.6%) performed poorly in PCA despite performing well in other domains. Notably, user ratings did not consistently align with PCA scores; some apps scored highly with users but poorly in PCA and DP. The 4-cluster typology underscores areas needing improvement, particularly PCA. Findings suggest limited association between the examined app characteristics and quality clusters, indicating a need for further investigation into what factors truly influence app quality.

Indexed as

Mobile ApplicationsCluster AnalysisCross-Sectional StudiesDigital HealthHumansSurveys and Questionnairesappclinical assurancecluster analysisdata privacydigital healthdigital health appmHealthmobile healthORCHA assessmentOrganisation for the Review of Care and Health Appsquality assessmentuseruser experience

Identifiers

PMID40699949
PMCPMC12309620

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.