Evidence map›Paper›PMID 33692488›Full record

ArticleNPJ digital medicine2021

Assessing the quality of mobile applications in chronic disease management: a scoping review.

Payal Agarwal, Dara Gordon, Janessa Griffith, Natasha Kithulegoda, Holly O Witteman, R Sacha Bhatia, Andre W Kushniruk, Elizabeth M Borycki, Lise Lamothe, Elena Springall and 1 more

Abstract readScoping Review
In one paragraph

Article in NPJ digital medicine, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 37 papers, 3 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
37citing papers in PubMed, 3 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

37 citing papers in PubMed, 3 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Trial
  5. Trial
  6. Article
  7. Article
  8. Review
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Review
  17. Physiotherapy Canada. Physiotherapie Canada · 2024
    Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors.

Payal AgarwalInstitute for Health Systems Solutions and Virtual Care, Women's College Hospital, Toronto, ON, Canada. Payal.agarwal@wchospital.ca.
Dara GordonInstitute for Health Systems Solutions and Virtual Care, Women's College Hospital, Toronto, ON, Canada.
Janessa GriffithInstitute of Medical Science, University of Toronto, Toronto, ON, Canada.
Natasha KithulegodaInstitute for Health Systems Solutions and Virtual Care, Women's College Hospital, Toronto, ON, Canada.
Holly O WittemanDepartment of Family and Emergency Medicine, Faculty of Medicine, Laval University, Québec City, QC, Canada.
R Sacha BhatiaInstitute for Health Systems Solutions and Virtual Care, Women's College Hospital, Toronto, ON, Canada.ORCID http://orcid.org/0000-0001-6206-5318
Andre W KushnirukSchool of Health Information Science, University of Victoria, Greater Victoria, BC, Canada.
Elizabeth M BoryckiSchool of Health Information Science, University of Victoria, Greater Victoria, BC, Canada.
Lise LamotheÉcole de santé publique, Université de Montréal, Montreal, QC, Canada.
Elena SpringallGerstein Library, University of Toronto, Toronto, ON, Canada.ORCID http://orcid.org/0000-0003-3686-7098
James ShawInstitute for Health Systems Solutions and Virtual Care, Women's College Hospital, Toronto, ON, Canada.ORCID http://orcid.org/0000-0002-9522-0756

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

While there has been a rapid growth of digital health apps to support chronic diseases, clear standards on how to best evaluate the quality of these evolving tools are absent. This scoping review aims to synthesize the emerging field of mobile health app quality assessment by reviewing criteria used by previous studies to assess the quality of mobile apps for chronic disease management. A literature review was conducted in September 2017 for published studies that use a set of quality criteria to directly evaluate two or more patient-facing apps supporting promote chronic disease management. This resulted in 8182 citations which were reviewed by research team members, resulting in 65 articles for inclusion. An inductive coding schema to synthesize the quality criteria utilized by included articles was developed, with 40 unique quality criteria identified. Of the 43 (66%) articles that reported resources used to support criteria selection, 19 (29%) used clinical guidelines, and 10 (15%) used behavior change theory. The most commonly used criteria included the presence of user engagement or behavior change functions (97%, n = 63) and technical features of the app such as customizability (20%, n = 13, while Usability was assessed by 24 studies (36.9%). This study highlights the significant variation in quality criteria employed for the assessment of mobile health apps. Future methods for app evaluation will benefit from approaches that leverage the best evidence regarding the clinical impact and behavior change mechanisms while more directly reflecting patient needs when evaluating the quality of apps.

Identifiers

PMID33692488
PMCPMC7946941

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.