Evidence map›Paper›PMID 34939117›Full record

ArticleJournal of the American Medical Informatics Association : JAMIA2022

Review, Assess, Classify, and Evaluate (RACE): a framework for studying m-health apps and its application for opioid apps.

Upkar Varshney, Neetu Singh, Anu G Bourgeois, Shanta R Dube

Open access · bronzeAbstract read
In one paragraph

Article in Journal of the American Medical Informatics Association : JAMIA, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 5 papers.

0numbers the graph read from it
0cells of the map it votes in
5citing papers in PubMed
3.2field-weighted citation impact, top 8% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

5 citing papers in PubMed, 13 citations in OpenAlex.

  1. Article
  2. Article
  3. Review
  4. Adaptive interventions for opioid prescription management and consumption monitoring.Journal of the American Medical Informatics Association : JAMIA · 2023
    Article
  5. Addressing Consequential Public Health Problems Through Informatics and Data Science.Journal of the American Medical Informatics Association : JAMIA · 2022
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors at 3 institutions in 1 country.

Upkar VarshneyDepartment of Computer Information Systems, Georgia State University, Atlanta, Georgia, USA.
Neetu SinghDepartment of Management Information Systems, University of Illinois at Springfield, Springfield, Illinois, USA.
Anu G BourgeoisDepartment of Computer Science, Georgia State University, Atlanta, Georgia, USA.
Shanta R DubeDepartment of Public Health, Levine College of Health Sciences, Wingate University, Wingate, North Carolina, USA.
Georgia State University · USUniversity of Illinois at Springfield · USWingate University · US

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectiveThe proliferation of m-health interventions has led to a growing research area of app analysis. We derived RACE (Review, Assess, Classify, and Evaluate) framework through the integration of existing methodologies for the purpose of analyzing m-health apps, and applied it to study opioid apps. MATERIALS AND

methodsThe 3-step RACE framework integrates established methods and evidence-based criteria used in a successive manner to identify and analyze m-health apps: the Preferred Reporting Items for Systematic Reviews and Meta-Analyses, inter-rater reliability analysis, and Nickerson-Varshney-Muntermann taxonomy.

resultsUsing RACE, 153 opioid apps were identified, assessed, and classified leading to dimensions of Target Audience, Key Function, Operation, Security & Privacy, and Impact, with Cohen's kappa < 1.0 suggesting subjectivity in app narrative assessments. The most common functions were education (24%), prescription (16%), reminder-monitoring-support (13%), and treatment & recovery (37%). A majority are passive apps (56%). The target audience are patients (49%), healthcare professionals (39%), and others (12%). Security & Privacy is evident in 84% apps. DISCUSSION: Applying the 3-step RACE framework revealed patterns and gaps in opioid apps leading to systematization of knowledge. Lessons learned can be applied to the study of m-health apps for other health conditions.

conclusionWith over 350 000 existing and emerging m-health apps, RACE shows promise as a robust and replicable framework for analyzing m-health apps for specific health conditions. Future research can utilize the RACE framework toward understanding the dimensions and characteristics of existing m-health apps to inform best practices for collaborative, connected and continued care.

Indexed as

Mobile ApplicationsTelemedicineAnalgesics, OpioidHumansPrivacyReproducibility of ResultsAnalgesics, Opioidevidence-based criteriaframeworkm-health appsopioidsstructured taxonomy

Identifiers

PMID34939117
PMCPMC8827031
OpenAlexW4200166051

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.