Evidence map›Paper›PMID 26377990›Full record

ArticleJournal of the American Medical Informatics Association : JAMIA2016

Quantifying usability: an evaluation of a diabetes mHealth system on effectiveness, efficiency, and satisfaction metrics with associated user characteristics.

Mattias Georgsson, Nancy Staggers

Open access · bronzeAbstract read
PubMed Full text at PMC Publisher
In one paragraph

Article in Journal of the American Medical Informatics Association : JAMIA, 2016. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 94 papers, 5 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
94citing papers in PubMed, 5 pooled it
23.2field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

94 citing papers in PubMed, 5 syntheses or guidelines pooled it, 209 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Trial
  7. Trial
  8. Trial
  9. Content Analysis: First-Time Patient User Challenges with Top-Rated Commercial Diabetes Apps.Telemedicine journal and e-health : the official journal of the American Telemedicine Association · 2021
    Trial
  10. Trial
  11. Article
  12. Review
  13. Review
  14. Article
  15. Article
  16. Article
  17. Article
  18. Review
  19. Article
  20. Article

34 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

2 authors at 2 institutions in 2 countries.

Mattias GeorgssonDepartment of Biomedical Informatics, University of Utah, Salt Lake City, Utah, USA Faculty of Computing, Blekinge Institute of Technology, Karlskrona, Sweden mattias.georgsson@bth.se.
Nancy StaggersDepartment of Biomedical Informatics, University of Utah, Salt Lake City, Utah, USA School of Nursing, University of Maryland, Baltimore, Maryland, USA.
Blekinge Institute of Technology · SEUniversity of Utah · US

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectiveMobile health (mHealth) systems are becoming more common for chronic disease management, but usability studies are still needed on patients' perspectives and mHealth interaction performance. This deficiency is addressed by our quantitative usability study of a mHealth diabetes system evaluating patients' task performance, satisfaction, and the relationship of these measures to user characteristics. MATERIALS AND

methodsWe used metrics in the International Organization for Standardization (ISO) 9241-11 standard. After standardized training, 10 patients performed representative tasks and were assessed on individual task success, errors, efficiency (time on task), satisfaction (System Usability Scale [SUS]) and user characteristics.

resultsTasks of exporting and correcting values proved the most difficult, had the most errors, the lowest task success rates, and consumed the longest times on task. The average SUS satisfaction score was 80.5, indicating good but not excellent system usability. Data trends showed males were more successful in task completion, and younger participants had higher performance scores. Educational level did not influence performance, but a more recent diabetes diagnosis did. Patients with more experience in information technology (IT) also had higher performance rates. DISCUSSION: Difficult task performance indicated areas for redesign. Our methods can assist others in identifying areas in need of improvement. Data about user background and IT skills also showed how user characteristics influence performance and can provide future considerations for targeted mHealth designs.

conclusionUsing the ISO 9241-11 usability standard, the SUS instrument for satisfaction and measuring user characteristics provided objective measures of patients' experienced usability. These could serve as an exemplar for standardized, quantitative methods for usability studies on mHealth systems.

Indexed as

Consumer BehaviorTelemedicineAdultAgedAge FactorsDiabetes MellitusEfficiencyFemaleHumansMaleMiddle AgedPatient SatisfactionSelf CareUser-Computer Interfacediabetesmobile healthself-managementusability evaluationuser-centered design

Identifiers

PMID26377990
PMCPMC4713903
OpenAlexW2177887065

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.