Evidence map›Paper›PMID 30487119›Full record

ArticleJMIR human factors2018

Bridging the Gap Between Academic Research and Pragmatic Needs in Usability: A Hybrid Approach to Usability Evaluation of Health Care Information Systems.

Devin M Mann, Sara Kuppin Chokshi, Andre Kushniruk

Abstract read
In one paragraph

Article in JMIR human factors, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 18 papers.

0numbers the graph read from it
0cells of the map it votes in
18citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

18 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Devin M Mann *Department of Population Health, School of Medicine, New York University, New York, NY, United States.ORCID http://orcid.org/0000-0002-2099-0852
Sara Kuppin Chokshi *Department of Population Health, School of Medicine, New York University, New York, NY, United States.ORCID http://orcid.org/0000-0002-3952-6654
Andre Kushniruk *School of Health Information Science, University of Victoria, Victoria, BC, Canada.ORCID http://orcid.org/0000-0002-2557-9288

Funding

Integrated Clinical Prediction Rules: Bringing Evidence to Diverse Primary Care SettingsR01AI108680 · NIAID · NEW YORK UNIVERSITY SCHOOL OF MEDICINE · PI FELDSTEIN, DAVID ALAN, MANN, DEVIN M · 2014 to 2024
$7.9M
NIAID NIH HHS R01 AI108680
6 · The paper itself

Abstract

backgroundTechnology is increasingly embedded into the full spectrum of health care. This movement has benefited from the application of software development practices such as usability testing and agile development processes. These practices are frequently applied in both commercial or operational and academic settings. However, the relative importance placed on rapid iteration, validity, reproducibility, generalizability, and efficiency differs between the 2 settings and the needs and objectives of academic versus pragmatic usability evaluations.

objectiveThis paper explores how usability evaluation typically varies on key dimensions in pragmatic versus academic settings that impact the rapidity, validity, and reproducibility of findings and proposes a hybrid approach aimed at satisfying both pragmatic and academic objectives.

methodsWe outline the characteristics of pragmatic versus academically oriented usability testing in health care, describe the tensions and gaps resulting from differing contexts and goals, and present a model of this hybrid process along with 2 case studies of digital development projects in which we demonstrate this integrated approach to usability evaluation.

resultsThe case studies presented illustrate design choices characteristic of our hybrid approach to usability evaluation.

conclusionsDesigned to leverage the strengths of both pragmatically and academically focused usability studies, a hybrid approach allows new development projects to efficiently iterate and optimize from usability data as well as preserves the ability of these projects to produce deeper insights via thorough qualitative analysis to inform further tool development and usability research by way of academically focused dissemination.

Indexed as

medical informaticssoftware designuser-computer interface

Identifiers

PMID30487119
PMCPMC6291682

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.