Evidence map›Paper›PMID 24567081›Full record

ArticleJournal of the American Medical Informatics Association : JAMIA2014

Examining construct and predictive validity of the Health-IT Usability Evaluation Scale: confirmatory factor analysis and structural equation modeling results.

Po-Yin Yen, Karen H Sousa, Suzanne Bakken

Abstract readValidation Study
In one paragraph

Article in Journal of the American Medical Informatics Association : JAMIA, 2014. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 41 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
41citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

41 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Trial
  4. Trial
  5. Trial
  6. Article
  7. Article
  8. Article
  9. Parent Perspectives on Mobile Health Autism Screeners.Journal of autism and developmental disorders · 2026
    Article
  10. Article
  11. Article
  12. Review
  13. Article
  14. Article
  15. Article
  16. Article
  17. Inpatient nurses' preferences and decisions with risk information visualization.Journal of the American Medical Informatics Association : JAMIA · 2023
    Article
  18. Article
  19. Celebrating Suzanne Bakken, 2023 Morris F. Collen Award winner and pioneer in health equity.Journal of the American Medical Informatics Association : JAMIA · 2023
    Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Po-Yin YenDepartment of Biomedical Informatics, The Ohio State University, Columbus, Ohio, USA.ORCID http://orcid.org/0000-0002-7061-4185
Karen H SousaCollege of Nursing, University of Colorado, Aurora, Colorado, USA.
Suzanne BakkenSchool of Nursing and Department of Biomedical Informatics, Columbia University, New York, New York, USA.

Funding

Self-Management, Biobehavioral and Informatics CoreP30NR010677 · NINR · COLUMBIA UNIVERSITY HEALTH SCIENCES · PI REAME, NANCY E · 2007 to 2011
$2.7M
NINR NIH HHS P30 NR010677NINR NIH HHS P30NR010677
6 · The paper itself

Abstract

backgroundIn a previous study, we developed the Health Information Technology Usability Evaluation Scale (Health-ITUES), which is designed to support customization at the item level. Such customization matches the specific tasks/expectations of a health IT system while retaining comparability at the construct level, and provides evidence of its factorial validity and internal consistency reliability through exploratory factor analysis.

objectiveIn this study, we advanced the development of Health-ITUES to examine its construct validity and predictive validity.

methodsThe health IT system studied was a web-based communication system that supported nurse staffing and scheduling. Using Health-ITUES, we conducted a cross-sectional study to evaluate users' perception toward the web-based communication system after system implementation. We examined Health-ITUES's construct validity through first and second order confirmatory factor analysis (CFA), and its predictive validity via structural equation modeling (SEM).

resultsThe sample comprised 541 staff nurses in two healthcare organizations. The CFA (n=165) showed that a general usability factor accounted for 78.1%, 93.4%, 51.0%, and 39.9% of the explained variance in 'Quality of Work Life', 'Perceived Usefulness', 'Perceived Ease of Use', and 'User Control', respectively. The SEM (n=541) supported the predictive validity of Health-ITUES, explaining 64% of the variance in intention for system use.

conclusionsThe results of CFA and SEM provide additional evidence for the construct and predictive validity of Health-ITUES. The customizability of Health-ITUES has the potential to support comparisons at the construct level, while allowing variation at the item level. We also illustrate application of Health-ITUES across stages of system development.

Indexed as

Evaluation Studies as TopicMedical InformaticsNursing StaffAttitude of Health PersonnelCross-Sectional StudiesFactor Analysis, StatisticalHumansModels, TheoreticalReproducibility of ResultsSurveys and Questionnairesfactor analysisscale developmentstructural equation modelingtechnology acceptanceusability

Identifiers

PMID24567081
PMCPMC4173162

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.