ArticlePeerJ. Computer science2024
Validation of system usability scale as a usability metric to evaluate voice user interfaces.
Article in PeerJ. Computer science, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 9 papers.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
9 citing papers in PubMed.
- Performance and operative outcomes' evaluation of a hand-held articulating laparoscopic device: a prospective clinical trial on the HandX™ platform.Journal of robotic surgery · 2025Trial
- Combining Subjective Perceptions and Objective Behavioral Metrics With the Elderly Digital Twin System: Quantitative Usability Study.JMIR aging · 2026Article
- A WeChat mini-program-based perioperative cognitive management tool (WACDAM): development and clinical evaluation in elderly patients undergoing oromaxillofacial malignancy surgery-a mixed-methods study.Perioperative medicine (London, England) · 2026Article
- Usability Evaluation of a Central Monitoring System with AI-Based Cardiac Arrest Prediction in the ICU.Journal of clinical medicine · 2026Article
- Investigating the Feasibility, Usability, and Efficacy of a Mobile App to Reduce Anxiety and Depression in Families of Critical Care Cancer Patients: A Quasi-Experimental Pilot Study.Healthcare (Basel, Switzerland) · 2026Article
- A Knowledge-Enhanced Platform (MetaSepsisKnowHub) for Retrieval Augmented Generation-Based Sepsis Heterogeneity and Personalized Management: Development Study.Journal of medical Internet research · 2025Article
- Strategic technological innovation through ChatMu: transforming information accessibility in Muhammadiyah.Frontiers in artificial intelligence · 2025Article
- Need-based remote exercise management platform for colorectal cancer patients with intestinal stoma: design and pilot usability evaluation.Frontiers in rehabilitation sciences · 2025Article
- Monitoring Upper Extremity Function of Individuals With Breast Cancer: Development and Usability of theInquiry : a journal of medical care organization, provision and financingArticle
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
2 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
In recent years, user experience (UX) has gained importance in the field of interactive systems. To ensure its success, interactive systems must be evaluated. As most of the standardized evaluation tools are dedicated to graphical user interfaces (GUIs), the evaluation of voice-based interactive systems or voice user interfaces is still in its infancy. With the help of a well-established evaluation scale, the System Usability Scale (SUS), two prominent, widely accepted voice assistants were evaluated. The evaluation, with SUS, was conducted with 16 participants who performed a set of tasks on Amazon Alexa Echo Dot and Google Nest Mini. We compared the SUS score of Amazon Alexa Echo Dot and Google Nest Mini. Furthermore, we derived the confidence interval for both voice assistants. To enhance understanding for usability practitioners, we analyzed the Adjective Rating Score of both interfaces to comprehend the experience of an interface's usability through words rather than numbers. Additionally, we validated the correlation between the SUS score and the Adjective Rating Score. Finally, a paired sample t-test was conducted to compare the SUS score of Amazon Alexa Echo Dot and Google Nest Mini. This resulted in a huge difference in scores. Hence, in this study, we corroborate the utility of the SUS in voice user interfaces and conclude by encouraging researchers to use SUS as a usability metric to evaluate voice user interfaces.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.