Evidence map›Paper›PMID 38378044›Full record

ArticleApplied clinical informatics2024

Usability Testing of Situation Awareness Clinical Decision Support in the Intensive Care Unit.

Matthew J Molloy, Matthew Zackoff, Annika Gifford, Philip Hagedorn, Ken Tegtmeyer, Maria T Britto, Maya Dewan

Registry-linked trialAbstract read
In one paragraph

Article in Applied clinical informatics, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT06553534 (Situation Awareness Incorporating Multidisciplinary Teams Reduce Arrests In the Pediatric ICU in the Pediatric Resuscitation Quality Collaborative), which is not on this map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT06553534 naactive not recruitingnot on this map

Situation Awareness Incorporating Multidisciplinary Teams Reduce Arrests In the Pediatric ICU in the Pediatric Resuscitation Quality Collaborative

TypeinterventionalSponsorChildren's Hospital Medical Center, CincinnatiRan2024 to 2029Enrolled5ConditionsIn-hospital Cardiac Arrest, Cardiopulmonary ResuscitationArmsSAMURAI PICU Bundle
3 · Its place in the literature

Who cites it

3 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Matthew J MolloyDepartment of Pediatrics, University of Cincinnati College of Medicine, Cincinnati, Ohio, United States.
Matthew ZackoffDepartment of Pediatrics, University of Cincinnati College of Medicine, Cincinnati, Ohio, United States.
Annika GiffordBrigham Young University, Provo, Utah, United States.
Philip HagedornDepartment of Pediatrics, University of Cincinnati College of Medicine, Cincinnati, Ohio, United States.
Ken TegtmeyerDepartment of Pediatrics, University of Cincinnati College of Medicine, Cincinnati, Ohio, United States.
Maria T BrittoDepartment of Pediatrics, University of Cincinnati College of Medicine, Cincinnati, Ohio, United States.
Maya DewanDepartment of Pediatrics, University of Cincinnati College of Medicine, Cincinnati, Ohio, United States.

Funding

AHRQ Mentored Clinical Scientist Research Career Development Award (K08): Maya DewanK08HS026975 · AHRQ · CINCINNATI CHILDRENS HOSP MED CTR · PI DEWAN, MAYA L · 2020 to 2024
$752k
AHRQ HHS K08 HS026975
6 · The paper itself

Abstract

objectiveOur objective was to evaluate the usability of an automated clinical decision support (CDS) tool previously implemented in the pediatric intensive care unit (PICU) to promote shared situation awareness among the medical team to prevent serious safety events within children's hospitals.

methodsWe conducted a mixed-methods usability evaluation of a CDS tool in a PICU at a large, urban, quaternary, free-standing children's hospital in the Midwest. Quantitative assessment was done using the system usability scale (SUS), while qualitative assessment involved think-aloud usability testing. The SUS was scored according to survey guidelines. For think-aloud testing, task times were calculated, and means and standard deviations were determined, stratified by role. Qualitative feedback from participants and moderator observations were summarized.

resultsFifty-one PICU staff members, including physicians, advanced practice providers, nurses, and respiratory therapists, completed the SUS, while ten participants underwent think-aloud usability testing. The overall median usability score was 87.5 (interquartile range: 80-95), with over 96% rating the tool's usability as "good" or "excellent." Task completion times ranged from 2 to 92 seconds, with the quickest completion for reviewing high-risk criteria and the slowest for adding to high-risk criteria. Observations and participant responses from think-aloud testing highlighted positive aspects of learnability and clear display of complex information that is easily accessed, as well as opportunities for improvement in tool integration into clinical workflows.

conclusionThe PICU Warning Tool demonstrates good usability in the critical care setting. This study demonstrates the value of postimplementation usability testing in identifying opportunities for continued improvement of CDS tools.

Indexed as

Decision Support Systems, ClinicalIntensive Care UnitsAwarenessHumansIntensive Care Units, Pediatric

Identifiers

PMID38378044
PMCPMC11062760

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.