Evidence map›Paper›PMID 37657712›Full record

ArticleJournal of biomedical informatics2023

A voice-based digital assistant for intelligent prompting of evidence-based practices during ICU rounds.

Andrew J King, Derek C Angus, Gregory F Cooper, Danielle L Mowery, Jennifer B Seaman, Kelly M Potter, Leigh A Bukowski, Ali Al-Khafaji, Scott R Gunn, Jeremy M Kahn

Abstract read
In one paragraph

Article in Journal of biomedical informatics, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 5 papers.

0numbers the graph read from it
0cells of the map it votes in
5citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

5 citing papers in PubMed.

  1. Trial
  2. Review
  3. Delirium and Coronavirus Disease 2019: Looking Back, Moving Forward.Critical care nursing clinics of North America · 2024
    Review
  4. Sketching AI Concepts with Capabilities and Examples: AI Innovation in the Intensive Care Unit.Proceedings of the SIGCHI conference on human factors in computing systems. CHI Conference · 2024
    Article
  5. Investigating Why Clinicians Deviate from Standards of Care: Liberating Patients from Mechanical Ventilation in the ICU.Proceedings of the SIGCHI conference on human factors in computing systems. CHI Conference · 2024
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

Andrew J KingDepartment of Critical Care Medicine, University of Pittsburgh School of Medicine, Scaife Hall Suite 600, 3550 Terrace Street, Pittsburgh, PA 15261, USA. Electronic address: andrew.king@pitt.edu.
Derek C AngusDepartment of Critical Care Medicine, University of Pittsburgh School of Medicine, Scaife Hall Suite 600, 3550 Terrace Street, Pittsburgh, PA 15261, USA. Electronic address: angusdc@upmc.edu.
Gregory F CooperDepartment of Biomedical Informatics, University of Pittsburgh School of Medicine, Offices at Baum 4th Floor, 5607 Baum Blvd, Pittsburgh, PA 15206, USA. Electronic address: gfc@pitt.edu.
Danielle L MoweryDepartment of Biostatistics, Epidemiology, and Informatics, University of Pennsylvania School of Medicine, Blockley Hall 8th Floor, 423 Guardian Drive, Philadelphia, PA 19104, USA. Electronic address: dlmowery@pennmedicine.upenn.edu.
Jennifer B SeamanDepartment of Acute & Tertiary Care, University of Pittsburgh School of Nursing, 336 Victoria Building, 3500 Victoria Street, Pittsburgh, PA 15261, USA. Electronic address: jbs31@pitt.edu.
Kelly M PotterDepartment of Critical Care Medicine, University of Pittsburgh School of Medicine, Scaife Hall Suite 600, 3550 Terrace Street, Pittsburgh, PA 15261, USA. Electronic address: kelly.potter@pitt.edu.
Leigh A BukowskiDepartment of Critical Care Medicine, University of Pittsburgh School of Medicine, Scaife Hall Suite 600, 3550 Terrace Street, Pittsburgh, PA 15261, USA. Electronic address: lab108@pitt.edu.
Ali Al-KhafajiDepartment of Critical Care Medicine, University of Pittsburgh School of Medicine, Scaife Hall Suite 600, 3550 Terrace Street, Pittsburgh, PA 15261, USA. Electronic address: alkhafajia2@upmc.edu.
Scott R GunnDepartment of Critical Care Medicine, University of Pittsburgh School of Medicine, Scaife Hall Suite 600, 3550 Terrace Street, Pittsburgh, PA 15261, USA. Electronic address: gunnsr@ccm.upmc.edu.
Jeremy M KahnDepartment of Critical Care Medicine, University of Pittsburgh School of Medicine, Scaife Hall Suite 600, 3550 Terrace Street, Pittsburgh, PA 15261, USA. Electronic address: jeremykahn@pitt.edu.

Funding

The internship in Biomedical Research, Informatics, and Computer Science (iBRIC): Biomedical Informatics and Data Science research experiences for students from Minority Serving InstitutionsT15LM007059 · NLM · UNIVERSITY OF PITTSBURGH AT PITTSBURGH · PI HARRY S HOCHHEISER · 1987 to 2026
$23.9M
Organizational strategies for improving evidence-uptake in intensive careR35HL144804 · NHLBI · UNIVERSITY OF PITTSBURGH AT PITTSBURGH · PI KAHN, JEREMY M · 2019 to 2025
$6.6M
Multidisciplinary Training in Critical Care Outcomes ResearchT32HL007820 · NHLBI · UNIVERSITY OF PITTSBURGH AT PITTSBURGH · PI Timothy D Girard, Jeremy M Kahn · 1996 to 2026
$6.4M
NCATS NIH HHS L30 TR003001NHLBI NIH HHS R35 HL144804NHLBI NIH HHS T32 HL007820NLM NIH HHS T15 LM007059
6 · The paper itself

Abstract

objectiveTo evaluate the technical feasibility and potential value of a digital assistant that prompts intensive care unit (ICU) rounding teams to use evidence-based practices based on analysis of their real-time discussions.

methodsWe evaluated a novel voice-based digital assistant which audio records and processes the ICU care team's rounding discussions to determine which evidence-based practices are applicable to the patient but have yet to be addressed by the team. The system would then prompt the team to consider indicated but not yet delivered practices, thereby reducing cognitive burden compared to traditional rigid rounding checklists. In a retrospective analysis, we applied automatic transcription, natural language processing, and a rule-based expert system to generate personalized prompts for each patient in 106 audio-recorded ICU rounding discussions. To assess technical feasibility, we compared the system's prompts to those created by experienced critical care nurses who directly observed rounds. To assess potential value, we also compared the system's prompts to a hypothetical paper checklist containing all evidence-based practices.

resultsThe positive predictive value, negative predictive value, true positive rate, and true negative rate of the system's prompts were 0.45 ± 0.06, 0.83 ± 0.04, 0.68 ± 0.07, and 0.66 ± 0.04, respectively. If implemented in lieu of a paper checklist, the system would generate 56% fewer prompts per patient, with 50%±17% greater precision.

conclusionA voice-based digital assistant can reduce prompts per patient compared to traditional approaches for improving evidence uptake on ICU rounds. Additional work is needed to evaluate field performance and team acceptance.

Indexed as

Intensive Care UnitsEvidence-Based PracticeHumansNatural Language ProcessingTeaching RoundsVoiceArtificial intelligenceChecklistEvidence-based practiceImplementation scienceIntensive care units

Identifiers

PMID37657712
PMCPMC10591951

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.