Evidence map›Paper›PMID 37864949›Full record

ArticleInternational journal of medical informatics2023

Limitations in the use of automated mental status detection for clinical decision support.

Jesse O Wrenn, Matthew A Christensen, Michael J Ward

Open access · greenAbstract read
In one paragraph

Article in International journal of medical informatics, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact, top 73% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed, 0 citations in OpenAlex.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors at 2 institutions in 1 country.

Jesse O WrennDepartment of Emergency Medicine, Vanderbilt University Medical Center, Nashville, TN, United States; Division of Emergency Medicine, Tennessee Valley Healthcare System VA, Nashville, TN, United States. Electronic address: jesse.wrenn.1@vumc.org.
Matthew A ChristensenDivision of Allergy, Pulmonary, & Critical Care Medicine, Vanderbilt University Medical Center, Nashville, TN, United States.
Michael J WardDepartment of Emergency Medicine, Vanderbilt University Medical Center, Nashville, TN, United States; Division of Emergency Medicine, Tennessee Valley Healthcare System VA, Nashville, TN, United States; Geriatric Research Education and Clinical Care Center, Tennessee Valley Healthcare System VA, Nashville, TN, United States.
VA Tennessee Valley Healthcare System · USVanderbilt University Medical Center · US

Funding

Interdisciplinary Training in Injury and Critical IllnessT32GM135094 · NIGMS · VANDERBILT UNIVERSITY MEDICAL CENTER · PI PATEL, MAYUR B · 2021 to 2025
$967k
NIGMS NIH HHS T32 GM135094
6 · The paper itself

Abstract

backgroundClinical decision support (CDS) tools improve adherence to evidence-based practices but are dependent upon data quality in the electronic health record (EHR). Mental status is an integral component of many risk stratification scores, but it is not known whether EHR-measures of altered mental status are reliable. The Glasgow Coma Scale (GCS) is a measure of altered mentation that is widely adopted and entered in the EHR in structured format. We sought to determine the accuracy GCS < 15 as an EHR-measure of altered mentation compared to ED provider documentation.

methodsIn patients presenting to an academic Emergency Department (ED) with pneumonia we abstracted GCS values entered by nurses during routine care and in a randomly selected subset manually reviewed provider documentation for evidence of altered mental status. We defined eConfusion as present if GCS < 15 at any point during the ED encounter. We then calculated the CURB-65 score and corresponding suggested disposition using each method. Performance of eConfusion and corresponding CURB-65 compared to manual versions was measured using agreement (Cohen's K), sensitivity, and specificity.

resultsAmong 300 randomly selected encounters, 47 (16 %) had eConfusion present and 46 (15 %) had evidence of altered mental status in provider documentation with Cohen's K 0.73. eConfusion had 78 % sensitivity and 96 % specificity for provider documented altered mental status. When input into CURB-65 to recommend inpatient disposition, eConfusion had 95 % sensitivity, and recommended discordant disposition for 3 %.

conclusionsThere was modest agreement between eConfusion and provider documentation of altered mental status. eConfusion had good specificity but low sensitivity which resulted in under-estimation of the CURB-65 score and occasional inappropriate disposition recommendations compared to provider documentation. These data do not support the use of GCS as a measure for altered mentation for use in CDS tools in the ED.

Indexed as

Decision Support Systems, ClinicalDocumentationElectronic Health RecordsEmergency Service, HospitalHumansRisk FactorsAltered Mental StatusClinical Decision SupportEmergency DepartmentGlasgow Coma ScalePneumoniaSepsis

Identifiers

PMID37864949
PMCPMC12822685
OpenAlexW4387502141

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.