Evidence map›Paper›PMID 37745932›Full record

ArticleJournal of clinical and translational science2023

Identification of delirium from real-world electronic health record clinical notes.

Jennifer St Sauver, Sunyang Fu, Sunghwan Sohn, Susan Weston, Chun Fan, Janet Olson, Bjoerg Thorsteinsdottir, Nathan LeBrasseur, Sandeep Pagali, Walter Rocca and 1 more

Abstract read
In one paragraph

Article in Journal of clinical and translational science, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 14 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
14citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

14 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Observational
  10. Article
  11. Article
  12. Article
  13. Article
  14. Advancing regulatory science through real-world data and real-world evidence.Journal of clinical and translational science · 2024
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors.

Jennifer St SauverDivision of Epidemiology, Department of Quantitative Health Sciences, Mayo Clinic, Rochester, MN, USA.ORCID https://orcid.org/0000-0002-9789-8544
Sunyang FuDepartment of Artificial Intelligence and Informatics, Mayo Clinic, Rochester, MN, USA.
Sunghwan SohnDepartment of Artificial Intelligence and Informatics, Mayo Clinic, Rochester, MN, USA.
Susan WestonDepartment of Artificial Intelligence and Informatics, Mayo Clinic, Rochester, MN, USA.
Chun FanDivision of Clinical Trials and Biostatistics, Department of Quantitative Health Sciences, Mayo Clinic, Rochester, MN, USA.
Janet OlsonDivision of Epidemiology, Department of Quantitative Health Sciences, Mayo Clinic, Rochester, MN, USA.
Bjoerg ThorsteinsdottirDepartment of Medicine, Mayo Clinic, Rochester, MN, USA.
Nathan LeBrasseurRobert and Arlene Kogod Center on Aging, Mayo Clinic, Rochester, MN, USA.
Sandeep PagaliDepartment of Medicine, Mayo Clinic, Rochester, MN, USA.
Walter RoccaDivision of Epidemiology, Department of Quantitative Health Sciences, Mayo Clinic, Rochester, MN, USA.
Hongfang LiuDivision of Epidemiology, Department of Quantitative Health Sciences, Mayo Clinic, Rochester, MN, USA.

Funding

Interdisciplinary Infrastructure for Aging Research: Rochester Epidemiology ProjectR33AG058738 · NIA · MAYO CLINIC ROCHESTER · PI LEBRASSEUR, NATHAN K, OLSON, JANET E · 2020 to 2022
$2.4M
Facilitate Observational Studies of Alzheimer's Disease and Alzheimer's Disease-Related Dementias Using Ontology and Natural Language ProcessingR01AG072799 · NIA · YALE UNIVERSITY · PI HONGFANG LIU, Cui Tao · 2025 to 2026
$1.7M
NIA NIH HHS R01 AG072799NIA NIH HHS R33 AG058738
6 · The paper itself

Abstract

Introduction: We tested the ability of our natural language processing (NLP) algorithm to identify delirium episodes in a large-scale study using real-world clinical notes. Methods: We used the Rochester Epidemiology Project to identify persons ≥ 65 years who were hospitalized between 2011 and 2017. We identified all persons with an International Classification of Diseases code for delirium within ±14 days of a hospitalization. We independently applied our NLP algorithm to all clinical notes for this same population. We calculated rates using number of delirium episodes as the numerator and number of hospitalizations as the denominator. Rates were estimated overall, by demographic characteristics, and by year of episode, and differences were tested using Poisson regression. Results: In total, 14,255 persons had 37,554 hospitalizations between 2011 and 2017. The code-based delirium rate was 3.02 per 100 hospitalizations (95% CI: 2.85, 3.20). The NLP-based rate was 7.36 per 100 (95% CI: 7.09, 7.64). Rates increased with age (both Conclusions: The NLP algorithm identified more delirium episodes compared to the ICD code method. However, NLP may still underestimate delirium cases because of limitations in real-world clinical notes, including incomplete documentation, practice changes over time, and missing clinical notes in some time periods.

Indexed as

bioinformaticsDeliriumelectronic health recordsInternational Classification of Diseases (ICD)natural language processing algorithm

Identifiers

PMID37745932
PMCPMC10514685

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.