Evidence map›Paper›PMID 31331322›Full record

ArticleBMC medical informatics and decision making2019

Development and validation of a pragmatic natural language processing approach to identifying falls in older adults in the emergency department.

Brian W Patterson, Gwen C Jacobsohn, Manish N Shah, Yiqiang Song, Apoorva Maru, Arjun K Venkatesh, Monica Zhong, Katherine Taylor, Azita G Hamedani, Eneida A Mendonça

Open access · goldAbstract readValidation Study
In one paragraph

Article in BMC medical informatics and decision making, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 14 papers, 4 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
14citing papers in PubMed, 4 pooled it
3.1field-weighted citation impact, top 9% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

14 citing papers in PubMed, 4 syntheses or guidelines pooled it, 23 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Using natural language processing in emergency medicine health service research: A systematic review and meta-analysis.Academic emergency medicine : official journal of the Society for Academic Emergency Medicine · 2024
    Pooled it
  4. The use of natural language processing in detecting and predicting falls within the healthcare setting: a systematic review.International journal for quality in health care : journal of the International Society for Quality in Health Care · 2023
    Pooled it
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. A hybrid model to identify fall occurrence from electronic health records.International journal of medical informatics · 2022
    Article
  13. Observational
  14. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors at 3 institutions in 1 country.

Brian W PattersonBerbeeWalsh Department of Emergency Medicine, University of Wisconsin School of Medicine and Public Health, Madison, WI, USA. bpatter@medicine.wisc.edu.ORCID 0000-0002-4584-3808
Gwen C JacobsohnBerbeeWalsh Department of Emergency Medicine, University of Wisconsin School of Medicine and Public Health, Madison, WI, USA.
Manish N ShahBerbeeWalsh Department of Emergency Medicine, University of Wisconsin School of Medicine and Public Health, Madison, WI, USA.
Yiqiang SongDepartment of Biostatistics and Medical Informatics, University of Wisconsin-Madison, Madison, WI, USA.
Apoorva MaruBerbeeWalsh Department of Emergency Medicine, University of Wisconsin School of Medicine and Public Health, Madison, WI, USA.
Arjun K VenkateshDepartment of Emergency Medicine and Center for Outcomes Research and Evaluation, Yale University School of Medicine, New Haven, CT, USA.
Monica ZhongBerbeeWalsh Department of Emergency Medicine, University of Wisconsin School of Medicine and Public Health, Madison, WI, USA.
Katherine TaylorBerbeeWalsh Department of Emergency Medicine, University of Wisconsin School of Medicine and Public Health, Madison, WI, USA.
Azita G HamedaniBerbeeWalsh Department of Emergency Medicine, University of Wisconsin School of Medicine and Public Health, Madison, WI, USA.
Eneida A MendonçaDepartment of Biostatistics and Medical Informatics, University of Wisconsin-Madison, Madison, WI, USA.
University of Wisconsin–Madison · USRegenstrief Institute · USYale University · US

Funding

Yale Clinical and Translational Science Award (U Component)UL1TR001863 · NCATS · YALE UNIVERSITY · PI John H. Krystal, LUCILA OHNO-MACHADO · 2016 to 2026
$102.9M
Mentoring and Research in Patient-Oriented Geriatric Emergency CareK24AG054560 · NIA · UNIVERSITY OF WISCONSIN-MADISON · PI SHAH, MANISH N · 2017 to 2021
$955k
AHRQ HHS K08HS024558
6 · The paper itself

Abstract

backgroundFalls among older adults are both a common reason for presentation to the emergency department, and a major source of morbidity and mortality. It is critical to identify fall patients quickly and reliably during, and immediately after, emergency department encounters in order to deliver appropriate care and referrals. Unfortunately, falls are difficult to identify without manual chart review, a time intensive process infeasible for many applications including surveillance and quality reporting. Here we describe a pragmatic NLP approach to automating fall identification.

methodsIn this single center retrospective review, 500 emergency department provider notes from older adult patients (age 65 and older) were randomly selected for analysis. A simple, rules-based NLP algorithm for fall identification was developed and evaluated on a development set of 1084 notes, then compared with identification by consensus of trained abstractors blinded to NLP results.

resultsThe NLP pipeline demonstrated a recall (sensitivity) of 95.8%, specificity of 97.4%, precision of 92.0%, and F1 score of 0.939 for identifying fall events within emergency physician visit notes, as compared to gold standard manual abstraction by human coders.

conclusionsOur pragmatic NLP algorithm was able to identify falls in ED notes with excellent precision and recall, comparable to that of more labor-intensive manual abstraction. This finding offers promise not just for improving research methods, but as a potential for identifying patients for targeted interventions, quality measure development and epidemiologic surveillance.

Indexed as

Accidental FallsAlgorithmsElectronic Health RecordsEmergency Service, HospitalNatural Language ProcessingAgedAged, 80 and overFemaleGeriatricsHumansMaleRetrospective StudiesElectronic health recordEmergency medicineFallsGeriatricsNatural language processing

Identifiers

PMID31331322
PMCPMC6647058
OpenAlexW2962766399

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.