Evidence map›Paper›PMID 33105045›Full record

ArticleJournal of gastroenterology and hepatology2021

Early identification of patients with acute gastrointestinal bleeding using natural language processing and decision rules.

Dennis Shung, Cynthia Tsay, Loren Laine, David Chang, Fan Li, Prem Thomas, Caitlin Partridge, Michael Simonov, Allen Hsiao, J Kenneth Tay and 1 more

Open access · greenAbstract read
In one paragraph

Article in Journal of gastroenterology and hepatology, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 15 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
15citing papers in PubMed, 2 pooled it
1.3field-weighted citation impact, top 19% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

15 citing papers in PubMed, 2 syntheses or guidelines pooled it, 21 citations in OpenAlex.

  1. Pooled it
  2. Using natural language processing in emergency medicine health service research: A systematic review and meta-analysis.Academic emergency medicine : official journal of the Society for Academic Emergency Medicine · 2024
    Pooled it
  3. Article
  4. Artificial intelligence for early diagnosis in emergency department.Journal of anesthesia, analgesia and critical care · 2026
    Review
  5. Review
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Deep learningWorld journal of gastroenterology · 2021
    Article
  14. Review
  15. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors at 3 institutions in 1 country.

Dennis ShungYale School of Medicine, New Haven, Connecticut, USA.ORCID https://orcid.org/0000-0001-8226-1842
Cynthia TsayYale School of Medicine, New Haven, Connecticut, USA.
Loren LaineSection of Digestive Diseases, Department of Medicine, Yale School of Medicine, New Haven, Connecticut, USA.ORCID https://orcid.org/0000-0002-4296-7901
David ChangComputational Biology and Bioinformatics, Yale University, New Haven, Connecticut, USA.
Fan LiDepartment of Biostatistics, Yale School of Public Health, New Haven, Connecticut, USA.
Prem ThomasYale School of Medicine, New Haven, Connecticut, USA.
Caitlin PartridgeClinical Informatics, Yale-New Haven Health System, New Haven, Connecticut, USA.
Michael SimonovYale School of Medicine, New Haven, Connecticut, USA.
Allen HsiaoYale School of Medicine, New Haven, Connecticut, USA.
J Kenneth TayDepartment of Statistics, Stanford University, Palo Alto, California, USA.
Andrew TaylorDepartment of Emergency Medicine, Yale School of Medicine, New Haven, Connecticut, USA.
Yale University · USPalo Alto University · USYale New Haven Health System · US

Funding

TRAINING PROGRAM IN INVESTIGATIVE GASTROENTEROLOGYT32DK007017 · NIDDK · YALE UNIVERSITY · PI Fred Sanford Gorelick, Liza Konnikova · 1986 to 2026
$7.1M
NIDDK NIH HHS T32 DK007017NIH HHS T32 DK007017
6 · The paper itself

Abstract

BACKGROUND AND

aimGuidelines recommend risk stratification scores in patients presenting with gastrointestinal bleeding (GIB), but such scores are uncommonly employed in practice. Automation and deployment of risk stratification scores in real time within electronic health records (EHRs) would overcome a major impediment. This requires an automated mechanism to accurately identify ("phenotype") patients with GIB at the time of presentation. The goal is to identify patients with acute GIB by developing and evaluating EHR-based phenotyping algorithms for emergency department (ED) patients.

methodsWe specified criteria using structured data elements to create rules for identifying patients and also developed multiple natural language processing (NLP)-based approaches for automated phenotyping of patients, tested them with tenfold cross-validation for 10 iterations (n = 7144) and external validation (n = 2988) and compared them with a standard method to identify patient conditions, the Systematized Nomenclature of Medicine. The gold standard for GIB diagnosis was the independent dual manual review of medical records. The primary outcome was the positive predictive value.

resultsA decision rule using GIB-specific terms from ED triage and ED review-of-systems assessment performed better than the Systematized Nomenclature of Medicine on internal validation and external validation (positive predictive value = 85% confidence interval:83%-87% vs 69% confidence interval:66%-72%; P < 0.001). The syntax-based NLP algorithm and Bidirectional Encoder Representation from Transformers neural network-based NLP algorithm had similar performance to the structured-data fields decision rule.

conclusionsAn automated decision rule employing GIB-specific triage and review-of-systems terms can be used to trigger EHR-based deployment of risk stratification models to guide clinical decision making in real time for patients with acute GIB presenting to the ED.

Indexed as

Clinical Decision RulesNatural Language ProcessingAcute DiseaseAlgorithmsEarly DiagnosisElectronic Health RecordsEmergency Service, HospitalFemaleGastrointestinal HemorrhageHumansMaleMiddle AgedRisk AssessmentTriageGastrointestinal hemorrhageInformaticsNatural language processing

Identifiers

PMID33105045
PMCPMC11874507
OpenAlexW3094616447

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.