Evidence map›Paper›PMID 34090671›Full record

ArticleSurgery2021

Natural language processing for the surveillance of postoperative venous thromboembolism.

Jianlin Shi, John F Hurdle, Stacy A Johnson, Jeffrey P Ferraro, David E Skarda, Samuel R G Finlayson, Matthew H Samore, Brian T Bucher

Abstract readMulticenter Study
In one paragraph

Article in Surgery, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 7 papers.

0numbers the graph read from it
0cells of the map it votes in
7citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

7 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

8 authors.

Jianlin ShiDepartment of Biomedical Informatics, University of Utah School of Medicine, Salt Lake City, UT.
John F HurdleDepartment of Biomedical Informatics, University of Utah School of Medicine, Salt Lake City, UT.
Stacy A JohnsonDepartment of Medicine, University of Utah School of Medicine, Salt Lake City, UT; Thrombosis Service, University of Utah Health, Salt Lake City, UT.
Jeffrey P FerraroDepartment of Medicine, University of Utah School of Medicine, Salt Lake City, UT; IDEAS Center 2.0, VA Salt Lake City Health Care System, Salt Lake City, UT.
David E SkardaIntermountain Healthcare, Salt Lake City, UT; Department of Surgery, University of Utah School of Medicine, Salt Lake City, UT.
Samuel R G FinlaysonDepartment of Surgery, University of Utah School of Medicine, Salt Lake City, UT. Electronic address: https://twitter.com/srgfin.
Matthew H SamoreDepartment of Medicine, University of Utah School of Medicine, Salt Lake City, UT; IDEAS Center 2.0, VA Salt Lake City Health Care System, Salt Lake City, UT.
Brian T BucherDepartment of Biomedical Informatics, University of Utah School of Medicine, Salt Lake City, UT; Department of Surgery, University of Utah School of Medicine, Salt Lake City, UT. Electronic address: brian.bucher@utah.edu.

Funding

Health Information Technology for Surveillance of Health Care-Associated InfectionsK08HS025776 · AHRQ · UNIVERSITY OF UTAH · PI BUCHER, BRIAN T · 2018 to 2022
$801k
From genomics to natural language processing: A protected environment for research computing in the health scienceS10OD021644 · OD · UNIVERSITY OF UTAH · PI CHEATHAM, THOMAS E. · 2017 to 2017
$494k
AHRQ HHS K08 HS025776NIH HHS S10 OD021644
6 · The paper itself

Abstract

backgroundThe objective of this study was to develop a portal natural language processing approach to aid in the identification of postoperative venous thromboembolism events from free-text clinical notes.

methodsWe abstracted clinical notes from 25,494 operative events from 2 independent health care systems. A venous thromboembolism detected as part of the American College of Surgeons National Surgical Quality Improvement Program (ACS NSQIP) was used as the reference standard. A natural language processing engine, easy clinical information extractor-pulmonary embolism/deep vein thrombosis (EasyCIE-PEDVT), was trained to detect pulmonary embolism and deep vein thrombosis from clinical notes. International Classification of Diseases (ICD) discharge diagnosis codes for venous thromboembolism were used as baseline comparators. The classification performance of EasyCIE-PEDVT was compared with International Classification of Diseases codes using sensitivity, specificity, area under the receiver operating characteristic curve, using an internal and external validation cohort.

resultsTo detect pulmonary embolism, EasyCIE-PEDVT had a sensitivity of 0.714 and 0.815 in internal and external validation, respectively. To detect deep vein thrombosis, EasyCIE-PEDVT had a sensitivity of 0.846 and 0.849 in internal and external validation, respectively. EasyCIE-PEDVT had significantly higher discrimination for deep vein thrombosis compared with International Classification of Diseases codes in internal validation (area under the receiver operating characteristic curve: 0.920 vs 0.761; P < .001) and external validation (area under the receiver operating characteristic curve: 0.921 vs 0.794; P < .001). There was no significant difference in the discrimination for pulmonary embolism between EasyCIE-PEDVT and ICD codes.

conclusionAccurate surveillance of postoperative venous thromboembolism may be achieved using natural language processing on clinical notes in 2 independent health care systems. These findings suggest natural language processing may augment manual chart abstraction for large registries such as NSQIP.

Indexed as

Natural Language ProcessingQuality ImprovementCohort StudiesFemaleHumansMaleMiddle AgedPostoperative ComplicationsRetrospective StudiesROC CurveVenous Thrombosis

Identifiers

PMID34090671
PMCPMC8490271

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.