Evidence map›Paper›PMID 32773639›Full record

ArticleAnnals of surgery2020

Portable Automated Surveillance of Surgical Site Infections Using Natural Language Processing: Development and Validation.

Brian T Bucher, Jianlin Shi, Jeffrey P Ferraro, David E Skarda, Matthew H Samore, John F Hurdle, Adi V Gundlapalli, Wendy W Chapman, Samuel R G Finlayson

Open access · greenAbstract readValidation Study
In one paragraph

Article in Annals of surgery, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 27 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
27citing papers in PubMed, 1 pooled it
3.9field-weighted citation impact, top 6% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

27 citing papers in PubMed, 1 synthesis or guideline pooled it, 43 citations in OpenAlex.

  1. Natural language processing in dermatology: A systematic literature review and state of the art.Journal of the European Academy of Dermatology and Venereology : JEADV · 2024
    Pooled it
  2. Observational
  3. Article
  4. Article
  5. Article
  6. Review
  7. Review
  8. Article
  9. Article
  10. Article
  11. Review
  12. Article
  13. Article
  14. Article
  15. Review
  16. Observational
  17. Article
  18. Review
  19. Article
  20. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

9 authors at 2 institutions in 1 country.

Brian T BucherDepartment of Surgery University of Utah School of Medicine, Salt Lake City, Utah.
Jianlin ShiDepartment of Biomedical Informatics, University of Utah School of Medicine, Salt Lake City, Utah.
Jeffrey P FerraroIntermountain Healthcare, Salt Lake City, Utah.
David E SkardaDepartment of Surgery University of Utah School of Medicine, Salt Lake City, Utah.
Matthew H SamoreDepartment of Medicine, University of Utah School of Medicine, Salt Lake City, Utah.
John F HurdleDepartment of Biomedical Informatics, University of Utah School of Medicine, Salt Lake City, Utah.
Adi V GundlapalliDepartment of Medicine, University of Utah School of Medicine, Salt Lake City, Utah.
Wendy W ChapmanDepartment of Biomedical Informatics, University of Utah School of Medicine, Salt Lake City, Utah.
Samuel R G FinlaysonDepartment of Surgery University of Utah School of Medicine, Salt Lake City, Utah.
University of Utah · USIntermountain Healthcare · US

Funding

Health Information Technology for Surveillance of Health Care-Associated InfectionsK08HS025776 · AHRQ · UNIVERSITY OF UTAH · PI BUCHER, BRIAN T · 2018 to 2022
$801k
From genomics to natural language processing: A protected environment for research computing in the health scienceS10OD021644 · OD · UNIVERSITY OF UTAH · PI CHEATHAM, THOMAS E. · 2017 to 2017
$494k
AHRQ HHS K08 HS025776NIH HHS S10 OD021644
6 · The paper itself

Abstract

objectivesWe present the development and validation of a portable NLP approach for automated surveillance of SSIs. SUMMARY OF BACKGROUND DATA: The surveillance of SSIs is labor-intensive limiting the generalizability and scalability of surgical quality surveillance programs.

methodsWe abstracted patient clinical text notes after surgical procedures from 2 independent healthcare systems using different electronic healthcare records. An SSI detected as part of the American College of Surgeons' National Surgical Quality Improvement Program was used as the reference standard. We developed a rules-based NLP system (Easy Clinical Information Extractor [CIE]-SSI) for operative event-level detection of SSIs using an training cohort (4574 operative events) from 1 healthcare system and then conducted internal validation on a blind cohort from the same healthcare system (1850 operative events) and external validation on a blind cohort from the second healthcare system (15,360 operative events). EasyCIE-SSI performance was measured using sensitivity, specificity, and area under the receiver-operating-curve (AUC).

resultsThe prevalence of SSI was 4% and 5% in the internal and external validation corpora. In internal validation, EasyCIE-SSI had a sensitivity, specificity, AUC of 94%, 88%, 0.912 for the detection of SSI, respectively. In external validation, EasyCIE-SSI had sensitivity, specificity, AUC of 79%, 92%, 0.852 for the detection of SSI, respectively. The sensitivity of EasyCIE-SSI decreased in clean, skin/subcutaneous, and outpatient procedures in the external validation compared to internal validation.

conclusionAutomated surveillance of SSIs can be achieved using NLP of clinical notes with high sensitivity and specificity.

Indexed as

Mobile ApplicationsNatural Language ProcessingAdultAgedCohort StudiesFemaleHumansMaleMiddle AgedPopulation SurveillanceQuality ImprovementSurgical Procedures, OperativeSurgical Wound Infection

Identifiers

PMID32773639
PMCPMC9040555
OpenAlexW3048403583

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.