Evidence map›Paper›PMID 24786209›Full record

ArticleJournal of the American Medical Informatics Association : JAMIA

N-gram support vector machines for scalable procedure and diagnosis classification, with applications to clinical free text data from the intensive care unit.

Ben J Marafino, Jason M Davies, Naomi S Bardach, Mitzi L Dean, R Adams Dudley

Open access · bronzeAbstract read
In one paragraph

Article in Journal of the American Medical Informatics Association : JAMIA. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 27 papers.

0numbers the graph read from it
0cells of the map it votes in
27citing papers in PubMed
5.1field-weighted citation impact, top 4% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

27 citing papers in PubMed, 83 citations in OpenAlex.

  1. Article
  2. A Traumatic Brain Injury Prescreening Tool for Intimate Partner Violence Patients Using Initial Clinical Reports and Machine Learning.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2024
    Article
  3. Review
  4. Natural Language Processing Methods to Identify Oncology Patients at High Risk for Acute Care with Clinical Notes.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2023
    Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Applications of machine learning in acute care research.Journal of the American College of Emergency Physicians open · 2020
    Article
  10. Article
  11. Extracting Smoking Status from Electronic Health Records Using NLP and Deep Learning.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2020
    Article
  12. Medical knowledge infused convolutional neural networks for cohort selection in clinical trials.Journal of the American Medical Informatics Association : JAMIA · 2019
    Article
  13. Article
  14. Review
  15. Article
  16. Article
  17. Interpretable Predictions of Clinical Outcomes with An Attention-based Recurrent Neural Network.ACM-BCB ... ... : the ... ACM Conference on Bioinformatics, Computational Biology and Biomedicine. ACM Conference on Bioinformatics, Computational Biology and Biomedicine · 2017
    Article
  18. DeepDeath: Learning to predict the underlying cause of death with Big Data.Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference · 2017
    Article
  19. Content Coding of Psychotherapy Transcripts Using Labeled Topic Models.IEEE journal of biomedical and health informatics · 2017
    Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors at 1 institution in 1 country.

Ben J MarafinoPhilip R. Lee Institute for Health Policy Studies, School of Medicine, University of California, San Francisco, California, USA.
Jason M DaviesPhilip R. Lee Institute for Health Policy Studies, School of Medicine, University of California, San Francisco, California, USA Department of Neurosurgery, University of California, San Francisco, California, USA.
Naomi S BardachPhilip R. Lee Institute for Health Policy Studies, School of Medicine, University of California, San Francisco, California, USA Department of Pediatrics, University of California, San Francisco, California, USA.
Mitzi L DeanPhilip R. Lee Institute for Health Policy Studies, School of Medicine, University of California, San Francisco, California, USA.
R Adams DudleyPhilip R. Lee Institute for Health Policy Studies, School of Medicine, University of California, San Francisco, California, USA Center for Healthcare Value, University of California, San Francisco, California, USA Department of Epidemiology and Biostatistics, University of California, San Francisco, California, USA Department of Medicine, University of California, San Francisco, California, USA.
University of California, San Francisco · US

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundExisting risk adjustment models for intensive care unit (ICU) outcomes rely on manual abstraction of patient-level predictors from medical charts. Developing an automated method for abstracting these data from free text might reduce cost and data collection times.

objectiveTo develop a support vector machine (SVM) classifier capable of identifying a range of procedures and diagnoses in ICU clinical notes for use in risk adjustment. MATERIALS AND

methodsWe selected notes from 2001-2008 for 4191 neonatal ICU (NICU) and 2198 adult ICU patients from the MIMIC-II database from the Beth Israel Deaconess Medical Center. Using these notes, we developed an implementation of the SVM classifier to identify procedures (mechanical ventilation and phototherapy in NICU notes) and diagnoses (jaundice in NICU and intracranial hemorrhage (ICH) in adult ICU). On the jaundice classification task, we also compared classifier performance using n-gram features to unigrams with application of a negation algorithm (NegEx).

resultsOur classifier accurately identified mechanical ventilation (accuracy=0.982, F1=0.954) and phototherapy use (accuracy=0.940, F1=0.912), as well as jaundice (accuracy=0.898, F1=0.884) and ICH diagnoses (accuracy=0.938, F1=0.943). Including bigram features improved performance on the jaundice (accuracy=0.898 vs 0.865) and ICH (0.938 vs 0.927) tasks, and outperformed NegEx-derived unigram features (accuracy=0.898 vs 0.863) on the jaundice task. DISCUSSION: Overall, a classifier using n-gram support vectors displayed excellent performance characteristics. The classifier generalizes to diverse patient populations, diagnoses, and procedures.

conclusionsSVM-based classifiers can accurately identify procedure status and diagnoses among ICU patients, and including n-gram features improves performance, compared to existing methods.

Indexed as

Electronic Health RecordsInformation Storage and RetrievalSupport Vector MachineAdultClassificationHumansInfant, NewbornIntensive Care UnitsJaundice, NeonatalPhototherapyRespiration, ArtificialclassificationICUn-gramRisk adjustmentSVM

Identifiers

PMID24786209
PMCPMC4147615
OpenAlexW2106107776

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.