Evidence map›Paper›PMID 31437930›Full record

ArticleStudies in health technology and informatics2019

Impact of De-Identification on Clinical Text Classification Using Traditional and Deep Learning Classifiers.

Jihad S Obeid, Paul M Heider, Erin R Weeda, Andrew J Matuskowitz, Christine M Carr, Kevin Gagnon, Tami Crawford, Stephane M Meystre

Abstract read
In one paragraph

Article in Studies in health technology and informatics, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 6 papers.

0numbers the graph read from it
0cells of the map it votes in
6citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

6 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Review
  6. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Jihad S ObeidBiomedical Informatics Center, Medical University of South Carolina, Charleston, SC, USA.
Paul M HeiderBiomedical Informatics Center, Medical University of South Carolina, Charleston, SC, USA.
Erin R WeedaDepartment of Clinical Pharmacy and Outcome Sciences, Medical University of South Carolina, Charleston, SC, USA.
Andrew J MatuskowitzDepartment of Emergency Medicine, Medical University of South Carolina, Charleston, SC, USA.
Christine M CarrDepartment of Emergency Medicine, Medical University of South Carolina, Charleston, SC, USA.
Kevin GagnonDepartment of Computer Science, University of South Carolina, Columbia, SC, USA.
Tami CrawfordBiomedical Informatics Center, Medical University of South Carolina, Charleston, SC, USA.
Stephane M MeystreBiomedical Informatics Center, Medical University of South Carolina, Charleston, SC, USA.

Funding

Subproject Title: Clinical Research Education, Mentoring and Career Development CoreU54GM104941 · NIGMS · UNIVERSITY OF DELAWARE · PI Gregory E Hicks · 2013 to 2026
$60.5M
South Carolina Clinical & Translational Research Institute (SCTR)UL1TR001450 · NCATS · MEDICAL UNIVERSITY OF SOUTH CAROLINA · PI BRADY, KATHLEEN T., FLUME, PATRICK A · 2015 to 2024
$41.1M
NCATS NIH HHS UL1 TR001450NIGMS NIH HHS U54 GM104941
6 · The paper itself

Abstract

Clinical text de-identification enables collaborative research while protecting patient privacy and confidentiality; however, concerns persist about the reduction in the utility of the de-identified text for information extraction and machine learning tasks. In the context of a deep learning experiment to detect altered mental status in emergency department provider notes, we tested several classifiers on clinical notes in their original form and on their automatically de-identified counterpart. We tested both traditional bag-of-words based machine learning models as well as word-embedding based deep learning models. We evaluated the models on 1,113 history of present illness notes. A total of 1,795 protected health information tokens were replaced in the de-identification process across all notes. The deep learning models had the best performance with accuracies of 95% on both original and de-identified notes. However, there was no significant difference in the performance of any of the models on the original vs. the de-identified notes.

Indexed as

Data AnonymizationDeep LearningConfidentialityElectronic Health RecordsHumansMachine LearningData AnonymizationMachine LearningNatural Language Processing

Identifiers

PMID31437930
PMCPMC6779034

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.