Evidence map›Paper›PMID 32000770›Full record

ArticleBMC medical informatics and decision making2020

Customization scenarios for de-identification of clinical notes.

Tzvika Hartman, Michael D Howell, Jeff Dean, Shlomo Hoory, Ronit Slyper, Itay Laish, Oren Gilon, Danny Vainstein, Greg Corrado, Katherine Chou and 9 more

Abstract read
In one paragraph

Article in BMC medical informatics and decision making, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 14 papers.

0numbers the graph read from it
0cells of the map it votes in
14citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

14 citing papers in PubMed.

  1. Review
  2. Article
  3. Article
  4. Review
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Review
  11. Review
  12. Article
  13. Improving domain adaptation in de-identification of electronic health records through self-training.Journal of the American Medical Informatics Association : JAMIA · 2021
    Article
  14. Deidentification of free-text medical records using pre-trained bidirectional transformers.Proceedings of the ACM Conference on Health, Inference, and Learning · 2020
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

19 authors.

Tzvika HartmanGoogle Research, Google LLC, 1600 Amphitheatre Parkway, Mountain View, CA, USA.
Michael D HowellGoogle Research, Google LLC, 1600 Amphitheatre Parkway, Mountain View, CA, USA.
Jeff DeanGoogle Research, Google LLC, 1600 Amphitheatre Parkway, Mountain View, CA, USA.
Shlomo HooryGoogle Research, Google LLC, 1600 Amphitheatre Parkway, Mountain View, CA, USA. hoorys@google.com.ORCID 0000-0002-8166-4428
Ronit SlyperGoogle Research, Google LLC, 1600 Amphitheatre Parkway, Mountain View, CA, USA.
Itay LaishGoogle Research, Google LLC, 1600 Amphitheatre Parkway, Mountain View, CA, USA.
Oren GilonGoogle Research, Google LLC, 1600 Amphitheatre Parkway, Mountain View, CA, USA.
Danny VainsteinGoogle Research, Google LLC, 1600 Amphitheatre Parkway, Mountain View, CA, USA.
Greg CorradoGoogle Research, Google LLC, 1600 Amphitheatre Parkway, Mountain View, CA, USA.
Katherine ChouGoogle Research, Google LLC, 1600 Amphitheatre Parkway, Mountain View, CA, USA.
Ming Jack PoGoogle Research, Google LLC, 1600 Amphitheatre Parkway, Mountain View, CA, USA.
Jutta Williams, Palo Alto, CA, USA.
Scott EllisGoogle Research, Google LLC, 1600 Amphitheatre Parkway, Mountain View, CA, USA.
Gavin BeeGoogle Research, Google LLC, 1600 Amphitheatre Parkway, Mountain View, CA, USA.
Avinatan HassidimGoogle Research, Google LLC, 1600 Amphitheatre Parkway, Mountain View, CA, USA.
Rony AmiraGoogle Research, Google LLC, 1600 Amphitheatre Parkway, Mountain View, CA, USA.
Genady BeryozkinGoogle Research, Google LLC, 1600 Amphitheatre Parkway, Mountain View, CA, USA.
Idan SzpektorGoogle Research, Google LLC, 1600 Amphitheatre Parkway, Mountain View, CA, USA.
Yossi MatiasGoogle Research, Google LLC, 1600 Amphitheatre Parkway, Mountain View, CA, USA.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundAutomated machine-learning systems are able to de-identify electronic medical records, including free-text clinical notes. Use of such systems would greatly boost the amount of data available to researchers, yet their deployment has been limited due to uncertainty about their performance when applied to new datasets.

objectiveWe present practical options for clinical note de-identification, assessing performance of machine learning systems ranging from off-the-shelf to fully customized.

methodsWe implement a state-of-the-art machine learning de-identification system, training and testing on pairs of datasets that match the deployment scenarios. We use clinical notes from two i2b2 competition corpora, the Physionet Gold Standard corpus, and parts of the MIMIC-III dataset.

resultsFully customized systems remove 97-99% of personally identifying information. Performance of off-the-shelf systems varies by dataset, with performance mostly above 90%. Providing a small labeled dataset or large unlabeled dataset allows for fine-tuning that improves performance over off-the-shelf systems.

conclusionHealth organizations should be aware of the levels of customization available when selecting a de-identification deployment solution, in order to choose the one that best matches their resources and target performance level.

Indexed as

Electronic Health RecordsData AnonymizationDatasets as TopicHumansMachine LearningClinical notesDe-identificationElectronic health recordsFree textNatural language processingRecurrent neural networks

Identifiers

PMID32000770
PMCPMC6993314

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.