Evidence map›Paper›PMID 22771529›Full record

ArticleJournal of the American Medical Informatics Association : JAMIA

Hiding in plain sight: use of realistic surrogates to reduce exposure of protected health information in clinical text.

David Carrell, Bradley Malin, John Aberdeen, Samuel Bayer, Cheryl Clark, Ben Wellner, Lynette Hirschman

Abstract readEvaluation Study
In one paragraph

Article in Journal of the American Medical Informatics Association : JAMIA. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 36 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
36citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

36 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Article
  4. Review
  5. Article
  6. The DRAGON benchmark for clinical NLP.NPJ digital medicine · 2025
    Article
  7. Robust privacy amidst innovation with large language models through a critical assessment of the risks.Journal of the American Medical Informatics Association : JAMIA · 2025
    Article
  8. DIRI: Adversarial Patient Reidentification with Large Language Models for Evaluating Clinical Text Anonymization.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2025
    Article
  9. Review
  10. Article
  11. Article
  12. MedAlign: A Clinician-Generated Dataset for Instruction Following with Electronic Medical Records.Proceedings of the ... AAAI Conference on Artificial Intelligence. AAAI Conference on Artificial Intelligence · 2024
    Article
  13. Article
  14. Pragmatic De-Identification of Cross-Domain Unstructured Documents: A Utility-Preserving Approach with Relation Extraction Filtering.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2024
    Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

David CarrellGroup Health Research Institute, Seattle, WA 98101, USA. carrell.d@ghc.org
Bradley Malin
John Aberdeen
Samuel Bayer
Cheryl Clark
Ben Wellner
Lynette Hirschman

Funding

eMERGE Coordinating Center - Administrative SupplementU01HG006385 · NHGRI · VANDERBILT UNIVERSITY · PI HARRIS, PAUL A. · 2011 to 2014
$5.4M
Vanderbilt Genome Electronic Records ProjectU01HG006378 · NHGRI · VANDERBILT UNIVERSITY · PI RODEN, DAN M · 2011 to 2014
$4.0M
Technologies to Enable Privacy in Biomedical DatabanksR01LM009989 · NLM · VANDERBILT UNIVERSITY MEDICAL CENTER · PI MALIN, BRADLEY A. · 2009 to 2014
$1.6M
NHGRI NIH HHS U01 HG006378NHGRI NIH HHS U01 HG006385NHGRI NIH HHS U01HG006385NLM NIH HHS R01 LM009989
6 · The paper itself

Abstract

objectiveSecondary use of clinical text is impeded by a lack of highly effective, low-cost de-identification methods. Both, manual and automated methods for removing protected health information, are known to leave behind residual identifiers. The authors propose a novel approach for addressing the residual identifier problem based on the theory of Hiding In Plain Sight (HIPS). MATERIALS AND

methodsHIPS relies on obfuscation to conceal residual identifiers. According to this theory, replacing the detected identifiers with realistic but synthetic surrogates should collectively render the few 'leaked' identifiers difficult to distinguish from the synthetic surrogates. The authors conducted a pilot study to test this theory on clinical narrative, de-identified by an automated system. Test corpora included 31 oncology and 50 family practice progress notes read by two trained chart abstractors and an informaticist.

resultsExperimental results suggest approximately 90% of residual identifiers can be effectively concealed by the HIPS approach in text containing average and high densities of personal identifying information. DISCUSSION: This pilot test suggests HIPS is feasible, but requires further evaluation. The results need to be replicated on larger corpora of diverse origin under a range of detection scenarios. Error analyses also suggest areas where surrogate generation techniques can be refined to improve efficacy.

conclusionsIf these results generalize to existing high-performing de-identification systems with recall rates of 94-98%, HIPS could increase the effective de-identification rates of these systems to levels above 99% without further advancements in system recall. Additional and more rigorous assessment of the HIPS approach is warranted.

Indexed as

Computer SecurityConfidentialityElectronic Health RecordsInformation DisseminationNatural Language ProcessingBiomedical ResearchData CollectionHumansPilot ProjectsUnited States

Identifiers

PMID22771529
PMCPMC3638183

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.