Evidence map›Paper›PMID 24169276›Full record

ArticleJournal of the American Medical Informatics Association : JAMIA2013

Validating a strategy for psychosocial phenotyping using a large corpus of clinical text.

Adi V Gundlapalli, Andrew Redd, Marjorie Carter, Guy Divita, Shuying Shen, Miland Palmer, Matthew H Samore

Abstract read
In one paragraph

Article in Journal of the American Medical Informatics Association : JAMIA, 2013. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 19 papers.

0numbers the graph read from it
0cells of the map it votes in
19citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

19 citing papers in PubMed.

  1. Article
  2. Article
  3. Review
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Review
  11. Empirical advances with text mining of electronic health records.BMC medical informatics and decision making · 2017
    Article
  12. 'Big data' in mental health research: current status and emerging possibilities.Social psychiatry and psychiatric epidemiology · 2016
    Review
  13. Article
  14. Ensembles of NLP Tools for Data Element Extraction from Clinical Notes.AMIA ... Annual Symposium proceedings. AMIA Symposium · 2016
    Article
  15. Review
  16. Big data in medicine is driving big changes.Yearbook of medical informatics · 2014
    Review
  17. Article
  18. Article
  19. CQL4NLP: Development and Integration of FHIR NLP Extensions in Clinical Quality Language for EHR-driven Phenotyping.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Adi V GundlapalliIDEAS Center, VA Salt Lake City Health Care System, Salt Lake City, Utah, USA.
Andrew Redd
Marjorie Carter
Guy Divita
Shuying Shen
Miland Palmer
Matthew H Samore

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectiveTo develop algorithms to improve efficiency of patient phenotyping using natural language processing (NLP) on text data. Of a large number of note titles available in our database, we sought to determine those with highest yield and precision for psychosocial concepts. MATERIALS AND

methodsFrom a database of over 1 billion documents from US Department of Veterans Affairs medical facilities, a random sample of 1500 documents from each of 218 enterprise note titles were chosen. Psychosocial concepts were extracted using a UIMA-AS-based NLP pipeline (v3NLP), using a lexicon of relevant concepts with negation and template format annotators. Human reviewers evaluated a subset of documents for false positives and sensitivity. High-yield documents were identified by hit rate and precision. Reasons for false positivity were characterized.

resultsA total of 58 707 psychosocial concepts were identified from 316 355 documents for an overall hit rate of 0.2 concepts per document (median 0.1, range 1.6-0). Of 6031 concepts reviewed from a high-yield set of note titles, the overall precision for all concept categories was 80%, with variability among note titles and concept categories. Reasons for false positivity included templating, negation, context, and alternate meaning of words. The sensitivity of the NLP system was noted to be 49% (95% CI 43% to 55%).

conclusionsPhenotyping using NLP need not involve the entire document corpus. Our methods offer a generalizable strategy for scaling NLP pipelines to large free text corpora with complex linguistic annotations in attempts to identify patients of a certain phenotype.

Indexed as

AlgorithmsElectronic Health RecordsNatural Language ProcessingPhenotypePsychologyHumansUnited StatesUnited States Department of Veterans Affairsclinical informaticshigh through-putnatural language processingpatient phenotypepsychosocial concepts

Identifiers

PMID24169276
PMCPMC3861921

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.