Evidence map›Paper›PMID 31032481›Full record

ArticleJAMIA open2019

Weakly supervised natural language processing for assessing patient-centered outcome following prostate cancer treatment.

Imon Banerjee, Kevin Li, Martin Seneviratne, Michelle Ferrari, Tina Seto, James D Brooks, Daniel L Rubin, Tina Hernandez-Boussard

Abstract read
In one paragraph

Article in JAMIA open, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 27 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
27citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

27 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Review
  4. Review
  5. Article
  6. Review
  7. Article
  8. Knowledge-Informed Machine Learning for Cancer Diagnosis and Prognosis: A Review.IEEE transactions on automation science and engineering : a publication of the IEEE Robotics and Automation Society · 2025
    Article
  9. Article
  10. Review
  11. Article
  12. Review
  13. Article
  14. Machine learning approaches for electronic health records phenotyping: a methodical review.Journal of the American Medical Informatics Association : JAMIA · 2023
    Article
  15. Article
  16. Article
  17. Article
  18. Review
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Imon BanerjeeDepartment of Biomedical Data Science, Stanford University School of Medicine, Medical School Office Building (MSOB), 1265 Welch Road, Stanford, California 94305-5479, USA.
Kevin LiStanford University School of Medicine, 291 Campus Drive, Stanford, California 94305-5479, USA.
Martin SeneviratneDepartment of Biomedical Data Science, Stanford University School of Medicine, Medical School Office Building (MSOB), 1265 Welch Road, Stanford, California 94305-5479, USA.
Michelle FerrariDepartment of Urology - Divisions, Stanford University School of Medicine, 875 Blake Wilbur, Stanford, California 94305-5479, USA.
Tina SetoIRT Research Technology, Stanford University School of Medicine, Stanford, California 94305-5479, USA.
James D BrooksDepartment of Urology - Divisions, Stanford University School of Medicine, 875 Blake Wilbur, Stanford, California 94305-5479, USA.
Daniel L RubinDepartment of Biomedical Data Science, Stanford University School of Medicine, Medical School Office Building (MSOB), 1265 Welch Road, Stanford, California 94305-5479, USA.
Tina Hernandez-BoussardDepartment of Biomedical Data Science, Stanford University School of Medicine, Medical School Office Building (MSOB), 1265 Welch Road, Stanford, California 94305-5479, USA.

Funding

Utilizing Electronic Health Records to Measure and Improve Prostate Cancer CareR01CA183962 · NCI · STANFORD UNIVERSITY · PI HERNANDEZ-BOUSSARD, TINA · 2015 to 2019
$3.1M
NCI NIH HHS R01 CA183962
6 · The paper itself

Abstract

Background: The population-based assessment of patient-centered outcomes (PCOs) has been limited by the efficient and accurate collection of these data. Natural language processing (NLP) pipelines can determine whether a clinical note within an electronic medical record contains evidence on these data. We present and demonstrate the accuracy of an NLP pipeline that targets to assess the presence, absence, or risk discussion of two important PCOs following prostate cancer treatment: urinary incontinence (UI) and bowel dysfunction (BD). Methods: We propose a weakly supervised NLP approach which annotates electronic medical record clinical notes without requiring manual chart review. A weighted function of neural word embedding was used to create a sentence-level vector representation of relevant expressions extracted from the clinical notes. Sentence vectors were used as input for a multinomial logistic model, with output being either presence, absence or risk discussion of UI/BD. The classifier was trained based on automated sentence annotation depending only on domain-specific dictionaries (weak supervision). Results: The model achieved an average F1 score of 0.86 for the sentence-level, three-tier classification task (presence/absence/risk) in both UI and BD. The model also outperformed a pre-existing rule-based model for note-level annotation of UI with significant margin. Conclusions: We demonstrate a machine learning method to categorize clinical notes based on important PCOs that trains a classifier on sentence vector representations labeled with a domain-specific dictionary, which eliminates the need for manual engineering of linguistic rules or manual chart review for extracting the PCOs. The weakly supervised NLP pipeline showed promising sensitivity and specificity for identifying important PCOs in unstructured clinical text notes compared to rule-based algorithms.

Indexed as

natural language processingneural word embeddingpatient-centered outcomesprostate cancertext mining

Identifiers

PMID31032481
PMCPMC6482003

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.