Evidence map›Paper›PMID 29447188›Full record

ArticlePloS one2018

Comparing deep learning and concept extraction based methods for patient phenotyping from clinical narratives.

Sebastian Gehrmann, Franck Dernoncourt, Yeran Li, Eric T Carlson, Joy T Wu, Jonathan Welt, John Foote, Edward T Moseley, David W Grant, Patrick D Tyler and 1 more

Abstract readComparative Study
In one paragraph

Article in PloS one, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 78 papers.

0numbers the graph read from it
0cells of the map it votes in
78citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

78 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Review
  6. Article
  7. Utility of word embeddings from large language models in medical diagnosis.Journal of the American Medical Informatics Association : JAMIA · 2025
    Article
  8. Article
  9. A hybrid framework with large language models for rare disease phenotyping.BMC medical informatics and decision making · 2024
    Article
  10. Article
  11. Article
  12. Article
  13. Review
  14. Article
  15. Review
  16. Semi-supervised ROC analysis for reliable and streamlined evaluation of phenotyping algorithms.Journal of the American Medical Informatics Association : JAMIA · 2024
    Article
  17. Comparison of Prompt Engineering and Fine-Tuning Strategies in Large Language Models in the Classification of Clinical Notes.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2024
    Article
  18. Article
  19. Automated HIV Case Identification from the MIMIC-IV Database.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2024
    Article
  20. Selective prediction for extracting unstructured clinical data.Journal of the American Medical Informatics Association : JAMIA · 2023
    Article

18 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors.

Sebastian GehrmannMIT Critical Data, Laboratory for Computational Physiology, Cambridge, MA, United States of America.ORCID 0000-0002-8257-9516
Franck DernoncourtMIT Critical Data, Laboratory for Computational Physiology, Cambridge, MA, United States of America.
Yeran LiMIT Critical Data, Laboratory for Computational Physiology, Cambridge, MA, United States of America.
Eric T CarlsonMIT Critical Data, Laboratory for Computational Physiology, Cambridge, MA, United States of America.
Joy T WuMIT Critical Data, Laboratory for Computational Physiology, Cambridge, MA, United States of America.
Jonathan WeltMIT Critical Data, Laboratory for Computational Physiology, Cambridge, MA, United States of America.
John FooteMIT Critical Data, Laboratory for Computational Physiology, Cambridge, MA, United States of America.
Edward T MoseleyMIT Critical Data, Laboratory for Computational Physiology, Cambridge, MA, United States of America.
David W GrantMIT Critical Data, Laboratory for Computational Physiology, Cambridge, MA, United States of America.
Patrick D TylerMIT Critical Data, Laboratory for Computational Physiology, Cambridge, MA, United States of America.
Leo A CeliMIT Critical Data, Laboratory for Computational Physiology, Cambridge, MA, United States of America.

Funding

Critical Care Informatics: Ethical considerations around the use and sharing of health-related dataR01EB017205 · NIBIB · MASSACHUSETTS INSTITUTE OF TECHNOLOGY · PI CELI, LEO ANTHONY G, MARK, ROGER GREENWOOD · 2014 to 2021
$3.8M
Critical Care InformaticsR56EB017205 · NIBIB · MASSACHUSETTS INSTITUTE OF TECHNOLOGY · PI CELI, LEO ANTHONY G, GHASSEMI, MARZYEH · 2018 to 2023
$783k
NIBIB NIH HHS R01 EB017205NIBIB NIH HHS R56 EB017205
6 · The paper itself

Abstract

In secondary analysis of electronic health records, a crucial task consists in correctly identifying the patient cohort under investigation. In many cases, the most valuable and relevant information for an accurate classification of medical conditions exist only in clinical narratives. Therefore, it is necessary to use natural language processing (NLP) techniques to extract and evaluate these narratives. The most commonly used approach to this problem relies on extracting a number of clinician-defined medical concepts from text and using machine learning techniques to identify whether a particular patient has a certain condition. However, recent advances in deep learning and NLP enable models to learn a rich representation of (medical) language. Convolutional neural networks (CNN) for text classification can augment the existing techniques by leveraging the representation of language to learn which phrases in a text are relevant for a given medical condition. In this work, we compare concept extraction based methods with CNNs and other commonly used models in NLP in ten phenotyping tasks using 1,610 discharge summaries from the MIMIC-III database. We show that CNNs outperform concept extraction based methods in almost all of the tasks, with an improvement in F1-score of up to 26 and up to 7 percentage points in area under the ROC curve (AUC). We additionally assess the interpretability of both approaches by presenting and evaluating methods that calculate and extract the most salient phrases for a prediction. The results indicate that CNNs are a valid alternative to existing approaches in patient phenotyping and cohort identification, and should be further investigated. Moreover, the deep learning approach presented in this paper can be used to assist clinicians during chart review or support the extraction of billing codes from text by identifying and highlighting relevant phrases for various medical conditions.

Indexed as

LanguageLearningPhenotypeHumans

Identifiers

PMID29447188
PMCPMC5813927

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.