Evidence map›Paper›PMID 27185608›Full record

ArticleJournal of biomedical informatics2016

A study of the effectiveness of machine learning methods for classification of clinical interview fragments into a large number of categories.

Mehedi Hasan, Alexander Kotov, April Carcone, Ming Dong, Sylvie Naar, Kathryn Brogan Hartlieb

Abstract read
In one paragraph

Article in Journal of biomedical informatics, 2016. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 15 papers.

0numbers the graph read from it
0cells of the map it votes in
15citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

15 citing papers in PubMed.

  1. Observational
  2. Article
  3. Article
  4. Language Use in Mother-Adolescent Dyadic Interaction: Preliminary Results.International Conference on Affective Computing and Intelligent Interaction and workshops : [proceedings]. ACII (Conference) · 2022
    Article
  5. Article
  6. Article
  7. Article
  8. Automated Analysis of Public Health Laboratory Test Results.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2020
    Article
  9. Article
  10. Computer-Based Readability Testing of Information Booklets for German Cancer Patients.Journal of cancer education : the official journal of the American Association for Cancer Education · 2019
    Article
  11. Article
  12. IMPROVING THE PREDICTION OF THERAPIST BEHAVIORS IN ADDICTION COUNSELING BY EXPLOITING CLASS CONFUSIONS.Proceedings of the ... IEEE International Conference on Acoustics, Speech, and Signal Processing. ICASSP (Conference) · 2019
    Article
  13. Article
  14. Deep Neural Architectures for Discourse Segmentation in E-Mail Based Behavioral Interventions.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2019
    Article
  15. Predicting the Outcome of Patient-Provider Communication Sequences using Recurrent Neural Networks and Probabilistic Models.AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science · 2018
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Mehedi Hasan *Department of Computer Science, Wayne State University, 5057 Woodward Ave, Detroit, MI 48202, USA.
Alexander Kotov *Department of Computer Science, Wayne State University, 5057 Woodward Ave, Detroit, MI 48202, USA.
April CarconePediatric Prevention Research Center, School of Medicine, Wayne State University, 540 E Canfield St, Detroit, MI 48201, USA.
Ming DongDepartment of Computer Science, Wayne State University, 5057 Woodward Ave, Detroit, MI 48202, USA.
Sylvie NaarPediatric Prevention Research Center, School of Medicine, Wayne State University, 540 E Canfield St, Detroit, MI 48201, USA.
Kathryn Brogan HartliebDepartment of Dietetics and Nutrition, Florida International University, 11200 SW 8th St, Miami, FL 33199, USA.

Funding

Tumor Biology and Microenvironment (Program 1)P30CA022453 · NCI · WAYNE STATE UNIVERSITY · PI PAUL M STEMMER · 1985 to 2026
$68.4M
Interventionist Procedures for Adherence to Weight Loss Recs in Black AdolescentsU01HL097889 · NHLBI · WAYNE STATE UNIVERSITY · PI JEN, KAI-LIN CATHERINE, NAAR, SYLVIE · 2009 to 2013
$5.5M
NCI NIH HHS P30 CA022453NHLBI NIH HHS U01 HL097889
6 · The paper itself

Abstract

This study examines the effectiveness of state-of-the-art supervised machine learning methods in conjunction with different feature types for the task of automatic annotation of fragments of clinical text based on codebooks with a large number of categories. We used a collection of motivational interview transcripts consisting of 11,353 utterances, which were manually annotated by two human coders as the gold standard, and experimented with state-of-art classifiers, including Naïve Bayes, J48 Decision Tree, Support Vector Machine (SVM), Random Forest (RF), AdaBoost, DiscLDA, Conditional Random Fields (CRF) and Convolutional Neural Network (CNN) in conjunction with lexical, contextual (label of the previous utterance) and semantic (distribution of words in the utterance across the Linguistic Inquiry and Word Count dictionaries) features. We found out that, when the number of classes is large, the performance of CNN and CRF is inferior to SVM. When only lexical features were used, interview transcripts were automatically annotated by SVM with the highest classification accuracy among all classifiers of 70.8%, 61% and 53.7% based on the codebooks consisting of 17, 20 and 41 codes, respectively. Using contextual and semantic features, as well as their combination, in addition to lexical ones, improved the accuracy of SVM for annotation of utterances in motivational interview transcripts with a codebook consisting of 17 classes to 71.5%, 74.2%, and 75.1%, respectively. Our results demonstrate the potential of using machine learning methods in conjunction with lexical, semantic and contextual features for automatic annotation of clinical interview transcripts with near-human accuracy.

Indexed as

Decision TreesMachine LearningBayes TheoremData CurationSemanticsSupport Vector MachineAnnotation of clinical textDeep learningMachine learningMotivational interviewingText classification

Identifiers

PMID27185608
PMCPMC4987168

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.