Evidence map›Paper›PMID 33970116›Full record

ArticleJMIR mental health2021

Knowledge-Infused Abstractive Summarization of Clinical Diagnostic Interviews: Framework Development Study.

Gaur Manas, Vamsi Aribandi, Ugur Kursuncu, Amanuel Alambo, Valerie L Shalin, Krishnaprasad Thirunarayan, Jonathan Beich, Meera Narasimhan, Amit Sheth

Open access · goldAbstract read
In one paragraph

Article in JMIR mental health, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
2.4field-weighted citation impact, top 10% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed, 21 citations in OpenAlex.

  1. Article
  2. Article
  3. Summarizing Patients' Problems from Hospital Progress Notes Using Pre-trained Sequence-to-Sequence Models.Proceedings of COLING. International Conference on Computational Linguistics · 2022
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors at 3 institutions in 1 country.

Gaur Manas *Artificial Intelligence Institute, University of South Carolina, Columbia, SC, United States.ORCID https://orcid.org/0000-0002-5411-2230
Vamsi AribandiKno.e.sis Center, Department of Computer Science and Engineering, Wright State University, Dayton, OH, United States.ORCID https://orcid.org/0000-0002-4345-1763
Ugur KursuncuArtificial Intelligence Institute, University of South Carolina, Columbia, SC, United States.ORCID https://orcid.org/0000-0002-8108-9590
Amanuel AlamboKno.e.sis Center, Department of Computer Science and Engineering, Wright State University, Dayton, OH, United States.ORCID https://orcid.org/0000-0002-3643-9053
Valerie L ShalinDepartment of Psychology, Wright State University, Dayton, OH, United States.ORCID https://orcid.org/0000-0001-8135-2793
Krishnaprasad ThirunarayanKno.e.sis Center, Department of Computer Science and Engineering, Wright State University, Dayton, OH, United States.ORCID https://orcid.org/0000-0002-7041-6963
Jonathan BeichDepartment of Psychiatry, Wright State University, Dayton, OH, United States.ORCID https://orcid.org/0000-0002-7656-8335
Meera NarasimhanDepartment of Neuropsychiatry & Behavioral Science, School of Medicine, Prisma Health, University of South Carolina, Columbia, SC, United States.ORCID https://orcid.org/0000-0002-7065-4435
Amit ShethArtificial Intelligence Institute, University of South Carolina, Columbia, SC, United States.ORCID https://orcid.org/0000-0002-0021-5293
Wright State University · USUniversity of South Carolina · USPrisma Health · US

Funding

Modeling Social Behavior for Healthcare Utilization in DepressionR01MH105384 · NIMH · WEILL MEDICAL COLL OF CORNELL UNIV · PI PATHAK, JYOTISHMAN, SHETH, AMIT P · 2015 to 2018
$2.1M
Trending: Social media analysis to monitor cannabis and synthetic cannabinoid useR01DA039454 · NIDA · WRIGHT STATE UNIVERSITY · PI DANIULAITYTE, RAMINTA, SHETH, AMIT P · 2014 to 2016
$1.4M
NIDA NIH HHS R01 DA039454NIMH NIH HHS R01 MH105384
6 · The paper itself

Abstract

backgroundIn clinical diagnostic interviews, mental health professionals (MHPs) implement a care practice that involves asking open questions (eg, "What do you want from your life?" "What have you tried before to bring change in your life?") while listening empathetically to patients. During these interviews, MHPs attempted to build a trusting human-centered relationship while collecting data necessary for professional medical and psychiatric care. Often, because of the social stigma of mental health disorders, patient discomfort in discussing their presenting problem may add additional complexities and nuances to the language they use, that is, hidden signals among noisy content. Therefore, a focused, well-formed, and elaborative summary of clinical interviews is critical to MHPs in making informed decisions by enabling a more profound exploration of a patient's behavior, especially when it endangers life.

objectiveThe aim of this study is to propose an unsupervised, knowledge-infused abstractive summarization (KiAS) approach that generates summaries to enable MHPs to perform a well-informed follow-up with patients to improve the existing summarization methods built on frequency heuristics by creating more informative summaries.

methodsOur approach incorporated domain knowledge from the Patient Health Questionnaire-9 lexicon into an integer linear programming framework that optimizes linguistic quality and informativeness. We used 3 baseline approaches: extractive summarization using the SumBasic algorithm, abstractive summarization using integer linear programming without the infusion of knowledge, and abstraction over extractive summarization to evaluate the performance of KiAS. The capability of KiAS on the Distress Analysis Interview Corpus-Wizard of Oz data set was demonstrated through interpretable qualitative and quantitative evaluations.

resultsKiAS generates summaries (7 sentences on average) that capture informative questions and responses exchanged during long (58 sentences on average), ambiguous, and sparse clinical diagnostic interviews. The summaries generated using KiAS improved upon the 3 baselines by 23.3%, 4.4%, 2.5%, and 2.2% for thematic overlap, Flesch Reading Ease, contextual similarity, and Jensen Shannon divergence, respectively. On the Recall-Oriented Understudy for Gisting Evaluation-2 and Recall-Oriented Understudy for Gisting Evaluation-L metrics, KiAS showed an improvement of 61% and 49%, respectively. We validated the quality of the generated summaries through visual inspection and substantial interrater agreement from MHPs.

conclusionsOur collaborator MHPs observed the potential utility and significant impact of KiAS in leveraging valuable but voluminous communications that take place outside of normally scheduled clinical appointments. This study shows promise in generating semantically relevant summaries that will help MHPs make informed decisions about patient status.

Indexed as

abstractive summarizationdistress clinical diagnostic interviewshealthcare informaticsinterpretable evaluationsknowledge-infusionPatient Health Questionnaire-9

Identifiers

PMID33970116
PMCPMC8145083
OpenAlexW3135413417

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.