Evidence map›Paper›PMID 32769074›Full record

ArticleJMIR formative research2020

Natural Language Processing Tools for Assessing Progress and Outcome of Two Veteran Populations: Cohort Study From a Novel Online Intervention for Posttraumatic Growth.

Kim P Norman, Anita Govindjee, Seth R Norman, Michael Godoy, Kimberlie L Cerrone, Dustin W Kieschnick, William Kassler

Open access · goldAbstract read
In one paragraph

Article in JMIR formative research, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 9 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
9citing papers in PubMed, 2 pooled it
1.1field-weighted citation impact, top 14% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

9 citing papers in PubMed, 2 syntheses or guidelines pooled it, 21 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Article
  4. Article
  5. Review
  6. Peer Support Activities for Veterans, Serving Members, and Their Families: Results of a Scoping Review.International journal of environmental research and public health · 2023
    Article
  7. Article
  8. Article
  9. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors at 2 institutions in 1 country.

Kim P Norman *Young Adult and Family Center, UCSF Weill Institute for Neurosciences, University of California, San Francisco, CA, United States.ORCID https://orcid.org/0000-0002-9468-7602
Anita Govindjee *IBM Watson Health, IBM Corporation, Palo Alto, CA, United States.ORCID https://orcid.org/0000-0002-4955-7868
Seth R Norman *Tiatros, Inc, San Francisco, CA, United States.ORCID https://orcid.org/0000-0003-0566-5143
Michael Godoy *Young Adult and Family Center, UCSF Weill Institute for Neurosciences, University of California, San Francisco, CA, United States.ORCID https://orcid.org/0000-0001-9207-6042
Kimberlie L Cerrone *Tiatros, Inc, San Francisco, CA, United States.ORCID https://orcid.org/0000-0002-3493-6355
Dustin W Kieschnick *Young Adult and Family Center, UCSF Weill Institute for Neurosciences, University of California, San Francisco, CA, United States.ORCID https://orcid.org/0000-0002-4948-9631
William Kassler *IBM Watson Health, IBM Corporation, Palo Alto, CA, United States.ORCID https://orcid.org/0000-0003-0238-0898
University of California, San Francisco · USIBM (United States) · US

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundOver 100 million Americans lack affordable access to behavioral health care. Among these, military veterans are an especially vulnerable population. Military veterans require unique behavioral health services that can address military experiences and challenges transitioning to the civilian sector. Real-world programs to help veterans successfully transition to civilian life must build a sense of community, have the ability to scale, and be able to reach the many veterans who cannot or will not access care. Digitally based behavioral health initiatives have emerged within the past few years to improve this access to care. Our novel behavioral health intervention teaches mindfulness-based cognitive behavioral therapy and narrative therapy using peer support groups as guides, with human-facilitated asynchronous online discussions. Our study applies natural language processing (NLP) analytics to assess effectiveness of our online intervention in order to test whether NLP may provide insights and detect nuances of personal change and growth that are not currently captured by subjective symptom measures.

objectiveThis paper aims to study the value of NLP analytics in assessing progress and outcomes among combat veterans and military sexual assault survivors participating in novel online interventions for posttraumatic growth.

methodsIBM Watson and Linguistic Inquiry and Word Count tools were applied to the narrative writings of combat veterans and survivors of military sexual trauma who participated in novel online peer-supported group therapies for posttraumatic growth. Participants watched videos, practiced skills such as mindfulness meditation, told their stories through narrative writing, and participated in asynchronous, facilitated online discussions with peers. The writings, including online postings, by the 16 participants who completed the program were analyzed after completion of the program.

resultsOur results suggest that NLP can provide valuable insights on shifts in personality traits, personal values, needs, and emotional tone in an evaluation of our novel online behavioral health interventions. Emotional tone analysis demonstrated significant decreases in fear and anxiety, sadness, and disgust, as well as increases in joy. Significant effects were found for personal values and needs, such as needing or desiring closeness and helping others, and for personality traits of openness, conscientiousness, extroversion, agreeableness, and neuroticism (ie, emotional range). Participants also demonstrated increases in authenticity and clout (confidence) of expression. NLP results were generally supported by qualitative observations and analysis, structured data, and course feedback.

conclusionsThe aggregate of results in our study suggest that our behavioral health intervention was effective and that NLP can provide valuable insights on shifts in personality traits, personal values, and needs, as well as measure changes in emotional tone. NLP's sensitivity to changes in emotional tone, values, and personality strengths suggests the efficacy of NLP as a leading indicator of treatment progress.

Indexed as

emotional toneinternet-based cognitive behavioral therapymilitary sexual traumamindfulnessnarrative therapynatural language analysisonline interventionspersonalityPTSDvalues

Identifiers

PMID32769074
PMCPMC7542412
OpenAlexW3047654255

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.