Evidence map›Paper›PMID 32130118›Full record

ArticleJournal of medical Internet research2020

A Framework for Applying Natural Language Processing in Digital Health Interventions.

Burkhardt Funk, Shiri Sadeh-Sharvit, Ellen E Fitzsimmons-Craft, Mickey Todd Trockel, Grace E Monterubio, Neha J Goel, Katherine N Balantekin, Dawn M Eichen, Rachael E Flatt, Marie-Laure Firebaugh and 5 more

Abstract read
In one paragraph

Article in Journal of medical Internet research, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 23 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
23citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

23 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Trial
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Review
  14. Article
  15. Article
  16. Review
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

15 authors.

Burkhardt Funk *Leuphana University, Institute of Information Systems, Lueneburg, Germany.ORCID 0000-0001-5855-2666
Shiri Sadeh-Sharvit *Palo Alto University, Center for m2Health, Palo Alto, CA, United States.ORCID 0000-0001-6499-9034
Ellen E Fitzsimmons-CraftWashington University in St Louis, Department of Psychiatry, St Louis, MO, United States.ORCID 0000-0001-7064-3835
Mickey Todd TrockelStanford University, Department of Psychiatry and Behavioral Sciences, Stanford, CA, United States.ORCID 0000-0001-7191-5791
Grace E MonterubioWashington University in St Louis, Department of Psychiatry, St Louis, MO, United States.ORCID 0000-0001-9691-4832
Neha J GoelPalo Alto University, Center for m2Health, Palo Alto, CA, United States.ORCID 0000-0002-8191-3359
Katherine N BalantekinWashington University in St Louis, Department of Psychiatry, St Louis, MO, United States.ORCID 0000-0002-6760-2714
Dawn M EichenWashington University in St Louis, Department of Psychiatry, St Louis, MO, United States.ORCID 0000-0001-5619-2177
Rachael E FlattPalo Alto University, Center for m2Health, Palo Alto, CA, United States.ORCID 0000-0002-2661-7987
Marie-Laure FirebaughWashington University in St Louis, Department of Psychiatry, St Louis, MO, United States.ORCID 0000-0002-3663-131X
Corinna JacobiTechnische Universität, Institute of Clinical Psychology and Psychotherapy, Dresden, Germany.ORCID 0000-0002-0982-0596
Andrea K GrahamNorthwestern University, Department of Medical Social Sciences, Chicago, IL, United States.ORCID 0000-0002-9736-8906
Mark HoogendoornVrije Universiteit, Department of Computer Science, Amsterdam, Netherlands.ORCID 0000-0003-3356-3574
Denise E WilfleyWashington University in St Louis, Department of Psychiatry, St Louis, MO, United States.ORCID 0000-0002-3599-8689
C Barr TaylorPalo Alto University, Center for m2Health, Palo Alto, CA, United States.ORCID 0000-0002-4564-6548

Funding

Washington University Nutrition Obesity Research CenterP30DK056341 · NIDDK · WASHINGTON UNIVERSITY · PI Brian N Finck · 1999 to 2026
$30.2M
WUSTL Transdisciplinary Pre- and Postdoctoral Training Program in Obesity and Cardiovascular DiseaseT32HL130357 · NHLBI · WASHINGTON UNIVERSITY · PI WILFLEY, DENISE ELLA · 2016 to 2025
$4.3M
Using Technology to Improve Eating Disorders TreatmentR01MH100455 · NIMH · WASHINGTON UNIVERSITY · PI TAYLOR, CRAIG BARR, WILFLEY, DENISE ELLA · 2013 to 2017
$3.4M
NUTRITION-BEHAVIORAL CARDIOVASCULAR DISEASE PREVENTIONT32HL007456 · NHLBI · WASHINGTON UNIVERSITY · PI WILFLEY, DENISE ELLA · 1985 to 2014
$2.9M
Novel Executive Function Training for ObesityK23DK114480 · NIDDK · UNIVERSITY OF CALIFORNIA, SAN DIEGO · PI EICHEN, DAWN · 2018 to 2022
$995k
Developing an Optimized Conversational Agent or "Chatbot" to Facilitate Mental Health Services Use in Individuals with Eating DisordersK08MH120341 · NIMH · WASHINGTON UNIVERSITY · PI FITZSIMMONS-CRAFT, ELLEN E. · 2019 to 2023
$824k
Testing Intervention Strategies for Addressing Obesity and Binge EatingK01DK116925 · NIDDK · NORTHWESTERN UNIVERSITY AT CHICAGO · PI GRAHAM, ANDREA KASS · 2018 to 2022
$799k
Analysis of Behavioral Interventions for Pediatric ObesityF32HD089586 · NICHD · UNIVERSITY OF CHICAGO · PI GRAHAM, ANDREA KASS · 2016 to 2017
$106k
NHLBI NIH HHS T32 HL007456NHLBI NIH HHS T32 HL130357NICHD NIH HHS F32 HD089586NIDDK NIH HHS K01 DK116925NIDDK NIH HHS K23 DK114480NIDDK NIH HHS P30 DK056341NIMH NIH HHS K08 MH120341NIMH NIH HHS R01 MH100455
6 · The paper itself

Abstract

backgroundDigital health interventions (DHIs) are poised to reduce target symptoms in a scalable, affordable, and empirically supported way. DHIs that involve coaching or clinical support often collect text data from 2 sources: (1) open correspondence between users and the trained practitioners supporting them through a messaging system and (2) text data recorded during the intervention by users, such as diary entries. Natural language processing (NLP) offers methods for analyzing text, augmenting the understanding of intervention effects, and informing therapeutic decision making.

objectiveThis study aimed to present a technical framework that supports the automated analysis of both types of text data often present in DHIs. This framework generates text features and helps to build statistical models to predict target variables, including user engagement, symptom change, and therapeutic outcomes.

methodsWe first discussed various NLP techniques and demonstrated how they are implemented in the presented framework. We then applied the framework in a case study of the Healthy Body Image Program, a Web-based intervention trial for eating disorders (EDs). A total of 372 participants who screened positive for an ED received a DHI aimed at reducing ED psychopathology (including binge eating and purging behaviors) and improving body image. These users generated 37,228 intervention text snippets and exchanged 4285 user-coach messages, which were analyzed using the proposed model.

resultsWe applied the framework to predict binge eating behavior, resulting in an area under the curve between 0.57 (when applied to new users) and 0.72 (when applied to new symptom reports of known users). In addition, initial evidence indicated that specific text features predicted the therapeutic outcome of reducing ED symptoms.

conclusionsThe case study demonstrates the usefulness of a structured approach to text data analytics. NLP techniques improve the prediction of symptom changes in DHIs. We present a technical framework that can be easily applied in other clinical trials and clinical presentations and encourage other groups to apply the framework in similar contexts.

Indexed as

Natural Language ProcessingFemaleHealth PromotionHumansMaleTelemedicinedigital health interventionsDigital Health Interventions Text Analytics (DHITA)eating disordersguided self-helpnatural language processingtext mining

Identifiers

PMID32130118
PMCPMC7059510

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.