Evidence map›Paper›PMID 38564502›Full record

ArticlePLOS digital health2024

Infusing behavior science into large language models for activity coaching.

Narayan Hegde, Madhurima Vardhan, Deepak Nathani, Emily Rosenzweig, Cathy Speed, Alan Karthikesalingam, Martin Seneviratne

Erratum issued Registry-linked trialAbstract read
In one paragraph

Article in PLOS digital health, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. An erratum has been issued. It is linked to trial NCT06798311 (Reducing Disparities in Urinary Control Symptoms for Minority Women), which is not on this map. Cited by 13 papers.

0numbers the graph read from it
0cells of the map it votes in
13citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT06798311 narecruitingnot on this map

Reducing Disparities in Urinary Control Symptoms for Minority Women

TypeinterventionalSponsorUniversity of ChicagoRan2024 to 2027Enrolled80ConditionsUrinary Incontinence (UI), Lower Urinary Tract Symptoms (LUTS), Pelvic Floor DisorderArmsSUPPORT workbook
3 · Its place in the literature

Who cites it

13 citing papers in PubMed.

  1. Article
  2. Review
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Review
  12. Article
  13. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

7 authors.

Narayan HegdeGoogle Research, Bangalore, India.ORCID https://orcid.org/0000-0002-8422-2908
Madhurima VardhanGoogle Research, Bangalore, India.
Deepak NathaniGoogle Research, Bangalore, India.
Emily RosenzweigVerily Life Sciences, San Francisco, United States of America.
Cathy SpeedGoogle Health, London, United Kingdom.
Alan KarthikesalingamGoogle Health, London, United Kingdom.
Martin SeneviratneGoogle Health, London, United Kingdom.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Large language models (LLMs) have shown promise for task-oriented dialogue across a range of domains. The use of LLMs in health and fitness coaching is under-explored. Behavior science frameworks such as COM-B, which conceptualizes behavior change in terms of capability (C), Opportunity (O) and Motivation (M), can be used to architect coaching interventions in a way that promotes sustained change. Here we aim to incorporate behavior science principles into an LLM using two knowledge infusion techniques: coach message priming (where exemplar coach responses are provided as context to the LLM), and dialogue re-ranking (where the COM-B category of the LLM output is matched to the inferred user need). Simulated conversations were conducted between the primed or unprimed LLM and a member of the research team, and then evaluated by 8 human raters. Ratings for the primed conversations were significantly higher in terms of empathy and actionability. The same raters also compared a single response generated by the unprimed, primed and re-ranked models, finding a significant uplift in actionability and empathy from the re-ranking technique. This is a proof of concept of how behavior science frameworks can be infused into automated conversational agents for a more principled coaching experience.

Identifiers

PMID38564502
PMCPMC10986996

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.