Evidence map›Paper›PMID 34563161›Full record

ArticleBMC public health2021

Evaluating the use of a recommender system for selecting optimal messages for smoking cessation: patterns and effects of user-system engagement.

Jinying Chen, Thomas K Houston, Jamie M Faro, Catherine S Nagawa, Elizabeth A Orvek, Amanda C Blok, Jeroan J Allison, Sharina D Person, Bridget M Smith, Rajani S Sadasivam

Registry-linked trialAbstract read
In one paragraph

Article in BMC public health, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT03224520 (Smoker-to-Smoker), which is not on this map. Cited by 7 papers.

0numbers the graph read from it
0cells of the map it votes in
7citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT03224520 nacompletednot on this map

Smoker-to-Smoker (S2S) Peer Marketing and Messaging to Disseminate Tobacco

TypeinterventionalSponsorUniversity of Massachusetts, WorcesterRan2017 to 2020Enrolled1,487ConditionsSmoking CessationArmsRecommender CTHC, Standard CTHC, Peer Recruitment, Standard Online Recruitment
3 · Its place in the literature

Who cites it

7 citing papers in PubMed.

  1. Review
  2. Review
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

Jinying ChenDivision of Health Informatics and Implementation Science, Department of Population and Quantitative Health Sciences, University of Massachusetts Chan Medical School, 368 Plantation Street, Worcester, MA, 01605, USA. jinying.chen@umassmed.edu.
Thomas K HoustonDepartment of Internal Medicine, Wake Forest School of Medicine, Winston-Salem, NC, USA.
Jamie M FaroDivision of Health Informatics and Implementation Science, Department of Population and Quantitative Health Sciences, University of Massachusetts Chan Medical School, 368 Plantation Street, Worcester, MA, 01605, USA.
Catherine S NagawaDivision of Health Informatics and Implementation Science, Department of Population and Quantitative Health Sciences, University of Massachusetts Chan Medical School, 368 Plantation Street, Worcester, MA, 01605, USA.
Elizabeth A OrvekDivision of Health Informatics and Implementation Science, Department of Population and Quantitative Health Sciences, University of Massachusetts Chan Medical School, 368 Plantation Street, Worcester, MA, 01605, USA.
Amanda C BlokVA Center for Clinical Management Research, VA Ann Arbor Healthcare System, United States Department of Veterans Affairs, Ann Arbor, MI, USA.
Jeroan J AllisonDivision of Health Informatics and Implementation Science, Department of Population and Quantitative Health Sciences, University of Massachusetts Chan Medical School, 368 Plantation Street, Worcester, MA, 01605, USA.
Sharina D PersonDivision of Biostatistics and Health Services Research, Department of Population and Quantitative Health Sciences, University of Massachusetts Chan Medical School, Worcester, MA, USA.
Bridget M SmithCenter of Innovation for Complex Chronic Healthcare, Spinal Cord Injury Quality Enhancement Research Initiative, Hines VA Medical Center, Chicago, IL, USA.
Rajani S SadasivamDivision of Health Informatics and Implementation Science, Department of Population and Quantitative Health Sciences, University of Massachusetts Chan Medical School, 368 Plantation Street, Worcester, MA, 01605, USA.

Funding

iDAPT: Implementation and Informatics - Developing Adaptable Processes and Technologies for Cancer Control P50CA244693 · NCI · WAKE FOREST UNIVERSITY HEALTH SCIENCES · PI HOUSTON, THOMAS K · 2019 to 2023
$4.1M
K12 Cardiopulmonary Implementation Science Scholars ProgramK12HL138049 · NHLBI · UNIV OF MASSACHUSETTS MED SCH WORCESTER · PI LEMON, STEPHENIE C., LINDENAUER, PETER KYLE · 2017 to 2021
$2.7M
Prevention And Control of Cancer: Training for Change in Individuals and SystemsT32CA172009 · NCI · UNIV OF MASSACHUSETTS MED SCH WORCESTER · PI LEMON, STEPHENIE C., OCKENE, JUDITH K · 2019 to 2023
$1.5M
NCI NIH HHS P50 CA244693NCI NIH HHS T32 CA172009NHLBI NIH HHS K12 HL138049
6 · The paper itself

Abstract

backgroundMotivational messaging is a frequently used digital intervention to promote positive health behavior changes, including smoking cessation. Typically, motivational messaging systems have not actively sought feedback on each message, preventing a closer examination of the user-system engagement. This study assessed the granular user-system engagement around a recommender system (a new system that actively sought user feedback on each message to improve message selection) for promoting smoking cessation and the impact of engagement on cessation outcome.

methodsWe prospectively followed a cohort of current smokers enrolled to use the recommender system for 6 months. The system sent participants motivational messages to support smoking cessation every 3 days and used machine learning to incorporate user feedback (i.e., user's rating on the perceived influence of each message, collected on a 5-point Likert scale with 1 indicating strong disagreement and 5 indicating strong agreement on perceiving the influence on quitting smoking) to improve the selection of the following message. We assessed user-system engagement by various metrics, including user response rate (i.e., the percent of times a user rated the messages) and the perceived influence of messages. We compared retention rates across different levels of user-system engagement and assessed the association between engagement and the 7-day point prevalence abstinence (missing outcome = smoking) by using multiple logistic regression.

resultsWe analyzed data from 731 participants (13% Black; 73% women). The user response rate was 0.24 (SD = 0.34) and user-perceived influence was 3.76 (SD = 0.84). The retention rate positively increased with the user response rate (trend test P < 0.001). Compared with non-response, six-month cessation increased with the levels of response rates: low response rate (odds ratio [OR] = 1.86, 95% confidence interval [CI]: 1.07-3.23), moderate response rate (OR = 2.30, 95% CI: 1.36-3.88), high response rate (OR = 2.69, 95% CI: 1.58-4.58). The association between perceived message influence and the outcome showed a similar pattern.

conclusionsHigh user-system engagement was positively associated with both high retention rate and smoking cessation, suggesting that investigation of methods to increase engagement may be crucial to increase the impact of the recommender system for smoking cessation.

trial registrationRegistration Identifier: NCT03224520 . Registration date: July 21, 2017.

Indexed as

Smoking CessationText MessagingFemaleHealth BehaviorHumansMaleMotivationSmokersSmokingComputer-tailored health communicationDigital health interventionEngagementMotivational messagingRecommender systemSmoking cessation

Identifiers

PMID34563161
PMCPMC8465689

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.