Evidence map›Paper›PMID 39037757›Full record

ArticleJMIR formative research2024

Measuring Engagement in Provider-Guided Digital Health Interventions With a Conceptual and Analytical Framework Using Nurse WRITE as an Exemplar: Exploratory Study With an Iterative Approach.

Yan Wang, Annette DeVito Dabbs, Teresa Hagan Thomas, Grace Campbell, Heidi Donovan

Abstract read
In one paragraph

Article in JMIR formative research, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed.

  1. Article
  2. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Yan WangDepartment of Health & Community Systems, School of Nursing, University of Pittsburgh, Pittsburgh, PA, United States.ORCID https://orcid.org/0000-0002-3136-3109
Annette DeVito DabbsDepartment of Acute & Tertiary Care, School of Nursing, University of Pittsburgh, Pittsburgh, PA, United States.ORCID https://orcid.org/0000-0003-3325-435X
Teresa Hagan ThomasDepartment of Health Promotion & Development, School of Nursing, University of Pittsburgh, Pittsburgh, PA, United States.ORCID https://orcid.org/0000-0001-7403-7314
Grace CampbellSchool of Nursing, Duquesne University, Pittsburgh, PA, United States.ORCID https://orcid.org/0000-0003-3942-0662
Heidi DonovanDepartment of Health & Community Systems, School of Nursing, University of Pittsburgh, Pittsburgh, PA, United States.ORCID https://orcid.org/0000-0002-4889-8644

Funding

NRG Oncology Network Group Operations Center - GY9 BIQSFP Reports/BudgetsU10CA180868 · NCI · NRG ONCOLOGY FOUNDATION, INC. · PI NORMAN WOLMARK · 2014 to 2026
$206.8M
Statistics CoreU10CA180822 · NCI · UNIVERSITY OF PITTSBURGH AT PITTSBURGH · PI James J. Dignam, GREG YOTHERS · 2014 to 2026
$146.4M
NRG Oncology NCORP Research Base-BIQSFPUG1CA189867 · NCI · NRG ONCOLOGY FOUNDATION, INC. · PI Deborah Watkins Bruner, Lisa A. Kachnic · 2014 to 2026
$140.5M
Web-Based Ovarian Cancer Symptom Control: Nurse-Guided vs. Self-DirectedR01NR010735 · NINR · UNIVERSITY OF PITTSBURGH AT PITTSBURGH · PI DONOVAN, HEIDI S · 2008 to 2012
$2.8M
NCI NIH HHS U10 CA180822NCI NIH HHS U10 CA180868NCI NIH HHS UG1 CA189867NINR NIH HHS R01 NR010735
6 · The paper itself

Abstract

backgroundLimited guidance exists for analyzing participant engagement in provider-guided digital health interventions (DHIs). System usage is commonly assessed, with acknowledged limitations in measuring socio-affective and cognitive aspects of engagement. Nurse WRITE, an 8-week web-based nurse-guided DHI for managing symptoms among women with recurrent ovarian cancer, offers an opportunity to develop a framework for assessing multidimensional engagement.

objectiveThis study aims to develop a conceptual and analytic framework to measure socio-affective, cognitive, and behavioral engagement with provider-guided DHIs. We then illustrate the framework's ability to describe and categorize engagement using Nurse WRITE as an example.

methodsA sample of 68 participants from Nurse WRITE who posted on the message boards were included. We adapted a prior framework for conceptualizing and operationalizing engagement across 3 dimensions and finalized a set of 6 distinct measures. Using patients' posts, we created 2 socio-affective engagement measures-total count of socio-affective engagement classes (eg, sharing personal experience) and total word count-and 2 cognitive engagement measures-total count of cognitive engagement classes (eg, asking information-seeking questions) and average question completion percentage. Additionally, we devised behavioral engagement measures using website data-the total count of symptom care plans and plan reviews. k-Means clustering categorized the participants into distinct groups based on levels of engagement across 3 dimensions. Descriptive statistics and narratives were used to describe engagement in 3 dimensions.

resultsOn average, participants displayed socio-affective engagement 34.7 times, writing 14,851 words. They showed cognitive engagement 19.4 times, with an average of 78.3% completion of nurses' inquiries. Participants also submitted an average of 1.6 symptom care plans and 0.7 plan reviews. Participants were clustered into high (n=13), moderate (n=17), and low engagers (n=38) based on the 6 measures. High engagers wrote a median of 36,956 (IQR 26,199-46,265) words. They demonstrated socio-affective engagement approximately 81 times and cognitive engagement around 46 times, approximately 6 times that of the low engagers and twice that of the moderate engagers. High engagers had a median of 91.7% (IQR 82.2%-93.7%) completion of the nurses' queries, whereas moderate engagers had 86.4% (IQR 80%-96.4%), and low engagers had 68.3% (IQR 60.1%-79.6%). High engagers completed a median of 3 symptom care plans and 2 reviews, while moderate engagers completed 2 plans and 1 review. Low engagers completed a median of 1 plan with no reviews.

conclusionsThis study developed and reported an engagement framework to guide behavioral intervention scientists in understanding and analyzing participants' engagement with provider-guided DHIs. Significant variations in engagement levels across 3 dimensions highlight the importance of measuring engagement with provider-guided DHIs in socio-affective, cognitive, and behavioral dimensions. Future studies should validate the framework with other DHIs, explore the influence of patient and provider factors on engagement, and investigate how engagement influences intervention efficacy.

Indexed as

digital health interventioneHealthengagementframeworkgynecological cancersymptom management

Identifiers

PMID39037757
PMCPMC11301115

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.