Evidence map›Paper›PMID 38488828›Full record

ArticleJMIR diabetes2024

New Approach to Equitable Intervention Planning to Improve Engagement and Outcomes in a Digital Health Program: Simulation Study.

Jackson A Killian, Manish Jain, Yugang Jia, Jonathan Amar, Erich Huang, Milind Tambe

Open access · goldAbstract read
In one paragraph

Article in JMIR diabetes, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
1.4field-weighted citation impact, top 18% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed, 4 citations in OpenAlex.

  1. Article
  2. Improving representativeness in trial recruitment: A data-driven approach.Contemporary clinical trials communications · 2026
    Article
  3. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors at 2 institutions in 1 country.

Jackson A KillianHarvard University, Cambridge, MA, United States.ORCID https://orcid.org/0000-0001-8555-1327
Manish JainGoogle Research, Palo Alto, CA, United States.ORCID https://orcid.org/0009-0009-7625-9784
Yugang JiaVerily Life Sciences, South San Francisco, CA, United States.ORCID https://orcid.org/0009-0008-0628-5461
Jonathan AmarVerily Life Sciences, South San Francisco, CA, United States.ORCID https://orcid.org/0000-0001-7172-3765
Erich HuangVerily Life Sciences, South San Francisco, CA, United States.ORCID https://orcid.org/0000-0001-5547-9408
Milind TambeHarvard University, Cambridge, MA, United States.ORCID https://orcid.org/0000-0003-3296-3672
Google (United States) · USHarvard University Press · US

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundDigital health programs provide individualized support to patients with chronic diseases and their effectiveness is measured by the extent to which patients achieve target individual clinical outcomes and the program's ability to sustain patient engagement. However, patient dropout and inequitable intervention delivery strategies, which may unintentionally penalize certain patient subgroups, represent challenges to maximizing effectiveness. Therefore, methodologies that optimize the balance between success factors (achievement of target clinical outcomes and sustained engagement) equitably would be desirable, particularly when there are resource constraints.

objectiveOur objectives were to propose a model for digital health program resource management that accounts jointly for the interaction between individual clinical outcomes and patient engagement, ensures equitable allocation as well as allows for capacity planning, and conducts extensive simulations using publicly available data on type 2 diabetes, a chronic disease.

methodsWe propose a restless multiarmed bandit (RMAB) model to plan interventions that jointly optimize long-term engagement and individual clinical outcomes (in this case measured as the achievement of target healthy glucose levels). To mitigate the tendency of RMAB to achieve good aggregate performance by exacerbating disparities between groups, we propose new equitable objectives for RMAB and apply bilevel optimization algorithms to solve them. We formulated a model for the joint evolution of patient engagement and individual clinical outcome trajectory to capture the key dynamics of interest in digital chronic disease management programs.

resultsIn simulation exercises, our optimized intervention policies lead to up to 10% more patients reaching healthy glucose levels after 12 months, with a 10% reduction in dropout compared to standard-of-care baselines. Further, our new equitable policies reduce the mean absolute difference of engagement and health outcomes across 6 demographic groups by up to 85% compared to the state-of-the-art.

conclusionsPlanning digital health interventions with individual clinical outcome objectives and long-term engagement dynamics as considerations can be both feasible and effective. We propose using an RMAB sequential decision-making framework, which may offer additional capabilities in capacity planning as well. The integration of an equitable RMAB algorithm further enhances the potential for reaching equitable solutions. This approach provides program designers with the flexibility to switch between different priorities and balance trade-offs across various objectives according to their preferences.

Indexed as

chronic diseasedigital healthequitymachine learningmulti-armed banditmulti-armed banditsresource allocationrestless multiarmed banditsT2Dtype-2 diabetes

Identifiers

PMID38488828
PMCPMC10980993
OpenAlexW4392847906

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.