Evidence map›Paper›PMID 42456184›Full record

ArticleJournal of medical Internet research2026

Developing a Core Outcome Set for the Evaluation of Remote Patient Monitoring Interventions Using the Sextuple Aim: Modified Delphi Study.

Anna Heilig, Tobias Bonten, Kasper Recourt, M Elske van den Akker-van Marle

Abstract read
In one paragraph

Article in Journal of medical Internet research, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Anna HeiligDepartment of Medical Decision Making, Leiden University Medical Center, Albinusdreef 2, Leiden, South Holland, 2333 ZA, The Netherlands, 31 0630205719.ORCID http://orcid.org/0009-0007-5867-6547
Tobias BontenDepartment of Public Health and Primary Care, Leiden University Medical Center, Leiden, The Netherlands.ORCID http://orcid.org/0000-0002-7719-6182
Kasper RecourtNational eHealth Living Lab (NeLL), Leiden University Medical Center, Leiden, The Netherlands.ORCID http://orcid.org/0000-0001-9282-9307
M Elske van den Akker-van MarleDepartment of Medical Decision Making, Leiden University Medical Center, Albinusdreef 2, Leiden, South Holland, 2333 ZA, The Netherlands, 31 0630205719.ORCID http://orcid.org/0000-0002-5269-509X

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Background: The rapid expansion of remote patient monitoring (RPM) interventions highlights the need for their comparison and evaluation. Current evaluation frameworks often fail to capture a multistakeholder perspective. Traditional health technology assessment approaches emphasize health and economic outcomes, providing an incomplete picture of RPM's broader impact. The Sextuple Aim, encompassing health outcomes, costs, patient and provider experience, equity, and sustainability, offers a more comprehensive approach. Yet, the specific aspects that are important for capturing each domain for diverse stakeholders, and that could form a core outcome set (COS) for RPM evaluation, remain undefined. Objective: This study aimed to identify the most important value aspects for evaluating RPM interventions from the Sextuple Aim domains. Methods: Value aspects relevant to evaluating RPM interventions within the Sextuple Aim framework were identified in a review of the literature, and this initial set was refined through stakeholder meetings. Subsequently, 6 stakeholder groups completed 3 Delphi rounds. Patients and informal caregivers (25-30 respondents per group) were recruited via a patient federation. Health care providers (20-30 experts), managers, insurers, and researchers (10-20 experts per group) were recruited. In each round, participants rated the importance of aspects on a 5-point Likert scale. In round 2, participants ranked aspects within each domain to determine their relative importance; in round 3, they ranked aspects across domains. A multicriteria consensus rule was used to select aspects for the preliminary COS. The COS was finalized during a multistakeholder expert meeting with 7 experts. Results: Of the 171 respondents, 137 (80%) completed all Delphi rounds. The input set, formed through a literature search and meetings, contained 43 value aspects. The total set contained 47 aspects after the first round. After all 3 rating rounds, 33 of 47 (70%) value aspects met the predefined importance threshold. Ranking results from rounds 2 and 3 identified aspects prioritized within and across domains. In total, 26 (55%) aspects met the multicriteria consensus rule and formed the preliminary COS. During the final multistakeholder expert meeting involving subgroup exercises and moderated discussions, value aspects with conceptual overlap were merged, removed, or relocated. The final COS included 17 value aspects, with 1 additional emergent aspect identified during the expert meeting and included as a recommended item, which also resulted in full Sextuple Aim domain coverage. Conclusions: An RPM Sextuple Aim COS comprising 17 value aspects and 1 recommended aspect was developed, providing a multidimensional and multistakeholder evaluation set. This COS provides a standardized, comprehensive basis for evaluating RPM interventions and can be used to support the validation and refinement of existing RPM evaluation tools. Future research may consider operationalizing the COS and its recommended aspect into measurable items and assessing its feasibility and uptake in practice.

Indexed as

Delphi TechniqueOutcome Assessment, Health CareHumansRemote Patient Monitoringcore outcome setDelphidigital healthremote monitoringremote patient monitoringSextuple Aimtelemonitoringvalue assessment framework

Identifiers

PMID42456184
PMCPMC13372298

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.