Evidence map›Paper›PMID 39514878›Full record

ArticlePain medicine (Malden, Mass.)2024

Recommendations for monitoring adherence and fidelity in pragmatic trials based on experience in the Pain Management Collaboratory.

James Dziura, Kathryn Gilstad-Hayden, Cynthia J Coffman, Cynthia R Long, Qilu Yu, Eugenia Buta, Scott Coggeshall, Mary Geda, Peter Peduzzi, Tassos C Kyriakides

Abstract read
In one paragraph

Article in Pain medicine (Malden, Mass.), 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed.

  1. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

James DziuraPain Management Collaboratory Coordinating Center, Yale University, New Haven, CT 06519, United States.
Kathryn Gilstad-HaydenDepartment of Psychiatry, Yale School of Medicine, New Haven, CT 06519, United States.
Cynthia J CoffmanADAPT Center of Innovation, Durham VA Health Care System, Durham, NC 27705, United States.
Cynthia R LongPalmer Center for Chiropractic Research, Palmer College of Chiropractic, Davenport, IA 52803, United States.
Qilu YuOffice of Clinical & Regulatory Affairs, National Center for Complementary and Integrative Health (NCCIH), Bethesda, MD 20892-5475, United States.ORCID 0000-0003-2641-3535
Eugenia ButaDepartment of Biostatistics and Yale Center for Analytical Sciences, School of Public Health, Yale University, New Haven, CT 06519, United States.
Scott CoggeshallVA Center of Innovation (COIN) for Veteran-Centered and Value-Driven Care, VA Puget Sound Healthcare System, Seattle, WA 98108, United States.
Mary GedaPain Management Collaboratory Coordinating Center, Yale University, New Haven, CT 06519, United States.
Peter PeduzziPain Management Collaboratory Coordinating Center, Yale University, New Haven, CT 06519, United States.
Tassos C KyriakidesPain Management Collaboratory Coordinating Center, Yale University, New Haven, CT 06519, United States.

Funding

Yale Clinical and Translational Science Award (U Component)UL1TR001863 · NCATS · YALE UNIVERSITY · PI John H. Krystal, LUCILA OHNO-MACHADO · 2016 to 2026
$102.9M
Pain Management Collaboratory Coordinating Center (PMC3)U24AT009769 · NCCIH · YALE UNIVERSITY · PI WILLIAM C BECKER, Alicia Heapy · 2017 to 2026
$16.4M
Chiropractic Care for Veterans: A Pragmatic Randomized Trial Addressing Dose Effects for cLBPUH3AT009761 · NCCIH · PALMER COLLEGE OF CHIROPRACTIC · PI GOERTZ, CHRISTINE MARIE, LONG, CYNTHIA R · 2019 to 2024
$7.2M
Improving Veteran Access To Integrated Management of Chronic Back PainUG3AT009790 · NCCIH · DUKE UNIVERSITY · PI GEORGE, STEVEN Z, HASTINGS, SUSAN NICOLE · 2017 to 2019
$1.9M
Engaging Veterans Seeking Service-Connection Payments in Pain TreatmentUG3AT009758 · NCCIH · YALE UNIVERSITY · PI MARTINO, STEVE, ROSEN, MARC I · 2017 to 2018
$1.2M
Cooperative Pain Education and Self-management: Expanding Treatment for Real-world Access (COPES ExTRA)UG3AT009767 · NCCIH · YALE UNIVERSITY · PI HEAPY, ALICIA · 2017 to 2018
$1.1M
Department of Veterans Affairs Health Services Research and Development ServiceNCATS NIH HHS UL1 TR001863NCCIH NIH HHS U24 AT009769NCCIH NIH HHS UG3 AT009758NCCIH NIH HHS UG3 AT009767NCCIH NIH HHS UG3 AT009790NCCIH NIH HHS UH3 AT009761NIH HHS UG3/UH3-AT009758Office of Behavioral and Social Sciences ResearchVA Health Services Research & Development Service # SDR-17-306
6 · The paper itself

Abstract

objectiveMost pragmatic trials follow the PRagmatic Explanatory Continuum Indicator Summary (PRECIS-2) criteria. The criteria specify unobtrusive measurement of participants' protocol adherence and practitioners' intervention fidelity but suggest no special monitoring strategies to assure trial integrity. We present experience with adherence/fidelity monitoring in the Pain Management Collaboratory (PMC) and provide recommendations for their monitoring in pragmatic trials to preserve inferences of treatment comparisons.

methodsIn November 2021, we surveyed 10 of 11 originally funded PMC pragmatic trials to determine the extent to which adherence and fidelity data were being monitored.

resultsOf the 10 PMC trials, 8 track adherence/fidelity. The electronic health record is the most frequent source for monitoring adherence (7/10) and fidelity (5/10). Most adherence data are used to monitor participant engagement with the trial intervention (4/10) and are reviewed by study teams (8/10) and often with a data and safety monitoring board (DSMB) (5/10). Half of the trials (5/10) reported using fidelity data for feedback/training; such data are not shared with a DSMB (0/10). Only 2 of 10 trials reported having prespecified guidance or rules around adherence/fidelity (eg, stopping rules or thresholds for corrective action, such as retraining).

conclusionsAs a best practice for pragmatic trials, we recommend early and regular adherence/fidelity monitoring to determine whether intervention delivery is as intended. We propose a 2-stage process with thresholds for intervening and triggers for conducting a formal futility analysis if adherence and fidelity are not maintained. The level of monitoring should be unobtrusive for both participants and those delivering the intervention; resulting data should be reviewed by an independent DSMB.

Indexed as

Pain ManagementPragmatic Clinical Trials as TopicGuideline AdherenceHumansadherencedata and safety monitoring boardfidelityintent-to-treat analysisper-protocol analysisPRECIS-2

Identifiers

PMID39514878
PMCPMC11548857

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.