Evidence map›Paper›PMID 30064484›Full record

SynthesisTrials2018

Comparison of registered and published intervention fidelity assessment in cluster randomised trials of public health interventions in low- and middle-income countries: systematic review.

Myriam Cielo Pérez, Nanor Minoyan, Valéry Ridde, Marie-Pierre Sylvestre, Mira Johri

Abstract readComparative StudySystematic Review
In one paragraph

Synthesis in Trials, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 9 papers.

0numbers the graph read from it
0cells of the map it votes in
9citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

9 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Myriam Cielo PérezCentre de Recherche du Centre Hospitalier de l'Université de Montréal (CRCHUM), 900, rue Saint-Denis, Pavillon R, Tour Saint-Antoine Porte S03.414, Montréal, Québec, H2X 0A9, Canada.
Nanor MinoyanCentre de Recherche du Centre Hospitalier de l'Université de Montréal (CRCHUM), 900, rue Saint-Denis, Pavillon R, Tour Saint-Antoine Porte S03.414, Montréal, Québec, H2X 0A9, Canada.
Valéry RiddeInstitut de Recherche en Santé Publique Université de Montréal (IRSPUM), Pavillon 7101 Avenue du Parc, P.O. Box 6128, Centre-ville Station, Montréal, Québec, H3C 3J7, Canada.
Marie-Pierre SylvestreCentre de Recherche du Centre Hospitalier de l'Université de Montréal (CRCHUM), 900, rue Saint-Denis, Pavillon R, Tour Saint-Antoine Porte S03.414, Montréal, Québec, H2X 0A9, Canada.
Mira JohriCentre de Recherche du Centre Hospitalier de l'Université de Montréal (CRCHUM), 900, rue Saint-Denis, Pavillon R, Tour Saint-Antoine Porte S03.414, Montréal, Québec, H2X 0A9, Canada. mira.johri@umontreal.ca.ORCID http://orcid.org/0000-0001-5642-787X

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundCluster randomised trials (CRTs) are a key instrument to evaluate public health interventions. Fidelity assessment examines study processes to gauge whether an intervention was delivered as initially planned. Evaluation of implementation fidelity (IF) is required to establish whether the measured effects of a trial are due to the intervention itself and may be particularly important for CRTs of complex interventions conducted in low- and middle-income countries (LMICs). However, current CRT reporting guidelines offer no guidance on IF assessment. The objective of this review was to study current practices concerning the assessment of IF in CRTs of public health interventions in LMICs.

methodsCRTs of public health interventions in LMICs that planned or reported IF assessment in either the trial protocol or the main trial report were included. The MEDLINE/PubMed, CINAHL and EMBASE databases were queried from January 2012 to May 2016. To ensure availability of a study protocol, CRTs reporting a registration number in the abstract were included. Relevant data were extracted from each study protocol and trial report by two researchers using a predefined screening sheet. Risk of bias for individual studies was assessed.

resultsWe identified 90 CRTs of public health interventions in LMICs with a study protocol in a publicly available trial registry published from January 2012 to May 2016. Among these 90 studies, 25 (28%) did not plan or report assessing IF; the remaining 65 studies (72%) addressed at least one IF dimension. IF assessment was planned in 40% (36/90) of trial protocols and reported in 71.1% (64/90) of trial reports. The proportion of overall agreement between the trial protocol and trial report concerning occurrence of IF assessment was 66.7% (60/90). Most studies had low to moderate risk of bias.

conclusionsIF assessment is not currently a systematic practice in CRTs of public health interventions carried out in LMICs. In the absence of IF assessment, it may be difficult to determine if CRT results are due to the intervention design, to its implementation, or to unknown or external factors that may influence results. CRT reporting guidelines should promote IF assessment.

trial registrationProtocol published and available at: https://doi.org/10.1186/s13643-016-0351-0.

Indexed as

Developing CountriesIncomePovertyDelivery of Health CareHumansPublic HealthRandomized Controlled Trials as TopicRegistriesResearch DesignCluster randomised trialsDeveloping countriesIntervention fidelityProcess evaluationPublic health interventionsSystematic review

Identifiers

PMID30064484
PMCPMC6069979

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.