ArticleImplementation science : IS2007
Looking inside the black box: a theory-based process evaluation alongside a randomised controlled trial of printed educational materials (the Ontario printed educational message, OPEM) to improve referral and prescribing practices in primary care in Ontario, Canada.
Article in Implementation science : IS, 2007. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 52 papers, 2 of them syntheses that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
52 citing papers in PubMed, 2 syntheses or guidelines pooled it, 88 citations in OpenAlex.
- Systematic review of the use of process evaluations in knowledge translation research.Systematic reviews · 2019Pooled it
- Improving child protection in the emergency department: a systematic review of professional interventions for health care providers.Academic emergency medicine : official journal of the Society for Academic Emergency Medicine · 2010Pooled it
- Trial
- Improving Lynch syndrome detection: a mixed-methods process evaluation of a hybrid type III effectiveness-implementation trial.BMC health services research · 2024Trial
- Implementing integrated care clinics for HIV-infection, diabetes and hypertension in Uganda (INTE-AFRICA): process evaluation of a cluster randomised controlled trial.BMC health services research · 2023Trial
- Engagement is a necessary condition to test audit and feedback design features: results of a pragmatic, factorial, cluster-randomized trial with an embedded process evaluation.Implementation science : IS · 2023Trial
- Impacts of two behavior change interventions on determinants of medication adherence: process evaluation applying the health action process approach and habit theory alongside a randomized controlled trial.Journal of behavioral medicine · 2022Trial
- Dose-Response Relationship of a Web-Based Tailored Intervention Promoting Human Papillomavirus Vaccination: Process Evaluation of a Randomized Controlled Trial.Journal of medical Internet research · 2020Trial
- Cluster randomised controlled trial of a theory-based multiple behaviour change intervention aimed at healthcare professionals to improve their management of type 2 diabetes in primary care.Implementation science : IS · 2018Trial
- Trial
- Printed educational messages fail to increase use of thiazides as first-line medication for hypertension in primary care: a cluster randomized controlled trial [ISRCTN72772651].Implementation science : IS · 2016Trial
- A theory-based process evaluation alongside a randomised controlled trial of printed educational messages to increase primary care physicians' prescription of thiazide diuretics for hypertension [ISRCTN72772651].Implementation science : IS · 2016Trial
- Appropriate prescribing in nursing homes demonstration project (APDP) study protocol: pragmatic, cluster-randomized trial and mixed methods process evaluation of an Ontario policy-maker initiative to improve appropriate prescribing of antipsychotics.Implementation science : IS · 2016Trial
- A Cluster-Randomized Trial of a Centralized Clinical Pharmacy Cardiovascular Risk Service to Improve Guideline Adherence.Pharmacotherapy · 2015Trial
- Looking inside the black box: results of a theory-based process evaluation exploring the results of a randomized controlled trial of printed educational messages to increase primary care physicians' diabetic retinopathy referrals [Trial registration number ISRCTN72772651].Implementation science : IS · 2014Trial
- Trial
- Supporting Policy In health with Research: an Intervention Trial (SPIRIT)-protocol for a stepped wedge trial.BMJ open · 2014Trial
- Improving Diabetes care through Examining, Advising, and prescribing (IDEA): protocol for a theory-based cluster randomised controlled trial of a multiple behaviour change intervention aimed at primary healthcare professionals.Implementation science : IS · 2014Trial
- Dentists United to Extinguish Tobacco (DUET): a study protocol for a cluster randomized, controlled trial for enhancing implementation of clinical practice guidelines for treating tobacco dependence in dental care settings.Implementation science : IS · 2014Trial
- Evidence-based care of older people with suspected cognitive impairment in general practice: protocol for the IRIS cluster randomised trial.Implementation science : IS · 2013Trial
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
13 authors at 5 institutions in 2 countries.
Funding
Abstract
backgroundRandomised controlled trials of implementation strategies tell us whether (or not) an intervention results in changes in professional behaviour but little about the causal mechanisms that produce any change. Theory-based process evaluations collect data on theoretical constructs alongside randomised trials to explore possible causal mechanisms and effect modifiers. This is similar to measuring intermediate endpoints in clinical trials to further understand the biological basis of any observed effects (for example, measuring lipid profiles alongside trials of lipid lowering drugs where the primary endpoint could be reduction in vascular related deaths).This study protocol describes a theory-based process evaluation alongside the Ontario Printed Educational Message (OPEM) trial. We hypothesize that the OPEM interventions are most likely to operate through changes in physicians' behavioural intentions due to improved attitudes or subjective norms with little or no change in perceived behavioural control. We will test this hypothesis using a well-validated social cognition model, the theory of planned behaviour (TPB) that incorporates these constructs. METHODS/
designWe will develop theory-based surveys using standard methods based upon the TPB for the second and third replications, and survey a subsample of Ontario family physicians from each arm of the trial two months before and six months after the dissemination of the index edition of informed, the evidence based newsletter used for the interventions. In the third replication, our study will converge with the "TRY-ME" protocol (a second study conducted alongside the OPEM trial), in which the content of educational messages was constructed using both standard methods and methods informed by psychological theory. We will modify Dillman's total design method to maximise response rates. Preliminary analyses will initially assess the internal reliability of the measures and use regression to explore the relationships between predictor and dependent variable (intention to advise diabetic patients to have annual retinopathy screening and to prescribe thiazide diuretics for first line treatment of uncomplicated hypertension). We will then compare groups using methods appropriate for comparing independent samples to determine whether there have been changes in the predicted constructs (attitudes, subjective norms, or intentions) across the study groups as hypothesised, and will assess the convergence between the process evaluation results and the main trial results.
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.