Evidence map›Paper›PMID 18039362›Full record

ArticleImplementation science : IS2007

Looking inside the black box: a theory-based process evaluation alongside a randomised controlled trial of printed educational materials (the Ontario printed educational message, OPEM) to improve referral and prescribing practices in primary care in Ontario, Canada.

Jeremy M Grimshaw, Merrick Zwarenstein, Jacqueline M Tetroe, Gaston Godin, Ian D Graham, Louise Lemyre, Martin P Eccles, Marie Johnston, Jillian J Francis, Jan Hux and 3 more

Open access · goldAbstract read
In one paragraph

Article in Implementation science : IS, 2007. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 52 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
52citing papers in PubMed, 2 pooled it
7.5field-weighted citation impact, top 3% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

52 citing papers in PubMed, 2 syntheses or guidelines pooled it, 88 citations in OpenAlex.

  1. Pooled it
  2. Improving child protection in the emergency department: a systematic review of professional interventions for health care providers.Academic emergency medicine : official journal of the Society for Academic Emergency Medicine · 2010
    Pooled it
  3. Trial
  4. Trial
  5. Trial
  6. Trial
  7. Trial
  8. Trial
  9. Trial
  10. Trial
  11. Trial
  12. Trial
  13. Trial
  14. Trial
  15. Trial
  16. Trial
  17. Trial
  18. Trial
  19. Trial
  20. Trial
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

13 authors at 5 institutions in 2 countries.

Jeremy M GrimshawClinical Epidemiology Program, Ottawa Health Research Institute, Ottawa, Canada. jgrimshaw@ohri.ca
Merrick Zwarenstein
Jacqueline M Tetroe
Gaston Godin
Ian D Graham
Louise Lemyre
Martin P Eccles
Marie Johnston
Jillian J Francis
Jan Hux
Keith O'Rourke
France Légaré
Justin Presseau
University of Ottawa · CAInstitute for Clinical Evaluative Sciences · CAUniversité Laval · CAUniversity of Aberdeen · GBNewcastle University · GB

Funding

Chief Scientist Office HSRU2
6 · The paper itself

Abstract

backgroundRandomised controlled trials of implementation strategies tell us whether (or not) an intervention results in changes in professional behaviour but little about the causal mechanisms that produce any change. Theory-based process evaluations collect data on theoretical constructs alongside randomised trials to explore possible causal mechanisms and effect modifiers. This is similar to measuring intermediate endpoints in clinical trials to further understand the biological basis of any observed effects (for example, measuring lipid profiles alongside trials of lipid lowering drugs where the primary endpoint could be reduction in vascular related deaths).This study protocol describes a theory-based process evaluation alongside the Ontario Printed Educational Message (OPEM) trial. We hypothesize that the OPEM interventions are most likely to operate through changes in physicians' behavioural intentions due to improved attitudes or subjective norms with little or no change in perceived behavioural control. We will test this hypothesis using a well-validated social cognition model, the theory of planned behaviour (TPB) that incorporates these constructs. METHODS/

designWe will develop theory-based surveys using standard methods based upon the TPB for the second and third replications, and survey a subsample of Ontario family physicians from each arm of the trial two months before and six months after the dissemination of the index edition of informed, the evidence based newsletter used for the interventions. In the third replication, our study will converge with the "TRY-ME" protocol (a second study conducted alongside the OPEM trial), in which the content of educational messages was constructed using both standard methods and methods informed by psychological theory. We will modify Dillman's total design method to maximise response rates. Preliminary analyses will initially assess the internal reliability of the measures and use regression to explore the relationships between predictor and dependent variable (intention to advise diabetic patients to have annual retinopathy screening and to prescribe thiazide diuretics for first line treatment of uncomplicated hypertension). We will then compare groups using methods appropriate for comparing independent samples to determine whether there have been changes in the predicted constructs (attitudes, subjective norms, or intentions) across the study groups as hypothesised, and will assess the convergence between the process evaluation results and the main trial results.

Identifiers

PMID18039362
PMCPMC2213685
OpenAlexW1984234647

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.