Evidence map›Paper›PMID 27938405›Full record

Trial reportImplementation science : IS2016

Effect of a web-based audit and feedback intervention with outreach visits on the clinical performance of multidisciplinary teams: a cluster-randomized trial in cardiac rehabilitation.

Wouter T Gude, Mariëtte M van Engen-Verheul, Sabine N van der Veer, Hareld M C Kemps, Monique W M Jaspers, Nicolette F de Keizer, Niels Peek

Open access · goldAbstract readMulticenter StudyRandomized Controlled Trial
In one paragraph

Trial report in Implementation science : IS, 2016. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 21 papers, 6 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
21citing papers in PubMed, 6 pooled it
2.0field-weighted citation impact, top 12% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

21 citing papers in PubMed, 6 syntheses or guidelines pooled it, 38 citations in OpenAlex.

  1. Pooled it
  2. Audit and feedback: effects on professional practice.The Cochrane database of systematic reviews · 2025
    Pooled it
  3. Pooled it
  4. Pooled it
  5. Systematic review and narrative synthesis of computerized audit and feedback systems in healthcare.Journal of the American Medical Informatics Association : JAMIA · 2022
    Pooled it
  6. Pooled it
  7. Trial
  8. Trial
  9. Article
  10. Article
  11. Article
  12. Article
  13. Review
  14. Review
  15. Review
  16. Article
  17. Article
  18. Article
  19. Review
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors at 4 institutions in 2 countries.

Wouter T GudeDepartment of Medical Informatics, Academic Medical Center/University of Amsterdam, Room J1B-127. Meibergdreef 9, 1105, AZ, Amsterdam, The Netherlands. w.t.gude@amc.uva.nl.
Mariëtte M van Engen-VerheulDepartment of Medical Informatics, Academic Medical Center/University of Amsterdam, Room J1B-127. Meibergdreef 9, 1105, AZ, Amsterdam, The Netherlands.
Sabine N van der VeerMRC Health eResearch Centre, Division of Informatics, Imaging and Data Sciences, The University of Manchester, Manchester Academic Health Science Centre, Manchester, UK.
Hareld M C KempsDepartment of Cardiology, Máxima Medical Centre, Veldhoven, The Netherlands.
Monique W M JaspersDepartment of Medical Informatics, Academic Medical Center/University of Amsterdam, Room J1B-127. Meibergdreef 9, 1105, AZ, Amsterdam, The Netherlands.
Nicolette F de KeizerDepartment of Medical Informatics, Academic Medical Center/University of Amsterdam, Room J1B-127. Meibergdreef 9, 1105, AZ, Amsterdam, The Netherlands.
Niels PeekMRC Health eResearch Centre, Division of Informatics, Imaging and Data Sciences, The University of Manchester, Manchester Academic Health Science Centre, Manchester, UK.
University of Amsterdam · NLUniversity of Manchester · GBAcademic Medical Center · NLRadboud University Nijmegen · NL

Funding

Medical Research Council MC_PC_13042Medical Research Council MR/K006665/1
6 · The paper itself

Abstract

backgroundThe objective of this study was to assess the effect of a web-based audit and feedback (A&F) intervention with outreach visits to support decision-making by multidisciplinary teams.

methodsWe performed a multicentre cluster-randomized trial within the field of comprehensive cardiac rehabilitation (CR) in the Netherlands. Our participants were multidisciplinary teams in Dutch CR centres who were enrolled in the study between July 2012 and December 2013 and received the intervention for at least 1 year. The intervention included web-based A&F with feedback on clinical performance, facilities for goal setting and action planning, and educational outreach visits. Teams were randomized either to receive feedback that was limited to psychosocial rehabilitation (study group A) or to physical rehabilitation (study group B). The main outcome measure was the difference in performance between study groups in 11 care processes and six patient outcomes, measured at patient level. Secondary outcomes included effects on guideline concordance for the four main CR therapies.

resultsData from 18 centres (14,847 patients) were analysed, of which 12 centres (9353 patients) were assigned to group A and six (5494 patients) to group B. During the intervention, a total of 233 quality improvement goals was identified by participating teams, of which 49 (21%) were achieved during the study period. Except for a modest improvement in data completeness (4.5% improvement per year; 95% CI 0.65 to 8.36), we found no effect of our intervention on any of our primary or secondary outcome measures.

conclusionsWithin a multidisciplinary setting, our web-based A&F intervention engaged teams to define local performance improvement goals but failed to support them in actually completing the improvement actions that were needed to achieve those goals. Future research should focus on improving the actionability of feedback on clinical performance and on addressing the socio-technical perspective of the implementation process.

trial registrationNTR3251.

Indexed as

InternetPatient Care TeamAgedCardiac RehabilitationCluster AnalysisFemaleHumansMaleNetherlandsOutcome Assessment, Health CareQuality ImprovementSurveys and QuestionnairesCardiac rehabilitationFeedbackGuideline adherenceHealth careQuality improvementQuality indicators

Identifiers

PMID27938405
PMCPMC5148845
OpenAlexW2560209223

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.