Evidence map›Paper›PMID 24438584›Full record

ArticleImplementation science : IS2014

No more 'business as usual' with audit and feedback interventions: towards an agenda for a reinvigorated intervention.

Noah M Ivers, Anne Sales, Heather Colquhoun, Susan Michie, Robbie Foy, Jill J Francis, Jeremy M Grimshaw

5 registry-linked trialsAbstract read
In one paragraph

Article in Implementation science : IS, 2014. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to 5 registered trials, which are not on this map. Cited by 216 papers, 14 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
216citing papers in PubMed, 14 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT02979964 nacompletednot on this mapstarted 2016, after this paper: background citation

Pragmatic Factorial Cluster Trial of Framing and Comparators for Audit and Feedback Aiming to Address High Risk Prescribing in Nursing Homes in Ontario

TypeinterventionalSponsorWomen's College HospitalRan2016 to 2018Enrolled285ConditionsHigh-risk Prescribing in Nursing HomesArmsAudit and Feedback
NCT03843957 nacompletednot on this mapstarted 2019, after this paper: background citation

Effectiveness and Implementation of mPATH-CRC: a Mobile Health System for Colorectal Cancer Screening

TypeinterventionalSponsorWake Forest University Health SciencesRan2019 to 2023Enrolled77,145ConditionsColorectal Cancer, Cancer, Rectum Cancer, Colon CancerArmsmPATH-CRC, mPATH-Checkin, "high touch" Implementation strategy, "low touch" Implementation Strategy
NCT04356274 naenrolling by invitationnot on this mapstarted 2019, after this paper: background citation

Participatory System Dynamics vs Audit and Feedback: A Cluster Randomized Trial of Mechanisms of Implementation Change to Expand Reach of Evidence-based Addiction and Mental Health Care

TypeinterventionalSponsorPalo Alto Veterans Institute for ResearchRan2019 to 2027Enrolled720ConditionsPTSD, Depression, Alcohol Use Disorder, Opioid Use DisorderArmsParticipatory System Dynamics (PSD), Audit and Feedback (AF)
NCT05099497 nacompletednot on this mapstarted 2021, after this paper: background citation

Big Data and Little Behaviours: Feedback and Quality Improvement Supports to Primary Care to Facilitate COVID-19 Vaccine Uptake

TypeinterventionalSponsorWomen's College HospitalRan2021 to 2022Enrolled600ConditionsCovid19 Vaccination, Vaccine UptakeArmsUsing Practice Facilitators to Support Physicians
NCT05761873 nacompletednot on this mapstarted 2023, after this paper: background citation

Comparing Paper Letters in Addition to Emailed Audit and Feedback in Refining Asthma Treatment to Improve Clinical and Environmental Results in Primary Care

TypeinterventionalSponsorUniversity of LeedsRan2023 to 2025Enrolled273ConditionsAsthmaArmsProvision of audit and feedback via email and paper, Provision of audit and feedback via paper only
3 · Its place in the literature

Who cites it

216 citing papers in PubMed, 14 syntheses or guidelines pooled it.

  1. Audit and feedback: effects on professional practice.The Cochrane database of systematic reviews · 2025
    Pooled it
  2. Audit and Feedback Interventions for Antibiotic Prescribing in Primary Care: A Systematic Review and Meta-analysis.Clinical infectious diseases : an official publication of the Infectious Diseases Society of America · 2025
    Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Pooled it
  7. Pooled it
  8. Pooled it
  9. Pooled it
  10. Strategies to reduce diagnostic errors: a systematic review.BMC medical informatics and decision making · 2019
    Pooled it
  11. Pooled it
  12. Pooled it
  13. Barriers to effective management of type 2 diabetes in primary care: qualitative systematic review.The British journal of general practice : the journal of the Royal College of General Practitioners · 2016
    Pooled it
  14. Pooled it
  15. Trial
  16. Trial
  17. Trial
  18. Trial
  19. Trial
  20. Trial

156 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Noah M IversDepartment of Family and Community Medicine, Institute for Health Systems Solutions and Virtual Care, Women's College Hospital, University of Toronto, 77 Grenville Street, Toronto, ON M5S 1B3, Canada. noahivers@utoronto.ca.
Anne Sales
Heather Colquhoun
Susan Michie
Robbie Foy
Jill J Francis
Jeremy M Grimshaw

Funding

Canadian Institutes of Health Research
6 · The paper itself

Abstract

backgroundAudit and feedback interventions in healthcare have been found to be effective, but there has been little progress with respect to understanding their mechanisms of action or identifying their key 'active ingredients.' DISCUSSION: Given the increasing use of audit and feedback to improve quality of care, it is imperative to focus further research on understanding how and when it works best. In this paper, we argue that continuing the 'business as usual' approach to evaluating two-arm trials of audit and feedback interventions against usual care for common problems and settings is unlikely to contribute new generalizable findings. Future audit and feedback trials should incorporate evidence- and theory-based best practices, and address known gaps in the literature. SUMMARY: We offer an agenda for high-priority research topics for implementation researchers that focuses on reviewing best practices for designing audit and feedback interventions to optimize effectiveness.

Indexed as

FeedbackMedical AuditAttitude of Health PersonnelBehaviorEvidence-Based MedicineHealth Services ResearchHumansQuality of Health Care

Identifiers

PMID24438584
PMCPMC3896824

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.