Evidence map›Paper›PMID 16011811›Full record

ArticleBMC health services research2005

What do we know about how to do audit and feedback? Pitfalls in applying evidence from a systematic review.

R Foy, M P Eccles, G Jamtvedt, J Young, J M Grimshaw, R Baker

Registry-linked trialAbstract read
In one paragraph

Article in BMC health services research, 2005. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT04356274 (Participatory System Dynamics vs Audit and Feedback), which is not on this map. Cited by 112 papers, 6 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
112citing papers in PubMed, 6 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT04356274 naenrolling by invitationnot on this mapstarted 2019, after this paper: background citation

Participatory System Dynamics vs Audit and Feedback: A Cluster Randomized Trial of Mechanisms of Implementation Change to Expand Reach of Evidence-based Addiction and Mental Health Care

TypeinterventionalSponsorPalo Alto Veterans Institute for ResearchRan2019 to 2027Enrolled720ConditionsPTSD, Depression, Alcohol Use Disorder, Opioid Use DisorderArmsParticipatory System Dynamics (PSD), Audit and Feedback (AF)
3 · Its place in the literature

Who cites it

112 citing papers in PubMed, 6 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Pooled it
  7. Trial
  8. Trial
  9. Trial
  10. Trial
  11. Trial
  12. Trial
  13. Trial
  14. Trial
  15. Trial
  16. Trial
  17. Trial
  18. Randomized trial of enhanced profiling in substance abuse treatment.Administration and policy in mental health · 2011
    Trial
  19. Trial
  20. Trial

52 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

R FoyCentre for Health Services Research, University of Newcastle upon Tyne, Newcastle upon Tyne, United Kingdom. r.c.foy@ncl.ac.uk
M P Eccles
G Jamtvedt
J Young
J M Grimshaw
R Baker

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundImproving the quality of health care requires a range of evidence-based activities. Audit and feedback is commonly used as a quality improvement tool in the UK National Health Service [NHS]. We set out to assess whether current guidance and systematic review evidence can sufficiently inform practical decisions about how to use audit and feedback to improve quality of care.

methodsWe selected an important chronic disease encountered in primary care: diabetes mellitus. We identified recommendations from National Institute for Clinical Excellence (NICE) guidance on conducting audit and generated questions which would be relevant to any attempt to operationalise audit and feedback in a healthcare service setting. We explored the extent to which a systematic review of audit and feedback could provide practical guidance about whether audit and feedback should be used to improve quality of diabetes care and, if so, how audit and feedback could be optimised.

resultsNational guidance suggests the importance of securing the right organisational conditions and processes. Review evidence suggests that audit and feedback can be effective in changing healthcare professional practice. However, the available evidence says relatively little about the detail of how to use audit and feedback most efficiently.

conclusionAudit and feedback will continue to be an unreliable approach to quality improvement until we learn how and when it works best. Conceptualising audit and feedback within a theoretical framework offers a way forward.

Indexed as

Diabetes MellitusEvidence-Based MedicineFeedbackMedical AuditPractice Guidelines as TopicPrimary Health CareQuality Assurance, Health CareHumansPatient Education as TopicState MedicineSystematic Reviews as TopicUnited Kingdom

Identifiers

PMID16011811
PMCPMC1183206

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.