Evidence map›Paper›PMID 28494799›Full record

SynthesisImplementation science : IS2017

A systematic review of electronic audit and feedback: intervention effectiveness and use of behaviour change theory.

Timothy Tuti, Jacinta Nzinga, Martin Njoroge, Benjamin Brown, Niels Peek, Mike English, Chris Paton, Sabine N van der Veer

Open access · goldAbstract readMeta-AnalysisMulticenter StudySystematic Review
In one paragraph

Synthesis in Implementation science : IS, 2017. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 76 papers, 15 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
76citing papers in PubMed, 15 pooled it
23.1field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

76 citing papers in PubMed, 15 syntheses or guidelines pooled it, 153 citations in OpenAlex.

  1. Pooled it
  2. Audit and feedback: effects on professional practice.The Cochrane database of systematic reviews · 2025
    Pooled it
  3. Pooled it
  4. Pooled it
  5. Pooled it
  6. Pooled it
  7. A Systematic Review of Electronic Medical Record Driven Quality Measurement and Feedback Systems.International journal of environmental research and public health · 2022
    Pooled it
  8. Pooled it
  9. Pooled it
  10. Systematic review and narrative synthesis of computerized audit and feedback systems in healthcare.Journal of the American Medical Informatics Association : JAMIA · 2022
    Pooled it
  11. Pooled it
  12. Pooled it
  13. Pooled it
  14. Pooled it
  15. Pooled it
  16. Trial
  17. Trial
  18. Trial
  19. Trial
  20. Article

16 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors at 3 institutions in 2 countries.

Timothy TutiKEMRI-Wellcome Trust Research Programme, Nairobi, Kenya. TTuti@kemri-wellcome.org.ORCID 0000-0002-7915-3004
Jacinta NzingaKEMRI-Wellcome Trust Research Programme, Nairobi, Kenya.
Martin NjorogeKEMRI-Wellcome Trust Research Programme, Nairobi, Kenya.
Benjamin BrownCentre for Health Informatics, Division of Informatics, Imaging and Data Sciences, Faculty of Biology, Medicine and Health, Manchester Academic Health Science Centre, The University of Manchester, Manchester, UK.
Niels PeekCentre for Health Informatics, Division of Informatics, Imaging and Data Sciences, Faculty of Biology, Medicine and Health, Manchester Academic Health Science Centre, The University of Manchester, Manchester, UK.
Mike EnglishKEMRI-Wellcome Trust Research Programme, Nairobi, Kenya.
Chris PatonNuffield Department of Medicine, Oxford University, Oxford, UK.
Sabine N van der VeerCentre for Health Informatics, Division of Informatics, Imaging and Data Sciences, Faculty of Biology, Medicine and Health, Manchester Academic Health Science Centre, The University of Manchester, Manchester, UK.
Kenya Medical Research Institute · KEManchester Academic Health Science Centre · GBUniversity of Oxford · GB

Funding

Medical Research Council MC_PC_13042Medical Research Council MR/K006665/1Wellcome TrustWellcome Trust 092654Wellcome Trust 097170Wellcome Trust 106823
6 · The paper itself

Abstract

backgroundAudit and feedback is a common intervention for supporting clinical behaviour change. Increasingly, health data are available in electronic format. Yet, little is known regarding if and how electronic audit and feedback (e-A&F) improves quality of care in practice.

objectiveThe study aimed to assess the effectiveness of e-A&F interventions in a primary care and hospital context and to identify theoretical mechanisms of behaviour change underlying these interventions.

methodsIn August 2016, we searched five electronic databases, including MEDLINE and EMBASE via Ovid, and the Cochrane Central Register of Controlled Trials for published randomised controlled trials. We included studies that evaluated e-A&F interventions, defined as a summary of clinical performance delivered through an interactive computer interface to healthcare providers. Data on feedback characteristics, underlying theoretical domains, effect size and risk of bias were extracted by two independent review authors, who determined the domains within the Theoretical Domains Framework (TDF). We performed a meta-analysis of e-A&F effectiveness, and a narrative analysis of the nature and patterns of TDF domains and potential links with the intervention effect.

resultsWe included seven studies comprising of 81,700 patients being cared for by 329 healthcare professionals/primary care facilities. Given the extremely high heterogeneity of the e-A&F interventions and five studies having a medium or high risk of bias, the average effect was deemed unreliable. Only two studies explicitly used theory to guide intervention design. The most frequent theoretical domains targeted by the e-A&F interventions included 'knowledge', 'social influences', 'goals' and 'behaviour regulation', with each intervention targeting a combination of at least three. None of the interventions addressed the domains 'social/professional role and identity' or 'emotion'. Analyses identified the number of different domains coded in control arm to have the biggest role in heterogeneity in e-A&F effect size.

conclusionsGiven the high heterogeneity of identified studies, the effects of e-A&F were found to be highly variable. Additionally, e-A&F interventions tend to implicitly target only a fraction of known theoretical domains, even after omitting domains presumed not to be linked to e-A&F. Also, little evaluation of comparative effectiveness across trial arms was conducted. Future research should seek to further unpack the theoretical domains essential for effective e-A&F in order to better support strategic individual and team goals.

Indexed as

FeedbackMedical AuditBehavior TherapyElectronic Health RecordsHealth PersonnelHumansPrimary Health CareQuality of Health CareBehaviour and behaviour mechanismsFeedbackMedical auditMeta-analysisPerformanceTheoryUser-computer interface

Identifiers

PMID28494799
PMCPMC5427645
OpenAlexW2611998760

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.