Evidence map›Paper›PMID 33292847›Full record

ArticleImplementation science communications2020

Repeated analyses of national clinical audit reports demonstrate improvements in feedback methods.

Tasneem Khan, Sarah Alderson, Jill J Francis, Fabiana Lorencatto, John Grant-Casey, Simon J Stanworth, Robbie Foy

Abstract read
In one paragraph

Article in Implementation science communications, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 5 papers.

0numbers the graph read from it
0cells of the map it votes in
5citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

5 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Observational
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Tasneem KhanLeeds Institute for Health Sciences, University of Leeds, Leeds, UK. tasneemkhan@doctors.org.uk.ORCID http://orcid.org/0000-0003-3211-9324
Sarah AldersonLeeds Institute for Health Sciences, University of Leeds, Leeds, UK.
Jill J FrancisSchool of Health Sciences, City University of London, London, UK.
Fabiana LorencattoCentre for Behaviour Change, University College London, London, UK.
John Grant-CaseyNHS Blood and Transplant, Oxford, UK.
Simon J StanworthTransfusion Medicine, NHS Blood and Transplant, Oxford, UK.
Robbie FoyLeeds Institute for Health Sciences, University of Leeds, Leeds, UK.

Funding

Department of Health RP-PG-1210-12010Programme Grants for Applied Research RP-PG-1210-12010
6 · The paper itself

Abstract

backgroundThere is growing interest in the impact of national clinical audit programmes on the quality of healthcare. There is also an evolving evidence-base for enhancing the design and delivery of audit and feedback. We assessed the extent to which a sample of UK national clinical audit feedback reports met a set of good practice criteria over three time points.

methodsWe undertook three cross-sectional content analyses. We developed good practice criteria for the content and delivery of feedback based upon evidence, behavioural theory and expert opinion. We applied these to a feedback reports from 23 national audits listed on the Healthcare Quality Improvement Partnership (HQIP) website in November 2015. We repeated our assessments in January 2017 for 20 repeat feedback reports, after HQIP had published reporting guidance for national audits, and in August 2019 for a further 14 repeat feedback reports. We verified our assessments, where possible, with audit leads.

resultsFeedback reports consistently included strengths at baseline, including past or planned repeated audit cycles (21; 91%), stating the importance of the topic in relation to patient care (22; 93%), using multi-modal data presentation (23; 100%), and summarising key findings (23; 100%). We observed improvements over subsequent assessments, so that by 2019, at least 13 out of 14 (93%) feedback reports presented easily identifiable key findings and recommendations, linked recommendations to audit standards, and proposed easily identifiable action plans. Whilst the use of regional comparators did not improve, audit leads highlighted that programmes now provide local data via additional means. The main shortcoming was the time lag between data collection and feedback; none of the 14 reports assessed in 2019 presented performance data less than 6 months old. Audit leads highlighted that some of these data might be available via programme websites.

conclusionWe identified increased adherence to good practice in feedback by national clinical audit programmes that may enhance their impact on service delivery and outcomes. There is scope for improvement, especially in the recency of performance data. With further refinements, a criterion-based assessment offers an efficient means of monitoring the quality of national clinical audit feedback reports.

Indexed as

Audit and feedbackHealthcare quality improvementImplementation Science

Identifiers

PMID33292847
PMCPMC7691059

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.