Evidence map›Paper›PMID 38581009›Full record

ArticleBMC health services research2024

Developing a questionnaire to evaluate an automated audit & feedback intervention: a Rand-modified Delphi method.

Ine Van den Wyngaert, Gijs Van Pottelbergh, Kristien Coteur, Bert Vaes, Steve Van den Bulck

Abstract read
In one paragraph

Article in BMC health services research, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed.

  1. Article
  2. Article
  3. Development and early implementation of automated audit and feedback monitoring instruments in Belgian primary care: lessons for scalable systems.International journal for quality in health care : journal of the International Society for Quality in Health Care · 2026
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Ine Van den WyngaertAcademic Centre for General Practice, Department of Public Health and Primary Care, University of Leuven, Leuven, Belgium. ine.vandenwyngaert@kuleuven.be.
Gijs Van PottelberghAcademic Centre for General Practice, Department of Public Health and Primary Care, University of Leuven, Leuven, Belgium.
Kristien CoteurAcademic Centre for General Practice, Department of Public Health and Primary Care, University of Leuven, Leuven, Belgium.
Bert VaesAcademic Centre for General Practice, Department of Public Health and Primary Care, University of Leuven, Leuven, Belgium.
Steve Van den BulckAcademic Centre for General Practice, Department of Public Health and Primary Care, University of Leuven, Leuven, Belgium.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundAudit and feedback (A&F) is a widely used implementation strategy to evaluate and improve medical practice. The optimal design of an A&F system is uncertain and structured process evaluations are currently lacking. This study aimed to develop and validate a questionnaire to evaluate the use of automated A&F systems.

methodsBased on the Clinical Performance Feedback Intervention Theory (CP-FIT) and the REFLECT-52 (REassessing audit & Feedback interventions: a tooL for Evaluating Compliance with suggested besT practices) evaluation tool a questionnaire was designed for the purpose of evaluating automated A&F systems. A Rand-modified Delphi method was used to develop the process evaluation and obtain validation. Fourteen experts from different domains in primary care consented to participate and individually scored the questions on a 9-point Likert scale. Afterwards, the questions were discussed in a consensus meeting. After approval, the final questionnaire was compiled.

resultsA 34-question questionnaire composed of 57 items was developed and presented to the expert panel. The consensus meeting resulted in a selection of 31 questions, subdivided into 43 items. A final list of 30 questions consisting of 42 items was obtained.

conclusionA questionnaire consisting of 30 questions was drawn up for the assessment and improvement of automated A&F systems, based on CP-FIT and REFLECT-52 theory and approved by experts. Next steps will be piloting and implementation of the questionnaire.

Indexed as

Process Assessment, Health CareDelphi TechniqueFeedbackHumansSurveys and QuestionnairesAudit and feedbackDelphi methodMedical auditProcess evaluationQuality of health careQuestionnaire

Identifiers

PMID38581009
PMCPMC10998400

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.