Evidence map›Paper›PMID 30496227›Full record

ArticlePloS one2018

Development of actionable quality indicators and an action implementation toolbox for appropriate antibiotic use at intensive care units: A modified-RAND Delphi study.

Marlot C Kallen, Marie-Jose Roos-Blom, Dave A Dongelmans, Jeroen A Schouten, Wouter T Gude, Evert de Jonge, Jan M Prins, Nicolette F de Keizer

Abstract read
In one paragraph

Article in PloS one, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 16 papers.

0numbers the graph read from it
0cells of the map it votes in
16citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

16 citing papers in PubMed.

  1. Article
  2. Article
  3. Comprehensive Evaluation of Quality Indicators: Analyzing the Dutch Breast Cancer Audit.International journal of health policy and management · 2025
    Article
  4. Review
  5. Article
  6. Article
  7. Article
  8. Article
  9. Organization of antibiotic stewardship in Europe: the way to go.Wiener medizinische Wochenschrift (1946) · 2021
    Article
  10. Article
  11. Article
  12. Observational
  13. Article
  14. Article
  15. Article
  16. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors.

Marlot C KallenAmsterdam UMC, University of Amsterdam, Department of Infectious Diseases, Amsterdam, The Netherlands.ORCID 0000-0003-1339-6465
Marie-Jose Roos-BlomAmsterdam UMC, University of Amsterdam, Department of Medical Informatics, Amsterdam Public Health Research Institute, Amsterdam, The Netherlands.
Dave A DongelmansNational Intensive Care Evaluation (NICE) Foundation, Amsterdam, The Netherlands.
Jeroen A SchoutenCanisius Wilhelmina Hospital, Department of Intensive Care Medicine, Nijmegen, The Netherlands.
Wouter T GudeAmsterdam UMC, University of Amsterdam, Department of Medical Informatics, Amsterdam Public Health Research Institute, Amsterdam, The Netherlands.
Evert de JongeNational Intensive Care Evaluation (NICE) Foundation, Amsterdam, The Netherlands.
Jan M PrinsAmsterdam UMC, University of Amsterdam, Department of Infectious Diseases, Amsterdam, The Netherlands.
Nicolette F de KeizerAmsterdam UMC, University of Amsterdam, Department of Medical Informatics, Amsterdam Public Health Research Institute, Amsterdam, The Netherlands.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

introductionExtensive antibiotic use makes the intensive care unit (ICU) an important focus for antibiotic stewardship programs. The aim of this study was to develop a set of actionable quality indicators for appropriate antibiotic use at ICUs and an implementation toolbox, which can be used to assess and improve the appropriateness of antibiotic use in the treatment of adult patients at an ICU.

methodsA four round modified-RAND Delphi procedure was used. Potential indicators were identified by a multidisciplinary panel of 15 Dutch experts, from international literature and guidelines. Using an online survey, the identified indicators were rated on three criteria: relevance, actionability and feasibility. Experts discussed and rated the indicators for the second time during a face-to-face consensus meeting. During a final consensus meeting the toolbox was developed, containing potential barriers and improvement strategies which were identified using a validated checklist by Flottorp et al., and if available also containing supporting material.

resultsThe first round resulted in 24 potential indicators. After the final meeting a set of three process indicators, one structure indicator and one quantity metric remained: 1) perform at least two sets of blood cultures before start of empirical systemic therapy; 2) perform therapeutic drug monitoring in patients treated with vancomycin or aminoglycosides; 3) perform surveillance cultures if selective digestive or oropharyngeal decontamination is applied at the ICU; 4) biannual face-to-face meetings between ICU and microbiology staff in which local resistance rates are discussed; and 5) quantitative antibiotic use at the ICU expressed in days of therapy (DOT). The toolbox contains 24 unique barriers and 37 improvement strategies.

conclusionsOur study identified a set of four actionable quality indicators and one quantity metric, together with an implementation toolbox, to improve appropriate antibiotic use at ICUs.

Indexed as

Decision Support TechniquesAnti-Bacterial AgentsAntimicrobial StewardshipDelphi TechniqueHumansIntensive Care UnitsNetherlandsQuality Indicators, Health CareSurveys and QuestionnairesAnti-Bacterial Agents

Identifiers

PMID30496227
PMCPMC6264509

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.