Evidence map›Paper›PMID 41701301›Full record

ArticleInternational journal of clinical pharmacy2026

Nationwide validation of the CLEO tool to evaluate the relevance of pharmacists' interventions in German hospitals.

Vivien Berger, Annika van der Linde, Lisa Cuba, Charlotte Horn, Denise Köster, Heike Lanzinger, Katharina Wien, Ha Thi Vo, Pierrick Bedouch, Claudia Langebrake

Abstract readValidation Study
In one paragraph

Article in International journal of clinical pharmacy, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed.

  1. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

10 authors.

Vivien BergerHospital Pharmacy, University Medical Center Hamburg-Eppendorf, Hamburg, Germany. v.berger@uke.de.ORCID http://orcid.org/0000-0002-6424-6013
Annika van der LindeHospital Pharmacy, University Medical Center Hamburg-Eppendorf, Hamburg, Germany.
Lisa CubaPharmacy Department, Universitätsklinikum Erlangen and Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany.ORCID http://orcid.org/0000-0002-4287-8503
Charlotte HornPharmacy Department, University Hospital Carl Gustav Carus, Dresden, Germany.
Denise KösterInstitute of Medical Biometry and Epidemiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany.ORCID http://orcid.org/0000-0003-0975-3650
Heike LanzingerHospital Pharmacy, General Hospital Heidenheim, Heidenheim, Germany.
Katharina WienHospital Pharmacy, University Hospital Schleswig-Holstein, Lübeck, Germany.ORCID http://orcid.org/0000-0001-6516-4119
Ha Thi VoPham Ngoc, Thach University of Medicine, Ho Chi Minh City, Vietnam.ORCID http://orcid.org/0000-0001-6170-0957
Pierrick BedouchUF Pharmacie Clinique, Pôle Pharmacie, CHU Grenoble-Alpes, Grenoble, France.ORCID http://orcid.org/0000-0003-2245-0160
Claudia LangebrakeHospital Pharmacy, University Medical Center Hamburg-Eppendorf, Hamburg, Germany.ORCID http://orcid.org/0000-0003-1249-4223

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

introductionThe clinical relevance of pharmacists' interventions (PIs) is complex to determine. The CLEO tool is a multidimensional scoring system to assess the relevance of PIs across three dimensions: clinical, economic, and organisational impact.

aimThis study aimed to nationwide validate the CLEO tool by clinical pharmacists in German hospitals using structured and representative clinical cases.

methodThe German CLEO version was adapted to the German hospital setting and supplemented with practical examples. Fifty up-to-date cases from the inpatient setting were developed in a multistage process following the Identification, Situation, Background, Assessment, Recommendation structure. In the first round, each rater was randomly assigned 20 from the pool of 50 clinical cases, ensuring that all cases were evaluated by multiple raters. After a 14-day washout period, the same 20 cases were reassessed by the same raters. In the second round, all raters from the first round were invited again, and a subset who volunteered assessed another 20 cases after intensified training. Inter- and intra-rater reliability were calculated using Krippendorff's α and the intraclass correlation coefficient (ICC). User feedback was collected through a 16-item questionnaire.

resultsA total of 79 pharmacists from 56 hospitals participated in the first round; 27 completed the second round as well. Inter-rater reliability was poor across all three CLEO dimensions (Krippendorff's α < 0.67), both overall and among experienced clinical pharmacists. Intra-rater reliability was good for all dimensions (ICC 0.63-0.74), highest for the clinical dimension (0.74). Most raters (77%) needed less than one minute per case. Overall, the CLEO tool was perceived by users as appropriate, precise, acceptable and feasible (mean score 5.36; 7-point Likert scale; 1 = strongly disagree, 7 = strongly agree).

conclusionSince clinical pharmacy is still a developing discipline in German hospitals, differences in clinical practice and professional expertise complicate the evaluation of PIs. While intra-rater reliability was good, the validation of the CLEO tool in Germany did not achieve satisfactory inter-rater reliability. The CLEO tool may be useful within institutions with shared standards, but broader application across diverse settings in Germany requires additional training, further research and standardisation of clinical pharmacy services.

Indexed as

PharmacistsPharmacy Service, HospitalProfessional RoleFemaleGermanyHumansMaleReproducibility of ResultsSurveys and QuestionnairesClinical pharmacyDrug-related problems (DRPs)Medication error (ME)Medication reviewPharmacists’ interventionValidation

Identifiers

PMID41701301
PMCPMC13176046

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.