Evidence map›Paper›PMID 25427972›Full record

ArticleBMC research notes2014

Tools for assessing the content of guidelines are needed to enable their effective use--a systematic comparison.

Michaela Eikermann, Nicole Holzmann, Ulrich Siering, Alric Rüther

Open access · goldAbstract readComparative Study
In one paragraph

Article in BMC research notes, 2014. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 15 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
15citing papers in PubMed, 1 pooled it
1.0field-weighted citation impact, top 20% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

15 citing papers in PubMed, 1 synthesis or guideline pooled it, 31 citations in OpenAlex.

  1. Migrant Healthcare Guidelines: A Systematic Quality Assessment.Journal of immigrant and minority health · 2019
    Pooled it
  2. Review
  3. Article
  4. COPD Action Plans: Gaps in Development Methods, Content, and Format.International journal of chronic obstructive pulmonary disease · 2026
    Review
  5. Treatments for non-small cell lung cancer: a systematic quality assessment of clinical practice guidelines.Clinical & translational oncology : official publication of the Federation of Spanish Oncology Societies and of the National Cancer Institute of Mexico · 2023
    Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Is it time to develop AGREE III?CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne · 2019
    Article
  12. Article
  13. Article
  14. Assessing Strength of Evidence of Appropriate Use Criteria for Diagnostic Imaging Examinations.Journal of the American Medical Informatics Association : JAMIA · 2016
    Article
  15. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors at 1 institution in 1 country.

Michaela EikermannDepartment Evidence-based Health Services Research, Faculty of Health, Department of Medicine, Institute for Research in Operative Medicine (IFOM), Witten/Herdecke University, Ostmerheimer Str, 200, Building 38, 51109 Cologne, Germany. michaela.eikermann@uni-wh.de.
Nicole Holzmann
Ulrich Siering
Alric Rüther
Institute for Quality and Efficiency in Health Care · DE

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundTo ensure that clinical practice guidelines (CPGs) form a sound basis for decision-making in health care, it is necessary to be able to reliably assess and ensure their quality. This results in the need to assess the content of guidelines systematically, particularly with regard to the validity of their recommendations.The aim of the present analysis was to determine the suitability and applicability of frequently used assessment tools for evidence syntheses with regard to the assessment of guideline content.

methodsWe conducted a systematic comparison and analysis of established tools for the assessment of evidence syntheses (guidelines, systematic reviews, health technology assessments). The tools analyzed were: ADAPTE, AGREE II, AMSTAR, GLIA and the INAHTA checklist. We analyzed methodological steps related to the assessment of the reliability and validity of guideline recommendations. Data were extracted and analyzed by two persons independently of one another.

resultsWidely used tools for the methodological assessment of evidence syntheses are not suitable for a comprehensive content-related assessment. They remain mostly at the level of assessment of the documentation of processes. Some tools assess selected content-related aspects, but operationalization is either unspecific or lacking.

conclusionNone of the tools analyzed enables the structured and comprehensive assessment of the content of guideline recommendations with special regard to their reliability and validity. All tools contribute towards the judicious use of evidence syntheses by supporting their systematic development or assessment. However, further progress is needed, particularly with regard to the assessment of content quality. This includes comprehensive operationalization and documentation of the assessment process to ensure reliability and validity, and therefore to enable the effective use of trustworthy guidelines in the health care system.

Indexed as

Practice Guidelines as TopicBiomedical TechnologyEvidence-Based MedicineHumansQuality ControlQuality of Health CareReproducibility of ResultsResearch Design

Identifiers

PMID25427972
PMCPMC4258382
OpenAlexW2105956623

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.