Evidence map›Paper›PMID 39984946›Full record

ArticleScandinavian journal of trauma, resuscitation and emergency medicine2025

Determining the methodological rigor and overall quality of out-of-hospital clinical practice guidelines: a scoping review.

Brendan V Schultz, Timothy H Barker, Emma Bosley, Zachary Munn

Abstract readScoping Review
In one paragraph

Article in Scandinavian journal of trauma, resuscitation and emergency medicine, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed.

  1. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Brendan V SchultzJBI, School of Public Health, Faculty of Health and Medical Science, The University of Adelaide, Adelaide, SA, Australia. brendan.schultz@ambulance.qld.gov.au.
Timothy H BarkerHealth Evidence Synthesis, Recommendations, and Impact (HESRI), School of Public Health, Faculty of Health and Medical Science, The University of Adelaide, Adelaide, SA, Australia.
Emma BosleyQueensland Ambulance Service, Department of Health, Queensland Government, 125 Kedron Park Road, Kedron, Brisbane, QLD, 4031, Australia.
Zachary MunnHealth Evidence Synthesis, Recommendations, and Impact (HESRI), School of Public Health, Faculty of Health and Medical Science, The University of Adelaide, Adelaide, SA, Australia.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectivesOut-of-hospital clinical practice guidelines (CPGs) guide paramedics, emergency medical technicians and first responders, but their quality remains uncertain. This scoping review aims to identify, aggregate and describe all literature that has used a structured appraisal instrument to assess the methodological rigor and overall quality of out-of-hospital CPGs.

methodsThis study was conducted in accordance with the JBI methodology for scoping reviews and involved systematically searching the following databases and/or information sources with no publication or language limit applied: MEDLINE (Ovid), Embase (Elsevier), CINAHL with full text (EBSCO), Scopus (Elsevier), ProQuest Central (ProQuest).

resultsThis review identified 15 articles that appraised 311 unique out-of-hospital CPGs. These CPGs ranged in date of publication from 1998 to 2022. The majority of CPGs (267/311) were assessed using the Appraisal of Guidelines for Research & Evaluation (AGREE-II) instrument, with 146 guidelines appraised against two tools. Following aggregation, CPGs scored highest in Domain 4 (clarity of presentation) at 77.7% (SD = 15.1%), and lowest in Domain 5 (applicability) at 42.6% (SD = 23.7%). The average Domain 3 score (rigor of development) was 55.6% (SD = 25.7%). Of CPGs appraised against the AGREE-II instrument, 34.4% met our a priori definition of being high-quality (Domain 3 score of equal to or greater than 75%), while 31.3% were deemed medium-quality (Domain 3 score between 74% and 50%), and 34.3% were considered low-quality (Domain 3 score less than 50%). There were no significant changes observed in the average Domain 3 score over time (p = 0.092). 146 CPGs were assessed against the National Academy of Medicine criteria with 34.9% meeting all elements indicative of being a high-quality guideline, while 39 CPGs were assessed the 2016 National Health and Medical Research Council Standards for Guidelines with 0% meeting all criteria.

conclusionsOut-of-hospital CPGs currently have poor methodological rigor and are of medium to low overall quality. These results should be used to inform future research and initiatives that aim to standardize the methods used to develop guidelines used in this healthcare setting.

Indexed as

Emergency Medical ServicesPractice Guidelines as TopicHumansAmbulanceClinical practice guidelineGuideline appraisalParamedicinePre-hospital

Identifiers

PMID39984946
PMCPMC11846300

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.