SynthesisPloS one2011
Using and reporting the Delphi method for selecting healthcare quality indicators: a systematic review.
Synthesis in PloS one, 2011. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT04381260 (RUral dispaRities in prehospitAL STEMI), which is not on this map. Cited by 895 papers, 13 of them syntheses that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
RUral dispaRities in prehospitAL STEMI
Who cites it
895 citing papers in PubMed, 13 syntheses or guidelines pooled it.
- Systematic review and scoring-based selection of pharmacokinetic models for precision dosing of vancomycin in neonates and children.British journal of clinical pharmacology · 2026Pooled it
- Methodological evaluation of the psychometric properties of medication-related quality indicators in residential aged care homes: a systematic review.International journal for quality in health care : journal of the International Society for Quality in Health Care · 2026Pooled it
- Increasing the environmental sustainability of operating rooms in Canada: an evidence-informed guideline for policy.CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne · 2026Guideline
- International Society for Diseases of the Esophagus consensus on the diagnosis and treatment of anastomotic leak after esophagectomy.Diseases of the esophagus : official journal of the International Society for Diseases of the Esophagus · 2026Guideline
- Primary and Revisional One Anastomosis Gastric Bypass: A Systematic Review and GRADE-Based IFSO Position Statement.Obesity surgery · 2026Pooled it
- Clinical significance and minimal clinically important differences for the survival outcomes in randomized clinical trials of lung cancer.BMC cancer · 2025Pooled it
- Pooled it
- Z-drug abuse and dependence: clinical guideline of the Brazilian Academy of Neurology for diagnosis and management.Arquivos de neuro-psiquiatria · 2025Guideline
- Guideline
- RECOVER Guidelines: Newborn Resuscitation in Dogs and Cats. Evidence and Knowledge Gap Analysis With Treatment Recommendations.Journal of veterinary emergency and critical care (San Antonio, Tex. : 2001) · 2025Pooled it
- RECOVER Guidelines: Newborn Resuscitation in Dogs and Cats. Clinical Guidelines.Journal of veterinary emergency and critical care (San Antonio, Tex. : 2001) · 2025Guideline
- Outcome metrics in recommended performance measurement tools for emergency department performance evaluation: a systematic review.Scandinavian journal of trauma, resuscitation and emergency medicine · 2025Pooled it
- Evidence-based joint statement position of perioperative bone optimization in the arthroplasty candidate, from FEMECOT, AMMOM, ACOMM, SCCOT, SECOT, SEFRAOS, SEIOMM.Osteoporosis international : a journal established as result of cooperation between the European Foundation for Osteoporosis and the National Osteoporosis Foundation of the USA · 2025Guideline
- Learning to manage tracheostomy-related emergencies: a pilot study comparing three teaching strategies for junior doctors in intensive care.BMC medical education · 2026Trial
- Concise stakeholder-informed tool for reporting modifications to innovative surgical procedures and devices: Surgical ModificAtion Reporting Tool (SMART) checklist.The British journal of surgery · 2026Article
- Promising Patient-Engagement Practices Used by National Research Networks at the US Veterans Health Administration: Perspectives of Veterans, Staff, and Research Leaders.Learning health systems · 2026Article
- Physical Exercise in Obesity and Metabolic Bariatric Surgery: The First Latin American Consensus.Obesity surgery · 2026Article
- A tiered training program for emergency nurses' core competencies based on Kolb's Experiential Learning Cycle: A Delphi study.BMC nursing · 2026Article
- Delphi consensus of specialist radiologists on imaging criteria for gadolinium contrast use and whole-body MRI in prostate cancer.Insights into imaging · 2026Article
- Key Strategies for Improving Psychiatric Home-Based Care in Spain: A Modified Delphi Study.Scandinavian journal of caring sciences · 2026Article
835 more citing papers are in PubMed but not listed here.
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
5 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
objectiveDelphi technique is a structured process commonly used to developed healthcare quality indicators, but there is a little recommendation for researchers who wish to use it. This study aimed 1) to describe reporting of the Delphi method to develop quality indicators, 2) to discuss specific methodological skills for quality indicators selection 3) to give guidance about this practice. METHODOLOGY AND MAIN FINDING: Three electronic data bases were searched over a 30 years period (1978-2009). All articles that used the Delphi method to select quality indicators were identified. A standardized data extraction form was developed. Four domains (questionnaire preparation, expert panel, progress of the survey and Delphi results) were assessed. Of 80 included studies, quality of reporting varied significantly between items (9% for year's number of experience of the experts to 98% for the type of Delphi used). Reporting of methodological aspects needed to evaluate the reliability of the survey was insufficient: only 39% (31/80) of studies reported response rates for all rounds, 60% (48/80) that feedback was given between rounds, 77% (62/80) the method used to achieve consensus and 57% (48/80) listed quality indicators selected at the end of the survey. A modified Delphi procedure was used in 49/78 (63%) with a physical meeting of the panel members, usually between Delphi rounds. Median number of panel members was 17(Q1:11; Q3:31). In 40/70 (57%) studies, the panel included multiple stakeholders, who were healthcare professionals in 95% (38/40) of cases. Among 75 studies describing criteria to select quality indicators, 28 (37%) used validity and 17(23%) feasibility.
conclusionThe use and reporting of the Delphi method for quality indicators selection need to be improved. We provide some guidance to the investigators to improve the using and reporting of the method in future surveys.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.