Evidence map›Paper›PMID 34322364›Full record

ReviewWorld journal of methodology2021

Delphi methodology in healthcare research: How to decide its appropriateness.

Prashant Nasa, Ravi Jain, Deven Juneja

10 registry-linked trialsAbstract readReview
In one paragraph

Review in World journal of methodology, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to 10 registered trials, which are not on this map. Cited by 886 papers, 6 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
886citing papers in PubMed, 6 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT05007704 completednot on this map

Competencies Required by Anesthesiologists Managing Critically Ill Medical and Surgical Patients in an Intensive Care Unit

TypeobservationalSponsorPrashant NasaRan2021 to 2022Enrolled1,155ConditionsTraining, Education, CompetenceArmsGlobal Experts Consensus opinion using Delphi Methodology
NCT05762068 completednot on this mapstarted 2023, after this paper: background citation

Expert Consensus Statements for the Management of a Physiologically Difficult Airway Using the Delphi Method (PDADelphi)

TypeobservationalSponsorUniversity of Texas Southwestern Medical CenterRan2023 to 2024Enrolled35ConditionsIntubation, Difficult or Failed, Intubation Complication, Hemodynamic InstabilityArmsDelphi procedure
NCT05948332 completednot on this mapstarted 2023, after this paper: background citation

Definition and Management of Right Ventricular Injury in Adult Patients Receiving Extracorporeal Membrane Oxygenation for Respiratory Support Using the Delphi Method: A PRORVnet - Expert Consensus Statements

TypeobservationalSponsorPrashant NasaRan2023 to 2024Enrolled52ConditionsExtracorporeal Circulation, Complications, Extracorporeal Membrane Oxygenation Complication, Right Heart FailureArmsDelphi Rounds to generate consensus opinions among Experts
NCT06159465 completednot on this mapstarted 2023, after this paper: background citation

Consensus Statements on the Utility of Defining ARDS and the Utility of Past and Current Definitions of ARDS--Protocol for a Delphi Study

TypeobservationalSponsorNMC Specialty HospitalRan2023 to 2024Enrolled40ConditionsRespiratory Distress Syndrome, Adult, Hypoxemic Respiratory Failure, Respiratory Failure, Phenotypic Abnormality
NCT06356402 naunknown statusnot on this mapstarted 2024, after this paper: background citation

A Feasibility Study of the Investigation on the Efficacy of Oral Health Education for Mothers (OHEM) Module for Improving Oral Hygiene in Children.

TypeinterventionalSponsorZiauddin UniversityRan2024 to 2025Enrolled540ConditionsDental Plaque, GingivitisArmsOral Health Educational Module for Mothers (OHEM) lecture, Oral Health Educational Module for Mothers (OHEM) exhibition, Oral Health Educational Module for Mothers (OHEM) demonstration
NCT06585215 enrolling by invitationnot on this map

Expert Survey, Interactive Case Planning, and Modified Delphi Consensus: A Comprehensive Approach to Define Standards for Physician-Modified Stent Grafts in the Treatment of Abdominal Aortic Aneurysms

TypeobservationalSponsorEnte Ospedaliero Cantonale, BellinzonaRan2014 to 2025Enrolled100ConditionsAbdominal Aortic Aneurysm, Endovascular Procedures, Stents, Vascular Surgical Procedures
NCT06726135 not yet recruitingnot on this mapstarted 2025, after this paper: background citation

The National Rehabilitation Centre Dataset. Development of a Minimum Dataset for Multidisciplinary Rehabilitation: a Modified E-Delphi Study

Typeobservational_patient_registrySponsorThomasCorbettRan2025 to 2025Enrolled50ConditionsPain, Traumatic Brain Injury, Major Trauma, Multiple Sclerosis
NCT07258030 recruitingnot on this mapstarted 2025, after this paper: background citation

Development of a Decision Algorithm for Vital Sign Assessment in the Outpatient Physical Therapy Setting: An e-Delphi Study

TypeobservationalSponsorYoungstown State UniversityRan2025 to 2026Enrolled100ConditionsHealthyArmsE-Delphi
NCT07481435 not yet recruitingnot on this mapstarted 2026, after this paper: background citation

TRacheostomy in DElphi for iNTensive Care' (TRiDENT)

TypeobservationalSponsorUniversita degli Studi di GenovaRan2026 to 2026Enrolled40ConditionsDelphi Process, Delphi StudyArmsDelphi Consensus Process
NCT07563842 enrolling by invitationnot on this mapstarted 2025, after this paper: background citation

Expert Consensus On Definitions And Management Of Intra-Abdominal Hypertension And Abdominal Compartment Syndrome

Typeobservational_patient_registrySponsorMedical University of LublinRan2025 to 2026Enrolled60ConditionsAbdominal Hypertension, Abdominal Compartment SyndromeArmsDelphi study
3 · Its place in the literature

Who cites it

886 citing papers in PubMed, 6 syntheses or guidelines pooled it.

  1. International Society for Heart and Lung Transplantation Scientific Statement on pulmonary antibody-mediated rejection and proposed graft, antibody, and pathology (GAP) definition.The Journal of heart and lung transplantation : the official publication of the International Society for Heart Transplantation · 2026
    Guideline
  2. Pooled it
  3. Guideline
  4. Pooled it
  5. Pooled it
  6. Pooled it
  7. Trial
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Fertility-Sparing Treatment of Endometrial Cancer: Survey of Australian Practice.The Australian & New Zealand journal of obstetrics & gynaecology · 2026
    Article
  14. Article
  15. Article
  16. The consensus-based CINEX guideline for reporting clinical information extraction studies.Journal of the American Medical Informatics Association : JAMIA · 2026
    Article
  17. Equitable Patient and Public Involvement Strategies for Scaling Health and Social Care Interventions: A Consensus Study Inspired by Delphi Methods.Health expectations : an international journal of public participation in health care and health policy · 2026
    Article
  18. Article
  19. Article
  20. Article

826 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Prashant NasaDepartment of Critical Care Medicine, NMC Specialty Hospital, Dubai 00000, United Arab Emirates. dr.prashantnasa@hotmail.com.
Ravi JainCritical Care Medicine, Mahatma Gandhi Medical College and Hospital, Jaipur 302001, Rajasthan, India.
Deven JunejaInstitute of Critical Care Medicine, Max Super Speciality Hospital, New Delhi 110017, India.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

The Delphi technique is a systematic process of forecasting using the collective opinion of panel members. The structured method of developing consensus among panel members using Delphi methodology has gained acceptance in diverse fields of medicine. The Delphi methods assumed a pivotal role in the last few decades to develop best practice guidance using collective intelligence where research is limited, ethically/logistically difficult or evidence is conflicting. However, the attempts to assess the quality standard of Delphi studies have reported significant variance, and details of the process followed are usually unclear. We recommend systematic quality tools for evaluation of Delphi methodology; identification of problem area of research, selection of panel, anonymity of panelists, controlled feedback, iterative Delphi rounds, consensus criteria, analysis of consensus, closing criteria, and stability of the results. Based on these nine qualitative evaluation points, we assessed the quality of Delphi studies in the medical field related to coronavirus disease 2019. There was inconsistency in reporting vital elements of Delphi methods such as identification of panel members, defining consensus, closing criteria for rounds, and presenting the results. We propose our evaluation points for researchers, medical journal editorial boards, and reviewers to evaluate the quality of the Delphi methods in healthcare research.

Indexed as

ConsensusCoronavirus disease 2019Delphi studiesDelphi techniqueExpert panelQuality tools for methodologyResearch methodsSARS-CoV-2

Identifiers

PMID34322364
PMCPMC8299905

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

and 4 more above

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.