Evidence map›Paper›PMID 34475183›Full record

SynthesisBMJ open2021

Patient participation in Delphi surveys to develop core outcome sets: systematic review.

Heather Barrington, Bridget Young, Paula R Williamson

Abstract readSystematic Review
In one paragraph

Synthesis in BMJ open, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 35 papers.

0numbers the graph read from it
0cells of the map it votes in
35citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

35 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Identifying social prescribing core outcomes using a Delphi approach: findings and future directions.Health promotion and chronic disease prevention in Canada : research, policy and practice · 2026
    Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Consensus on clinical outcome measures for lumbar spinal stenosis: recommendations from the ISSLS lumbar spinal stenosis taskforce.European spine journal : official publication of the European Spine Society, the European Spinal Deformity Society, and the European Section of the Cervical Spine Research Society · 2025
    Article
  14. Core outcome domains forERJ open research · 2025
    Article
  15. Article
  16. Article
  17. Review
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Heather BarringtonDepartment of Health Data Science, University of Liverpool, Liverpool, UK Heather.Barrington@liverpool.ac.uk.ORCID 0000-0001-9103-2670
Bridget YoungDepartment of Psychological Sciences, University of Liverpool, Liverpool, UK.
Paula R WilliamsonDepartment of Health Data Science, University of Liverpool, Liverpool, UK.

Funding

Medical Research Council MR/S014357/1
6 · The paper itself

Abstract

objectivesTo describe the design and conduct of core outcome set (COS) studies that have included patients as participants, exploring how study characteristics might impact their response rates.

designSystematic review of COS studies published between 2015 and 2019 that included more than one patient, carer or representative as participants (hereafter referred to as patients for brevity) in scoring outcomes in a Delphi.

resultsThere were variations in the design and conduct of COS studies that included patients in the Delphi process, including differing: scoring and feedback systems, approaches to recruiting patients, length of time between rounds, use of reminders, incentives, patient and public involvement, and piloting. Minimal reporting of participant characteristics and a lack of translation of Delphi surveys into local languages were found. Additionally, there were indications that studies that recruited patients through treatment centres had higher round two response rates than studies recruiting through patient organisations.

conclusionsVariability was striking in how COS Delphi surveys were designed and conducted to include patient participants and other stakeholders. Future research is needed to explore what motivates patients to take part in COS studies and what factors influence COS developer recruitment strategies. Improved reporting would increase knowledge of how methods affect patient participation in COS Delphi studies.

Indexed as

Patient ParticipationResearch DesignConsensusDelphi TechniqueHumansOutcome Assessment, Health CareTreatment Outcomegeneral medicine (see internal medicine)statistics & research methodssurgery

Identifiers

PMID34475183
PMCPMC8413947

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.