Evidence map›Paper›PMID 34154641›Full record

ReviewTrials2021

Methods for conducting international Delphi surveys to optimise global participation in core outcome set development: a case study in gastric cancer informed by a comprehensive literature review.

Bilal Alkhaffaf, Jane M Blazeby, Aleksandra Metryka, Anne-Marie Glenny, Ademola Adeyeye, Paulo Matos Costa, Ismael Diez Del Val, Suzanne S Gisbertz, Ali Guner, Simon Law and 14 more

Abstract readReview
In one paragraph

Review in Trials, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 6 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
6citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

6 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Article
  4. Article
  5. Article
  6. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

24 authors.

Bilal AlkhaffafDepartment of Oesophago-Gastric Surgery, Salford Royal Hospital, Salford Royal NHS Foundation Trust, Stott Lane, Manchester, M6 8HD, UK. bilal.alkhaffaf@srft.nhs.uk.ORCID http://orcid.org/0000-0001-5751-1846
Jane M BlazebyCentre for Surgical Research and Bristol and Weston NIHR Biomedical Research Centre, University of Bristol, Bristol, UK.
Aleksandra MetrykaPaediatric ENT Department, Royal Manchester Children's Hospital, Manchester University NHS Foundation Trust, Manchester, UK.
Anne-Marie GlennyDivision of Dentistry, School of Medical Sciences, Faculty of Biology, Medicine and Health, University of Manchester, Manchester, UK.
Ademola AdeyeyeUniversity of Ilorin Teaching Hospital, Ilorin, Nigeria.
Paulo Matos CostaHospital Garcia de Orta, Faculdade de Medicina da Universidade de Lisboa, Lisbon, Portugal.
Ismael Diez Del ValBasurto University Hospital, Bilbao, Spain.
Suzanne S GisbertzDepartment of Surgery, Cancer Center, Amsterdam UMC, University of Amsterdam, Amsterdam, The Netherlands.
Ali GunerDepartment of General Surgery, Faculty of Medicine, Karadeniz Technical University, Trabzon, Turkey.
Simon LawDepartment of Surgery, The University of Hong Kong, Hong Kong, China.
Hyuk-Joon LeeDepartment of Surgery and Cancer Research Institute, Seoul National University College of Medicine, Seoul, South Korea.
Ziyu LiPeking University Cancer Hospital and Institute, Beijing, China.
Koji NakadaDepartment of Laboratory Medicine, The Jikei University Daisan Hospital, Komae, Japan.
Rafael Mauricio Restrepo NuñezHospital Universitario Rey Juan Carlos, Mostoles, Spain.
Daniel ReimDepartment of Surgery, TUM School of Medicine, Munich, Germany.
John V ReynoldsDepartment of Surgery, Trinity Translational Medicine Institute and St James's Hospital, Dublin, Ireland.
Peter VorwaldHospital Universitario Fundación Jiménez Diaz, Madrid, Spain.
Daniela ZanottiRegional Centre for Oesophago-gastric Surgery, Broomfield Hospital, Chelmsford, UK.
William AllumDepartment of Academic Surgery, Royal Marsden NHS Foundation Trust, London, UK.
M Asif ChaudryDepartment of Academic Surgery, Royal Marsden NHS Foundation Trust, London, UK.
Ewen GriffithsUpper GI Unit, University Hospitals Birmingham NHS Foundation Trust, Queen Elizabeth Hospital Birmingham, Birmingham, UK.
Paula R Williamson *MRC North West Hub for Trials Methodology Research, University of Liverpool and a member of Liverpool Health Partners, Liverpool, UK.
Iain A Bruce *Division of Infection, Immunity and Respiratory Medicine, Faculty of Biology, Medicine and Health, University of Manchester, Manchester, UK.
GASTROS International Working Group

Funding

Department of Health DRF-2015-08-023Medical Research Council MR/K025643/1National Institute for Health Research DRF-2015-08-023
6 · The paper itself

Abstract

backgroundCore outcome sets (COS) should be relevant to key stakeholders and widely applicable and usable. Ideally, they are developed for international use to allow optimal data synthesis from trials. Electronic Delphi surveys are commonly used to facilitate global participation; however, this has limitations. It is common for these surveys to be conducted in a single language potentially excluding those not fluent in that tongue. The aim of this study is to summarise current approaches for optimising international participation in Delphi studies and make recommendations for future practice.

methodsA comprehensive literature review of current approaches to translating Delphi surveys for COS development was undertaken. A standardised methodology adapted from international guidance derived from 12 major sets of translation guidelines in the field of outcome reporting was developed. As a case study, this was applied to a COS project for surgical trials in gastric cancer to translate a Delphi survey into 7 target languages from regions active in gastric cancer research.

resultsThree hundred thirty-two abstracts were screened and four studies addressing COS development in rheumatoid and osteoarthritis, vascular malformations and polypharmacy were eligible for inclusion. There was wide variation in methodological approaches to translation, including the number of forward translations, the inclusion of back translation, the employment of cognitive debriefing and how discrepancies and disagreements were handled. Important considerations were identified during the development of the gastric cancer survey including establishing translation groups, timelines, understanding financial implications, strategies to maximise recruitment and regulatory approvals. The methodological approach to translating the Delphi surveys was easily reproducible by local collaborators and resulted in an additional 637 participants to the 315 recruited to complete the source language survey. Ninety-nine per cent of patients and 97% of healthcare professionals from non-English-speaking regions used translated surveys.

conclusionConsideration of the issues described will improve planning by other COS developers and can be used to widen international participation from both patients and healthcare professionals.

Indexed as

Stomach NeoplasmsConsensusDelphi TechniqueHumansResearch DesignTreatment Outcome

Identifiers

PMID34154641
PMCPMC8218463

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.