Evidence map›Paper›PMID 31171041›Full record

SynthesisTrials2019

Beyond interviews and focus groups: a framework for integrating innovative qualitative methods into randomised controlled trials of complex public health interventions.

Katy Davis, Nicole Minckas, Virginia Bond, Cari Jo Clark, Tim Colbourn, Sarah J Drabble, Therese Hesketh, Zelee Hill, Joanna Morrison, Oliver Mweemba and 8 more

2 registry-linked trialsAbstract readSystematic Review
In one paragraph

Synthesis in Trials, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to 2 registered trials, which are not on this map. Cited by 40 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
40citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT06373588 narecruitingnot on this mapstarted 2024, after this paper: background citation

Co-design and Evaluation of a Patient Navigator Intervention for Migrant Children and Youth with Special Healthcare Needs (CYSHCN) Experiencing Care Transitions (MiNav Trial)

TypeinterventionalSponsorMcGill University Health Centre/Research Institute of the McGill University Health CentreRan2024 to 2027Enrolled324ConditionsPatient NavigationArmsPatient Navigator
NCT07461857 nacompletednot on this mapstarted 2025, after this paper: background citation

Minority-focused Environmental Health Education and Tracking (MEET) Pilot Study

TypeinterventionalSponsorMillion Marker Wellness, Inc.Ran2025 to 2026Enrolled151ConditionsEnvironmental ExposureArmsEducation curriculum
3 · Its place in the literature

Who cites it

40 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Trial
  3. Trial
  4. Trial
  5. Trial
  6. Trial
  7. Trial
  8. Trial
  9. Trial
  10. Trial
  11. Review
  12. [Relevance of eHealth Literacy (eHL) for health services research and practice - Part II].Gesundheitswesen (Bundesverband der Arzte des Offentlichen Gesundheitsdienstes (Germany)) · 2026
    Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

18 authors.

Katy DavisInstitute for Global Health, University College London, 30 Guilford Street, London, WC1N 1EH, UK.
Nicole MinckasInstitute for Global Health, University College London, 30 Guilford Street, London, WC1N 1EH, UK.
Virginia BondDepartment of Global Health and Development, Faculty of Public Health and Policy, London School of Hygiene and Tropical Medicine, 15-17 Tavistock Place, London, WC1H 9SH, UK.
Cari Jo ClarkRollins School of Public Health, Emory University, 1518 Clifton Road NE, Claudia Nance Rollins Building, 7033, Atlanta, GA, 30322, USA.
Tim ColbournInstitute for Global Health, University College London, 30 Guilford Street, London, WC1N 1EH, UK.
Sarah J DrabbleSchool of Health and Related Research, University of Sheffield, 30 Regent St, Sheffield, S1 4DA, UK.
Therese HeskethInstitute for Global Health, University College London, 30 Guilford Street, London, WC1N 1EH, UK.
Zelee HillInstitute for Global Health, University College London, 30 Guilford Street, London, WC1N 1EH, UK.
Joanna MorrisonInstitute for Global Health, University College London, 30 Guilford Street, London, WC1N 1EH, UK.
Oliver MweembaDepartment of Health Promotion and Education, School of Public Health, Ridgeway Campus University of Zambia, Box 50110, Lusaka, 10101, Zambia.
David OsrinInstitute for Global Health, University College London, 30 Guilford Street, London, WC1N 1EH, UK.
Audrey ProstInstitute for Global Health, University College London, 30 Guilford Street, London, WC1N 1EH, UK.
Janet SeeleyDepartment of Global Health and Development, Faculty of Public Health and Policy, London School of Hygiene and Tropical Medicine, 15-17 Tavistock Place, London, WC1H 9SH, UK.
Maryam ShahmaneshInstitute for Global Health, University College London, 30 Guilford Street, London, WC1N 1EH, UK.
Esther J SpindlerHeilbrunn Department of Population and Family Health, Columbia University Mailman School of Public Health, 722 W 168th St, New York, 10032, NY, USA.
Erin SternDepartment of Global Health and Development, Faculty of Public Health and Policy, London School of Hygiene and Tropical Medicine, 15-17 Tavistock Place, London, WC1H 9SH, UK.
Katrina M TurnerPopulation Health Sciences, University of Bristol, 39 Whatley Road, Bristol, BS8 2PS, UK.
Jenevieve MannellInstitute for Global Health, University College London, 30 Guilford Street, London, WC1N 1EH, UK. j.mannell@ucl.ac.uk.ORCID http://orcid.org/0000-0002-7456-3194

Funding

Maximizing combination HIV prevention, uptake and retention by adolescent girls and young womenR01MH114560 · NIMH · KWAZULU-NATAL RESEARCH INSTITUTE TB-HIV · PI SHAHMANESH, MARYAM · 2017 to 2023
$2.0M
Academy of Medical Sciences HOP001\1027Medical Research Council MR/K025643/1NIMH NIH HHS R01 MH114560
6 · The paper itself

Abstract

backgroundRandomised controlled trials (RCTs) are widely used for establishing evidence of the effectiveness of interventions, yet public health interventions are often complex, posing specific challenges for RCTs. Although there is increasing recognition that qualitative methods can and should be integrated into RCTs, few frameworks and practical guidance highlight which qualitative methods should be integrated and for what purposes. As a result, qualitative methods are often poorly or haphazardly integrated into existing trials, and researchers rely heavily on interviews and focus group discussions. To improve current practice, we propose a framework for innovative qualitative research methods that can help address the challenges of RCTs for complex public health interventions.

methodsWe used a stepped approach to develop a practical framework for researchers. This consisted of (1) a systematic review of the innovative qualitative methods mentioned in the health literature, (2) in-depth interviews with 23 academics from different methodological backgrounds working on RCTs of public health interventions in 11 different countries, and (3) a framework development and group consensus-building process.

resultsThe findings are presented in accordance with the CONSORT (Consolidated Standards of Reporting Trials) Statement categories for ease of use. We identify the main challenges of RCTs for public health interventions alongside each of the CONSORT categories, and potential innovative qualitative methods that overcome each challenge are listed as part of a Framework for the Integration of Innovative Qualitative Methods into RCTs of Complex Health Interventions. Innovative qualitative methods described in the interviews include rapid ethnographic appraisals, document analysis, diary methods, interactive voice responses and short message service, community mapping, spiral walks, pair interviews and visual participatory analysis.

conclusionsThe findings of this study point to the usefulness of observational and participatory methods for trials of complex public health interventions, offering a novel contribution to the broader literature about the need for mixed methods approaches. Integrating a diverse toolkit of qualitative methods can enable appropriate adjustments to the intervention or process (or both) of data collection during RCTs, which in turn can create more sustainable and effective interventions. However, such integration will require a cultural shift towards the adoption of method-neutral research approaches, transdisciplinary collaborations, and publishing regimes.

Indexed as

Public HealthQualitative ResearchResearch DesignConsensusDiffusion of InnovationFocus GroupsHumansInterviews as TopicRandomized Controlled Trials as TopicComplex interventionInnovationPublic healthQualitative methodRCTs

Identifiers

PMID31171041
PMCPMC6555705

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.