Evidence map›Paper›PMID 35090472›Full record

ArticleHealth research policy and systems2022

Methodological pluralism for better evaluations of complex interventions: lessons from evaluating an innovation platform in Australia.

J Bailie, F Cunningham, S Abimbola, A Laycock, R Bainbridge, R Bailie, K Conte, M Passey, D Peiris

Open access · goldAbstract readLetter
In one paragraph

Article in Health research policy and systems, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
1.0field-weighted citation impact, top 23% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed, 7 citations in OpenAlex.

  1. Article
  2. Article
  3. Giving meaning to quality of healthcare in Malaysia.International journal for quality in health care : journal of the International Society for Quality in Health Care · 2024
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors at 4 institutions in 2 countries.

J BailieThe University Centre for Rural Health, The University of Sydney, 61 Uralba Street, Lismore, NSW, 2480, Australia. jodie.bailie@sydney.edu.au.ORCID http://orcid.org/0000-0003-4393-5773
F CunninghamMenzies School of Health Research, Charles Darwin University, Brisbane, Australia.
S AbimbolaThe School of Public Health, The University of Sydney, Sydney, Australia.
A LaycockThe University Centre for Rural Health, The University of Sydney, 61 Uralba Street, Lismore, NSW, 2480, Australia.
R BainbridgeSchool of Health, Medical and Applied Sciences, Central Queensland University, Cairns, Australia.
R BailieThe University Centre for Rural Health, The University of Sydney, 61 Uralba Street, Lismore, NSW, 2480, Australia.
K ConteThe University Centre for Rural Health, The University of Sydney, 61 Uralba Street, Lismore, NSW, 2480, Australia.
M PasseyThe University Centre for Rural Health, The University of Sydney, 61 Uralba Street, Lismore, NSW, 2480, Australia.
D PeirisThe School of Public Health, The University of Sydney, Sydney, Australia.
The University of Sydney · AUCentral Queensland University · AUCharles Darwin University · AUUniversity of Technology Sydney · AU

Funding

National Health and Medical Research Council 1078927National Health and Medical Research Council 1139631National Health and Medical Research Council 1159601National Health and Medical Research Council 1170882University of Sydney Postgraduate Award SC0649
6 · The paper itself

Abstract

Complex interventions, such as innovation platforms, pose challenges for evaluators. A variety of methodological approaches are often required to build a more complete and comprehensive understanding of how complex interventions work. In this paper, we outline and critically appraise a methodologically pluralist evaluation of an innovation platform to strengthen primary care for Aboriginal and Torres Strait Islander Australians. In doing so, we aim to identify lessons learned from the approach taken and add to existing literature on implementing evaluations in complex settings, such as innovation platforms. The pluralist design used four evaluation approaches-developmental evaluation, principles-focused evaluation, network analysis, and framework analysis-with differing strengths and challenges. Taken together, the multiple evaluation approaches yielded a detailed description and nuanced understanding of the formation, functioning and outcomes of the innovation platform that would be difficult to achieve with any single evaluation method. While a methodologically pluralist design may place additional pressure on logistical and analytic resources available, it enables a deeper understanding of the mechanisms that underlie complex interventions.

Indexed as

Cultural DiversityAustraliaAustralian Aboriginal and Torres Strait Islander PeoplesHumansPrimary Health CareCollaborationsComplex interventionsDevelopmental evaluationInnovation platformsNetwork analysisPrinciples-focused evaluationSystems thinkingUtilization-focused

Identifiers

PMID35090472
PMCPMC8796351
OpenAlexW4210601716

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.