Evidence map›Paper›PMID 34385243›Full record

ArticleBMJ open2021

Stakeholder engagement in economic evaluation: Protocol for using the nominal group technique to elicit patient, healthcare provider, and health system stakeholder input in the development of an early economic evaluation model of chimeric antigen receptor T-cell therapy.

Mackenzie Wilson, Kednapa Thavorn, Terry Hawrysh, Ian D Graham, Harold Atkins, Natasha Kekre, Doug Coyle, Manoj M Lalu, Dean A Fergusson, Kelvin Kw Chan and 2 more

Open access · goldAbstract read
In one paragraph

Article in BMJ open, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 5 papers.

0numbers the graph read from it
0cells of the map it votes in
5citing papers in PubMed
1.2field-weighted citation impact, top 13% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

5 citing papers in PubMed, 8 citations in OpenAlex.

  1. Article
  2. Review
  3. Article
  4. Supporting translation with early health technology assessment: from definition to action.International journal of technology assessment in health care · 2025
    Article
  5. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

12 authors at 4 institutions in 2 countries.

Mackenzie WilsonClinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Ontario, Canada.ORCID 0000-0002-3265-6579
Kednapa Thavorn *Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Ontario, Canada kthavorn@ohri.ca.
Terry HawryshPatient Partner, Toronto, Ontario, Canada.
Ian D GrahamClinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Ontario, Canada.
Harold AtkinsCancer Therapeutics Program, Ottawa Hospital Research Institute, Ottawa, Ontario, Canada.
Natasha KekreClinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Ontario, Canada.
Doug CoyleSchool of Epidemiology and Public Health, University of Ottawa, Ottawa, Ontario, Canada.
Manoj M LaluClinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Ontario, Canada.ORCID 0000-0002-0322-382X
Dean A FergussonClinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Ontario, Canada.ORCID 0000-0002-3389-2485
Kelvin Kw ChanSunnybrook Odette Cancer Centre, University of Toronto, Toronto, Ontario, Canada.ORCID 0000-0002-2501-3057
Daniel A OllendorfCenter for the Evaluation of Value and Risk in Health, Institute for Clinical Research and Health Policy Studies, Tufts Medical Center, Boston, Massachusetts, USA.
Justin Presseau *Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Ontario, Canada.
University of Ottawa · CAOttawa Hospital · CASunnybrook Health Science Centre · CATufts University · US

Funding

CIHR FDN# 143237
6 · The paper itself

Abstract

introductionChimeric antigen receptor T-cell (CAR-T) therapy is a class of immunotherapy. An economic evaluation conducted at an early stage of development of CAR-T therapy for treatment of adult relapsed or refractory acute lymphoblastic leukaemia could provide insight into factors contributing to the cost of treatment, the potential clinical benefits, and what the health system can afford. Traditionally, stakeholders are engaged in certain parts of health technology assessment processes, such as in the identification and selection of technologies, formulation of recommendations, and implementation of recommendations; however, little is known about processes for stakeholder engagement during the conduct of the assessment. This is especially the case for economic evaluations. Stakeholders, such as clinicians, policy-makers, patients, and their support networks, have insight into factors that can enhance the validity of an economic evaluation model. This research outlines a specific methodology for stakeholder engagement and represents an avenue to enhance health economic evaluations and support the use of these models to inform decision making for resource allocation. This protocol may inform a tailored framework for stakeholder engagement processes in future economic evaluation model development. METHODS AND ANALYSIS: We will involve clinicians, healthcare researchers, payers, and policy-makers, as well as patients and their support networks in the conduct and verification of an early economic evaluation of a novel health technology to incorporate stakeholder-generated knowledge. Three stakeholder-specific focus groups will be conducted using an online adaptation of the nominal group technique to elicit considerations from each. This study will use CAR-T therapy for adults with relapsed or refractory B-cell acute lymphoblastic leukaemia as a basis for investigating broader stakeholder engagement processes. ETHICS AND DISSEMINATION: This study received ethics approval from the Ottawa Hospital Research Institute Research Ethics Board (REB 20200320-01HT) and the results will be shared via conference presentations, peer-reviewed publications, and ongoing stakeholder engagement.

Indexed as

Immunotherapy, AdoptiveReceptors, Chimeric AntigenAdultCell- and Tissue-Based TherapyCost-Benefit AnalysisHealth PersonnelHumansStakeholder ParticipationReceptors, Chimeric Antigenhealth economicsoncologyqualitative researchstatistics & research methods

Identifiers

PMID34385243
PMCPMC8362692
OpenAlexW3193270825

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.