Evidence map›Paper›PMID 34407834›Full record

ReviewHealth research policy and systems2021

How has implementation been incorporated in health technology assessments in the United Kingdom? A systematic rapid review.

Robert Heggie, Kathleen Boyd, Olivia Wu

Abstract readReview
In one paragraph

Review in Health research policy and systems, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 4 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

4 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Article
  3. Article
  4. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

Robert HeggieHealth Economics and Health Technology Assessment (HEHTA), Institute of Health and Wellbeing, University of Glasgow, 1 Lilybank Gardens, Glasgow, G12 8RZ, UK. Robert.Heggie@glasgow.ac.uk.ORCID http://orcid.org/0000-0001-7396-4773
Kathleen BoydHealth Economics and Health Technology Assessment (HEHTA), Institute of Health and Wellbeing, University of Glasgow, 1 Lilybank Gardens, Glasgow, G12 8RZ, UK.
Olivia WuHealth Economics and Health Technology Assessment (HEHTA), Institute of Health and Wellbeing, University of Glasgow, 1 Lilybank Gardens, Glasgow, G12 8RZ, UK.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

objectivesHealth interventions in a clinical setting may be complex. This is particularly true of clinical interventions which require systems reorganization or behavioural change, and/or when implementation involves additional challenges not captured within a clinical trial setting. Medical Research Council guidance on complex interventions highlights the need to consider economic evaluation alongside implementation. However, the extent to which this guidance has been adhered to, and how, is unclear. The failure to incorporate implementation within the evaluation of an intervention may hinder the translation of research findings into routine practice. This will have consequences for patient care. This study examined the methods used to address implementation within health research conducted through funding from the National Institute for Health Research (NIHR) Health Technology Assessment (HTA) programme.

methodsWe conducted a rapid review using a systematic approach. We included all NIHR HTA monographs which contained the word "implementation" within the title or abstract published between 2014 and 2020. We assessed the studies according to existing recommendations for specifying and reporting implementation approaches in research. Additional themes which were not included in the recommendation, but were of particular relevance to our research question, were also identified and summarized in a narrative synthesis.

resultsThe extent to which implementation was formally incorporated, and defined, varied among studies. Methods for examining implementation ranged from single stakeholder engagement events to the more comprehensive process evaluation. There was no obvious pattern as to whether approaches to implementation had evolved over recent years. Approximately 50% (22/42) of studies included an economic evaluation. Of these, two studies included the use of qualitative data obtained within the study to quantitatively inform aspects relating to implementation and economic evaluation in their study. DISCUSSION: A variety of approaches were identified for incorporating implementation within an HTA. However, they did not go far enough in terms of incorporating implementation into the actual design and evaluation. To ensure the implementation of clinically effective and cost-effective interventions, we propose that further guidance on how to incorporate implementation within complex interventions is required. Incorporating implementation into economic evaluation provides a step in this direction.

Indexed as

Technology Assessment, BiomedicalCost-Benefit AnalysisHumansUnited KingdomEconomic evaluationHealth technology assessmentImplementationMixed methods

Identifiers

PMID34407834
PMCPMC8371806

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.