Evidence map›Paper›PMID 33882947›Full record

SynthesisHealth research policy and systems2021

Applying a framework to assess the impact of cardiovascular outcomes improvement research.

Mitchell N Sarkies, Suzanne Robinson, Tom Briffa, Stephen J Duffy, Mark Nelson, John Beltrame, Louise Cullen, Derek Chew, Julian Smith, David Brieger and 3 more

Abstract readSystematic Review
PubMed Full text at PMC Publisher
In one paragraph

Synthesis in Health research policy and systems, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 6 papers.

0numbers the graph read from it
0cells of the map it votes in
6citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

6 citing papers in PubMed.

  1. Article
  2. Article
  3. Review
  4. Article
  5. Review
  6. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

13 authors.

Mitchell N SarkiesCentre for Healthcare Resilience and Implementation Science, Australian Institute of Health Innovation, Faculty of Medicine, Health and Human Sciences, Macquarie University, 75 Talavera Road, Sydney, NSW, 2109, Australia. mitchell.sarkies@mq.edu.au.ORCID http://orcid.org/0000-0001-7318-3598
Suzanne RobinsonHealth Systems and Health Economics Group, Health Research and Data Analytics Hub, School of Public Health, Faculty of Health Sciences, Curtin University, Perth, Australia.
Tom BriffaFaculty of Health and Medical Sciences, Population and Public Health, The University of Western Australia, Perth, Australia.
Stephen J DuffyDepartment of General Cardiology, Alfred Health, Melbourne, Australia.
Mark NelsonMenzies Institute for Medical Research, University of Tasmania, Hobart, Australia.
John BeltrameDiscipline of Medicine, University of Adelaide, Adelaide, Australia.
Louise CullenInstitute of Health and Biomedical Innovation and School of Public Health and Social Work, Faculty of Health, Queensland University of Technology, Brisbane, Australia.
Derek ChewDepartment of Cardiovascular Medicine, Flinders University, Adelaide, Adelaide, Australia.
Julian SmithDepartment of Surgery (School of Clinical Sciences At Monash Health), Monash University, Melbourne, Australia.
David BriegerDivision of Cardiology, Concord Hospital and University of Sydney, Sydney, Australia.
Peter MacdonaldSt Vincent's Hospital, Victor Chang Cardiac Research Institute, University of New South Wales, Sydney, Australia.
Danny LiewDepartment of Epidemiology and Preventative Medicine, Monash University, Melbourne, Australia.
Chris ReidDepartment of Epidemiology and Preventative Medicine, Monash University, Melbourne, Australia.

Funding

National Health and Medical Research Council 1111170
6 · The paper itself

Abstract

backgroundHealth and medical research funding agencies are increasingly interested in measuring the impact of funded research. We present a research impact case study for the first four years of an Australian National Health and Medical Research Council funded Centre of Research Excellence in Cardiovascular Outcomes Improvement (2016-2020). The primary aim of this paper was to explore the application of a research impact matrix to assess the impact of cardiovascular outcomes improvement research.

methodsWe applied a research impact matrix developed from a systematic review of existing methodological frameworks used to measure research impact. This impact matrix was used as a bespoke tool to identify and understand various research impacts over different time frames. Data sources included a review of existing internal documentation from the research centre and publicly available information sources, informal iterative discussions with 10 centre investigators, and confirmation of information from centre grant and scholarship recipients.

resultsBy July 2019, the impact on the short-term research domain category included over 41 direct publications, which were cited over 87 times (median journal impact factor of 2.84). There were over 61 conference presentations, seven PhD candidacies, five new academic collaborations, and six new database linkages conducted. The impact on the mid-term research domain category involved contributions towards the development of a national cardiac registry, cardiovascular guidelines, application for a Medicare Benefits Schedule reimbursement item number, introduction of patient-reported outcome measures into several databases, and the establishment of nine new industry collaborations. Evidence of long-term impacts were described as the development and use of contemporary management for aortic stenosis, a cardiovascular risk prediction model and prevention targets in several data registries, and the establishment of cost-effectiveness for stenting compared to surgery.

conclusionsWe considered the research impact matrix a feasible tool to identify evidence of academic and policy impact in the short- to midterm; however, we experienced challenges in capturing long-term impacts. Cost containment and broader economic impacts represented another difficult area of impact to measure.

Indexed as

Biomedical ResearchAgedAustraliaCost-Benefit AnalysisHumansJournal Impact FactorNational Health ProgramsCardiovascular outcomesDisseminationEvaluationHealth researchImpact matrixImplementation scienceKnowledge translationResearch impactResearch outputResearch translation

Identifiers

PMID33882947
PMCPMC8059028

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.