Evidence map›Paper›PMID 36604697›Full record

SynthesisHealth research policy and systems2023

Tools for assessing health research partnership outcomes and impacts: a systematic review.

K J Mrklas, J M Boyd, S Shergill, S Merali, M Khan, L Nowell, A Goertzen, L M Pfadenhauer, K Paul, K M Sibley and 6 more

Open access · goldAbstract readSystematic Review
In one paragraph

Synthesis in Health research policy and systems, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 17 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
17citing papers in PubMed, 1 pooled it
14.9field-weighted citation impact, top 1% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

17 citing papers in PubMed, 1 synthesis or guideline pooled it, 35 citations in OpenAlex.

  1. Pooled it
  2. Article
  3. Article
  4. Article
  5. Article
  6. Article
  7. Article
  8. Involving Knowledge Users in Health Services Research: Collective Reflections and Learning From a National Evaluation of Recurrent Miscarriage Services.Health expectations : an international journal of public participation in health care and health policy · 2024
    Article
  9. Article
  10. Establishing a standing patient advisory board in family practice research: A qualitative evaluation from patients' and researchers' perspectives.Health expectations : an international journal of public participation in health care and health policy · 2024
    Article
  11. Article
  12. Article
  13. Review
  14. Article
  15. Article
  16. Article
  17. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

16 authors at 8 institutions in 2 countries.

K J MrklasDepartment of Community Health Sciences, Cumming School of Medicine, University of Calgary, 3D10, 3280 Hospital Drive NW, Calgary, AB, T2N 4Z6, Canada. kjdurego@ucalgary.ca.ORCID http://orcid.org/0000-0002-3887-1843
J M BoydKnowledge Translation Program, St Michael's Hospital, Li Ka Shing Knowledge Institute, Unity Health Toronto, Toronto, ON, Canada.
S ShergillCumming School of Medicine, University of Calgary, Calgary, AB, Canada.
S MeraliFaculty of Kinesiology, University of Calgary, Calgary, AB, Canada.
M KhanDepartment of Community Health Sciences, University of Manitoba, Winnipeg, MB, Canada.
L NowellFaculty of Nursing, University of Calgary, Calgary, AB, Canada.
A GoertzenFaculty of Science, University of Alberta, Edmonton, AB, Canada.
L M PfadenhauerInstitute for Medical Information Processing, Biometry, and Epidemiology-IBE, Ludwig-Maximilian Universität Munich, Munich, Germany.
K PaulUniversity of Calgary Summer Studentships Program, Calgary, AB, Canada.
K M SibleyDepartment of Community Health Sciences, University of Manitoba, Winnipeg, MB, Canada.
L SwainDepartment of Community Health Sciences, Cumming School of Medicine, University of Calgary, 3D10, 3280 Hospital Drive NW, Calgary, AB, T2N 4Z6, Canada.
M Vis-DunbarUniversity of British Columbia - Okanagan, Kelowna, BC, Canada.
M D HillDepartment of Community Health Sciences, Cumming School of Medicine, University of Calgary, 3D10, 3280 Hospital Drive NW, Calgary, AB, T2N 4Z6, Canada.
S Raffin-BouchalFaculty of Nursing, University of Calgary, Calgary, AB, Canada.
M TonelliDepartment of Medicine, Cumming School of Medicine, University of Calgary, Calgary, AB, Canada.
I D GrahamCentre for Implementation Research, Ottawa Hospital Research Institute, Ottawa, ON, Canada.
University of Calgary · CAGeorge & Fay Yee Centre for Healthcare Innovation · CALudwig-Maximilians-Universität München · DESt. Michael's Hospital · CAUniversity of Alberta · CAUniversity of British Columbia · CAUniversity of Manitoba · CAUniversity of Ottawa · CA

Funding

CIHR FDN#143237CIHR FRN#156372
6 · The paper itself

Abstract

objectiveTo identify and assess the globally available valid, reliable and acceptable tools for assessing health research partnership outcomes and impacts.

methodsWe searched Ovid MEDLINE, Embase, CINAHL Plus and PsycINFO from origin to 2 June 2021, without limits, using an a priori strategy and registered protocol. We screened citations independently and in duplicate, resolving discrepancies by consensus and retaining studies involving health research partnerships, the development, use and/or assessment of tools to evaluate partnership outcomes and impacts, and reporting empirical psychometric evidence. Study, tool, psychometric and pragmatic characteristics were abstracted using a hybrid approach, then synthesized using descriptive statistics and thematic analysis. Study quality was assessed using the quality of survey studies in psychology (Q-SSP) checklist.

resultsFrom 56 123 total citations, we screened 36 027 citations, assessed 2784 full-text papers, abstracted data from 48 studies and one companion report, and identified 58 tools. Most tools comprised surveys, questionnaires and scales. Studies used cross-sectional or mixed-method/embedded survey designs and employed quantitative and mixed methods. Both studies and tools were conceptually well grounded, focusing mainly on outcomes, then process, and less frequently on impact measurement. Multiple forms of empirical validity and reliability evidence was present for most tools; however, psychometric characteristics were inconsistently assessed and reported. We identified a subset of studies (22) and accompanying tools distinguished by their empirical psychometric, pragmatic and study quality characteristics. While our review demonstrated psychometric and pragmatic improvements over previous reviews, challenges related to health research partnership assessment and the nascency of partnership science persist.

conclusionThis systematic review identified multiple tools demonstrating empirical psychometric evidence, pragmatic strength and moderate study quality. Increased attention to psychometric and pragmatic requirements in tool development, testing and reporting is key to advancing health research partnership assessment and partnership science. PROSPERO CRD42021137932.

Indexed as

Cross-Sectional StudiesHumansPsychometricsReproducibility of ResultsSurveys and QuestionnairesAcceptabilityEvaluation toolsHealth research partnershipsPsychometricsSystematic review

Identifiers

PMID36604697
PMCPMC9817421
OpenAlexW4313561620

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.