Evidence map›Paper›PMID 39013650›Full record

ArticleBMJ open2024

Multimethods study to develop tools for competency-based assessments of implementation research training programmes in low and middle-income countries.

Olakunle Alonge, Aditi Rao, Anna Kalbarczyk, Latifat Ibisomi, Phyllis Dako-Gyeke, Yodi Mahendradhata, Carlos Alberto Rojas, Choolwe Jacobs, Kwasi Torpey, Edwin Rolando Gonzalez Marulanda and 2 more

Abstract read
In one paragraph

Article in BMJ open, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

12 authors.

Olakunle AlongeSparkman Center for Global Health, The University of Alabama at Birmingham, Birmingham, Alabama, USA oalonge@uab.edu.ORCID 0000-0001-7642-2806
Aditi RaoInternational Health, Johns Hopkins University Bloomberg School of Public Health, Baltimore, Maryland, USA.
Anna KalbarczykInternational Health, Johns Hopkins University Bloomberg School of Public Health, Baltimore, Maryland, USA.ORCID 0000-0002-6143-8634
Latifat IbisomiUniversity of the Witwatersrand, School of Public Health, Johannesburg, Gauteng, South Africa.
Phyllis Dako-GyekeSocial and Behavioural Sciences, University of Ghana School of Public Health, Accra, Ghana.ORCID 0000-0002-4632-1833
Yodi MahendradhataFaculty of Medicine, Public Health and Nursing, Universitas Gadjah Mada, Yogyakarta, Daerah Istimewa Yogyakarta, Indonesia.
Carlos Alberto RojasFacultad Nacional de Salud Publica, Universidad de Antioquia, Medellin, Colombia.
Choolwe JacobsEpidemiology and biostatistics, University of Zambia, Lusaka, Zambia, Zambia.
Kwasi TorpeyUniversity of Ghana, Legon, Greater Accra, Ghana.
Edwin Rolando Gonzalez MarulandaFacultad Nacional de Salud Publica, Universidad de Antioquia, Medellin, Colombia.
Pascal LaunoisSpecial Programme for Research & Training in Tropical Diseases (TDR), WHO, Geneva, Switzerland.
Mahnaz VahediSpecial Programme for Research & Training in Tropical Diseases (TDR), WHO, Geneva, Switzerland.

Funding

World Health Organization 001
6 · The paper itself

Abstract

introductionMethods and validated tools for evaluating the performance of competency-based implementation research (IR) training programmes in low-middle-income countries (LMICs) are lacking. In this study, we developed tools for assessing the performance of IR training programmes based on a framework of IR core competencies in LMICs.

methodsWe developed self-assessment and objective-assessment tools drawing on the IR competency framework. We used exploratory factor analyses and a one-parameter logistic model to establish construct validity and internal consistency of the tools drawing on a survey conducted in 2020 with 166 trainees before and after an index IR course across five universities and LMICs under the Special Program for Research and Training in Tropical Diseases postgraduate IR training scheme. We conducted key informant interviews (KII) with 20 trainees and five trainers to reflect on the usefulness of the tools and framework for guiding IR training in LMICs.

resultsTwo 16-item tools for self-assessment of IR knowledge and self-efficacy and a 40-item objective assessment tool were developed. The factor loadings of items in the self-assessment tools were 0.65-0.87 with Cronbach's alpha (α) of 0.97, and 0.77-0.91 with α of 0.98 for the IR knowledge and self-efficacy tools, respectively. The distribution of item difficulty in the objective-assessment tool was consistent before and after the index IR course. Pearson correlation coefficient (r) between the self-assessed and objectively assessed IR knowledge before the index IR course was low, r=0.27 (p value: <0.01), with slight improvements after the index IR course, r=0.43 (p value: <0.01). All KII respondents reported the assessment tools and framework were valid for assessing IR competencies.

conclusionThe IR competency framework and tools developed for assessing IR competencies and performance of IR training programmes in LMICs are reliable and valid. Self-assessment methods alone may not suffice to yield a valid assessment of performance in these settings.

Indexed as

Developing CountriesCompetency-Based EducationFemaleHumansImplementation ScienceMaleReproducibility of ResultsSelf-AssessmentSelf EfficacySurveys and QuestionnairesEDUCATION & TRAINING (see Medical Education & Training)Implementation SciencePUBLIC HEALTH

Identifiers

PMID39013650
PMCPMC11288145

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.