ArticleCanadian medical education journal2021
Developing a dashboard for faculty development in competency-based training programs: a design-based research project.
Article in Canadian medical education journal, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 16 papers, 1 of them a synthesis that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
16 citing papers in PubMed, 1 synthesis or guideline pooled it.
- Entrustable professional activities in medical education: strategies and results - a systematic review.Medical education online · 2026Pooled it
- Assessment burden by design: exploring the variability in competence by design assessment forms.Canadian medical education journal · 2026Article
- Reframing Validity: How Values Shape Assessment in Postgraduate Medical Education.Perspectives on medical education · 2026Article
- Competency-Based Health Professions Education in Evolution: Challenges and Adaptations After Implementation.Perspectives on medical education · 2026Article
- Entrustable professional activity use in emergency medicine: A scoping review.AEM education and training · 2025Article
- Enabling Implementation of Competency Based Medical Education through an Outcomes-Focused Accreditation System.Perspectives on medical education · 2024Article
- Sharing Is Caring: Helping Institutions and Health Organizations Leverage Data for Educational Improvement.Perspectives on medical education · 2024Article
- Competence By Design: a transformational national model of time-variable competency-based postgraduate medical education.Perspectives on medical education · 2024Article
- The Quality of Assessment for Learning score for evaluating written feedback in anesthesiology postgraduate medical education: a generalizability and decision study.Canadian medical education journal · 2023Article
- Competency-based faculty development: applying transformations from lessons learned in competency-based medical education.Canadian medical education journal · 2023Article
- Developing and authenticating an electronic health record-based report card for assessing residents' clinical performance.AEM education and training · 2023Article
- Developing a dashboard for program evaluation in competency-based training programs: a design-based research project.Canadian medical education journal · 2022Article
- Integrating training, practice, and reflection within a new model for Canadian medical licensure: a concept paper prepared for the Medical Council of Canada.Canadian medical education journal · 2022Article
- The Impact of Electronic Data to Capture Qualitative Comments in a Competency-Based Assessment System.Cureus · 2022Article
- The Learning Loop: Conceptualizing Just-in-Time Faculty Development.AEM education and training · 2022Article
- Overcrowded curriculum is an impediment to change (Part A).Canadian medical education journal · 2021Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
8 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
backgroundCanadian specialist residency training programs are implementing a form of competency-based medical education (CBME) that requires frequent assessments of entrustable professional activities (EPAs). Faculty struggle to provide helpful feedback and assign appropriate entrustment scores. CBME faculty development initiatives rarely incorporate teaching metrics. Dashboards could be used to visualize faculty assessment data to support faculty development.
methodsUsing a design-based research process, we identified faculty development needs related to CBME assessments and designed a dashboard containing elements (data, analytics, and visualizations) meeting these needs. Data was collected within the emergency medicine residency program at the University of Saskatchewan through interviews with program leaders, faculty development experts, and faculty participating in development sessions. Two investigators thematically analyzed interview transcripts to identify faculty needs that were audited by a third investigator. The needs were described using representative quotes and the dashboard elements designed to address them.
resultsBetween July 1, 2019 and December 11, 2020 we conducted 15 interviews with nine participants (two program leaders, three faculty development experts, and four faculty members). Three needs emerged as themes from the analysis: analysis of assessments, contextualization of assessments, and accessible reporting. We addressed these needs by designing an accessible dashboard to present contextualized quantitative and narrative assessment data for each faculty member.
conclusionsWe identified faculty development needs related to EPA assessments and designed dashboard elements to meet them. The resulting dashboard was used for faculty development sessions. This work will inform the development of CBME assessment dashboards for faculty.
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.