ArticleCanadian medical education journal2020
Developing a dashboard to meet Competence Committee needs: a design-based research project.
Article in Canadian medical education journal, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 24 papers.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
24 citing papers in PubMed.
- Assessment burden by design: exploring the variability in competence by design assessment forms.Canadian medical education journal · 2026Article
- Reframing Validity: How Values Shape Assessment in Postgraduate Medical Education.Perspectives on medical education · 2026Article
- Trainee-supervisor collaboration, progress-visualisation, and coaching: a survey on challenges in assessment of ICU trainees.BMC medical education · 2024Article
- Enabling Implementation of Competency Based Medical Education through an Outcomes-Focused Accreditation System.Perspectives on medical education · 2024Article
- Systems Policy Analysis for Antimicrobial Resistance Targeted Action (SPAARTA): A Research Protocol.Wellcome open research · 2024Article
- Sharing Is Caring: Helping Institutions and Health Organizations Leverage Data for Educational Improvement.Perspectives on medical education · 2024Article
- Competence By Design: a transformational national model of time-variable competency-based postgraduate medical education.Perspectives on medical education · 2024Article
- Evaluating Competence by Design as a Large System Change Initiative: Readiness, Fidelity, and Outcomes.Perspectives on medical education · 2024Article
- Using learning analytics in clinical competency committees: Increasing the impact of competency-based medical education.Medical education online · 2023Article
- User-Centered Evaluation and Design Recommendations for an Internal Medicine Resident Competency Assessment Dashboard.Applied clinical informatics · 2023Article
- Unintended consequences of technology in competency-based education: a qualitative study of lessons learned in an OtoHNS program.Journal of otolaryngology - head & neck surgery = Le Journal d'oto-rhino-laryngologie et de chirurgie cervico-faciale · 2023Article
- Development and Acceptability of a Kidney Therapy Decision Aid for Patients Aged 75 Years and Older: A Design-Based Research Involving Patients, Caregivers, and a Multidisciplinary Team.Kidney medicine · 2023Article
- Developing and authenticating an electronic health record-based report card for assessing residents' clinical performance.AEM education and training · 2023Article
- Developing a dashboard for program evaluation in competency-based training programs: a design-based research project.Canadian medical education journal · 2022Article
- Integrating training, practice, and reflection within a new model for Canadian medical licensure: a concept paper prepared for the Medical Council of Canada.Canadian medical education journal · 2022Article
- Requirements for a Bespoke Intensive Care Unit Dashboard in Response to the COVID-19 Pandemic: Semistructured Interview Study.JMIR human factors · 2022Article
- The Impact of Electronic Data to Capture Qualitative Comments in a Competency-Based Assessment System.Cureus · 2022Article
- Developing a dashboard for faculty development in competency-based training programs: a design-based research project.Canadian medical education journal · 2021Article
- Workplace-based Assessment Data in Emergency Medicine: A Scoping Review of the Literature.AEM education and training · 2021Article
- Design and usability testing of an in-house developed performance feedback tool for medical students.BMC medical education · 2021Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
7 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
backgroundCompetency-based programs are being adopted in medical education around the world. Competence Committees must visualize learner assessment data effectively to support their decision-making. Dashboards play an integral role in decision support systems in other fields. Design-based research allows the simultaneous development and study of educational environments.
methodsWe utilized a design-based research process within the emergency medicine residency program at the University of Saskatchewan to identify the data, analytics, and visualizations needed by its Competence Committee, and developed a dashboard incorporating these elements. Narrative data were collected from two focus groups, five interviews, and the observation of two Competence Committee meetings. Data were qualitatively analyzed to develop a thematic framework outlining the needs of the Competence Committee and to inform the development of the dashboard.
resultsThe qualitative analysis identified four Competence Committee needs (Explore Workplace-Based Assessment Data, Explore Other Assessment Data, Understand the Data in Context, and Ensure the Security of the Data). These needs were described with narratives and represented through visualizations of the dashboard elements.
conclusionsThis work addresses the practical challenges of supporting data-driven decision making by Competence Committees and will inform the development of dashboards for programs, institutions, and learner management systems.
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.