ArticleCanadian medical education journal2022
Validity evidence for the Quality of Assessment for Learning score: a quality metric for supervisor comments in Competency Based Medical Education.
Article in Canadian medical education journal, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 12 papers, 1 of them a synthesis that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
12 citing papers in PubMed, 1 synthesis or guideline pooled it.
- Entrustable professional activities in medical education: strategies and results - a systematic review.Medical education online · 2026Pooled it
- Article
- Leveraging Large Language Models to Evaluate the Quality of Narrative Feedback for Surgery Residents in Competency-Based Medical Education.Annals of surgery open : perspectives of surgical history, education, and clinical approaches · 2025Article
- Home Field Advantage? Comparing the Quality of EPA Observations Completed On- vs Off-Service.Journal of graduate medical education · 2025Article
- "But Why?": Explanatory Feedback Is a Reliable Marker of High-Quality Narrative Assessment of Surgical Performance.Academic medicine : journal of the Association of American Medical Colleges · 2025Article
- Entrustable professional activity use in emergency medicine: A scoping review.AEM education and training · 2025Article
- Exploring the Quality of Feedback in Entrustable Professional Activity Narratives Across 24 Residency Training Programs.Journal of graduate medical education · 2024Article
- The Quality of Assessment for Learning score for evaluating written feedback in anesthesiology postgraduate medical education: a generalizability and decision study.Canadian medical education journal · 2023Article
- The influence of clinical coaching teams on quality of entrustable professional activity assessments.AEM education and training · 2023Article
- Quality of Narratives in Assessment: Piloting a List of Evidence-Based Quality Indicators.Perspectives on medical education · 2023Article
- It's hard to get better as a teacher when you're on your own: consider instructional coaching.Canadian medical education journal · 2022Article
- Evaluating Feedback Comments in Entrustable Professional Activities: A Cross-Sectional Study.Journal of medical education and curricular developmentArticle
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
8 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
Background: Competency based medical education (CBME) relies on supervisor narrative comments contained within entrustable professional activities (EPA) for programmatic assessment, but the quality of these supervisor comments is unassessed. There is validity evidence supporting the QuAL (Quality of Assessment for Learning) score for rating the usefulness of short narrative comments in direct observation. Objective: We sought to establish validity evidence for the QuAL score to rate the quality of supervisor narrative comments contained within an EPA by surveying the key end-users of EPA narrative comments: residents, academic advisors, and competence committee members. Methods: In 2020, the authors randomly selected 52 de-identified narrative comments from two emergency medicine EPA databases using purposeful sampling. Six collaborators (two residents, two academic advisors, and two competence committee members) were recruited from each of four EM Residency Programs (Saskatchewan, McMaster, Ottawa, and Calgary) to rate these comments with a utility score and the QuAL score. Correlation between utility and QuAL score were calculated using Pearson's correlation coefficient. Sources of variance and reliability were calculated using a generalizability study. Results: All collaborators ( Conclusion: The QuAL score may serve as an outcome measure for program evaluation of supervisors, and as a resource for faculty development.
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.