ArticleCanadian journal of surgery. Journal canadien de chirurgie2014
How to assess communication, professionalism, collaboration and the other intrinsic CanMEDS roles in orthopedic residents: use of an objective structured clinical examination (OSCE).
Article in Canadian journal of surgery. Journal canadien de chirurgie, 2014. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 21 papers, 3 of them syntheses that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
21 citing papers in PubMed, 3 syntheses or guidelines pooled it.
- Impact of station number and duration time per station on the reliability of Objective Structured Clinical Examination (OSCE) scores: a systematic review and meta-analysis.BMC medical education · 2025Pooled it
- Core Professionalism Education in Surgery: A Systematic Review.Balkan medical journal · 2018Pooled it
- Assessing medical professionalism: A systematic review of instruments and their measurement properties.PloS one · 2017Pooled it
- Assessing nursing students' palliative care training needs and profiles: a cross-sectional study using K-means clustering.BMC nursing · 2025Article
- What do we know about Objective Structured Clinical Examination in Sport and Exercise Medicine? A scoping review.Canadian medical education journal · 2024Article
- Developing an innovative national ACP-OSCE program in Taiwan: a mixed method study.BMC medical education · 2024Article
- Physicians' Social Skills - Conceptualization, Taxonomy, and Behavioral Assessment.Perspectives on medical education · 2024Article
- Evaluating the Construct Validity of Competencies: A Retrospective Analysis.Medical science educator · 2023Article
- "You Never Get a Second Chance": First Impressions of Physicians Depend on Their Body Posture and Gender.Frontiers in psychology · 2022Article
- An Objective Structured Clinical Examination for Medical Student Radiology Clerkships: Reproducibility Study.JMIR medical education · 2020Article
- Evaluation of inter-professional communication and leadership skills among graduating Canadian urology residents.Canadian Urological Association journal = Journal de l'Association des urologues du Canada · 2019Article
- Selected Abstracts From the Proceedings of the 2017 Society of Teachers of Family Medicine Conference on Medical Student Education.PRiMER (Leawood, Kan.) · 2019Article
- Strategies identified by program directors to improve adoption of the CanMEDS framework.Canadian medical education journal · 2018Article
- A Comparison of Assessment Tools: Is Direct Observation an Improvement Over Objective Structured Clinical Examinations for Communications Skills Evaluation?Journal of graduate medical education · 2018Article
- Review
- Visions and reality: the idea of competence-oriented assessment for German medical students is not yet realised in licensing examinations.GMS journal for medical education · 2017Observational
- Measuring medical students' empathy using direct verbal expressions.Korean journal of medical education · 2016Article
- Cognitive and Psychomotor Entrustable Professional Activities: Can Simulators Help Assess Competency in Trainees?Clinical orthopaedics and related research · 2016Article
- An assessment of the Chilean National Examination of Orthopaedic Surgery.BMC medical education · 2016Article
- An objective structured clinical exam to measure intrinsic CanMEDS roles.Medical education online · 2016Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
13 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
backgroundAssessing residents' understanding and application of the 6 intrinsic CanMEDS roles (communicator, professional, manager, collaborator, health advocate, scholar) is challenging for postgraduate medical educators. We hypothesized that an objective structured clinical examination (OSCE) designed to assess multiple intrinsic CanMEDS roles would be sufficiently reliable and valid.
methodsThe OSCE comprised 6 10-minute stations, each testing 2 intrinsic roles using case-based scenarios (with or without the use of standardized patients). Residents were evaluated using 5-point scales and an overall performance rating at each station. Concurrent validity was sought by correlation with in-training evaluation reports (ITERs) from the last 12 months and an ordinal ranking created by program directors (PDs).
resultsTwenty-five residents from postgraduate years (PGY) 0, 3 and 5 participated. The interstation reliability for total test scores (percent) was 0.87, while reliability for each of the communicator, collaborator, manager and professional roles was greater than 0.8. Total test scores, individual station scores and individual CanMEDS role scores all showed a significant effect by PGY level. Analysis of the PD rankings of intrinsic roles demonstrated a high correlation with the OSCE role scores. A correlation was seen between ITER and OSCE for the communicator role, while the ITER medical expert and total scores highly correlated with the communicator, manager and professional OSCE scores.
conclusionAn OSCE designed to assess the intrinsic CanMEDS roles was sufficiently valid and reliable for regular use in an orthopedic residency program.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.