ArticleBMC medical education2017
Examiner effect on the objective structured clinical exam - a study at five medical schools.
Article in BMC medical education, 2017. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 31 papers.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
31 citing papers in PubMed.
- The influence of candidates' physical attributes on patient ratings in simulated assessments of clinical practice.Medical teacher · 2022Trial
- Influence of a Survival Swimming Training Programme on Water Safety Knowledge, Attitudes and Skills: A Randomized Controlled Trial among Young Adults in Sri Lanka.International journal of environmental research and public health · 2021Trial
- AI for Clinical Competency Assessment: Scoping Review of Methods and Applications.JMIR medical education · 2026Article
- Fairness, Consistency and Bias in the RACS General Surgery Fellowship Examination.ANZ journal of surgery · 2026Article
- From Conventional OSCE to Virtual Reality-Enhanced OSCE: A Narrative Review of Promise and Pitfalls in Medical Education.Advances in medical education and practice · 2026Review
- Developing and Assessing an Integrated Comprehensive Obstetric Ultrasound Training Program for Undergraduate Medical Students - the Fetal Assessment in Medical Education Study (FAME study).Geburtshilfe und Frauenheilkunde · 2025Article
- Applying generalized theory to optimize the quality of high-stakes objective structured clinical examinations for undergraduate medical students: experience from the French medical school.BMC medical education · 2025Article
- Network analysis of an OSCE-based graduation skills assessment for clinical medical students.BMC medical education · 2025Article
- [Success factors and obstacles in the implementation of competence-oriented teaching in surgery].Chirurgie (Heidelberg, Germany) · 2024Article
- Article
- Variance due to the examination conditions and factors associated with success in objective structured clinical examinations (OSCEs): first experiences at Paris-Saclay medical school.BMC medical education · 2024Observational
- Strengthening the planning and design of Objective Structured Clinical Examinations.Health SA = SA Gesondheid · 2024Article
- BLU-DAT: a new reliable and accurate arthrometer for measuring anterior knee laxity.Knee surgery, sports traumatology, arthroscopy : official journal of the ESSKA · 2023Article
- Bias in Medical School Clerkship Grading: Is It Time for a Change?Academic psychiatry : the journal of the American Association of Directors of Psychiatric Residency Training and the Association for Academic Psychiatry · 2023Article
- Are we ready yet for digital transformation? Virtual versus on-campus OSCE as assessment tools in pharmacy education. A randomized controlled head-to-head comparative assessment.Saudi pharmaceutical journal : SPJ : the official publication of the Saudi Pharmaceutical Society · 2023Article
- Detection of grey zones in inter-rater agreement studies.BMC medical research methodology · 2023Article
- Pilot study of the DART tool - an objective healthcare simulation debriefing assessment instrument.BMC medical education · 2022Article
- Minimally Trained Analysts Can Perform Fast, Objective Assessment of Orthopedic Technical Skill from Fluoroscopic Images.IISE transactions on healthcare systems engineering · 2022Article
- Objective structured clinical examination: Challenges and opportunities from students' perspective.PloS one · 2022Article
- "Could You Work in My Team?": Exploring How Professional Clinical Role Expectations Influence Decision-Making of Assessors During Exit-Level Medical School OSCEs.Frontiers in medicine · 2022Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
10 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
backgroundThe Objective Structured Clinical Examination (OSCE) is increasingly used at medical schools to assess practical competencies. To compare the outcomes of students at different medical schools, we introduced standardized OSCE stations with identical checklists.
methodsWe investigated examiner bias at standardized OSCE stations for knee- and shoulder-joint examinations, which were implemented into the surgical OSCE at five different medical schools. The checklists for the assessment consisted of part A for knowledge and performance of the skill and part B for communication and interaction with the patient. At each medical faculty, one reference examiner also scored independently to the local examiner. The scores from both examiners were compared and analysed for inter-rater reliability and correlation with the level of clinical experience. Possible gender bias was also evaluated.
resultsIn part A of the checklist, local examiners graded students higher compared to the reference examiner; in part B of the checklist, there was no trend to the findings. The inter-rater reliability was weak, and the scoring correlated only weakly with the examiner's level of experience. Female examiners rated generally higher, but male examiners scored significantly higher if the examinee was female.
conclusionsThese findings of examiner effects, even in standardized situations, may influence outcome even when students perform equally well. Examiners need to be made aware of these biases prior to examining.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.