Evidence map›Paper›PMID 38012637›Full record

ArticleBMC medical education2023

Assessor discomfort and failure to fail in clinical performance assessments.

Catherine E Scarff, Margaret Bearman, Neville Chiavaroli, Stephen Trumble

Open access · goldAbstract read
In one paragraph

Article in BMC medical education, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 5 papers.

0numbers the graph read from it
0cells of the map it votes in
5citing papers in PubMed
2.3field-weighted citation impact, top 11% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

5 citing papers in PubMed, 8 citations in OpenAlex.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors at 3 institutions in 1 country.

Catherine E ScarffDepartment of Medical Education, Melbourne Medical School, University of Melbourne, Room N722, Level 7 North Medical Building Grattan Street, Melbourne, VIC, Australia. catherine.scarff@unimelb.edu.au.
Margaret BearmanCentre for Research in Assessment and Digital Learning (CRADLE), Deakin University, Melbourne, VIC, Australia.
Neville ChiavaroliDepartment of Medical Education, Melbourne Medical School, University of Melbourne, Room N722, Level 7 North Medical Building Grattan Street, Melbourne, VIC, Australia.
Stephen TrumbleDepartment of Medical Education, Melbourne Medical School, University of Melbourne, Room N722, Level 7 North Medical Building Grattan Street, Melbourne, VIC, Australia.
The University of Melbourne · AUAustralian Council for Educational Research · AUDeakin University · AU

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundAssessment of trainee performance in the workplace is critical to ensuring high standards of clinical care. However, some supervisors find the task to be challenging, and may feel unable to deliver their true judgement on a trainee's performance. They may 'keep MUM' (that is, keep mum about undesirable messages) and fail to fail an underperforming trainee. In this study, we explore the effect of discomfort on assessors.

methodsUsing a survey method, supervisors of trainees in the Australasian College of Dermatologists were asked to self-report experiences of discomfort in various aspects of trainee workplace assessment and for their engagement in MUM behaviours including failure to fail.

resultsSixty-one responses were received from 135 eligible assessors. 12.5% of assessors self-reported they had failed to fail a trainee and 18% admitted they had grade inflated a trainee's score on a clinical performance assessment in the previous 12-month period. Assessors who reported higher levels of discomfort in the clinical performance assessment context were significantly more likely to report previously failing to fail a trainee. The study did not reveal significant associations with assessor demographics and self-reports of discomfort or MUM behaviours.

conclusionsThis study reveals the impact of assessor discomfort on the accuracy of assessment information and feedback to trainees, including as a contributing factor to the failure to fail phenomenon. Addressing assessor experience of discomfort offers one opportunity to impact on the complex and multifactorial issue that failure to fail represents.

Indexed as

Clinical CompetenceJudgmentHumansSelf ReportSurveys and QuestionnairesWorkplaceClinical supervisorFailure to failFeedbackIn-training assessmentJudgementWorkplace assessment

Identifiers

PMID38012637
PMCPMC10680261
OpenAlexW4389056618

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.