Evidence map›Paper›PMID 32799871›Full record

Trial reportBMC medical education2020

A randomised controlled pilot trial of the influence of non-native English accents on examiners' scores in OSCEs.

An Kozato, Nimesh Patel, Kiyoshi Shikino

Abstract readRandomized Controlled Trial
In one paragraph

Trial report in BMC medical education, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 4 papers.

0numbers the graph read from it
0cells of the map it votes in
4citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

4 citing papers in PubMed.

  1. Article
  2. Observational
  3. Article
  4. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

3 authors.

An KozatoQueen Mary University of London, Centre for Medical Education, Institute of Health Sciences Education, Barts and The London School of Medicine & Dentistry, Garrod Building, Turner Street, London, UK.
Nimesh PatelQueen Mary University of London, Centre for Medical Education, Institute of Health Sciences Education, Barts and The London School of Medicine & Dentistry, Garrod Building, Turner Street, London, UK.
Kiyoshi ShikinoDepartment of General Medicine, Chiba University Hospital, 1-8-1, Inohana, Chuo-ku, Chiba-city, Chiba, Japan. kshikino@gmail.com.ORCID http://orcid.org/0000-0002-3721-3443

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundObjective structured clinical examinations (OSCEs) are important aspects of assessment in medical education. There is anecdotal evidence suggesting that students with non-native English accents (NNEA) may be subjected to unconscious bias. It is imperative to minimise the examiners' bias so that the difference in the scores reflects students' clinical competence. Research shows NNEAs can cause stereotyping, often leading to the speaker being negatively judged. However, no medical education study has looked at the influence of NNEAs in assessment.

methodsThis is a randomized, single-blinded controlled trial. Four videos of one mock OSCE station were produced. A professional actor played a medical student. Two near identical scripts were prepared. Two videos showed the actor speaking with an Indian accent and two videos showed the actor speaking without the accent in either script. Forty-two OSCE examiners in the United Kingdom (UK) were recruited and randomly assigned to two groups. They watched two videos online, each with either script, each with a different script. One video with a NNEA and one video was without. Checklist item scores were analysed with descriptive statistics and non-parametric independent samples median test. Global scores were analysed with descriptive statistics and Mann-Whitney test.

resultsThirty-two examiners completed the study. The average scores for the checklist items (41.6 points) did not change when the accent variable was changed. Independent samples median test showed no statistically significant relationship between the accent and the scores (p = 0.787). For the global scores received by the videos with the NNEA, there were one less 'Good' grade and one more 'Fail' grade compared to those without the NNEA. Mann-Whitney test on global score showed lower scores for videos with NNEA (p = 0.661).

conclusionsExaminers were not biased either positively or negatively towards NNEAs when providing checklist or global scores. Further study is required to validate the findings of this study. More discussion is warranted to consider how the accent should be considered in current medical education assessment. REGISTRATION: Trial registration completed trial, ID: ISRCTN17360102, Retrospectively registered on 15/04/2020.

Indexed as

Educational MeasurementStudents, MedicalClinical CompetenceHumansPilot ProjectsSingle-Blind MethodUnited KingdomAccentBiasClinical competenceExaminerLanguageOSCEStereotypes

Identifiers

PMID32799871
PMCPMC7429462

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.