Evidence map›Paper›PMID 31455049›Full record

ArticleKorean journal of medical education2019

Investigating possible causes of bias in a progress test translation: an one-edged sword.

Dario Cecilio-Fernandes, André Bremers, Carlos Fernando Collares, Wybe Nieuwland, Cees van der Vleuten, René A Tio

Abstract read
In one paragraph

Article in Korean journal of medical education, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed.

  1. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Dario Cecilio-FernandesSchool of Medical Sciences, University of Campinas, Campinas, Brazil.
André BremersDepartment of Surgery, Radboud University Nijmegen Medical Center, Nijmegen, The Netherlands.
Carlos Fernando CollaresDepartment of Educational Development and Research, Faculty of Health, Medicine and Life Sciences at Maastricht University, Maastricht, The Netherlands.
Wybe NieuwlandDepartment of Cardiology, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands.
Cees van der VleutenDepartment of Educational Development and Research, Faculty of Health, Medicine and Life Sciences at Maastricht University, Maastricht, The Netherlands.
René A TioDepartment of Educational Development and Research, Faculty of Health, Medicine and Life Sciences at Maastricht University, Maastricht, The Netherlands.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

purposeAssessment in different languages should measure the same construct. However, item characteristics, such as item flaws and content, may favor one test-taker group over another. This is known as item bias. Although some studies have focused on item bias, little is known about item bias and its association with items characteristics. Therefore, this study investigated the association between item characteristics and bias.

methodsThe University of Groningen offers both an international and a national bachelor's program in medicine. Students in both programs take the same progress test, but the international progress test is literally translated into English from the Dutch version. Differential item functioning was calculated to analyze item bias in four subsequent progress tests. Items were also classified by their categories, number of alternatives, item flaw, item length, and whether it was a case-based question.

resultsThe proportion of items with bias ranged from 34% to 36% for the various tests. The number of items and the size of their bias was very similar in both programmes. We have identified that the more complex items with more alternatives favored the national students, whereas shorter items and fewer alternatives favored the international students.

conclusionAlthough nearly 35% of all items contain bias, the distribution and the size of the bias were similar for both groups. The findings of this paper may be used to improve the writing process of the items, by avoiding some characteristics that may benefit one group whilst being a disadvantage for others.

Indexed as

BiasSchools, MedicalTranslatingEducational MeasurementEducation, MedicalFemaleHumansMaleNetherlandsStudents, MedicalBiasEducational measurementMedical education

Identifiers

PMID31455049
PMCPMC6715902

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.