Evidence map›Paper›PMID 26957002›Full record

ArticleBMC medical education2016

The predictive validity of a situational judgement test and multiple-mini interview for entry into postgraduate training in Australia.

Fiona Patterson, Emma Rowett, Robert Hale, Marcia Grant, Chris Roberts, Fran Cousans, Stuart Martin

Abstract read
In one paragraph

Article in BMC medical education, 2016. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 15 papers.

0numbers the graph read from it
0cells of the map it votes in
15citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

15 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Review
  5. Article
  6. Review
  7. Article
  8. Article
  9. Article
  10. Opening the black box of selection.Advances in health sciences education : theory and practice · 2020
    Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Fiona PattersonWork Psychology Group, 27 Brunel Parkway, Pride Park, Derby, DE24 8HR, UK. f.patterson@workpsychologygroup.com.
Emma RowettWork Psychology Group, 27 Brunel Parkway, Pride Park, Derby, DE24 8HR, UK. e.rowett@workpsychologygroup.com.
Robert HaleFormerly General Practice Education & Training (GPET), Canberra, Australia. findrob.hale@gmail.com.
Marcia GrantSydney Medical School - Northern, Hornsby Ku-ring-gai Hospital, Palmerston Road, Hornsby, NSW, 2077, Australia. mg3020@sydney.edu.au.
Chris RobertsSydney Medical School - Northern, Hornsby Ku-ring-gai Hospital, Palmerston Road, Hornsby, NSW, 2077, Australia. christopher.roberts@sydney.edu.au.
Fran CousansWork Psychology Group, 27 Brunel Parkway, Pride Park, Derby, DE24 8HR, UK. f.cousans@workpsychologygroup.com.
Stuart MartinWork Psychology Group, 27 Brunel Parkway, Pride Park, Derby, DE24 8HR, UK. s.martin@workpsychologygroup.com.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundEvidence for the predictive validity of situational judgement tests (SJTs) and multiple-mini interviews (MMIs) is well-established in undergraduate selection contexts, however at present there is less evidence to support the validity of their use in postgraduate settings. More research is also required to assess the extent to which SJTs and MMIs are complementary for predicting performance in practice. This study represents the first longitudinal evaluation of the complementary roles and predictive validity of an SJT and an MMI for selection for entry into postgraduate General Practice (GP) specialty training in Australia.

methodsLongitudinal data was collected from 443 GP registrars in Australia who were selected into GP training in 2010 or 2011. All 17 Regional Training Providers in Australia were asked to participate; performance data were received from 13 of these. Data was collected for participants' end-of-training assessment performance. Outcome measures include GP registrars' performance on the Royal Australian College of General Practitioners (RACGP) applied knowledge test, key feature problems and an objective structured clinical exam.

resultsPerformance on the SJT, MMI and the overall selection score significantly predicted all three end-of-training assessments (r = .12 to .54), indicating that both of the selection methods, as well the overall selection score, have good predictive validity. The SJT and MMI provide incremental validity over each other for two of the three end-of-training assessments.

conclusionsThe SJT and MMI were both significant positive predictors of all end-of-training assessments. Results provide evidence that they are complementary in predicting end-of-training assessment scores. This research adds to the limited literature at present regarding the predictive validity of postgraduate medical selection methods, and their comparable effectiveness when used in a single selection system. A future research agenda is proposed.

Indexed as

JudgmentSchool Admission CriteriaAdultAustraliaClinical CompetenceEducation, Medical, GraduateFemaleHumansInterviews as TopicLongitudinal StudiesMalePredictive Value of TestsPsychological TestsReproducibility of Results

Identifiers

PMID26957002
PMCPMC4784338

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.