Evidence map›Paper›PMID 40410727›Full record

ArticleBMC medical education2025

Educational utility of observational workplace-based assessment modalities in Australian vocational general practice training: a cross-sectional study.

Alison Fielding, Benjamin Mundy, Amanda Tapley, Sarah Gani, Rula Ali, Michael Bentley, Rachael Boland, Lina Zbaidi, Elizabeth Holliday, Jean Ball and 3 more

Abstract read
In one paragraph

Article in BMC medical education, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

13 authors.

Alison FieldingSchool of Medicine & Public Health, University of Newcastle, University Drive, Callaghan, NSW, 2308, Australia. alison.a.fielding@newcastle.edu.au.ORCID http://orcid.org/0000-0001-5884-3068
Benjamin MundyGeneral Practice Training Research, Royal Australian College of General Practitioners, Level 1, 20 Mclntosh Drive, Mayfield West, NSW, 2304, Australia.ORCID http://orcid.org/0000-0001-5574-9375
Amanda TapleySchool of Medicine & Public Health, University of Newcastle, University Drive, Callaghan, NSW, 2308, Australia.ORCID http://orcid.org/0000-0002-1536-5518
Sarah GaniGeneral Practice Training Medical Education, Royal Australian College of General Practitioners, Suite 2, 16 Napier Close, Deakin, ACT, 2600, Australia.
Rula AliDiscipline of General Practice, Faculty of Medicine and Health, University of New South Wales, Sydney, NSW, 2052, Australia.
Michael BentleyGeneral Practice Training Research, Royal Australian College of General Practitioners, TAS, 62 Patrick Street, Hobart, 7000, Australia.ORCID http://orcid.org/0000-0003-3016-6194
Rachael BolandGeneral Practice Training Medical Education, GP Training, Royal Australian College of General Practitioners, TAS, 62 Patrick Street, Hobart, 7000, Australia.
Lina ZbaidiNorthern Territory General Practice Education, Level 3, Building 1, Yellow Precinct, Charles Darwin University, Ellengowan Drive, Casuarina, NT, 0810, Australia.
Elizabeth HollidaySchool of Medicine & Public Health, University of Newcastle, University Drive, Callaghan, NSW, 2308, Australia.ORCID http://orcid.org/0000-0002-4066-6224
Jean BallClinical Research Design IT and Statistical Support Unit (CReDITSS), Hunter Medical Research Institute (HMRI), 1 Kookaburra Circuit, New Lambton Heights, NSW, 2305, Australia.ORCID http://orcid.org/0000-0001-5402-6415
Mieke van DrielGeneral Practice Clinical Unit, Faculty of Medicine, Mayne Medical Building, The University of Queensland, Level 2288 Herston Road, Herston, QLD, 4006, Australia.ORCID http://orcid.org/0000-0003-1711-9553
Linda KleinSchool of Medicine & Public Health, University of Newcastle, University Drive, Callaghan, NSW, 2308, Australia.ORCID http://orcid.org/0000-0002-2063-1518
Parker MaginSchool of Medicine & Public Health, University of Newcastle, University Drive, Callaghan, NSW, 2308, Australia.ORCID http://orcid.org/0000-0001-8071-8749

Funding

Royal Australian College of General Practitioners ERG2020-00002
6 · The paper itself

Abstract

backgroundDirect observation, workplace-based assessments (WBAs) are a fundamental component of competency-based postgraduate medical education. In Australian general practice vocational training, external clinical teaching visits (ECTVs) are key observation-based WBAs. Traditionally, ECTVs are conducted face-to-face, but the COVID-19 pandemic saw the development and implementation of remote ECTV modalities. It remains unknown if perceived educational utility of remote ECTVs differs from traditional face-to-face ECTVs. This study explored the educational utility of ECTVs, including face-to-face and remote formats.

methodsGeneral practice trainees ('registrars') and external clinical teaching visitors ('ECT visitors', who are independent experienced GP observers) each completed a cross-sectional questionnaire following individual ECTVs undertaken in 2020. Outcomes included overall educational utility of the ECTV as perceived by registrars, registrar ratings of likelihood to change their clinical practice as a result of the ECTV, registrar ratings of likelihood to change their approach to learning/training as a result of the ECTV, and overall educational utility of the ECTV as perceived by the ECT visitor. Educational utility ratings (5-point scales) were analysed descriptively. Univariable and multivariable logistic regression were employed to examine factors associated with dichotomised educational utility ratings.

resultsResponse rates were 41% (n = 801) for registrars and 39% (n = 742) for ECT visitors. Most registrars (64.1%) rated ECTV overall educational utility as 'very useful'; 58.5% and 47.9% of registrars rated their likelihood to change practice and approach to learning/training, respectively, as 'very likely'. No statistically significant differences in perceived educational utility ratings were identified between face-to-face and remote video/phone ECTVs (multivariable p-value range: .07-.96). Receiving feedback that was focused/specific/easy to translate into action was consistently associated with registrars' rating overall educational utility as 'very useful' (odds ratio (OR): 12.8, 95% confidence interval (CI): 8.26 to19.9), rating likelihood to change practice as 'very likely' (OR: 2.5, 95%CI: 1.59 to 3.94), and rating likelihood to change learning/training approach as 'very likely' (OR: 3.19, 95%CI: 1.97 to 5.17).

conclusionsECTVs are perceived by registrars and ECT visitors to be educationally useful across different delivery modalities and formats. The quality and features of the feedback provided appear most important in ECTVs as an assessment for learning.

Indexed as

Educational MeasurementEducation, Medical, GraduateGeneral PracticeAdultAustraliaClinical CompetenceCOVID-19Cross-Sectional StudiesFemaleHumansMaleSARS-CoV-2Surveys and QuestionnairesWorkplaceEducational Measurement (or Assessment, Educational)Education, medicalEducation, Medical, GraduateFamily PracticeFormative FeedbackGeneral Practice

Identifiers

PMID40410727
PMCPMC12102905

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.