Evidence map›Paper›PMID 35751119›Full record

ArticleBMC medical education2022

Colleague appraisal of Australian general practitioners in training: an analysis of multisource feedback data.

Caitlin Vayro, Ajit Narayanan, Michael Greco, Neil Spike, Jan Hanson, Ben Mitchell, Dale Hanson, Rebecca Stewart

Open access · goldAbstract read
In one paragraph

Article in BMC medical education, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
0.8field-weighted citation impact, top 28% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed, 4 citations in OpenAlex.

  1. Article
  2. Article
  3. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors at 7 institutions in 2 countries.

Caitlin VayroGeneral Practice Training Queensland, Brisbane, Australia. c.vayro@uq.edu.au.
Ajit NarayananSchool of Engineering, Computer and Mathematical Sciences, Auckland University of Technology, Auckland, New Zealand.
Michael GrecoSchool of Medicine, Griffith University, Brisbane, QLD, Australia.
Neil SpikeEastern Victoria General Practice Training, Hawthorn, VIC, Australia.
Jan HansonGeneral Practice Training Queensland, Brisbane, Australia.
Ben MitchellGeneral Practice Training Queensland, Brisbane, Australia.
Dale HansonGeneral Practice Training Queensland, Brisbane, Australia.
Rebecca StewartGeneral Practice Training Queensland, Brisbane, Australia.
University of Queensland · AUAuckland University of Technology · NZEastern Health · AUGovernment of the Northern Territory · AUGriffith University · AUJames Cook University · AURoyal Australian College of General Practitioners · AU

Funding

Australian General Practice Training Program ERG2020-00009
6 · The paper itself

Abstract

backgroundMultisource feedback is an evidence-based and validated tool used to provide clinicians, including those in training, feedback on their professional and interpersonal skills. Multisource feedback is mandatory for participants in the Royal Australian College of General Practitioners Practice Experience Program and for some Australian General Practice Training Registrars. Given the recency of the Practice Experience Program, there are currently no benchmarks available for comparison within the program and to other comparable cohorts including doctors in the Australian General Practice Training program. The aim of this study is to evaluate and compare colleague feedback within and across General Practice trainee cohorts.

methodsColleague feedback, from multisource feedback of Practice Experience Program participants and Australian General Practice Training Registrars, collected between January 2018 and April 2020, was compared to identify similarities and differences. Analyses entailed descriptive statistics, between and within groups rater consistency and agreement measures, principal component analysis, t-tests, analysis of variance, and psychometric network analysis.

resultsColleague ratings of Practice Experience Program participants (overall average 88.58%) were lower than for Registrars (89.08%), although this difference was not significant. 'Communication with patients' was rated significantly lower for Practice Experience Program participants (2.13%) while this group was rated significantly better for their 'Ability to say no' (1.78%). Psychometric network analyses showed stronger linkages between items making up the behavioural component (compared to the items of the performance and self-management components, as found by principal component analysis) for Practice Experience Program participants as compared to Registrars. Practice Experience Program participants were stronger in clinical knowledge and skills as well as confidentiality, while Registrars were stronger in communicating with patients, managing their own stress, and in their management and leadership skills.

conclusionsThe multisource feedback scores of doctors undertaking the Practice Experience Program suggests that, while all mean values are 'very good' to 'excellent', there are areas for improvement. The linkages between skills suggests that Practice Experience Program doctors' skills are somewhat isolated and have yet to fully synthesise. We now have a better understanding of how different groups of General Practitioners in training compare with respect to professional and interpersonal skills. Based on the demonstrated differences, the Practice Experience Program might benefit from the addition of educational activities to target the less developed skills.

Indexed as

General PracticeGeneral PractitionersAustraliaFeedbackHumansSurveys and QuestionnairesCommunication skillsGP RegistrarsGPs in TrainingMultisource feedbackProfessional developmentProfessionalism

Identifiers

PMID35751119
PMCPMC9233327
OpenAlexW4283360523

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.