Evidence map›Paper›PMID 30993615›Full record

ArticleJournal of general internal medicine2019

Clerkship Grading Committees: the Impact of Group Decision-Making for Clerkship Grading.

Annabel K Frank, Patricia O'Sullivan, Lynnea M Mills, Virginie Muller-Juge, Karen E Hauer

Abstract read
In one paragraph

Article in Journal of general internal medicine, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 8 papers.

0numbers the graph read from it
0cells of the map it votes in
8citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

8 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Bias in Medical School Clerkship Grading: Is It Time for a Change?Academic psychiatry : the journal of the American Association of Directors of Psychiatric Residency Training and the Association for Academic Psychiatry · 2023
    Article
  5. Article
  6. Trust as a Scaffold for Competency-Based Medical Education.Journal of general internal medicine · 2019
    Article
  7. Article
  8. Hawks and Doves: Perceptions and Reality of Faculty Evaluations.Journal of medical education and curricular development
    Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Annabel K FrankDepartment of Medicine, University of California, San Francisco, San Francisco, CA, USA.
Patricia O'SullivanDepartment of Medicine, University of California, San Francisco, San Francisco, CA, USA.
Lynnea M MillsDepartment of Medicine, University of California, San Francisco, San Francisco, CA, USA.
Virginie Muller-JugeDepartment of Medicine, University of California, San Francisco, San Francisco, CA, USA.
Karen E HauerDepartment of Medicine, University of California, San Francisco, San Francisco, CA, USA. karen.hauer@ucsf.edu.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundFaculty and students debate the fairness and accuracy of medical student clerkship grades. Group decision-making is a potential strategy to improve grading.

objectiveTo explore how one school's grading committee members integrate assessment data to inform grade decisions and to identify the committees' benefits and challenges.

designThis qualitative study used semi-structured interviews with grading committee chairs and members conducted between November 2017 and March 2018.

participantsParticipants included the eight core clerkship directors, who chaired their grading committees. We randomly selected other committee members to invite, for a maximum of three interviews per clerkship. APPROACH: Interviews were recorded, transcribed, and analyzed using inductive content analysis. KEY

resultsWe interviewed 17 committee members. Within and across specialties, committee members had distinct approaches to prioritizing and synthesizing assessment data. Participants expressed concerns about the quality of assessments, necessitating careful scrutiny of language, assessor identity, and other contextual factors. Committee members were concerned about how unconscious bias might impact assessors, but they felt minimally impacted at the committee level. When committee members knew students personally, they felt tension about how to use the information appropriately. Participants described high agreement within their committees; debate was more common when site directors reviewed students' files from other sites prior to meeting. Participants reported multiple committee benefits including faculty development and fulfillment, as well as improved grading consistency, fairness, and transparency. Groupthink and a passive approach to bias emerged as the two main threats to optimal group decision-making.

conclusionsGrading committee members view their practices as advantageous over individual grading, but they feel limited in their ability to address grading fairness and accuracy. Recommendations and support may help committees broaden their scope to address these aspirations.

Indexed as

Decision MakingEducational MeasurementEducation, MedicalFaculty, MedicalHumansQualitative ResearchStudents, Medicalclerkship gradingclinical competenceevaluationgrading committeesgroup decision-makingmedical education-qualitative methodsmedical education-undergraduate

Identifiers

PMID30993615
PMCPMC6502934

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.