Evidence map›Paper›PMID 38935851›Full record

ArticleFamily medicine2024

Imprecise Clinical Assessments and Inaccurate Grades: Family Medicine Clerkship Director Perspectives.

Arindam Sarkar, Joel J Heidelbaugh, Gage Hallbauer, Nital Appelbaum

Abstract read
In one paragraph

Article in Family medicine, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 3 papers.

0numbers the graph read from it
0cells of the map it votes in
3citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

3 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors.

Arindam SarkarDepartment of Family and Community Medicine, Baylor College of Medicine, Houston, TX.
Joel J HeidelbaughDepartment of Family Medicine, University of Michigan Medical School, Ann Arbor, MI.
Gage HallbauerDepartment of Family and Community Medicine, Baylor College of Medicine, Houston, TX.
Nital AppelbaumDepartment of Education, Innovation and Technology, Baylor College of Medicine, Houston, TX.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

BACKGROUND AND

objectivesAs application to residency programs becomes increasingly competitive, educational leaders face growing student concern about imprecise clinical assessments and clerkship grades.

methodsAs part of a large annual survey of family medicine clerkship directors (FMCDs), 10 questions were disseminated in May 2023 about perceived levels of imprecise assessments by faculty. We aimed to determine to what extent respondents felt their institution's evaluation system propagated inaccurate grading.

resultsA total of 52% of 169 FMCDs responded to the survey. Of these, 7% of respondents were completely confident that their preceptors would give two students of identical competence the same clinical evaluation rating. FMCDs estimated that an average of 38% of their preceptors inaccurately rate student performance. Most clerkships use an Honors/High Pass/Pass/Fail grading system. We found that 51% of FMCDs prefer to use a different grading paradigm than they currently use. We asked FMCDs to estimate the percentage of students that expressed concern over inaccurate preceptor ratings. Grading systems with more tiers were associated with a higher percentage of concerned students.

conclusionsClerkship grades are widely used by residency program directors to classify and differentiate student applicants. We identified a significant concern from FMCDs that clinical evaluation ratings can vary greatly. Given the high stakes and perceived inaccuracy of clerkship grading, we recommend continued investigation into the appropriate weighing and usage of clinical evaluations. Continued exploration is recommended to develop grading paradigms centered on criterion-based assessment.

Indexed as

Clinical ClerkshipClinical CompetenceEducational MeasurementFamily PracticeFaculty, MedicalHumansInternship and ResidencyPreceptorshipStudents, MedicalSurveys and Questionnaires

Identifiers

PMID38935851
PMCPMC11412289

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.