Measuring what matters: identifying assessments that reflect learning on the core surgical clerkship.

Purpose: There are various assessments used during the core surgical clerkship (CSC), each of which may be influenced by factors external to the CSC or have inherent biases from an equity lens. In particular, the National Board of Medical Examiners' Clinical Subject Exams ("Shelf") is used heavily and may not reflect clerkship curriculum or clinical learning. Methods: This is a retrospective review of medical student characteristics and assessments during the CSC from July 2017-June 2021. Assessment methods included: subjective Clinical Performance Assessments (CPA), Shelf, Objective Structured Clinical Examinations, and a short-answer in-house examination (IHE) culminating in a Final Grade (FG) of Honors/Pass/Fail. A Shelf score threshold for Honors was added in academic years 2020-2021. Descriptive, univariate, and multivariable logistic and linear regression statistics were utilized. Results: We reviewed records of 192 students. Of these, 107 (55.7%) were female, median age was 24 [IQR: 23-26] years, and most were White/Caucasian ( Conclusions: The Shelf is substantially influenced by temporal associations across Terms and timing in relation to other clerkships, such as Internal Medicine. An IHE reflective of a clerkship's specified curriculum may be a more equitable summative assessment of the learning that occurs from the CSC curriculum, with fewer biases or influences external to the CSC. Supplementary Information: The online version contains supplementary material available at 10.1007/s44186-022-00047-8.