Evidence map›Paper›PMID 35710660›Full record

ArticleJournal of general internal medicine2022

A Retrospective Analysis of Medical Student Performance Evaluations, 2014-2020: Recommend with Reservations.

Rebecca L Tisdale, Amy R Filsoof, Surbhi Singhal, Wendy Cáceres, Shriram Nallamshetty, Angela J Rogers, Abraham C Verghese, Robert A Harrington, Ronald M Witteles

Open access · bronzeAbstract read
In one paragraph

Article in Journal of general internal medicine, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 5 papers.

0numbers the graph read from it
0cells of the map it votes in
5citing papers in PubMed
1.6field-weighted citation impact, top 18% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

5 citing papers in PubMed, 10 citations in OpenAlex.

  1. Article
  2. Review
  3. Article
  4. Article
  5. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

9 authors at 2 institutions in 1 country.

Rebecca L TisdaleHealth Services Research and Development (HSR&D), Center for Innovation to Implementation (Ci2i), VA Palo Alto Health Care System (152-MPD), 795 Willow Road, Building 324, Menlo Park, CA, 94025, USA. rtisdale@stanford.edu.ORCID 0000-0003-2749-6889
Amy R FilsoofDepartment of Medicine, Stanford University School of Medicine, Stanford, CA, USA.
Surbhi SinghalDepartment of Medicine, Stanford University School of Medicine, Stanford, CA, USA.
Wendy CáceresDepartment of Medicine, Stanford University School of Medicine, Stanford, CA, USA.
Shriram NallamshettyHealth Services Research and Development (HSR&D), Center for Innovation to Implementation (Ci2i), VA Palo Alto Health Care System (152-MPD), 795 Willow Road, Building 324, Menlo Park, CA, 94025, USA.
Angela J RogersDepartment of Medicine, Stanford University School of Medicine, Stanford, CA, USA.
Abraham C VergheseDepartment of Medicine, Stanford University School of Medicine, Stanford, CA, USA.
Robert A HarringtonDepartment of Medicine, Stanford University School of Medicine, Stanford, CA, USA.
Ronald M WittelesDepartment of Medicine, Stanford University School of Medicine, Stanford, CA, USA.
Stanford University · USVA Palo Alto Health Care System · US

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundThe Medical Student Performance Evaluations (MSPE) is a cornerstone of residency applications. Little is known regarding adherence to Association of American Medical Colleges (AAMC) MSPE recommendations and longitudinal changes in MSPE content.

objectivesEvaluate current MSPE quality and longitudinal changes in MSPE and grading practices.

designRetrospective analysis.

participantsStudents from all Liaison Committee on Medical Education (LCME)-accredited medical schools from which the Stanford University Internal Medicine residency program received applications between 2014-2015 and 2019-2020. MAIN MEASURES: Inclusion of key words to describe applicant performance and metrics thereof, including distribution among students and key word assignment explanation; inclusion of clerkship grades, grade distributions, and grade composition; and evidence of grade inflation over time. KEY

resultsMSPE comprehensiveness varied substantially among the 149 schools analyzed. In total, 25% of schools provided complete information consistent with AAMC recommendations regarding key word/categorization of medical students and clerkship grades in 2019-2020. Seventy-seven distinct key word terms appeared across the 139 schools examined in 2019-2020. Grading practices markedly varied, with 2-83% of students receiving the top internal medicine clerkship grade depending on the year and school. Individual schools frequently changed key word and grading practices, with 33% and 18% of schools starting and/or stopping use of key words and grades, respectively. Significant grade inflation occurred over the 6-year study period, with an average 14% relative increase in the proportion of students receiving top clerkship grades.

conclusionsA minority of schools complies with AAMC MSPE guidelines, and MSPEs are inconsistent across time and schools. These practices may impair evaluation of students within and between schools.

Indexed as

Clinical ClerkshipInternship and ResidencyStudents, MedicalEducational MeasurementHumansRetrospective StudiesSchools, Medicalgraduate medical educationundergraduate medical education

Identifiers

PMID35710660
PMCPMC9296706
OpenAlexW4282960454

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.