ArticleJournal of graduate medical education2019
USMLE Step 2 CK: Best Predictor of Multimodal Performance in an Internal Medicine Residency.
Article in Journal of graduate medical education, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 24 papers, 1 of them a synthesis that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
24 citing papers in PubMed, 1 synthesis or guideline pooled it.
- A Systematic Review of Metrics Utilized in the Selection and Prediction of Future Performance of Residents in the United States.Journal of graduate medical education · 2023Pooled it
- Associations Between Medical School Metrics and Early Pediatric Resident Milestones.Journal of graduate medical education · 2026Article
- Which Filterable ERAS Metrics Predict Success in US Pediatric Residency? A Multisite Cohort Study.Journal of graduate medical education · 2026Article
- Are Physicians' USMLE Scores Associated With Patient Mortality? A Multilevel Modeling Approach to USMLE Predictive Validity Evidence.Health science reports · 2025Article
- Factors associated with infectious diseases fellowship academic success.Medical education online · 2024Article
- Article
- Comparison of internal medicine applicant and resident characteristics with performance on ACGME milestones.Medical education online · 2023Article
- Comparing ChatGPT and GPT-4 performance in USMLE soft skill assessments.Scientific reports · 2023Article
- Ophthalmology Residency Program Director Survey on Pass/Fail U.S. Medical Licensing Exam Step 1 Scoring.Journal of academic ophthalmology (2017) · 2023Article
- Values-Based Resident Selection in an Internal Medicine-Pediatrics Residency Program.Journal of general internal medicine · 2023Review
- Pediatric residency milestone performance is not predicted by the United States Medical Licensing Examination Step 2 Clinical Knowledge.MedEdPublish (2016) · 2023Article
- Medical Schools as Racialized Organizations: How Race-Neutral Structures Sustain Racial Inequality in Medical Education-a Narrative Review.Journal of general internal medicine · 2022Review
- A Generalizable Approach to Predicting Performance on USMLE Step 2 CK.Advances in medical education and practice · 2022Article
- Core Entrustable Professional Activities (EPAs) and the Transition from Medical School to Residency: the Postgraduate Year One Resident Perspective.Medical science educator · 2021Article
- Article
- The Residency Match: Escaping the Prisoner's Dilemma.Journal of graduate medical education · 2021Article
- Randomized Trial of a Year-Long USMLE Step 1 Preparation Near-Peer Teaching Program.Medical science educator · 2021Article
- The Feasibility of Blinding Residency Programs to USMLE Step 1 Scores During GME Application, Interview, and Match Processes.Journal of graduate medical education · 2021Article
- Association Between Internal Medicine Residency Applicant Characteristics and Performance on ACGME Milestones During Intern Year.Journal of graduate medical education · 2021Article
- Article
Corrections and comments
- Commented on by
Authors and funding
6 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
backgroundInternal medicine (IM) residency programs receive information about applicants via academic transcripts, but studies demonstrate wide variability in satisfaction with and usefulness of this information. In addition, many studies compare application materials to only 1 or 2 assessment metrics, usually standardized test scores and work-based observational faculty assessments.
objectiveWe sought to determine which application materials best predict performance across a broad array of residency assessment outcomes generated by standardized testing and a yearlong IM residency ambulatory long block.
methodsIn 2019, we analyzed available Electronic Residency Application Service data for 167 categorical IM residents, including advanced degree status, research experience, failures during medical school, undergraduate medical education award status, and United States Medical Licensing Examination (USMLE) scores. We compared these with post-match residency multimodal performance, including standardized test scores and faculty member, peer, allied health professional, and patient-level assessment measures.
resultsIn multivariate analyses, USMLE Step 2 Clinical Knowledge (CK) scores were most predictive of performance across all residency performance domains measured. Having an advanced degree was associated with higher patient-level assessments (eg, physician listens, physician explains, etc). USMLE Step 1 scores were associated with in-training examination scores only. None of the other measured application materials predicted performance.
conclusionsUSMLE Step 2 CK scores were the highest predictors of residency performance across a broad array of performance measurements generated by standardized testing and an IM residency ambulatory long block.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.