ArticleJournal of graduate medical education2020
A Critical Disconnect: Residency Selection Factors Lack Correlation With Intern Performance.
Article in Journal of graduate medical education, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 16 papers, 1 of them a synthesis that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
16 citing papers in PubMed, 1 synthesis or guideline pooled it, 28 citations in OpenAlex.
- A Systematic Review of Metrics Utilized in the Selection and Prediction of Future Performance of Residents in the United States.Journal of graduate medical education · 2023Pooled it
- From Evaluation to Elevation: Standardized Letter of Evaluation Domains Tied to Future Emergency Medicine Chief Residents.The western journal of emergency medicine · 2026Article
- The Wicked Problem of Selection and Competency-Based Education: Applying TRIZ Inversion to the Graduate Medical Education Selection Process.Perspectives on medical education · 2026Article
- A 30-year History of the Emergency Medicine Standardized Letter of Evaluation.The western journal of emergency medicine · 2025Article
- Socioeconomic Disparities in Research Participation: Bias in Plastic Surgery Residency Match.Plastic and reconstructive surgery. Global open · 2024Article
- Comparison of internal medicine applicant and resident characteristics with performance on ACGME milestones.Medical education online · 2023Article
- Expanding the Study of Bias in Medical Education Assessment.Journal of graduate medical education · 2023Article
- Association of Interview and Holistic Review Metrics With Resident Performance-Related Difficulties in an Internal Medicine Residency Program.Journal of graduate medical education · 2023Article
- Values-Based Resident Selection in an Internal Medicine-Pediatrics Residency Program.Journal of general internal medicine · 2023Review
- Embracing our responsibility to ensure trainee competency.AEM education and training · 2023Article
- Pediatric residency milestone performance is not predicted by the United States Medical Licensing Examination Step 2 Clinical Knowledge.MedEdPublish (2016) · 2023Article
- Assessing the impact of adopting a competency-based medical education framework and ACGME-I accreditation on educational outcomes in a family medicine residency program in Abu Dhabi Emirate, United Arab Emirates.Frontiers in medicine · 2023Article
- Medical Schools as Racialized Organizations: How Race-Neutral Structures Sustain Racial Inequality in Medical Education-a Narrative Review.Journal of general internal medicine · 2022Review
- Adaptive expertise: The optimal outcome of emergency medicine training.AEM education and training · 2022Article
- To the Editor: Retrospective "Ranking" of Former Graduate Trainees by Senior Faculty Who Worked With Them During Their Residency.Journal of graduate medical education · 2021Article
- Innovation in Resident Selection: Life Without Step 1.Journal of medical education and curricular developmentReview
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
9 authors at 8 institutions in 1 country.
Funding
No grant is acknowledged in the PubMed record.
Abstract
backgroundEmergency medicine (EM) residency programs want to employ a selection process that will rank best possible applicants for admission into the specialty.
objectiveWe tested if application data are associated with resident performance using EM milestone assessments. We hypothesized that a weak correlation would exist between some selection factors and milestone outcomes.
methodsUtilizing data from 5 collaborating residency programs, a secondary analysis was performed on residents trained from 2013 to 2018. Factors in the model were gender, underrepresented in medicine status, United States Medical Licensing Examination Step 1 and 2 Clinical Knowledge (CK), Alpha Omega Alpha (AOA), grades (EM, medicine, surgery, pediatrics), advanced degree, Standardized Letter of Evaluation global assessment, rank list position, and controls for year assessed and program. The primary outcomes were milestone level achieved in the core competencies. Multivariate linear regression models were fitted for each of the 23 competencies with comparisons made between each model's results.
resultsFor the most part, academic performance in medical school (Step 1, 2 CK, grades, AOA) was not associated with residency clinical performance on milestones. Isolated correlations were found between specific milestones (eg, higher surgical grade increased wound care score), but most had no correlation with residency performance.
conclusionsOur study did not find consistent, meaningful correlations between the most common selection factors and milestones at any point in training. This may indicate our current selection process cannot consistently identify the medical students who are most likely to be high performers as residents.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.