Evidence map›Paper›PMID 37733347›Full record

ArticleJAMA network open2023

Intersectional Disparities in Emergency Medicine Residents' Performance Assessments by Race, Ethnicity, and Sex.

Elle Lett, Nguyen Khai Tran, Nkemjika Nweke, Mytien Nguyen, Jung G Kim, Eric Holmboe, William McDade, Dowin Boatright

Open access · goldAbstract read
In one paragraph

Article in JAMA network open, 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 15 papers.

0numbers the graph read from it
0cells of the map it votes in
15citing papers in PubMed
6.3field-weighted citation impact, top 3% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

15 citing papers in PubMed, 14 citations in OpenAlex.

  1. Article
  2. Review
  3. Article
  4. Article
  5. Financial Compensation of Academic Emergency Medicine Physicians in the United States.Academic emergency medicine : official journal of the Society for Academic Emergency Medicine · 2026
    Article
  6. Cluster-Randomized Trials in Emergency Care Research.Academic emergency medicine : official journal of the Society for Academic Emergency Medicine · 2026
    Review
  7. Article
  8. Article
  9. Article
  10. Variability in Learner Performance Using the ACGME Harmonized Milestones During the First Year of Postgraduate Training.Academic medicine : journal of the Association of American Medical Colleges · 2025
    Article
  11. Article
  12. Article
  13. Review
  14. Review
  15. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

8 authors at 7 institutions in 2 countries.

Elle LettHealth Systems and Population Health, University of Washington School of Public Health, Seattle.
Nguyen Khai TranThe PRIDE Study/PRIDEnet, Stanford University School of Medicine, Palo Alto, California.
Nkemjika NwekeSt George's University School of Medicine, St George, Grenada.
Mytien NguyenYale School of Medicine, New Haven, Connecticut.
Jung G KimDepartment of Health System Science, Kaiser Permanente Bernard J. Tyson School of Medicine, Pasadena, California.
Eric HolmboeAccreditation Council for Graduate Medical Education, Chicago, Illinois.
William McDadeAccreditation Council for Graduate Medical Education, Chicago, Illinois.
Dowin BoatrightRonald O. Perelman Department of Emergency Medicine, New York University, New York.
Accreditation Council for Graduate Medical Education · USKaiser Permanente · USNew York University · USStanford University · USSt. George's University · GDUniversity of Pennsylvania · USYale University · US

Funding

Exploring Racial/Ethnic Bias in Internal Medicine ACGME Milestone Performance EvaluationsR21MD013481 · NIMHD · YALE UNIVERSITY · PI DZIURA, JAMES DAVID · 2020 to 2021
$461k
NIMHD NIH HHS R21 MD013481
6 · The paper itself

Abstract

Importance: Previous studies have demonstrated sex-specific disparities in performance assessments among emergency medicine (EM) residents. However, less work has focused on intersectional disparities by ethnoracial identity and sex in resident performance assessments. Objective: To estimate intersectional sex-specific ethnoracial disparities in standardized EM resident assessments. Design, Setting, and Participants: This retrospective cohort study used data from the Association of American Medical Colleges and the Accreditation Council for Graduate Medical Education Milestones (Milestones) assessments to evaluate ratings for EM residents at 128 EM training programs in the US. Statistical analyses were conducted in June 2020 to January 2023. Exposure: Training and assessment environments in EM residency programs across comparison groups defined by ethnoracial identity (Asian, White, or groups underrepresented in medicine [URM], ie, African American/Black, American Indian/Alaska Native, Hispanic/Latine, and Native Hawaiian/Other Pacific Islander) and sex (female/male). Main Outcomes and Measures: Mean Milestone scores (scale, 0-9) across 6 core competency domains: interpersonal and communications skills, medical knowledge, patient care, practice-based learning and improvement, professionalism, and system-based practice. Overall assessment scores were calculated as the mean of the 6 competency scores. Results: The study sample comprised 128 ACGME-accredited programs and 16 634 assessments for 2708 EM residents of which 1913 (70.6%) were in 3-year and 795 (29.4%) in 4-year programs. Most of the residents were White (n = 2012; 74.3%), followed by Asian (n = 477; 17.6%), Hispanic or Latine (n = 213; 7.9%), African American or Black (n = 160; 5.9%), American Indian or Alaska Native (n = 24; 0.9%), and Native Hawaiian or Other Pacific Islander (n = 4; 0.1%). Approximately 14.3% (n = 386) and 34.6% (n = 936) were of URM groups and female, respectively. Compared with White male residents, URM female residents in 3-year programs were rated increasingly lower in the medical knowledge (URM female score, -0.47; 95% CI, -0.77 to -0.17), patient care (-0.18; 95% CI, -0.35 to -0.01), and practice-based learning and improvement (-0.37; 95% CI, -0.65 to -0.09) domains by postgraduate year 3 year-end assessment; URM female residents in 4-year programs were also rated lower in all 6 competencies over the assessment period. Conclusions and Relevance: This retrospective cohort study found that URM female residents were consistently rated lower than White male residents on Milestone assessments, findings that may reflect intersectional discrimination in physician competency evaluation. Eliminating sex-specific ethnoracial disparities in resident assessments may contribute to equitable health care by removing barriers to retention and promotion of underrepresented and minoritized trainees and facilitating diversity and representation among the emergency physician workforce.

Indexed as

Emergency MedicineEthnicityInternship and ResidencyProfessional CompetenceRacial GroupsFemaleHumansMaleRetrospective Studies

Identifiers

PMID37733347
PMCPMC10514741
OpenAlexW4386910718

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.