Evidence map›Paper›PMID 42125624›Full record

ArticleAEM education and training2026

Preparing Emergency Medicine Residents for the Certifying Exam: A Pilot Study of a Longitudinal Simulation-Based Assessment Program.

Jennifer Yee, Christopher E San Miguel, Krystin N Miller, Simiao Li-Sauerwine, Geremiha Emerson, Jennifer M Mitzman, Cynthia G Leung, Colin G Kaide, Benjamin M Ostro, Andrew P Kendle and 4 more

Abstract read
In one paragraph

Article in AEM education and training, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed.

  1. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

14 authors.

Jennifer YeeDepartment of Emergency Medicine the Ohio State University College of Medicine Columbus Ohio USA.
Christopher E San MiguelDepartment of Emergency Medicine the Ohio State University College of Medicine Columbus Ohio USA.ORCID https://orcid.org/0000-0001-6977-5996
Krystin N MillerDepartment of Emergency Medicine the Ohio State University College of Medicine Columbus Ohio USA.
Simiao Li-SauerwineDepartment of Emergency Medicine the Ohio State University College of Medicine Columbus Ohio USA.
Geremiha EmersonDepartment of Emergency Medicine the Ohio State University College of Medicine Columbus Ohio USA.
Jennifer M MitzmanDepartment of Emergency Medicine the Ohio State University College of Medicine Columbus Ohio USA.ORCID https://orcid.org/0009-0007-2052-3932
Cynthia G LeungDepartment of Emergency Medicine the Ohio State University College of Medicine Columbus Ohio USA.
Colin G KaideDepartment of Emergency Medicine the Ohio State University College of Medicine Columbus Ohio USA.
Benjamin M OstroDepartment of Emergency Medicine the Ohio State University College of Medicine Columbus Ohio USA.
Andrew P KendleDepartment of Emergency Medicine the Ohio State University College of Medicine Columbus Ohio USA.
Ashish R PanchalDepartment of Emergency Medicine the Ohio State University College of Medicine Columbus Ohio USA.
Sally A SantenDepartment of Emergency Medicine the University of Cincinnati College of Medicine Cincinnati Ohio USA.ORCID https://orcid.org/0000-0002-8327-8002
Kelsey H JordanDepartment of Emergency Medicine the Ohio State University College of Medicine Columbus Ohio USA.
Sorabh KhandelwalDepartment of Emergency Medicine the Ohio State University College of Medicine Columbus Ohio USA.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Background: The American Board of Emergency Medicine (ABEM) has recently introduced a new Certifying Exam, which incorporates assessment of performance in a simulated clinical environment. Simulation-based assessments allow for reproducible, controlled evaluations. The residency program has a responsibility to prepare residents for the Certifying Exam and to verify resident competency. We sought to determine the feasibility of a simulation-based assessment program encompassing three domains (resuscitation, procedural skills, and communication) with assessments against pre-determined Minimum Competency Scores (MCS) to provide evidence for program director attestations of competence. Methods: Eight stations were chosen based on ABEM's Certifying Exam content, the Accreditation Council for Graduate Medical Education (ACGME) Milestones, and proposed Entrustable Professional Activities. Simulation-based case scenarios and assessment checklists were created with standard settings performed using the Mastery Angoff process. These stations were categorized into three different domains: resuscitation (Adult Medical, Pediatric Medical, Trauma, and Neonatal), procedural skills (Direct Laryngoscopy, Cricothyrotomy, and Central Venous Catheter Placement), and communication (Breaking Bad News). Results were summarized with descriptive statistics. Results: Thirty emergency medicine residents at an academic Midwestern residency program underwent assessments over one year. None of the residents achieved the MCS on all eight assessments. Residents achieved the MCS on an average of 4.24 stations. There was large performance variability, particularly for the Pediatric Medical (27%-100% items correct), Neonatal Resuscitation (30%-100%), and Breaking Bad News (31%-100%) scenarios. A greater percentage of residents met the MCS for procedural assessments. Conclusions: This pilot study demonstrated the feasibility of a simulation-based assessment program designed to provide objective evidence of clinical competency. Assessment outcomes and associated feedback can be used by learners to guide the development of educational plans for performance improvement. Educators can use the resulting data to assess readiness for independent practice, prepare for the Certifying Exam, and identify content areas that may require additional program-wide education.

Indexed as

clinical competencyclinical skillsemergency medicinegraduatemedical educationstandards

Identifiers

PMID42125624
PMCPMC13159544

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.