Evidence map›Paper›PMID 36277853›Full record

ArticleMedEdPORTAL : the journal of teaching and learning resources2022

Preparing Effective Narrative Evaluations for the Medical School Performance Evaluation (MSPE).

April O Buchanan, Lisa Strano-Paul, Kris Saudek, Carla Lupi, Lee Jones, Mary Jo Wagner, Donna Elliott

Open access · diamondAbstract read
In one paragraph

Article in MedEdPORTAL : the journal of teaching and learning resources, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 8 papers.

0numbers the graph read from it
0cells of the map it votes in
8citing papers in PubMed
1.6field-weighted citation impact, top 17% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

8 citing papers in PubMed, 10 citations in OpenAlex.

  1. Be AWARE: An Anti-bias Toolkit to Limit Bias in Narrative Evaluation of Medical Trainees.MedEdPORTAL : the journal of teaching and learning resources · 2026
    Article
  2. Review
  3. Article
  4. Review
  5. Article
  6. Article
  7. Article
  8. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors at 7 institutions in 2 countries.

April O BuchananProfessor, Department of Pediatrics, and Associate Dean for Medical Education, University of South Carolina School of Medicine Greenville; Pediatric Hospitalist, Prisma Health.ORCID 0000-0001-7608-6777
Lisa Strano-PaulProfessor, Department of Internal Medicine, and Assistant Dean for Clinical Education, Renaissance School of Medicine at Stony Brook University.
Kris SaudekAssociate Professor, Department of Pediatrics, and Associate Program Director, Pediatric Residency Program, Medical College of Wisconsin.
Carla LupiProfessor, Department of Clinical Sciences, and Associate Dean for Assessment and Evaluation, Kaiser Permanente Bernard J. Tyson School of Medicine.
Lee JonesProfessor, Department of Psychiatry, and Dean for Medical Education, Georgetown University School of Medicine.
Mary Jo WagnerProfessor, Department of Emergency Medicine, Central Michigan University College of Medicine; Chief Academic Officer/DIO, CMU Medical Education Partners.ORCID 0000-0002-8568-7838
Donna ElliottProfessor, Department of Pediatrics and Medical Education; Chair, Department of Medical Education; and Vice Dean for Medical Education, Keck School of Medicine of the University of Southern California.
Central Michigan University · USGeorgetown University · USKaiser Permanente · USMedical College of Wisconsin · USPrisma Health · USStony Brook School · USUniversity of Southern California · US

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Introduction: In 2016, the AAMC Medical School Performance Evaluation (MSPE) Task Force issued recommendations to standardize the MSPE but did not address the quality of the written narratives in that document. Narrative evaluations are hampered by code words, polite rhetoric, and bias to the detriment of students. To address this, the AAMC's Group on Student Affairs and Group on Educational Affairs convened an expert group to consider the state of narratives in the MSPE and develop resources to improve their quality. Methods: A series of interactive workshops was developed and presented at an AAMC webinar and national meetings. A presentation outlining challenges and possible approaches to improvement was followed with large-group discussion and/or small-group breakout activity to analyze and improve upon sample clinical comments and create summary clerkship paragraphs. The initial webinar used polling questions and free-text prompts to gather feedback for future workshops. Anonymous survey responses were collected at the end of each subsequent workshop to determine perceived effectiveness and potential utility at participants' institutions. Results: Over 680 administrators, faculty, and staff participated in the webinar or in one of four national-level workshops. Respondents agreed that the modules would be useful in faculty development and wanted to replicate their learning at their own institutions for overall better impact on the quality of MSPE narratives. Discussion: This resource addresses an important gap in the medical education literature. A variety of stakeholders affirmed that these workshops have value in training writers to improve their narrative comments for the MSPE.

Indexed as

Academic PerformanceEducation, MedicalFacultyFeedbackHumansSchools, MedicalAssessmentCompetency-Based Medical Education (Competencies, Milestones, EPAs)EvaluationFaculty DevelopmentNarrative Assessment

Identifiers

PMID36277853
PMCPMC9529862
OpenAlexW4301398564

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.