Evidence map›Paper›PMID 36040776›Full record

ArticleJournal of participatory medicine2022

Evaluating a Global Assessment Measure Created by Standardized Patients for the Multiple Mini Interview in Medical School Admissions: Mixed Methods Study.

Ann Blair Kennedy, Cindy Nessim Youssef Riyad, Ryan Ellis, Perry R Fleming, Mallorie Gainey, Kara Templeton, Anna Nourse, Virginia Hardaway, April Brown, Pam Evans and 1 more

Open access · goldAbstract read
In one paragraph

Article in Journal of participatory medicine, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact, top 88% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed, 0 citations in OpenAlex.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors at 2 institutions in 1 country.

Ann Blair KennedyBiomedical Sciences Department, School of Medicine Greenville, University of South Carolina, Greenville, SC, United States.ORCID https://orcid.org/0000-0002-3518-6314
Cindy Nessim Youssef RiyadSchool of Medicine Greenville, University of South Carolina, Greenville, SC, United States.ORCID https://orcid.org/0000-0003-4220-1903
Ryan EllisSchool of Medicine Greenville, University of South Carolina, Greenville, SC, United States.ORCID https://orcid.org/0000-0002-2328-219X
Perry R FlemingPatient Engagement Studio, University of South Carolina, Greenville, SC, United States.ORCID https://orcid.org/0000-0002-0452-7411
Mallorie GaineySchool of Medicine Greenville, University of South Carolina, Greenville, SC, United States.ORCID https://orcid.org/0000-0002-7539-904X
Kara TempletonPrisma Health-Upstate Simulation Center, School of Medicine Greenville, University of South Carolina, Greenville, SC, United States.ORCID https://orcid.org/0000-0001-7277-3721
Anna NoursePatient Engagement Studio, University of South Carolina, Greenville, SC, United States.ORCID https://orcid.org/0000-0002-9005-7435
Virginia HardawayAdmissions and Registration, School of Medicine Greenville, University of South Carolina, Greenville, SC, United States.ORCID https://orcid.org/0000-0001-5678-1385
April BrownPrisma Health-Upstate Simulation Center, School of Medicine Greenville, University of South Carolina, Greenville, SC, United States.ORCID https://orcid.org/0000-0002-3222-8531
Pam EvansPatient Engagement Studio, University of South Carolina, Greenville, SC, United States.ORCID https://orcid.org/0000-0003-3289-6895
Nabil NatafgiPatient Engagement Studio, University of South Carolina, Greenville, SC, United States.ORCID https://orcid.org/0000-0003-4979-0317
University of South Carolina · USPrisma Health · US

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundStandardized patients (SPs) are essential stakeholders in the multiple mini interviews (MMIs) that are increasingly used to assess medical school applicants' interpersonal skills. However, there is little evidence for their inclusion in the development of instruments.

objectiveThis study aimed to describe the process and evaluate the impact of having SPs co-design and cocreate a global measurement question that assesses medical school applicants' readiness for medical school and acceptance status.

methodsThis study used an exploratory, sequential, and mixed methods study design. First, we evaluated the initial MMI program and determined the next quality improvement steps. Second, we held a collaborative workshop with SPs to codevelop the assessment question and response options. Third, we evaluated the created question and the additional MMI rubric items through statistical tests based on 1084 applicants' data from 3 cohorts of applicants starting in the 2018-2019 academic year. The internal reliability of the MMI was measured using a Cronbach α test, and its prediction of admission status was tested using a forward stepwise binary logistic regression.

resultsProgram evaluation indicated the need for an additional quantitative question to assess applicant readiness for medical school. In total, 3 simulation specialists, 2 researchers, and 21 SPs participated in a workshop leading to a final global assessment question and responses. The Cronbach α's were >0.8 overall and in each cohort year. The final stepwise logistic model for all cohorts combined was statistically significant (P<.001), explained 9.2% (R

conclusionsThe collaborative nature of this project between stakeholders, including nonacademics and researchers, was vital for the success of this project. The SP-created question had a significant impact on the final model predicting acceptance to medical school. This finding indicates that SPs bring a critical perspective that can improve the process of evaluating medical school applicants.

Indexed as

acceptanceco-designcommunicationexploratory sequential mixed methods designinterviewmedical schoolmedical schoolsmedical studentsmultiple mini interviewsparticipatory designpatientschool admission criteriastudentstudy design

Identifiers

PMID36040776
PMCPMC9472042
OpenAlexW4289546367

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.