Evidence map›Paper›PMID 33030877›Full record

ArticleObstetrics and gynecology2020

Establishing Validity for a Vaginal Hysterectomy Simulation Model for Surgical Skills Assessment.

Chi Chung Grace Chen, Ernest G Lockrow, Christopher C DeStephano, Mikio A Nihira, Catherine Matthews, Leslie Kammire, Lisa M Landrum, Bruce D Anderson, Douglas Miyazaki

Open access · hybridAbstract readValidation Study
PubMed Full text at PMC Publisher
In one paragraph

Article in Obstetrics and gynecology, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed
1.2field-weighted citation impact, top 20% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed, 9 citations in OpenAlex.

  1. Article
  2. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors at 1 institution in 1 country.

Chi Chung Grace ChenDepartment of Gynecology and Obstetrics, Johns Hopkins University School of Medicine, Baltimore, Maryland; the Department of Obstetrics and Gynecology, Uniformed Services University of the Health Sciences, Bethesda, Maryland; the Department of Gynecology, Mayo Clinic, Jacksonville, Florida; the Department of Obstetrics and Gynecology, University of California Riverside, Riverside, California; the Department of Obstetrics and Gynecology, Oklahoma University College of Medicine, Oklahoma City, Oklahoma; Augmented Reality Systems Inc., Windham, New Hampshire; and the Department of Obstetrics and Gynecology, Wake Forest School of Medicine, Winston-Salem, North Carolina. At the time of study, all participating institutions were members of the American College of Obstetricians and Gynecologists Simulations Working Group.
Ernest G Lockrow
Christopher C DeStephano
Mikio A Nihira
Catherine Matthews
Leslie Kammire
Lisa M Landrum
Bruce D Anderson
Douglas Miyazaki
Johns Hopkins University · US

Funding

Effect of Validated Skills Simulation with the Miya Model on Operating Room Performance of Vaginal HysterectomyR44HD084151 · NICHD · MIYAZAKI ENTERPRISES, LLC · PI ANDERSON, BRUCE D, CHEN, CHI CHIUNG GRACE · 2016 to 2022
$4.5M
Development and Validation of the Miya Model, A Simulator Designed to Train Vaginal Surgery TechniquesR43HD084151 · NICHD · MIYAZAKI ENTERPRISES, LLC · PI MIYAZAKI, DOUGLAS W. · 2015 to 2015
$140k
NICHD NIH HHS R43 HD084151NICHD NIH HHS R44 HD084151
6 · The paper itself

Abstract

objectiveTo use the Messick validity framework for a simulation-based assessment of vaginal hysterectomy skills.

methodsVideo recordings of physicians at different levels of training and experience performing vaginal hysterectomy on a high-fidelity vaginal surgery model were objectively assessed using a modified 10-item Vaginal Surgical Skills Index, a one-item global scale of overall performance, and a pass-fail criterion. Participants included obstetrics and gynecology trainees and faculty from five institutions. Video recordings were independently assessed by expert surgeons blinded to the identities of the study participants.

resultsFifty surgeons (11 faculty, 39 trainees) were assessed. Experience level correlated strongly with both the modified Vaginal Surgical Skills Index and global scale score, with more experienced participants receiving higher scores (Pearson r=0.81, P<.001; Pearson r=0.74, P<.001). Likewise, surgical experience was also moderately correlated with the modified Vaginal Surgical Skills Index and global scale score (Pearson r=0.55, P<.001; Pearson r=0.58, P<.001). The internal consistency of the modified Vaginal Surgical Skills Index was excellent (Cronbach's alpha=0.97). Interrater reliability of the modified Vaginal Surgical Skills Index and global scale score, as measured by the intraclass correlation coefficient, was moderate to good (0.49-0.95; 0.50-0.87). Using the receiver operating characteristic curve and the pass-fail criterion, a modified Vaginal Surgical Skills Index cutoff score of 27 was found to most accurately (area under the curve 0.951, 95% CI 0.917-0.983) differentiate competent from noncompetent surgeons.

conclusionWe demonstrated validity evidence for using a high-fidelity vaginal surgery model with the modified Vaginal Surgical Skills Index or global scale score to assess vaginal hysterectomy skills.

Indexed as

Simulation TrainingAdultClinical CompetenceEducational MeasurementFemaleGynecologyHumansHysterectomy, VaginalObstetricsReproducibility of ResultsSurgeons

Identifiers

PMID33030877
PMCPMC7575024
OpenAlexW3091985585

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.