Evidence map›Paper›PMID 39953278›Full record

Trial reportSurgical endoscopy2025

Standardizing surgical training with objective performance indicators: a prospective cohort study.

Sarah Choksi, Mattia Ballo, Craig Profant, Katherine Portelli, Vikrom Dhar, Ryan Schmidt, Andrew Yee, Jaisa Olasky, Filippo Filicori

Abstract readRandomized Controlled Trial
PubMed Publisher
In one paragraph

Trial report in Surgical endoscopy, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 6 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
6citing papers in PubMed, 1 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

6 citing papers in PubMed, 1 synthesis or guideline pooled it.

  1. Pooled it
  2. Review
  3. Article
  4. Review
  5. Procedure‑specific impact of body mass index on robot‑derived intraoperative telemetry: a retrospective single‑surgeon cohort study.Wideochirurgia i inne techniki maloinwazyjne = Videosurgery and other miniinvasive techniques · 2026
    Article
  6. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors.

Sarah ChoksiIntraoperative Performance Analytics Laboratory, Department of Surgery, Lenox Hill Hospital, New York, NY, USA. sarah.choksi@outlook.com.ORCID 0009-0004-2549-7647
Mattia BalloNorthwell, New Hyde Park, NY, USA.
Craig ProfantNorthwell, New Hyde Park, NY, USA.
Katherine PortelliNorthwell, New Hyde Park, NY, USA.
Vikrom DharNorthwell, New Hyde Park, NY, USA.
Ryan SchmidtData and Analytics, Intuitive Surgical, Inc., Peachtree Corners, GA, USA.
Andrew YeeData and Analytics, Intuitive Surgical, Inc., Peachtree Corners, GA, USA.
Jaisa OlaskyNorthwell, New Hyde Park, NY, USA.
Filippo FilicoriNorthwell, New Hyde Park, NY, USA.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundMultiple surgical virtual reality (VR) simulators are currently available; however, there is lack of comparison between performance after practice on these simulators compared to bench top models. Utilizing the Intuitive Data recorder (IDR) and Objective performance indicators (OPI), we aim to objectively assess robotic surgical skills using a dry lab model. We hypothesize that practicing surgical skills will improve OPIs and that those who practice on the dry lab model will have a greater improvement in their OPIs compared to those who practice with Fundamentals of Robotic Surgery (FRS) SimNow VR.

methodsThe IDR was used to record kinematics as each participant went through five basic surgery tasks on a dry lab benchtop model to record baseline performance. Participants were then randomized to practice on the dry lab model or the corresponding SimNow Virtual reality (VR) tasks. The participants repeated the tasks again on the benchtop model. Statistical analysis was performed using paired samples t tests, independent samples t tests, and ANOVA tests.

resultsTwenty-seven surgeons participated in our study ranging from interns to attendings. Randomization to VR vs benchtop practice resulted in 11 and 13 participants in each group. For the rollercoaster, backhand suturing, railroad, and knot tying tasks, a significant improvement in kinematic profiles was observed. Bimanual dexterity, angular motion, and smoothness metrics improved most consistently across the tasks after practice. Kinematic profiles between those practicing on VR versus benchtop had no significant differences.

conclusionsThis study shows that OPIs can be used to benchmark surgical trainees. VR appears to be non-inferior to dry lab model for practice for trainees. We identified patterns in OPI improvement that can be tailored to specific skills depending on the trainees needs. Our study is the first step in developing a standardized training and assessment tool to assess competency in robotic surgery training.

Indexed as

Clinical CompetenceRobotic Surgical ProceduresSimulation TrainingAdultFemaleHumansMaleProspective StudiesVirtual RealityRobotic surgerySurgical educationSurgical simulation

Identifiers

PMID39953278

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.