ArticleSurgical endoscopy2021
An objective approach to evaluate novice robotic surgeons using a combination of kinematics and stepwise cumulative sum (CUSUM) analyses.
Article in Surgical endoscopy, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 21 papers, 4 of them syntheses that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
21 citing papers in PubMed, 4 syntheses or guidelines pooled it, 29 citations in OpenAlex.
- Objective assessment tools in laparoscopic or robotic-assisted gynecological surgery: A systematic review.Acta obstetricia et gynecologica Scandinavica · 2024Pooled it
- Measures of performance and proficiency in robotic assisted surgery: a systematic review.Journal of robotic surgery · 2024Pooled it
- Evaluation of objective tools and artificial intelligence in robotic surgery technical skills assessment: a systematic review.The British journal of surgery · 2024Pooled it
- Technical skill assessment in minimally invasive surgery using artificial intelligence: a systematic review.Surgical endoscopy · 2023Pooled it
- Quality over quantity: early performance predicts suturing proficiency in robotic surgery simulation.Journal of robotic surgery · 2026Observational
- Artificial intelligence-driven real-time assistance in minimally invasive surgery: a technology-oriented narrative review.Journal of minimally invasive surgery · 2026Review
- Quantifying surgical complexity: how smoothness metrics vary in robotic cholecystectomy.Surgical endoscopy · 2026Article
- Article
- Objective performance indicators provide a novel, quantitative method to evaluate surgeon proficiency in robotic lobectomy training.JTCVS open · 2025Article
- Scoping review and proposed curriculum for robotic hepatopancreatobiliary surgery training.Surgical endoscopy · 2025Article
- Systematic review of machine learning applications using nonoptical motion tracking in surgery.NPJ digital medicine · 2025Article
- From Data to Decision: A Comprehensive Review of Real-Time Analytics and Smart Technologies in the Surgical Suite.Methodist DeBakey cardiovascular journal · 2025Review
- Article
- The application of objective clinical human reliability analysis (OCHRA) in the assessment of basic robotic surgical skills.Surgical endoscopy · 2024Article
- A multifactorial evaluation of objective performance indicators and video analysis in the context of case complexity and clinical outcomes in robotic-assisted cholecystectomy.Surgical endoscopy · 2023Article
- Current progress in robotic hepatobiliary and pancreatic surgery at a high-volume center.Annals of gastroenterological surgery · 2023Review
- Outcome prediction in bariatric surgery through video-based assessment.Surgical endoscopy · 2023Article
- Objective performance indicators of cardiothoracic residents are associated with vascular injury during robotic-assisted lobectomy on porcine models.Journal of robotic surgery · 2023Article
- Identification of Main Influencers of Surgical Efficiency and Variability Using Task-Level Objective Metrics: A Five-Year Robotic Sleeve Gastrectomy Case Series.Frontiers in surgery · 2022Article
- How to Bring Surgery to the Next Level: Interpretable Skills Assessment in Robotic-Assisted Surgery.Visceral medicine · 2020Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
9 authors at 3 institutions in 1 country.
Funding
No grant is acknowledged in the PubMed record.
Abstract
backgroundCurrent evaluation methods for robotic-assisted surgery (ARCS or GEARS) are limited to 5-point Likert scales which are inherently time-consuming and require a degree of subjective scoring. In this study, we demonstrate a method to break down complex robotic surgical procedures using a combination of an objective cumulative sum (CUSUM) analysis and kinematics data obtained from the da Vinci® Surgical System to evaluate the performance of novice robotic surgeons.
methodsTwo HPB fellows performed 40 robotic-assisted hepaticojejunostomy reconstructions to model a portion of a Whipple procedure. Kinematics data from the da Vinci® system was recorded using the dV Logger® while CUSUM analyses were performed for each procedural step. Each kinematic variable was modeled using machine learning to reflect the fellows' learning curves for each task. Statistically significant kinematics variables were then combined into a single formula to create the operative robotic index (ORI).
resultsThe inflection points of our overall CUSUM analysis showed improvement in technical performance beginning at trial 16. The derived ORI model showed a strong fit to our observed kinematics data (R
conclusionsIn this study, we demonstrate a novel approach to objectively break down novice performance on the da Vinci® Surgical System. We identified kinematics variables associated with improved overall technical performance to create an objective ORI. This approach to robotic operative evaluation demonstrates a valuable method to break down complex surgical procedures in an objective, stepwise fashion. Continued research into objective methods of evaluation for robotic surgery will be invaluable for future training and clinical implementation of the robotic platform.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.