SynthesisThe British journal of surgery2024
Evaluation of objective tools and artificial intelligence in robotic surgery technical skills assessment: a systematic review.
Synthesis in The British journal of surgery, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 43 papers, 3 of them syntheses that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
43 citing papers in PubMed, 3 syntheses or guidelines pooled it.
- Learning curve of minimally invasive complete mesocolic excision for right-sided colon cancer: a systematic review.Surgical endoscopy · 2025Pooled it
- Untangling surgical gesture analysis-are we even speaking the same language? a systematic review.Surgical endoscopy · 2025Pooled it
- Digital transformation of robotic surgery train the trainer 'TTT' courses: training the trainer in technique and technology (the 4Ts course).Journal of robotic surgery · 2025Pooled it
- Randomized double-blind protocol for cross-specialty competency assessment in robotic surgery training using GEARS: a single-center initial validation study.Journal of robotic surgery · 2026Trial
- Artificial intelligence-based action recognition and skill assessment in robotic cardiac surgery simulation: a feasibility study.Journal of robotic surgery · 2025Trial
- Multi-perspective analysis of daVinci surgical virtual reality training: a prospective randomized controlled study.Journal of robotic surgery · 2025Trial
- The robotic PIANO: a critical narrative review of surgeon-controlled operative polyphony, human factors, and robotic training.Journal of robotic surgery · 2026Review
- SAFER: a simulation-based assessment tool for emergency robotic undocking with multisource validity evidence.Surgical endoscopy · 2026Article
- Artificial Intelligence in Cardiac Surgery and Surgical Training: Opportunities, Risks, and Safeguards for Preserving Expertise.Journal of clinical medicine · 2026Review
- Applications of Reinforcement Learning for Autonomous Surgical Robotics: A Systematic Review.Biomimetics (Basel, Switzerland) · 2026Review
- Development of a robotic training curriculum for visceral and gastrointestinal surgical trainees: an international Delphi study.Surgical endoscopy · 2026Article
- Review
- Blob representation of robotic surgical scenes for position-aware video generation.International journal of computer assisted radiology and surgery · 2026Article
- Complementary Error Patterns Between Human Evaluators and GPT-4o in Video-Based Cardiopulmonary Resuscitation Skills Assessment: Implications for Artificial Intelligence-Assisted Second Reading.Journal of clinical medicine · 2026Article
- Development of a Robotic Training Curriculum for Visceral and Gastrointestinal Surgical Trainees: An International Delphi Study.United European gastroenterology journal · 2026Article
- [Artificial intelligence in surgical disciplines: Clinical application, advantages, and potential-a Delphi expert consensus].Urologie (Heidelberg, Germany) · 2026Article
- Machine Learning Models for Objective Assessment of Vascular Anastomoses Using Computational Fluid Dynamics for Surgical Skill Training-A Retrospective Study.Journal of clinical medicine · 2026Article
- Identifying novel indicators of non-technical skills derived from operative video annotation.The British journal of surgery · 2026Article
- Article
- Association of skill and errors with outcomes in robotic rectal cancer surgery.Surgical endoscopy · 2026Article
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
11 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
backgroundThere is a need to standardize training in robotic surgery, including objective assessment for accreditation. This systematic review aimed to identify objective tools for technical skills assessment, providing evaluation statuses to guide research and inform implementation into training curricula.
methodsA systematic literature search was conducted in accordance with the PRISMA guidelines. Ovid Embase/Medline, PubMed and Web of Science were searched. Inclusion criterion: robotic surgery technical skills tools. Exclusion criteria: non-technical, laparoscopy or open skills only. Manual tools and automated performance metrics (APMs) were analysed using Messick's concept of validity and the Oxford Centre of Evidence-Based Medicine (OCEBM) Levels of Evidence and Recommendation (LoR). A bespoke tool analysed artificial intelligence (AI) studies. The Modified Downs-Black checklist was used to assess risk of bias.
resultsTwo hundred and forty-seven studies were analysed, identifying: 8 global rating scales, 26 procedure-/task-specific tools, 3 main error-based methods, 10 simulators, 28 studies analysing APMs and 53 AI studies. Global Evaluative Assessment of Robotic Skills and the da Vinci Skills Simulator were the most evaluated tools at LoR 1 (OCEBM). Three procedure-specific tools, 3 error-based methods and 1 non-simulator APMs reached LoR 2. AI models estimated outcomes (skill or clinical), demonstrating superior accuracy rates in the laboratory with 60 per cent of methods reporting accuracies over 90 per cent, compared to real surgery ranging from 67 to 100 per cent.
conclusionsManual and automated assessment tools for robotic surgery are not well validated and require further evaluation before use in accreditation processes.PROSPERO: registration ID CRD42022304901.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.