Evidence map›Paper›PMID 34337475›Full record

ReviewEuropean urology open science2020

Utilising an Accelerated Delphi Process to Develop Guidance and Protocols for Telepresence Applications in Remote Robotic Surgery Training.

Justin W Collins, Ahmed Ghazi, Danail Stoyanov, Andrew Hung, Mark Coleman, Tom Cecil, Anders Ericsson, Mehran Anvari, Yulun Wang, Yanick Beaulieu and 14 more

Abstract readReview
In one paragraph

Review in European urology open science, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 24 papers, 4 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
24citing papers in PubMed, 4 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

24 citing papers in PubMed, 4 syntheses or guidelines pooled it.

  1. Pooled it
  2. Guideline
  3. Pooled it
  4. Feasibility and Initial Outcomes of Telesurgery in Urology: a Systematic Review of the Literature.International braz j urol : official journal of the Brazilian Society of Urology
    Pooled it
  5. Article
  6. Article
  7. Designing self-assessment tools for learning five instrumental clinical procedures in ENT: A modified Delphi consensus approach.European archives of oto-rhino-laryngology : official journal of the European Federation of Oto-Rhino-Laryngological Societies (EUFOS) : affiliated with the German Society for Oto-Rhino-Laryngology - Head and Neck Surgery · 2026
    Article
  8. Article
  9. Article
  10. Review
  11. Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Review
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

24 authors.

Justin W CollinsDivision of Surgery and Interventional Science, Research Department of Targeted Intervention, University College London, London, UK.
Ahmed GhaziUniversity of Rochester Medical Center, Rochester, NY, USA.
Danail StoyanovWellcome/ESPRC Centre for Interventional and Surgical Sciences (WEISS), University College London, London, UK.
Andrew HungKeck School of Medicine of USC, Los Angeles, CA, USA.
Mark ColemanPlymouth Hospitals NHS Trust, Plymouth, UK.
Tom CecilHampshire Hospitals NHS Foundation Trust, Hampshire, UK.
Anders EricssonDepartment of Psychology, Florida State University, Tallahassee, FL, USA.
Mehran AnvariDepartment of Surgery, St. Joseph's Healthcare, McMaster University, Hamilton, Ontario, Canada.
Yulun WangInTouch Health, Santa Barbara, CA, USA.
Yanick BeaulieuDivision of Cardiology and Critical Care, Sacré-Coeur Hospital, University of Montreal, Montreal, Quebec, Canada.
Nadine HaramDepartment of Plastic Surgery, Royal Free London NHS Foundation Trust, London, UK.
Ashwin SridharDivision of Surgery and Interventional Science, Research Department of Targeted Intervention, University College London, London, UK.
Jacques MarescauxIRCAD, Research Institute Against Digestive Cancer, Strasbourg, France.
Michele DianaIRCAD, Research Institute Against Digestive Cancer, Strasbourg, France.
Hani J MarcusWellcome/ESPRC Centre for Interventional and Surgical Sciences (WEISS), University College London, London, UK.
Jeffrey LevyInstitute for Surgical Excellence, Philadelphia, PA, USA.
Prokar DasguptaMRC Centre for Transplantation, Kings College London, London, UK.
Dimitrios StefanidisIndiana University School of Medicine, Indianapolis, IN, USA.
Martin MartinoUniversity of Southern Florida, Tampa, FL, USA.
Richard FeinsDivision of C Surgery, University of North Carolina, Chapel Hill, NC, USA.
Vipul PatelGlobal Robotics Institute, Celebration, FL, USA.
Mark SlackDepartment of Obstetrics and Gynaecology, Addenbrooke's Hospital, Cambridge, UK.
Richard M SatavaUniversity of Washington Medical Center, Seattle, WA, USA.
John D KellyDivision of Surgery and Interventional Science, Research Department of Targeted Intervention, University College London, London, UK.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

contextThe role of robot-assisted surgery continues to expand at a time when trainers and proctors have travel restrictions during the coronavirus disease 2019 (COVID-19) pandemic.

objectiveTo provide guidance on setting up and running an optimised telementoring service that can be integrated into current validated curricula. We define a standardised approach to training candidates in skill acquisition via telepresence technologies. We aim to describe an approach based on the current evidence and available technologies, and define the key elements within optimised telepresence services, by seeking consensus from an expert committee comprising key opinion leaders in training. EVIDENCE ACQUISITION: This project was carried out in phases: a systematic review of the current literature, a teleconference meeting, and then an initial survey were conducted based on the current evidence and expert opinion, and sent to the committee. Twenty-four experts in training, including clinicians, academics, and industry, contributed to the Delphi process. An accelerated Delphi process underwent three rounds and was completed within 72 h. Additions to the second- and third-round surveys were formulated based on the answers and comments from the previous rounds. Consensus opinion was defined as ≥80% agreement. EVIDENCE SYNTHESIS: There was 100% consensus regarding an urgent need for international agreement on guidance for optimised telepresence. Consensus was reached in multiple areas, including (1) infrastructure and functionality; (2) definitions and terminology; (3) protocols for training, communication, and safety issues; and (4) accountability including ethical and legal issues. The resulting formulated guidance showed good internal consistency among experts, with a Cronbach alpha of 0.90.

conclusionsUsing the Delphi methodology, we achieved international consensus among experts for development and content validation of optimised telepresence services for robotic surgery training. This guidance lays the foundation for launching telepresence services in robotic surgery. This guidance will require further validation. PATIENT SUMMARY: Owing to travel restrictions during the coronavirus disease 2019 (COVID-19) pandemic, development of remote training and support via telemedicine is becoming increasingly important. We report a key opinion leader consensus view on a standardised approach to telepresence.

Indexed as

CommunicationCurriculum developmentDeliberate practicePatient safetyRobotic-assisted surgerySurgical educationTelementoringTelepresenceTelesurgeryTraining protocol

Identifiers

PMID34337475
PMCPMC8317899

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.