Evidence map›Paper›PMID 37932602›Full record

ArticleSurgical endoscopy2024

The application of objective clinical human reliability analysis (OCHRA) in the assessment of basic robotic surgical skills.

Jack Gorard, Matthew Boal, Vishaal Swamynathan, Walaa Ghamrawi, Nader Francis

Registry-linked trialAbstract read
PubMed Full text at PMC Publisher
In one paragraph

Article in Surgical endoscopy, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT07138859 (Prospective, Multiceter, Randomized, Controlled Study on the Intraoperative Technical Errors of Robotic vs. Laparoscopic Radical Right Hemiclectomy), which is not on this map. Cited by 5 papers.

0numbers the graph read from it
0cells of the map it votes in
5citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT07138859 nanot yet recruitingnot on this mapstarted 2025, after this paper: background citation

Prospective, Multiceter, Randomized, Controlled Study on the Intraoperative Technical Errors of Robotic vs. Laparoscopic Radical Right Hemiclectomy (Superiority Design，ROBOGEON® 2501study)

TypeinterventionalSponsorThe Affiliated Hospital of Qingdao UniversityRan2025 to 2030Enrolled368ConditionsColorectal Carcinoma (CRC), Right HemicolectomyArmsRobot assisted radical right hemicolectomy (D3 lymph node dissection), Laparoscopic assisted radical right hemicolectomy (D3 lymph node dissection)
3 · Its place in the literature

Who cites it

5 citing papers in PubMed.

  1. Article
  2. Article
  3. Review
  4. Article
  5. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Jack GorardDivision of Surgery & Interventional Science, Royal Free Hospital Campus, University College London, London, UK.
Matthew BoalDivision of Surgery & Interventional Science, Royal Free Hospital Campus, University College London, London, UK.
Vishaal SwamynathanDivision of Surgery & Interventional Science, Royal Free Hospital Campus, University College London, London, UK.
Walaa GhamrawiDivision of Surgery & Interventional Science, Royal Free Hospital Campus, University College London, London, UK.
Nader FrancisDivision of Surgery & Interventional Science, Royal Free Hospital Campus, University College London, London, UK. n.francis@griffininstitute.org.uk.ORCID 0000-0001-8498-9175

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundUsing a validated, objective, and standardised assessment tool to assess progression and competency is essential for basic robotic surgical training programmes. Objective clinical human reliability analysis (OCHRA) is an error-based assessment tool that provides in-depth analysis of individual technical errors. We conducted a feasibility study to assess the concurrent validity and reliability of OCHRA when applied to basic, generic robotic technical skills assessment.

methodsSelected basic robotic surgical skill tasks, in virtual reality (VR) and dry lab equivalent, were performed by novice robotic surgeons during an intensive 5-day robotic surgical skills course on da Vinci® X and Xi surgical systems. For each task, we described a hierarchical task analysis. Our developed robotic surgical-specific OCHRA methodology was applied to error events in recorded videos with a standardised definition. Statistical analysis to assess concurrent validity with existing tools and inter-rater reliability were performed.

resultsOCHRA methodology was applied to 272 basic robotic surgical skills tasks performed by 20 novice robotic surgeons. Performance scores improved from the start of the course to the end using all three assessment tools; Global Evaluative Assessment of Robotic Skills (GEARS) [VR: t(19) = - 9.33, p < 0.001] [dry lab: t(19) = - 10.17, p < 0.001], OCHRA [VR: t(19) = 6.33, p < 0.001] [dry lab: t(19) = 10.69, p < 0.001] and automated VR [VR: t(19) = - 8.26, p < 0.001]. Correlation analysis, for OCHRA compared to GEARS and automated VR scores, shows a significant and strong inverse correlation in every VR and dry lab task; OCHRA vs GEARS [VR: mean r = - 0.78, p < 0.001] [dry lab: mean r = - 0.82, p < 0.001] and OCHRA vs automated VR [VR: mean r = - 0.77, p < 0.001]. There is very strong and significant inter-rater reliability between two independent reviewers (r = 0.926, p < 0.001).

conclusionOCHRA methodology provides a detailed error analysis tool in basic robotic surgical skills with high reliability and concurrent validity with existing tools. OCHRA requires further evaluation in more advanced robotic surgical procedures.

Indexed as

RoboticsRobotic Surgical ProceduresVirtual RealityClinical CompetenceComputer SimulationHumansReproducibility of ResultsAssessment toolsError analysisOCHRARobotic surgerySurgical training

Identifiers

PMID37932602
PMCPMC10776495

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.