ArticleHealthcare technology letters
First-in-human real-time AI-assisted instrument deocclusion during augmented reality robotic surgery.
Article in Healthcare technology letters. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 14 papers, 1 of them a synthesis that pooled it.
What it found
Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.
The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.
The trial behind it
Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.
Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.
Who cites it
14 citing papers in PubMed, 1 synthesis or guideline pooled it.
- [Artificial intelligence in urological surgery].Urologie (Heidelberg, Germany) · 2026Pooled it
- Robotic versus laparoscopic hepatectomy: an umbrella review of systematic reviews and meta-analyses.Surgery in practice and science · 2026Review
- Toward augmented reality in laparoscopic liver surgery using electromagnetic tracking: a clinical feasibility study.Surgical endoscopy · 2026Article
- Metaverse in surgery - origins and future potential.Nature reviews. Urology · 2026Review
- Technical implementation and feasibility of the world's first artificial intelligence-assisted augmented reality-based instrument de-occlusion in robotic-assisted right hemicolectomy.Annals of coloproctology · 2025Article
- Global trends and hotspots in robot-assisted laparoscopic surgery for gastrointestinal diseases: a bibliometric and visualization.Journal of robotic surgery · 2025Article
- Optimizing intraoperative AI: evaluation of YOLOv8 for real-time recognition of robotic and laparoscopic instruments.Journal of robotic surgery · 2025Article
- Augmented and mixed reality in liver surgery: a comprehensive narrative review of novel clinical implications on cohort studies.Revista da Associacao Medica Brasileira (1992) · 2025Article
- Indocyanine Blue (ICB) as a Functional Alternative to Indocyanine Green (ICG) for Enhanced 700 nm NIR Imaging.International journal of molecular sciences · 2024Article
- Artificial intelligence-assisted augmented reality robotic lung surgery: Navigating the future of thoracic surgery.JTCVS techniques · 2024Article
- Review
- A System for Mixed-Reality Holographic Overlays of Real-Time Rendered 3D-Reconstructed Imaging Using a Video Pass-through Head-Mounted Display-A Pathway to Future Navigation in Chest Wall Surgery.Journal of clinical medicine · 2024Article
- Laparoscopic image segmentation of the hepatobiliary system: Current status and advances from a deep learning perspective.Digital healthReview
- First-in-human real-time AI-assisted instrument deocclusion during augmented reality robotic surgery.Healthcare technology lettersArticle
Corrections and comments
PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.
Authors and funding
16 authors.
Funding
No grant is acknowledged in the PubMed record.
Abstract
The integration of Augmented Reality (AR) into daily surgical practice is withheld by the correct registration of pre-operative data. This includes intelligent 3D model superposition whilst simultaneously handling real and virtual occlusions caused by the AR overlay. Occlusions can negatively impact surgical safety and as such deteriorate rather than improve surgical care. Robotic surgery is particularly suited to tackle these integration challenges in a stepwise approach as the robotic console allows for different inputs to be displayed in parallel to the surgeon. Nevertheless, real-time de-occlusion requires extensive computational resources which further complicates clinical integration. This work tackles the problem of instrument occlusion and presents, to the authors' best knowledge, the first-in-human on edge deployment of a real-time binary segmentation pipeline during three robot-assisted surgeries: partial nephrectomy, migrated endovascular stent removal, and liver metastasectomy. To this end, a state-of-the-art real-time segmentation and 3D model pipeline was implemented and presented to the surgeon during live surgery. The pipeline allows real-time binary segmentation of 37 non-organic surgical items, which are never occluded during AR. The application features real-time manual 3D model manipulation for correct soft tissue alignment. The proposed pipeline can contribute towards surgical safety, ergonomics, and acceptance of AR in minimally invasive surgery.
Indexed as
Identifiers
What OpenQuestion holds
Registered trials
Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.