Evidence map›Paper›PMID 39162975›Full record

ArticleInternational journal of computer assisted radiology and surgery2024

From microscope to head-mounted display: integrating hand tracking into microsurgical augmented reality.

Trishia El Chemaly, Caio Athayde Neves, Fanrui Fu, Brian Hargreaves, Nikolas H Blevins

Abstract read
PubMed Publisher
In one paragraph

Article in International journal of computer assisted radiology and surgery, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed.

  1. Perception-first digital twin for augmented reality microsurgery.International journal of computer assisted radiology and surgery · 2026
    Article
  2. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Trishia El ChemalyDepartment of Bioengineering, Stanford University, Stanford, California, USA. tchemaly@stanford.edu.ORCID http://orcid.org/0000-0002-4234-3082
Caio Athayde NevesDepartment of Otolaryngology, Stanford School of Medicine, Stanford, California, USA.
Fanrui FuDepartment of Otolaryngology, Stanford School of Medicine, Stanford, California, USA.
Brian HargreavesDepartment of Bioengineering, Stanford University, Stanford, California, USA.
Nikolas H BlevinsDepartment of Otolaryngology, Stanford School of Medicine, Stanford, California, USA.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

purposeThe operating microscope plays a central role in middle and inner ear procedures that involve working within tightly confined spaces under limited exposure. Augmented reality (AR) may improve surgical guidance by combining preoperative computed tomography (CT) imaging that can provide precise anatomical information, with intraoperative microscope video feed. With current technology, the operator must manually interact with the AR interface using a computer. The latter poses a disruption in the surgical flow and is suboptimal for maintaining the sterility of the operating environment. The purpose of this study was to implement and evaluate free-hand interaction concepts leveraging hand tracking and gesture recognition as an attempt to reduce the disruption during surgery and improve human-computer interaction.

methodsAn electromagnetically tracked surgical microscope was calibrated using a custom 3D printed calibration board. This allowed the augmentation of the microscope feed with segmented preoperative CT-derived virtual models. Ultraleap's Leap Motion Controller 2 was coupled to the microscope and used to implement hand-tracking capabilities. End-user feedback was gathered from a surgeon during development. Finally, users were asked to complete tasks that involved interacting with the virtual models, aligning them to physical targets, and adjusting the AR visualization.

resultsFollowing observations and user feedback, we upgraded the functionalities of the hand interaction system. User feedback showed the users' preference for the new interaction concepts that provided minimal disruption of the surgical workflow and more intuitive interaction with the virtual content.

conclusionWe integrated hand interaction concepts, typically used with head-mounted displays (HMDs), into a surgical stereo microscope system intended for AR in otologic microsurgery. The concepts presented in this study demonstrated a more favorable approach to human-computer interaction in a surgical context. They hold potential for a more efficient execution of surgical tasks under microscopic AR guidance.

Indexed as

Augmented RealityMicroscopyMicrosurgeryHandHumansImaging, Three-DimensionalSurgery, Computer-AssistedTomography, X-Ray ComputedUser-Computer InterfaceAugmented realityHand trackingHead and neck surgeryHuman-computer interactionStereo microscopeUser-centered design

Identifiers

PMID39162975

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.