Evidence map›Paper›PMID 39467893›Full record

SynthesisInternational journal of computer assisted radiology and surgery2025

Multimodal human-computer interaction in interventional radiology and surgery: a systematic literature review.

Josefine Schreiter, Florian Heinrich, Benjamin Hatscher, Danny Schott, Christian Hansen

Abstract readSystematic Review
In one paragraph

Synthesis in International journal of computer assisted radiology and surgery, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Josefine SchreiterFaculty of Computer Science and Research Campus STIMULATE, University of Magdeburg, Magdeburg, Germany.ORCID http://orcid.org/0000-0003-1761-8352
Florian HeinrichFaculty of Computer Science and Research Campus STIMULATE, University of Magdeburg, Magdeburg, Germany.ORCID http://orcid.org/0000-0002-8169-3157
Benjamin HatscherFaculty of Computer Science and Research Campus STIMULATE, University of Magdeburg, Magdeburg, Germany.
Danny SchottFaculty of Computer Science and Research Campus STIMULATE, University of Magdeburg, Magdeburg, Germany.ORCID http://orcid.org/0000-0002-2576-7799
Christian HansenFaculty of Computer Science and Research Campus STIMULATE, University of Magdeburg, Magdeburg, Germany. hansen@isg.cs.uni-magdeburg.de.ORCID http://orcid.org/0000-0002-5734-7529

Funding

Bundesministerium für Bildung und Forschung 13GW0473A
6 · The paper itself

Abstract

purposeAs technology advances, more research dedicated to medical interactive systems emphasizes the integration of touchless and multimodal interaction (MMI). Particularly in surgical and interventional settings, this approach is advantageous because it maintains sterility and promotes a natural interaction. Past reviews have focused on investigating MMI in terms of technology and interaction with robots. However, none has put particular emphasis on analyzing these kind of interactions for surgical and interventional scenarios.

methodsTwo databases were included in the query to search for relevant publications within the past 10 years. After identification, two screening steps followed which included eligibility criteria. A forward/backward search was added to identify more relevant publications. The analysis incorporated the clustering of references in terms of addressed medical field, input and output modalities, and challenges regarding the development and evaluation.

resultsA sample of 31 references was obtained (16 journal articles, 15 conference papers). MMI was predominantly developed for laparoscopy and radiology and interaction with image viewers. The majority implemented two input modalities, with voice-hand interaction being the most common combination-voice for discrete and hand for continuous navigation tasks. The application of gaze, body, and facial control is minimal, primarily because of ergonomic concerns. Feedback was included in 81% publications, of which visual cues were most often applied.

conclusionThis work systematically reviews MMI for surgical and interventional scenarios over the past decade. In future research endeavors, we propose an enhanced focus on conducting in-depth analyses of the considered use cases and the application of standardized evaluation methods. Moreover, insights from various sectors, including but not limited to the gaming sector, should be exploited.

Indexed as

Radiology, InterventionalSurgery, Computer-AssistedUser-Computer InterfaceHumansComputer-assisted medicineHuman–computer interactionMultimodal interactionTouchless interaction

Identifiers

PMID39467893
PMCPMC12034581

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.