Evidence map›Paper›PMID 41080710›Full record

ArticleFrontiers in robotics and AI2025

A multi-user multi-robot multi-goal multi-device human-robot interaction manipulation benchmark.

Akito Yoshida, Rousslan Fernand Julien Dossa, Marina Di Vincenzo, Shivakanth Sujit, Hannah Douglas, Kai Arulkumaran

Abstract read
In one paragraph

Article in Frontiers in robotics and AI, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed.

  1. Article
  2. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Akito Yoshida *Araya Inc., Tokyo, Japan.
Rousslan Fernand Julien Dossa *Araya Inc., Tokyo, Japan.
Marina Di VincenzoAraya Inc., Tokyo, Japan.
Shivakanth SujitAraya Inc., Tokyo, Japan.
Hannah DouglasAraya Inc., Tokyo, Japan.
Kai ArulkumaranAraya Inc., Tokyo, Japan.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

One weakness of human-robot interaction (HRI) research is the lack of reproducible results, due to the lack of standardised benchmarks. In this work we introduce a multi-user multi-robot multi-goal multi-device manipulation benchmark (M4Bench), a flexible HRI platform in which multiple users can direct either a single-or multiple-simulated robots to perform a multi-goal pick-and-place task. Our software exposes a web-based visual interface, with support for mouse, keyboard, gamepad, eye tracker and electromyograph/electroencephalograph (EMG/EEG) user inputs. It can be further extended using native browser libraries or WebSocket interfaces, allowing researchers to add support for their own devices. We also provide tracking for several HRI metrics, such as task completion and command selection time, enabling quantitative comparisons between different user interfaces and devices. We demonstrate the utility of our benchmark with a user study (n = 50) conducted to compare five different input devices, and also compare single-vs. multi-user control. In the pick-and-place task, we found that users performed worse when using the eye tracker + EMG device pair, as compared to mouse + keyboard or gamepad + gamepad, over four quantitative metrics (corrected p

Indexed as

benchmarkhuman-robot interactionmulti-agentmultimodalshared autonomy

Identifiers

PMID41080710
PMCPMC12507559

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.