Evidence map›Paper›PMID 38589579›Full record

ArticleInternational journal of computer assisted radiology and surgery2024

Cognitive effort detection for tele-robotic surgery via personalized pupil response modeling.

Regine Büter, Roger D Soberanis-Mukul, Rohit Shankar, Paola Ruiz Puentes, Ahmed Ghazi, Jie Ying Wu, Mathias Unberath

Abstract read
PubMed Publisher
In one paragraph

Article in International journal of computer assisted radiology and surgery, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors.

Regine BüterDepartment of Computer Science, Johns Hopkins University, 3400 N Charles St, Baltimore, 21218, MD, USA. rbuter1@jh.edu.ORCID http://orcid.org/0009-0002-9371-1719
Roger D Soberanis-MukulDepartment of Computer Science, Johns Hopkins University, 3400 N Charles St, Baltimore, 21218, MD, USA.ORCID http://orcid.org/0000-0003-0712-0534
Rohit ShankarDepartment of Computer Science, Johns Hopkins University, 3400 N Charles St, Baltimore, 21218, MD, USA.ORCID http://orcid.org/0000-0003-4352-7999
Paola Ruiz PuentesDepartment of Computer Science, Johns Hopkins University, 3400 N Charles St, Baltimore, 21218, MD, USA.ORCID http://orcid.org/0000-0002-4325-1446
Ahmed GhaziDepartment of Urology, Johns Hopkins Medical Institute, 600 N Wolfe St, Baltimore, 21287, MD, USA.ORCID http://orcid.org/0000-0002-7306-8140
Jie Ying WuDepartment of Computer Science, Vanderbilt University, 2201 West End Ave, Nashville, 37235, TN, USA.ORCID http://orcid.org/0000-0002-0055-9950
Mathias UnberathDepartment of Computer Science, Johns Hopkins University, 3400 N Charles St, Baltimore, 21218, MD, USA.

Funding

Intuitive Surgical Technology Research Grant NA
6 · The paper itself

Abstract

purposeGaze tracking and pupillometry are established proxies for cognitive load, giving insights into a user's mental effort. In tele-robotic surgery, knowing a user's cognitive load can inspire novel human-machine interaction designs, fostering contextual surgical assistance systems and personalized training programs. While pupillometry-based methods for estimating cognitive effort have been proposed, their application in surgery is limited by the pupil's sensitivity to brightness changes, which can mask pupil's response to cognitive load. Thus, methods considering pupil and brightness conditions are essential for detecting cognitive effort in unconstrained scenarios.

methodsTo contend with this challenge, we introduce a personalized pupil response model integrating pupil and brightness-based features. Discrepancies between predicted and measured pupil diameter indicate dilations due to non-brightness-related sources, i.e., cognitive effort. Combined with gaze entropy, it can detect cognitive load using a random forest classifier. To test our model, we perform a user study with the da Vinci Research Kit, where 17 users perform pick-and-place tasks in addition to auditory tasks known to generate cognitive effort responses.

resultsWe compare our method to two baselines (BCPD and CPD), demonstrating favorable performance in varying brightness conditions. Our method achieves an average true positive rate of 0.78, outperforming the baselines (0.57 and 0.64).

conclusionWe present a personalized brightness-aware model for cognitive effort detection able to operate under unconstrained brightness conditions, comparing favorably to competing approaches, contributing to the advancement of cognitive effort detection in tele-robotic surgery. Future work will consider alternative learning strategies, handling the difficult positive-unlabeled scenario in user studies, where only some positive and no negative events are reliably known.

Indexed as

CognitionPupilRobotic Surgical ProceduresAdultFemaleHumansMaleTelemedicineCognitive loadGaze entropyPupillometryTele-robotic surgery

Identifiers

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.