Evidence map›Paper›PMID 24414457›Full record

ArticleSurgical endoscopy2014

Assessing visual control during simulated and live operations: gathering evidence for the content validity of simulation using eye movement metrics.

Samuel J Vine, John S McGrath, Elizabeth Bright, Thomas Dutton, James Clark, Mark R Wilson

Abstract readEvaluation StudyValidation Study
PubMed Publisher
In one paragraph

Article in Surgical endoscopy, 2014. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 6 papers.

0numbers the graph read from it
0cells of the map it votes in
6citing papers in PubMed
1.6field-weighted citation impact, top 16% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

6 citing papers in PubMed, 21 citations in OpenAlex.

  1. Article
  2. Review
  3. Review
  4. Article
  5. Review
  6. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors at 2 institutions in 1 country.

Samuel J VineCollege of Life and Environmental Sciences, University of Exeter, St. Luke's Campus, Heavitree Road, Exeter, Devon, EX1 2LU, UK, s.j.vine@exeter.ac.uk.
John S McGrath
Elizabeth Bright
Thomas Dutton
James Clark
Mark R Wilson
Royal Devon & Exeter NHS Foundation Trust · GBUniversity of Exeter · GB

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundAlthough virtual reality (VR) simulators serve an important role in the training and assessment of surgeons, they need to be evaluated for evidence of validity. Eye-tracking technology and measures of visual control have been used as an adjunct to the performance parameters produced by VR simulators to help in objectively establishing the construct validity (experts vs. novices) of VR simulators. However, determining the extent to which VR simulators represent the real procedure and environment (content validity) has largely been a subjective process undertaken by experienced surgeons. This study aimed to examine the content validity of a VR transurethral resection of the prostate (TURP) simulator by comparing visual control metrics taken during simulated and real TURP procedures.

methodsEye-tracking data were collected from seven surgeons performing 14 simulated TURP operations and three surgeons performing 15 real TURP operations on live patients. The data were analyzed offline, and visual control metrics (number and duration of fixations, percentage of time the surgeons fixated on the screen) were calculated.

resultsThe surgeons displayed more fixations of a shorter duration and spent less time fixating on the video monitor during the real TURP than during the simulated TURP. This could have been due to (1) the increased complexity of the operating room (OR) environment (2) the decreased quality of the image of the urethra and associated anatomy (compared with the VR simulator), or (3) the impairment of visual attentional control due to the increased levels of stress likely experienced in the OR.

conclusionsThe findings suggest that the complexity of the environment surrounding VR simulators needs to be considered in the design of effective simulated training curricula. The study also provides support for the use of eye-tracking technology to assess the content validity of simulation and to examine psychomotor processes during live operations.

Indexed as

Eye MovementsPsychomotor PerformanceUser-Computer InterfaceAdultAttentionClinical CompetenceComputer-Assisted InstructionComputer SimulationCurriculumData DisplayFixation, OcularHumansMaleTransurethral Resection of ProstateUrologic Surgical Procedures

Identifiers

PMID24414457
OpenAlexW1987650303

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.