Evidence map›Paper›PMID 30655360›Full record

ArticleJournal of neurointerventional surgery2019

Validation studies of virtual reality simulation performance metrics for mechanical thrombectomy in ischemic stroke.

Robert Crossley, Thomas Liebig, Markus Holtmannspoetter, Johan Lindkvist, Pat Henn, Lars Lonn, Anthony Gerald Gallagher

Open access · hybridAbstract readValidation Study
In one paragraph

Article in Journal of neurointerventional surgery, 2019. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 24 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
24citing papers in PubMed, 1 pooled it
4.0field-weighted citation impact, top 6% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

24 citing papers in PubMed, 1 synthesis or guideline pooled it, 39 citations in OpenAlex.

  1. Pooled it
  2. Review
  3. Vascular geometry characterization for AI-based endovascular navigation.International journal of computer assisted radiology and surgery · 2026
    Article
  4. Article
  5. Virtual reality simulation training in stroke thrombectomy centers with limited patient volume-Simulator performance and patient outcome.Interventional neuroradiology : journal of peritherapeutic neuroradiology, surgical procedures and related neurosciences · 2026
    Article
  6. Article
  7. Article
  8. Article
  9. International expert consensus on a structured approach to robotic multiport right hemicolectomy with complete mesocolic excision and intracorporeal anastomosis.Colorectal disease : the official journal of the Association of Coloproctology of Great Britain and Ireland · 2025
    Article
  10. European expert consensus on a structured approach to circular stapling anastomosis in minimally invasive left-sided colorectal resection.Colorectal disease : the official journal of the Association of Coloproctology of Great Britain and Ireland · 2025
    Article
  11. Article
  12. Article
  13. Article
  14. Review
  15. Metric based virtual simulation training for endovascular thrombectomy improves interventional neuroradiologists' simulator performance.Interventional neuroradiology : journal of peritherapeutic neuroradiology, surgical procedures and related neurosciences · 2023
    Article
  16. Article
  17. Article
  18. Article
  19. Stroke and digital technology: a wake-up call from COVID-19 pandemic.Neurological sciences : official journal of the Italian Neurological Society and of the Italian Society of Clinical Neurophysiology · 2021
    Review
  20. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

7 authors at 6 institutions in 4 countries.

Robert CrossleyNeuroradiology, North Bristol NHS Trust, Southmead Hospital, Bristol, UK.
Thomas LiebigInstitute of Neuroradiology, Ludwig Maximilians University of Munich, Munich, Germany.
Markus HoltmannspoetterDepartment of Neuroradiology, Rigshospitalet, University of Copenhagen, Copenhagen, Denmark.
Johan LindkvistMentice AB, Gothenburg, Sweden.
Pat HennSchool of Medicine, University College Cork, Cork, Ireland.
Lars LonnDepartment of Cardiovascular Radiology, National Hospital, Copenhagen University, Copenhagen, Denmark.
Anthony Gerald GallagherFaculty of Life and Health Sciences, Ulster University, Londonderry, UK.
Copenhagen University Hospital · DKLudwig-Maximilians-Universität München · DERigshospitalet · DKSouthmead Hospital · GBUniversity College Cork · IEUniversity of Ulster · GB

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

introductionMechanical thrombectomy (MT) has transformed the treatment of ischemic stroke. However, patient access to MT may be limited due to a shortage of doctors specifically trained to perform MT. The studies reported here were done to (1) develop, operationally define, and seek consensus from procedure experts on the metrics which best characterize a reference procedure for the performance of an MT for ischemic stroke and (2) evaluate their construct validity when implemented in a virtual reality (VR) simulation.

methodsIn study 1, the metrics for a reference approach to an MT procedure for ischemic stroke of 10 phases, 46 steps, and 56 errors and critical errors, were presented to an international Delphi panel of 21 consultant level interventional neuroradiologists (INRs). In study 2, the metrics were used to assess 8 expert and 10 novice INRs performing a VR simulated routine MT procedure.

resultsIn study 1, the Delphi panel reached consensus on the appropriateness of the procedure metrics for a reference approach to MT in ischemic stroke. Group differences in median scores in study 2 demonstrated that experienced INRs performed the case 19% faster (P=0.029), completed 40% more procedure phases (P=0.009), 20% more steps (P=0.012), and made 42% fewer errors (P=0.016) than the novice group.

conclusionsThe international Delphi panel agreed metrics implemented in a VR simulation of MT distinguished between the computer scored procedure performance of INR experts and novices. The studies reported here support the demonstration of face, content, and construct validity of the MT metrics.

Indexed as

Virtual RealityAdultBrain IschemiaClinical CompetenceComputer SimulationConsensusDelphi TechniqueFemaleHumansMaleMiddle AgedStrokeThrombectomystrokethrombectomy

Identifiers

PMID30655360
PMCPMC6703121
OpenAlexW2909078987

What OpenQuestion holds

Textmetadata
LicenceCC BY-NC
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.