Evidence map›Paper›PMID 29465749›Full record

SynthesisThe British journal of surgery2018

Systematic review of measurement tools to assess surgeons' intraoperative cognitive workload.

R D Dias, M C Ngo-Howard, M T Boskovski, M A Zenati, S J Yule

Registry-linked trialAbstract readSystematic Review
In one paragraph

Synthesis in The British journal of surgery, 2018. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT04505956 (Prospective Randomized Double Blind Clinical Trial to Compare Holmium Laser Lithotripsy With and Without Moses Laser Technology for the Ureteroscopic Treatment of Nephrolithiasis), which is not on this map. Cited by 108 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
108citing papers in PubMed, 2 pooled it
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT04505956 nacompletednot on this mapstarted 2021, after this paper: background citation

Prospective Randomized Double Blind Clinical Trial to Compare Holmium Laser Lithotripsy With and Without Moses Laser Technology for the Ureteroscopic Treatment of Nephrolithiasis

TypeinterventionalSponsorVanderbilt University Medical CenterRan2021 to 2023Enrolled171ConditionsNephrolithiasisArmsHolmium laser lithotripsy with Moses Technology, Holmium laser lithotripsy without Moses Technology
3 · Its place in the literature

Who cites it

108 citing papers in PubMed, 2 syntheses or guidelines pooled it.

  1. Pooled it
  2. Pooled it
  3. Trial
  4. Trial
  5. Short-term outcomes of preoperative computed tomography angiography versus standard assessment in patients with BMI ≥ 25.0 kg/mGastric cancer : official journal of the International Gastric Cancer Association and the Japanese Gastric Cancer Association · 2025
    Trial
  6. Trial
  7. Trial
  8. Trial
  9. Article
  10. Article
  11. Article
  12. Article
  13. Instructional Design for Surgical Novices Based on Cognitive Load Theory: Implications for Urologic Surgery Training.International journal of urology : official journal of the Japanese Urological Association · 2026
    Review
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Article

48 more citing papers are in PubMed but not listed here.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

R D DiasSTRATUS Center for Medical Simulation, Brigham and Women's Hospital, Boston, Massachusetts, USA.ORCID 0000-0003-4959-5052
M C Ngo-HowardDepartment of Otolaryngology - Head and Neck Surgery, Boston University School of Medicine, Boston, Massachusetts, USA.
M T BoskovskiDepartment of Surgery, Brigham and Women's Hospital, Boston, Massachusetts, USA.
M A ZenatiHarvard Medical School, Boston, Massachusetts, USA.
S J YuleSTRATUS Center for Medical Simulation, Brigham and Women's Hospital, Boston, Massachusetts, USA.

Funding

RESEARCH METHODS IN PEDIATRICS HEART DISEASET32HL007572 · NHLBI · CHILDREN'S HOSPITAL BOSTON · PI Sarah D DE FERRANTI, Jane W. Newburger · 1985 to 2026
$13.0M
Developing Standardized Intraoperative Process Models to Enhance Surgical SafetyR01HL126896 · NHLBI · HARVARD MEDICAL SCHOOL · PI ZENATI, MARCO A. · 2016 to 2023
$3.7M
NHLBI NIH HHS R01 HL126896NHLBI NIH HHS T32 HL007572
6 · The paper itself

Abstract

backgroundSurgeons in the operating theatre deal constantly with high-demand tasks that require simultaneous processing of a large amount of information. In certain situations, high cognitive load occurs, which may impact negatively on a surgeon's performance. This systematic review aims to provide a comprehensive understanding of the different methods used to assess surgeons' cognitive load, and a critique of the reliability and validity of current assessment metrics.

methodsA search strategy encompassing MEDLINE, Embase, Web of Science, PsycINFO, ACM Digital Library, IEEE Xplore, PROSPERO and the Cochrane database was developed to identify peer-reviewed articles published from inception to November 2016. Quality was assessed by using the Medical Education Research Study Quality Instrument (MERSQI). A summary table was created to describe study design, setting, specialty, participants, cognitive load measures and MERSQI score.

resultsOf 391 articles retrieved, 84 met the inclusion criteria, totalling 2053 unique participants. Most studies were carried out in a simulated setting (59 studies, 70 per cent). Sixty studies (71 per cent) used self-reporting methods, of which the NASA Task Load Index (NASA-TLX) was the most commonly applied tool (44 studies, 52 per cent). Heart rate variability analysis was the most used real-time method (11 studies, 13 per cent).

conclusionSelf-report instruments are valuable when the aim is to assess the overall cognitive load in different surgical procedures and assess learning curves within competence-based surgical education. When the aim is to assess cognitive load related to specific operative stages, real-time tools should be used, as they allow capture of cognitive load fluctuation. A combination of both subjective and objective methods might provide optimal measurement of surgeons' cognition.

Indexed as

Clinical CompetenceSelf ReportCognitionHumansSurgeonsWorkload

Identifiers

PMID29465749
PMCPMC5878696

What OpenQuestion holds

Textmetadata
LicenceTDM
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.