Evidence map›Paper›PMID 37655892›Full record

ArticleOperative neurosurgery (Hagerstown, Md.)2023

Pilot Analysis of Surgeon Instrument Utilization Signatures Based on Shannon Entropy and Deep Learning for Surgeon Performance Assessment in a Cadaveric Carotid Artery Injury Control Simulation.

Alan Balu, Dhiraj J Pangal, Guillaume Kugener, Daniel A Donoho

Open access · greenAbstract read
In one paragraph

Article in Operative neurosurgery (Hagerstown, Md.), 2023. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers, 1 of them a synthesis that pooled it.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed, 1 pooled it
1.6field-weighted citation impact, top 17% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed, 1 synthesis or guideline pooled it, 5 citations in OpenAlex.

  1. Pooled it
  2. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

4 authors at 3 institutions in 1 country.

Alan BaluDepartment of Neurosurgery, Georgetown University School of Medicine, Washington , District of Columbia, USA.ORCID 0000-0001-9974-906
Dhiraj J PangalDepartment of Neurosurgery, Keck School of Medicine of University of Southern California, Los Angeles , California , USA.
Guillaume KugenerDepartment of Neurosurgery, Keck School of Medicine of University of Southern California, Los Angeles , California , USA.
Daniel A DonohoDivision of Neurosurgery, Children's National Hospital, Washington , District of Columbia , USA.
University of Southern California · USChildren's National · USGeorgetown University · US

Funding

Video Analysis of Neurosurgical Technical Performance and Adverse EventsK23EB034110 · NIBIB · CHILDREN'S RESEARCH INSTITUTE · PI DONOHO, DANIEL A. · 2022 to 2025
$640k
NIBIB NIH HHS K23 EB034110NIBIB NIH HHS K23EB034110
6 · The paper itself

Abstract

BACKGROUND AND

objectivesAssessment and feedback are critical to surgical education, but direct observational feedback by experts is rarely provided because of time constraints and is typically only qualitative. Automated, video-based, quantitative feedback on surgical performance could address this gap, improving surgical training. The authors aim to demonstrate the ability of Shannon entropy (ShEn), an information theory metric that quantifies series diversity, to predict surgical performance using instrument detections generated through deep learning.

methodsAnnotated images from a publicly available video data set of surgeons managing endoscopic endonasal carotid artery lacerations in a perfused cadaveric simulator were collected. A deep learning model was implemented to detect surgical instruments across video frames. ShEn score for the instrument sequence was calculated from each surgical trial. Logistic regression using ShEn was used to predict hemorrhage control success.

resultsShEn scores and instrument usage patterns differed between successful and unsuccessful trials (ShEn: 0.452 vs 0.370, P < .001). Unsuccessful hemorrhage control trials displayed lower entropy and less varied instrument use patterns. By contrast, successful trials demonstrated higher entropy with more diverse instrument usage and consistent progression in instrument utilization. A logistic regression model using ShEn scores (78% accuracy and 97% average precision) was at least as accurate as surgeons' attending/resident status and years of experience for predicting trial success and had similar accuracy as expert human observers.

conclusionShEn score offers a summative signal about surgeon performance and predicted success at controlling carotid hemorrhage in a simulated cadaveric setting. Future efforts to generalize ShEn to additional surgical scenarios can further validate this metric.

Indexed as

Carotid Artery InjuriesDeep LearningSurgeonsCadaverEntropyHemorrhageHumans

Identifiers

PMID37655892
PMCPMC12245247
OpenAlexW4386347734

What OpenQuestion holds

Textmetadata
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.