Evidence map›Paper›PMID 38853240›Full record

ArticleBMC ophthalmology2024

Automated detection of steps in videos of strabismus surgery using deep learning.

Ce Zheng, Wen Li, Siying Wang, Haiyun Ye, Kai Xu, Wangyi Fang, Yanli Dong, Zilei Wang, Tong Qiao

Abstract read
In one paragraph

Article in BMC ophthalmology, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 1 paper.

0numbers the graph read from it
0cells of the map it votes in
1citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

1 citing paper in PubMed.

  1. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors.

Ce ZhengDepartment of Ophthalmology, Xinhua Hospital Affiliated to Shanghai Jiaotong University School of Medicine, Shanghai, China.
Wen LiDepartment of Ophthalmology, Shanghai Children's Hospital, School of Medicine, Shanghai Jiao Tong University, Lu Ding Road # 355, Shanghai, 200000, China.
Siying WangDepartment of Ophthalmology, Shanghai Children's Hospital, School of Medicine, Shanghai Jiao Tong University, Lu Ding Road # 355, Shanghai, 200000, China.
Haiyun YeDepartment of Ophthalmology, Shanghai Children's Hospital, School of Medicine, Shanghai Jiao Tong University, Lu Ding Road # 355, Shanghai, 200000, China.
Kai XuDepartment of Ophthalmology, Shanghai Children's Hospital, School of Medicine, Shanghai Jiao Tong University, Lu Ding Road # 355, Shanghai, 200000, China.
Wangyi FangDepartment of Ophthalmology, Shanghai Children's Hospital, School of Medicine, Shanghai Jiao Tong University, Lu Ding Road # 355, Shanghai, 200000, China.
Yanli DongDepartment of Ophthalmology, Shanghai Children's Hospital, School of Medicine, Shanghai Jiao Tong University, Lu Ding Road # 355, Shanghai, 200000, China.
Zilei WangDepartment of Ophthalmology, Shanghai Children's Hospital, School of Medicine, Shanghai Jiao Tong University, Lu Ding Road # 355, Shanghai, 200000, China.
Tong QiaoDepartment of Ophthalmology, Shanghai Children's Hospital, School of Medicine, Shanghai Jiao Tong University, Lu Ding Road # 355, Shanghai, 200000, China. qiaojoel@163.com.

Funding

Hospital Funded Clinical Research, Xinhua Hospital Affiliated to Shanghai Jiao Tong University School of Medicine 21XJMR02Hospital Management Research Program of Institute of Hospital Development Strategy, China Hospital Development Institute, Shanghai Jiao Tong University HDSI-2022-A-001National Natural Science Foundation of China 81371010
6 · The paper itself

Abstract

backgroundLearning to perform strabismus surgery is an essential aspect of ophthalmologists' surgical training. Automated classification strategy for surgical steps can improve the effectiveness of training curricula and the efficient evaluation of residents' performance. To this end, we aimed to develop and validate a deep learning (DL) model for automated detecting strabismus surgery steps in the videos.

methodsIn this study, we gathered 479 strabismus surgery videos from Shanghai Children's Hospital, affiliated to Shanghai Jiao Tong University School of Medicine, spanning July 2017 to October 2021. The videos were manually cut into 3345 clips of the eight strabismus surgical steps based on the International Council of Ophthalmology's Ophthalmology Surgical Competency Assessment Rubrics (ICO-OSCAR: strabismus). The videos dataset was randomly split by eye-level into a training (60%), validation (20%) and testing dataset (20%). We evaluated two hybrid DL algorithms: a Recurrent Neural Network (RNN) based and a Transformer-based model. The evaluation metrics included: accuracy, area under the receiver operating characteristic curve, precision, recall and F1-score.

resultsDL models identified the steps in video clips of strabismus surgery achieved macro-average AUC of 1.00 (95% CI 1.00-1.00) with Transformer-based model and 0.98 (95% CI 0.97-1.00) with RNN-based model, respectively. The Transformer-based model yielded a higher accuracy compared with RNN-based models (0.96 vs. 0.83, p < 0.001). In detecting different steps of strabismus surgery, the predictive ability of the Transformer-based model was better than that of the RNN. Precision ranged between 0.90 and 1 for the Transformer-based model and 0.75 to 0.94 for the RNN-based model. The f1-score ranged between 0.93 and 1 for the Transformer-based model and 0.78 to 0.92 for the RNN-based model.

conclusionThe DL models can automate identify video steps of strabismus surgery with high accuracy and Transformer-based algorithms show excellent performance when modeling spatiotemporal features of video frames.

Indexed as

Deep LearningOculomotor MusclesOphthalmologic Surgical ProceduresStrabismusVideo RecordingAlgorithmsClinical CompetenceEducation, Medical, GraduateHumansInternship and ResidencyNeural Networks, ComputerOphthalmologyROC CurveAutomated detectionDeep learningStrabismus surgerySurgical videos

Identifiers

PMID38853240
PMCPMC11163806

What OpenQuestion holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the OpenQuestion graph.