Enhancing YOLO for laparoscopic tool detection: novel data augmentation and structural modifications addressing mis-detection of bifurcated targets.

purposeLaparoscopic tool detection is vital for assistance of minimally invasive surgeries, aiding tasks like tool pose estimation and surgical navigation. This study enhances YOLO models for better detection of bifurcated targets (BT) in such procedures, addressing the issue of mis-detection of bifurcated targets (MDBT) where BT tips are misidentified as separate entities or overlooked.

methodsWe proposed a data augmentation strategy, Random Target Masking, to prevent the model from identifying BT tips as separate laparoscopic tools. Mixup Plus was developed to balance instance count across categories with varying BT proportions. Additionally, we employed the Space-to-Depth Convolution block for downsampling to curb the model's tendency to overlook small-sized BT tips.

resultsThe YOLOv8 model featuring our modifications, tested on our dataset derived from EndoVis17 and EndoVis18, showed improvement in both

conclusionThis study focused on improving BT detection accuracy in laparoscopic tool detection using YOLO models, incorporating RTM and MUP data augmentation techniques along with SPD-Conv block integration. Experimental evaluations based on the EndoVis datasets validated the enhancements. The ablation study confirmed the effectiveness of each proposed improvement, particularly highlighting the distinct advantages of the proposed data augmentation methods.