Beef Cattle Behavior Recognition Based on Nighttime Farm Videos via Spatio-Temporal Enhancement and Dynamic Fusion.

Beef cattle behavior provides valuable information regarding their health status. Recently, deep convolutional network-based methods have achieved considerable results in beef cattle behavior recognition. However, their robustness under low-light or dark conditions remains limited, which restricts their application in real farm environments. To address this issue, this study constructed a realistic beef cattle behavior dataset in the dark, named Dark Beef Cattle Actions, which was collected under real nighttime farm conditions. The constructed dataset contains 1097 video clips collected from 30 beef cattle and covers 6 behavioral classes, including running, feeding, drinking, grooming, mounting, and fighting. Based on this dataset, we proposed a novel neural network architecture based on spatio-temporal dark enhancement and dynamic fusion for beef cattle behavior recognition in the dark. First, a spatio-temporal dark enhancement module was designed to improve dark video quality while preserving motion features. Second, a dynamic fusion module was introduced to adaptively fuse features from different branches and obtain more discriminative representations. In addition, a joint loss was adopted to optimize both dark enhancement and action recognition. Experimental results on the constructed dataset show that the proposed method achieved a weighted-averaged precision score of 88.47%, a weighted-averaged recall score of 80.18%, an accuracy score of 83.80%, and a weighted-averaged F1-score of 84.12%. Compared with other state-of-the-art methods, the proposed method achieved competitive performance in the recognition of night-time beef cattle behavior. These findings would provide support for intelligent livestock behavior recognition and monitoring in precision farming.