Winter wheat yield prediction using UAV-based multivariate time series data and variate-independent tokenization.

The breeding of high-yield wheat varieties is needed to ensure food security. Accurately and rapidly predicting wheat yield at the plot level via UAVs would enable breeders to identify meaningful genotypic variations and select superior lines, thus accelerating the selection of climate-adapted high-yield varieties. Although current prediction models have already utilized multivariate time series data, these models usually adopt a simple concatenation operation to embed all the raw data, resulting in low prediction accuracy. To address these limitations, we propose an improved transformer-based wheat yield prediction model with a variate-independent tokenization approach. The proposed variate-independent tokenization approach facilitates the embedding of 14 vegetation indices and 28 morphological traits via the feature dimension, enabling the learning of variate-centric representations. We also apply a multivariate attention mechanism to evaluate the contribution of each variate and capture the multivariate correlation. Extensive experiments are conducted to verify the effectiveness of our model, including comparisons across 3 nitrogen treatments, 2 years, and 56 wheat varieties. We also compare our model with state-of-the-art approaches. The experimental results indicate that our model achieves the optimal prediction performance, with an R