Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study introduces a hybrid Convolutional-Transformer framework for forecasting Antarctic sea ice concentration (SIC), addressing the complexities of spatial structure, long-range temporal dependencies, and seasonal variability. By integrating convolutional encoding with factorised self-attention and incorporating month-aware positional encoding and seasonal temporal bias, the model significantly outperforms traditional convolutional and recurrent approaches. The findings highlight the effectiveness of leveraging both spatial and temporal features, along with seasonal information, in enhancing forecasting accuracy for Antarctic SIC.
Seasonal priors in a hybrid Convolutional-Transformer model boost Antarctic sea ice concentration forecasting accuracy beyond conventional methods.
Antarctic sea ice concentration (SIC) forecasting is an important yet challenging task due to the coexistence of complex spatial structure, long-range temporal dependencies, and strong seasonal variability. Conventional convolution-based models are effective at capturing local spatial patterns, but often have limited ability to model long-term temporal evolution. To address these challenges, we build on a hybrid Convolutional-Transformer forecasting framework for monthly Antarctic SIC forecasting. This framework combines convolutional encoding for spatial feature extraction with factorised self-attention for spatio-temporal dependency modelling. We further introduce two seasonal prior mechanisms: a month-aware positional encoding that injects calendar-month information into the token representation, and a seasonal temporal bias that encourages attention to periodically related historical states. Experimental results show that the proposed framework achieves better performance than convolutional and recurrent baselines across both classification and regression metrics. Ablation studies further indicate that the seasonal prior mechanisms provide consistent additional gains in both short- and long-horizon prediction. These results demonstrate the value of combining convolutional structures, attention mechanisms, and periodic prior information for Antarctic SIC forecasting.