Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a Transformer-based model that generates dense representations of football events by learning latent dependencies among categorical features, such as action type and outcome. By encoding these features as learned embedding vectors, the model captures the intrinsic semantics of player actions, enhancing its applicability to various sports analytics tasks. Empirical results demonstrate that this approach significantly improves probability calibration on downstream tasks, outperforming traditional one-hot and ordinal embedding methods as indicated by lower Brier scores.
Encoding football event actions with learned embeddings leads to superior predictive performance, revealing the power of semantics in sports analytics.
Football event data constitute a rich spatiotemporal source for quantitative analysis of player actions in team sports. These datasets contain heterogeneous features, combining continuous location coordinates with categorical variables such as action type, action outcome, and body part. Such data have been applied in sports analytics for match outcome forecasting, player evaluation, and tactical pattern recognition. However, existing approaches predominantly encode categorical features using one-hot or ordinal embedding representations, overlooking the intrinsic semantics of action descriptors. The Transformer is a deep neural network architecture based on self-attention that captures dependencies between input features at arbitrary positions. We propose and implement a Transformer-based model to learn latent dependencies among categorical event features and produce dense representations of football events. By encoding categorical features as learned embedding vectors, sport-specific action semantics are captured during pretraining, enabling the representations to support downstream tasks such as action value estimation and play style recognition. Empirical evaluation shows that the embedding representations yield superior probability calibration over task-specific baselines on the downstream prediction tasks, as measured by Brier score.