Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces RePAIR, a self-supervised representation learning architecture that combines Masked Autoencoders, Joint Embedding Predictive Architectures, and BERT to effectively encode chess positions into meaningful representations. The method involves masking portions of latent states and using a lightweight Predictor to reconstruct these gaps, resulting in a refined representation space where chess concepts are meaningfully clustered. Experiments demonstrate that RePAIR enables intuitive analysis of chess games and reasoning about piece movements without the need for traditional reinforcement learning approaches.
RePAIR reveals that self-supervised learning can produce semantically rich representations of chess positions, enabling intuitive game analysis without reinforcement learning.
In this paper, we introduce Representation Prediction via Autoencoding using Iterative Refinement (RePAIR) - a novel self-supervised representation learning architecture that synthesizes Masked Autoencoders (MAE), Joint Embedding Predictive Architectures (JEPA), and Bidirectional Encoder Representations from Transformers (BERT). We demonstrate how it can be used to encode objects in sequential data like consecutive chess positions into compact yet meaningful representations. The basic principle of the architecture is to mask large portions of a sequence of latent states, similar to BERT and MAE. Then, we apply a lightweight Predictor to the latent representations that repairs gaps in the sequence in a lower-dimensional embedding space akin to JEPA. Our experiments in the domain of chess show that the Encoder refines the board representations such that meaningful chess concepts emerge clustered in the latent space. Furthermore, reconstructions of the masked board states show that the model is able to reason about the piece movements without relying on costly reinforcement learning methods. Lastly, we find that the resulting representation space allows for quick and intuitive dissections of chess games by observing the game path trajectories in this semantically rich space.