Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces ChessQueries, a novel approach for chess board recognition that integrates a Vision Transformer (ViT) encoder with a DETR-style decoder. The method significantly enhances performance on the ChessReD benchmark, achieving a remarkable accuracy of 99.2%, compared to the previous state-of-the-art of 15.3%. Additionally, ChessQueries demonstrates robust performance on out-of-distribution datasets and introduces a new challenging dataset sourced from top-level chess tournaments.
ChessQueries shatters previous benchmarks in chess board recognition, achieving a staggering 99.2% accuracy and redefining performance standards in the field.
Chess board recognition is the task of mapping the image of a chess board to the information of which piece is on which square. So far this task has two established benchmarks: ChessCog is synthetic, and ChessReD comes from smartphone pictures of a single chess board setup. We introduce ChessQueries, a new method combining a ViT encoder with a DETR-style decoder, which outperforms existing methods. On the ChessReD benchmark, we improve the state of the art from 15.3% to 99.2%, and demonstrate strong capabilities on out-of-distribution datasets. Our method saturates the task on the two datasets, with an average 0.01 wrong squares per board (vs. SotA: 3.4 / 0.15 respectively). We also share a new, harder public dataset, parsed from broadcasted top-level chess tournaments. Code, model weights and the SLCC data will be released.