Search papers, labs, and topics across Lattice.
This paper introduces HieDG, a Hierarchical Discrete Geometry-guided framework that enhances multi-animal tracking by transforming unstable continuous geometric signals into stable discrete representations. By employing a two-stage residual codebook to discretize position, scale, and velocity cues, HieDG improves identity association performance in challenging tracking conditions characterized by uniform appearance and irregular motion. Extensive evaluations on both animal-specific and generic multi-object tracking benchmarks demonstrate significant improvements in tracking metrics such as HOTA, AssA, and IDF1, establishing HieDG as a state-of-the-art solution in the field.
Transforming continuous geometric signals into structured discrete tokens leads to state-of-the-art performance in multi-animal tracking, even in the most challenging scenarios.
Multi-animal tracking (MAT) is critical for wildlife monitoring and behavioral analysis, yet remains challenging due to uniform appearance, high density, and irregular motion. Existing methods typically follow heuristic- or query-based paradigms: the former relies on handcrafted geometric associations without end-to-end optimization, whereas the latter enables joint optimization but relies heavily on appearance embeddings. In such conditions, continuous geometric embeddings can be unstable, as small coordinate perturbations may disproportionately alter cross-frame attention weights, degrading identity association performance. To address this limitation, we propose HieDG, a Hierarchical Discrete Geometry-guided tracking framework that reformulates geometric dynamics as structured discrete representations within a query-based tracker. Instead of directly using raw geometric signals, HieDG employs a two-stage residual codebook to discretize position, scale, and velocity cues, transforming unstable continuous geometry into structured, stable discrete tokens. These tokens are aligned with visual embeddings and integrated into the tracking queries to enhance identity consistency. Extensive experiments on animal-specific benchmarks (AnimalTrack, BFT, and BuckTales) demonstrate state-of-the-art association performance with significant improvements in HOTA, AssA, and IDF1. Additional evaluations on generic multi-object tracking benchmarks, including DanceTrack and SportsMOT, show competitive performance, indicating the broader applicability of discretized geometric modeling beyond animal-specific scenarios.
