Search papers, labs, and topics across Lattice.
The paper introduces REDI-Match, a novel framework that addresses the challenge of in-plane rotation in dense feature matching by utilizing a Rotation-Equivariant Distillation (REDI) approach. This method distills the semantic representations of a Vision Foundation Model (VFM) into a lightweight, strictly rotation-equivariant encoder, while an entropy-driven spatial alignment module enhances the decoder's performance by locking onto the canonical coordinate system. Extensive evaluations reveal that REDI-Match achieves state-of-the-art performance, with a 13.89% improvement in pose accuracy on the SatAst dataset and operates 1.9 times faster than the previous leading model, RoMa v2.
REDI-Match not only sets a new benchmark in dense feature matching but also accelerates inference speed, achieving 41 FPS on a single GPU.
Vision Foundation Models (VFMs) have significantly advanced dense feature matching, yet severe in-plane rotation remains a critical challenge. Existing solutions face a fundamental dilemma: data-driven methods require inefficient parameter scaling to implicitly learn rotations, whereas strictly equivariant networks lack the semantic capacity of modern VFMs. Consequently, current frameworks typically freeze VFMs and shift the entire burden of rotation generalization to the downstream decoder. To break this architectural bottleneck, we propose REDI-Match, an efficient framework driven by a novel Rotation-Equivariant Distillation (REDI) paradigm. Instead of relying on rotation data augmentation to establish rotational correspondences, REDI distills the non-equivariant semantic representations of a VFM into a lightweight, strictly rotation-equivariant encoder, leveraging an equivariant geometric architecture to constrain robust high-dimensional semantics. To fully exploit these features, we equip the decoder with an entropy-driven spatial alignment module. By evaluating discrete rotation hypotheses, this mechanism explicitly locks onto the canonical coordinate system, eliminating global ambiguity before continuous refinement. Extensive experiments demonstrate that REDI-Match establishes a new state-of-the-art (SOTA) across multiple benchmarks. Notably, it achieves a 13.89% absolute pose accuracy improvement on the highly challenging SatAst dataset while operating 1.9x faster than the current SOTA (RoMa v2), enabling real-time inference (~41 FPS) on a single RTX 4090 GPU. Code: https://github.com/YinjiGe/REDI-Match.
Tsinghua AI