Search papers, labs, and topics across Lattice.
The paper introduces Consistent-Recurrent Feature Flow Transformer (CRFT), a transformer-based architecture for cross-modal image registration that learns a modality-independent feature flow representation. CRFT uses a coarse-to-fine approach with multi-scale feature correlation for global alignment and hierarchical feature fusion with discrepancy-guided attention for local refinement. Experiments on cross-modal datasets show CRFT outperforms state-of-the-art methods in accuracy and robustness, particularly under large affine and scale variations.
Achieve state-of-the-art cross-modal image registration by recurrently refining feature flow with a transformer, even under significant geometric variations.
We present Consistent-Recurrent Feature Flow Transformer (CRFT), a unified coarse-to-fine framework based on feature flow learning for robust cross-modal image registration. CRFT learns a modality-independent feature flow representation within a transformer-based architecture that jointly performs feature alignment and flow estimation. The coarse stage establishes global correspondences through multi-scale feature correlation, while the fine stage refines local details via hierarchical feature fusion and adaptive spatial reasoning. To enhance geometric adaptability, an iterative discrepancy-guided attention mechanism with a Spatial Geometric Transform (SGT) recurrently refines the flow field, progressively capturing subtle spatial inconsistencies and enforcing feature-level consistency. This design enables accurate alignment under large affine and scale variations while maintaining structural coherence across modalities. Extensive experiments on diverse cross-modal datasets demonstrate that CRFT consistently outperforms state-of-the-art registration methods in both accuracy and robustness. Beyond registration, CRFT provides a generalizable paradigm for multimodal spatial correspondence, offering broad applicability to remote sensing, autonomous navigation, and medical imaging. Code and datasets are publicly available at https://github.com/NEU-Liuxuecong/CRFT.
