Search papers, labs, and topics across Lattice.
This paper introduces a novel coarse-to-fine framework for Visual Floorplan Localization (FLoc) that eliminates the need for ray matching by using an image-conditioned pose diffusion model to navigate multimodal pose distributions. By first generating stochastic pose particles and then refining them with a localized refiner to predict sub-meter pose residuals, the method addresses the challenges posed by repetitive indoor layouts and cross-modal information asymmetry. Experimental results on the S3D and ZInD benchmarks show that this approach achieves state-of-the-art accuracy and robustness without the resource demands of traditional methods.
Bypassing ray matching, this new framework achieves state-of-the-art indoor localization accuracy by transforming uncertainty into determinism in pose estimation.
Visual Floorplan Localization (FLoc) has emerged as a promising solution for indoor localization by matching egocentric images against minimalist structural maps. However, due to cross-modal information asymmetry and repetitive indoor layouts, visual FLoc is fundamentally challenged by multimodal pose distributions, where visually identical observations map to distinct, spatially separated locations. Existing ray-matching-based methods tackle this by explicitly predicting sparse geometric or semantic rays, which inherently incur information loss and demand resource-intensive preprocessing alongside exhaustive matching during inference. In this paper, we bypass the intermediate ray-matching paradigm and propose a coarse-to-fine visual FLoc framework that progresses from uncertainty to determinism. In the coarse stage, we design an image-conditioned pose diffusion model to parameterize the continuous multimodal pose distribution, effectively routing stochastically initialized pose particles toward distinct candidate modes. In the refinement stage, we propose a localized refiner that predicts bounded sub-meter pose residuals from candidate-centered floorplan crops, where structural ambiguities are largely eliminated. Our method effectively balances global multi-hypothesis tracking and local sub-meter refinement without requiring any offline map preprocessing or test-time lookup tables. Comprehensive results on the S3D (full) and ZInD benchmarks demonstrate that our approach achieves state-of-the-art accuracy and robustness.