Search papers, labs, and topics across Lattice.
CoordFormer reformulates very-high-resolution semantic segmentation as a continuous coordinate-query task, decoupling dense full-grid computation from global context aggregation via a Coordinate Decoder with Localized Cross-Attention. By conditioning coordinate embeddings and high-resolution local patch features on global tokens from a downsampled ViT foundation model, the system enables arbitrary-resolution querying and targeted, boundary-focused sparse compute to drastically cut memory overhead. The approach achieves state-of-the-art performance on the MaSS13K benchmark and outperforms significantly larger models on DIS5K and KPIs while maintaining pixel-level boundary fidelity.
Ultra-high-resolution segmentation doesn't require dense full-grid inference: continuous coordinate queries concentrated along semantic boundaries match or outperform much larger ViTs at a fraction of the compute.
Semantic segmentation on very-high-resolution images remains challenging due to the high computational cost and the difficulty of capturing fine-grained details. We propose CoordFormer, a novel coordinate-based architecture for semantic segmentation that predicts labels at arbitrary spatial locations through a Coordinate Decoder equipped with a Localized Cross-Attention mechanism. The decoder combines coordinate embeddings with high-resolution local patch features and interacts with global tokens extracted from a downsampled image processed by a ViT foundation encoder, enabling rich semantic context while preserving pixel-level precision. This design enables flexible inference at arbitrary resolutions while keeping memory low on very-high-resolution inputs, and supports an efficient semantic-edge-focused strategy that concentrates computation along boundaries, maintaining fine-grained accuracy while reducing latency and computational cost. CoordFormer achieves state-of-the-art performance on MaSS13K and outperforms comparably sized and higher-parameter methods on DIS5K and KPIs, demonstrating its effectiveness for high-quality, very-high-resolution semantic segmentation.