Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The paper introduces LALE, a novel lightweight-transformer architecture designed for efficient land-cover estimation from remote sensing imagery. By bifurcating its encoder into lightweight ConvMixer stages for high-resolution local features and transformer stages for low-resolution global context, LALE achieves a significant reduction in computational overhead while maintaining high performance. On the ARAS400k benchmark, LALE's smallest variant demonstrates a competitive F1 score with drastically fewer parameters and computational requirements compared to existing models.
LALE achieves near state-of-the-art performance in land-cover segmentation while using 4.5x fewer parameters and 17x fewer GMACs than leading models.
Semantic segmentation of remote sensing imagery requires models that capture both global context and local detail under tight computational budgets. Prior work typically optimizes for one of these axes: attention for global context, convolution for local detail, or compactness for efficiency. While hybrid approaches aim to capture both, they require architectural changes and encoder backbones with computational overhead, limiting efficiency and performance. We present LALE (Lightweight-transformer Architecture for Land-cover Estimation), an end-to-end remote sensing image segmentation architecture, that bifurcates its encoder by resolution: lightweight ConvMixer stages handle high-resolution local features, while transformer stages handle low-resolution global context, confining the quadratic cost of self-attention to deep, downsampled feature maps. An all-MLP multi-scale decoder, together with RMSNorm and StarReLU throughout, further reduces compute and parameter count. On the large-scale ARAS400k remote-sensing segmentation benchmark, LALE establishes a strong efficiency-performance trade-off against CNN, transformer, and hybrid baselines. Our smallest variant, (just 1.6M parameters), reaches within 2.6 F1 points of the best baseline (UPerNet) while using 4.5x fewer parameters, 7x less storage, 17x fewer GMACs, and delivering 1.8x higher throughput.