Search papers, labs, and topics across Lattice.
RF-HiT, a Rectified Flow Hierarchical Transformer, is introduced for efficient medical image segmentation by combining an hourglass transformer backbone with a multi-scale hierarchical encoder. It achieves linear complexity through rectified flow and efficient transformer blocks, requiring only a few discretization steps. RF-HiT attains state-of-the-art segmentation performance on ACDC and BraTS 2021 datasets with significantly reduced computational cost (10.14 GFLOPs) and parameters (13.6M).
Achieve state-of-the-art medical image segmentation with a model that's both accurate and lean, needing just 10 GFLOPs and a few inference steps.
Accurate medical image segmentation requires both long-range contextual reasoning and precise boundary delineation, a task where existing transformer- and diffusion-based paradigms are frequently bottlenecked by quadratic computational complexity and prohibitive inference latency. We propose RF-HiT, a Rectified Flow Hierarchical Transformer that integrates an hourglass transformer backbone with a multi-scale hierarchical encoder for anatomically guided feature conditioning. Unlike prior diffusion-based approaches, RF-HiT leverages rectified flow with efficient transformer blocks to achieve linear complexity while requiring only a few discretization steps. The model further fuses conditioning features across resolutions via learnable interpolation, enabling effective multi-scale representation with minimal computational overhead. As a result, RF-HiT achieves a strong efficiency-performance trade-off, requiring only 10.14 GFLOPs, 13.6M parameters, and inference in as few as three steps. Despite its compact design, RF-HiT attains 91.27% mean Dice on ACDC and 87.40% on BraTS 2021, achieving performance comparable to or exceeding that of significantly more intensive architectures. This demonstrates its strong potential as a robust, computationally efficient foundation for real-time clinical segmentation.
