Search papers, labs, and topics across Lattice.
This paper introduces Nexus, a novel framework for text-to-image generation that addresses the computational inefficiencies of existing diffusion and flow matching models. By leveraging a combination of sparse architecture, linear complexity, and low-bit quantization, Nexus achieves high-resolution synthesis with significantly reduced memory and computational requirements. Experimental results on COCO and LAION demonstrate that Nexus maintains generation quality on par with leading models like SDXL and SD3 while enhancing inference efficiency.
Nexus achieves high-resolution text-to-image generation with a fraction of the computational cost, rivaling leading models in quality.
Diffusion and flow matching models have made significant progress in text-to-image generation, yet high computation, quadratic complexity, and large memory footprint hinder high-resolution synthesis and edge deployment. We propose Nexus, which integrates sparse architecture, linear complexity, and low-bit quantization. It combines MoE feed-forward layers, gated DeltaNet attention, and per-expert low-bit training to reduce computation and memory. Their joint optimization allows Nexus to achieve generation quality comparable to mainstream models such as SDXL and SD3 while delivering markedly higher inference efficiency. Experiments on COCO and LAION validate its effectiveness.
