Search papers, labs, and topics across Lattice.
This paper introduces ROMS-IMLE, a minimalist generative model that leverages Implicit Maximum Likelihood Estimation (IMLE) and a simple convolutional architecture to challenge the prevailing belief that complex iterative transformations are essential for effective generative modeling. By stripping down to the core components, the authors demonstrate that a single-step approach can yield competitive performance, achieving an FID of 2.56 on ImageNet 256 while maintaining high precision and recall. This finding suggests that simplicity in model design can lead to both efficiency and quality in generative tasks, potentially reshaping the landscape of generative modeling techniques.
A minimalist generative model achieves state-of-the-art performance without the complexity of iterative denoising or advanced architectures.
Generative models have undergone many generations of evolution, from VAEs/GANs to diffusion/flow matching. Along the way, the underlying techniques have become more complicated and various beliefs about what drives strong empirical performance have taken hold. Due to the success of diffusion models and flow matching, one of the more common beliefs is the importance of transforming the noise distribution to the data distribution gradually through many small transformations. We ask whether this is truly necessary, and take a minimalist approach to designing a competitive generative model. We start with the bare-bones essentials, namely just a training objective and a model. We purposefully make both simple. For the training objective, we choose Implicit Maximum Likelihood Estimation (IMLE), and eschew more complicated alternatives such as variational inference, adversarial training and numerical integration. For the model, we eschew transformers and instead choose a moderately sized convolutional network. Then we judiciously added elements that are truly essential, which surprisingly do not include iterative denoising. The result is a single-step parameter-efficient generative model that produces high quality samples at fast speed: it achieves an FID of 2.56 on ImageNet 256 and simultaneously attains good precision and recall.
