Search papers, labs, and topics across Lattice.
This paper introduces Slot-RAE, a streamlined framework for object-centric learning that operates directly within the continuous semantic feature space of visual foundation models, eliminating the reliance on complex pipelines and pretrained generative priors. By employing a feature-space diffusion process with a Diffusion Transformer decoder and a Representation Alignment head, Slot-RAE achieves state-of-the-art performance on the COCO dataset. The results show that it not only matches the performance of existing methods in unsupervised object discovery and image reconstruction but also does so with greater speed and efficiency.
Slot-RAE achieves state-of-the-art object-centric learning without the cumbersome reliance on pretrained generative models, streamlining the process significantly.
Deploying object-centric models for real-world scene understanding typically requires complex pipelines to achieve both robust scene decomposition and high-fidelity generation. Recent diffusion-based approaches have improved visual quality, but they almost universally rely on heavy, pretrained generative priors (e.g., Stable Diffusion) and external VAE latent spaces. In this paper, we propose Slot-RAE, a much simpler, fully integrated framework that operates directly within the continuous semantic feature space of visual foundation models (e.g., DINOv3). Slot-RAE employs a feature-space diffusion process using a Diffusion Transformer (DiT) decoder and a Representation Alignment (REPA) head. Unlike existing diffusion-based objectcentric methods that rely heavily on subsidized text-toimage priors, the generative core of Slot-RAE (Slot Attention and the DiT) is trained from scratch within the frozen VFM feature space. This eliminates the need for VAE bottlenecks and task-agnostic generative pre-training. Experiments on the COCO dataset demonstrate that despite its architectural simplicity, Slot-RAE achieves state-of-the-art results. It delivers comparable unsupervised object discovery, higher-fidelity image reconstruction, and robust zero-shot compositionality, all while being significantly faster and more computationally efficient than existing object-centric latent diffusion models.
