Search papers, labs, and topics across Lattice.
MORPHOS introduces a novel autoregressive framework that generates dynamic 3D assets from videos using a unified 4D representation called Temporal Structured Latents (T-SLAT). This approach overcomes existing limitations in modeling topological changes and maintaining temporal consistency by encoding geometry and appearance along the temporal dimension. The framework achieves state-of-the-art performance in appearance and competitive results in geometry, showcasing its robustness and generalization across diverse representations in long-horizon generation tasks.
MORPHOS achieves unprecedented temporal consistency in 3D asset generation by leveraging a unified 4D representation that adapts to evolving topologies.
We present MORPHOS, a novel autoregressive framework that generates dynamic 3D assets from videos across diverse representations, including meshes, 3D Gaussians, and radiance fields. Existing methods are typically limited to a single representation, struggle to model topological changes, or fail to maintain temporal consistency over long videos. To address these limitations, we introduce the Temporal Structured Latents (T-SLAT), a unified 4D representation that jointly encodes geometry and appearance along the temporal dimension. Leveraging T-SLAT, MORPHOS autoregressively generates dynamic 3D assets via causal attention, conditioning each frame on its preceding history to ensure temporal consistency while handling evolving topologies. We also propose a temporal-structural augmentation to mitigate error accumulation in autoregressive generation. MORPHOS achieves state-of-the-art performance in appearance and competitive results in geometry across multiple benchmarks, demonstrating superior generalization across various representations and robustness in long-horizon generation.
