Search papers, labs, and topics across Lattice.
This paper introduces 3DCarGen, a scalable framework for generating high-quality 3D vehicle models from single-view images, addressing the limitations of existing multi-view diffusion methods that struggle with viewpoint diversity and geometric consistency. By synthesizing a set of images from fixed viewpoints and employing a feed-forward reconstruction model based on 3D Gaussian Splatting, the authors achieve a coarse 3D representation that serves as a foundation for generating 3D-consistent images from arbitrary camera angles. Extensive experiments show that 3DCarGen significantly improves geometric consistency and reconstruction fidelity over current techniques, making it a valuable tool for autonomous driving simulations.
3DCarGen achieves robust geometric consistency and high-fidelity 3D vehicle reconstruction from a single image, setting a new standard for autonomous driving simulations.
High-quality 3D vehicle assets are essential for autonomous driving simulation. Although multi-view diffusion-based paradigms enable controllable single-image reconstruction, they typically produce limited viewpoints and exhibit cross-view geometric inconsistencies, thereby reducing reconstruction fidelity in real-world scenarios. In this work, we introduce 3DCarGen, a scalable single-view 3D car generation framework designed for real-world images by synthesizing an arbitrary number of 3D-consistent multi-view images. Specifically, given a single image as input, we first synthesize a set of images from fixed viewpoints. These images are then fed into a feed-forward reconstruction model, resulting in a coarse 3D representation based on 3D Gaussian Splatting. Conditioned on this explicit 3D prior, our multi-view diffusion model generates 3D-consistent images from arbitrary camera viewpoints. We further extend a fast mesh reconstruction algorithm by incorporating color-normal joint optimization to recover detailed and coherent 3D vehicle models from the synthesized dense views. Extensive experiments on synthetic and real-world datasets demonstrate that our approach achieves robust geometric consistency and reconstruction fidelity compared to existing methods. Code and models will be released.
