Search papers, labs, and topics across Lattice.
SceneFrom3D introduces an automated view scheduling framework for geometry-conditioned outdoor 3D scene generation, addressing the challenges posed by unstructured and expansive geometries. By constructing a directed generation graph that optimally schedules anchor views and interpolation trajectories, the method enhances both the efficiency and quality of scene generation. Experimental results show that SceneFrom3D outperforms existing techniques, yielding high-quality, controllable 3D scenes that adhere closely to user-defined geometries and object appearances.
Automated view scheduling in SceneFrom3D transforms the landscape of outdoor 3D scene generation, enabling unprecedented control over object appearance and geometry.
Geometry-conditioned 3D scene generation enables the creation of 3D environments from user-provided geometry, offering direct control over scene structure and object layout. To generate such 3D scenes, current methods commonly adopt a three-stage design that first defines a view schedule, then synthesizes multi-view observations along the scheduled views, and finally reconstructs a 3D representation from the generated images. However, defining the view schedule becomes a major bottleneck for outdoor scenes, where large, unstructured, and unbounded geometry makes it difficult to obtain views that provide sufficient coverage while supporting stable generation. To address this bottleneck, we present SceneFrom3D, a framework that automatically schedules views from outdoor input geometries. SceneFrom3D constructs a directed generation graph whose nodes represent anchor views and whose edges represent interpolation trajectories, defining which views to synthesize, which view pairs to interpolate, and in which order generation should proceed. Beyond automatic view scheduling, SceneFrom3D further improves controllability through object-level conditioning, assigning each object an identity image for appearance guidance and a geometry-adherence parameter for region-wise control over the input geometry. Experiments demonstrate that SceneFrom3D achieves state-of-the-art geometry-conditioned outdoor 3D scene generation, producing high-quality scenes with controllable object appearance and geometry adherence.