Search papers, labs, and topics across Lattice.
This paper introduces SPVC, a novel framework for enhancing cross-dataset driving scene rendering by addressing common artifacts in 3D Gaussian Splatting. By leveraging structured spatial conditions and temporal cues, SPVC effectively corrects both background and foreground rendering issues across multiple datasets, significantly improving the quality of rendered driving sequences. The approach utilizes a two-stage controllable video diffusion model, demonstrating superior performance in artifact correction compared to existing methods tailored for specific settings.
Blurry structures and temporal flicker in driving scene rendering can be effectively mitigated using a unified framework that leverages spatial and temporal cues across datasets.
Driving scene reconstruction and rendering, especially with 3D Gaussian Splatting, has become an important component of autonomous driving simulation. However, rendered views often degrade under extrapolated ego trajectories and scene edits, producing blurry structures, temporal flicker, and foreground-background misalignment. Existing refinement methods are commonly designed for a specific setting, such as image-level novel-view repair or object-editing correction. In this paper, we introduce SPVC, a structured and panoptic video fixing framework for cross-dataset driving scene rendering. The name summarizes four design principles. (1) Structured fixing denotes the use of explicit spatial conditions, including camera pose, 3D bounding boxes, and HD maps, to guide the repair process and reduce uncontrolled hallucination. (2) Panoptic fixing refers to correcting both background rendering artifacts, such as distorted roads, buildings, and lanes, and foreground vehicle artifacts introduced by scene editing, such as inconsistent object appearance. (3) Video fixing means that the model operates on driving sequences rather than isolated frames, allowing temporal cues to be used during artifact correction. (4) Cross-dataset fixing means that a single shared network is trained and applied across multiple driving datasets, reducing the need for dataset-specific or scene-specific fixers. Concretely, we construct paired degraded-clean training data by simulating under-constrained 3DGS rendering and foreground vehicle insertion artifacts, and train a two-stage controllable video diffusion model that first addresses video-level appearance and then refines scene layout with structured controls.
