Search papers, labs, and topics across Lattice.
This paper introduces AsySplat, an asymmetric architecture for 3D Gaussian Splatting that effectively decouples geometry and appearance modeling to enhance long-sequence novel view synthesis (NVS). By leveraging coarse-grained tokens for geometry and fine-grained tokens for appearance, the model achieves significant computational efficiency, reducing redundancy while maintaining high-quality outputs. The results demonstrate that AsySplat not only matches the performance of traditional optimization-based methods but also offers a remarkable 800x speedup with fewer parameters and reduced training overhead.
Achieving nearly 800x speedup in 3D scene modeling without sacrificing quality, AsySplat redefines efficiency in long-sequence novel view synthesis.
Recent generalizable 3D Gaussian Splatting models have advanced long-sequence novel view synthesis (NVS), but at the cost of substantial redundant computation. We identify that the redundancy can be mitigated based on two observations: (i) high-precision geometry is not strictly required for high-quality NVS; (ii) appearance learning is generally easier than geometry recovery. Motivated by these insights, we propose an asymmetric architecture that decouples geometry and appearance modeling. The geometry branch processes coarse-grained tokens with most of the parameters for multi-view reconstruction, while the appearance branch operates on fine-grained tokens to capture details using significantly fewer parameters. The two branches interact through bilateral connections, enabling mutual guidance for their respective tasks. This task-aware asymmetry reduces the computational redundancy and allocates the computation more judiciously, thereby increasing parameter efficiency and enabling smaller models to achieve strong performance. On 32-view 960P inputs, our model matches optimization-based methods while delivering nearly 800x speedup, and surpasses the zero-shot performance of state-of-the-art generalizable models with markedly fewer parameters and reduced training/inference overhead, achieving an overall efficiency improvement.
