Search papers, labs, and topics across Lattice.
This paper introduces ECoNGS, a novel framework for volume visualization that leverages efficient compressive neural Gaussian splatting to enhance scene representation. By utilizing lightweight neural networks to predict implicit Gaussian splats from explicit anchor points, ECoNGS achieves a significant reduction in model size and training time while maintaining high reconstruction fidelity. The framework demonstrates up to 2.2 dB improvement in PSNR and a reduction in model size by up to 6.1x compared to previous methods, showcasing its effectiveness for large dataset visualizations.
ECoNGS achieves a remarkable 6.1x reduction in model size while enhancing reconstruction quality by up to 2.2 dB, revolutionizing volume visualization efficiency.
Recent advances in differentiable Gaussian splatting have highlighted the potential of primitive-based approaches as alternative scene representations for interactive, high-quality, volume visualization (VolVis) of large datasets. However, the explicit nature of current primitive-based methods, combined with isolated optimization for each VolVis scene, results in redundant, non-compact representations. We present ECoNGS, an efficient compressive neural Gaussian splatting framework for VolVis scene representation. ECoNGS employs lightweight neural networks to dynamically predict implicit, editable Gaussian splats from explicit anchor points, effectively combining model compactness and parameter efficiency of implicit representations with high-performance rendering of explicit primitives. We explore a joint learning strategy that clusters geometrically similar scenes and shares parameters across them, significantly reducing overall training time and model size while maintaining reconstruction fidelity. To achieve a more compact scene representation, we further compress the explicit anchor attributes using a neural entropy model that estimates their probability distributions, enabling compact storage via entropy coding. We systematically investigate Gaussian initialization strategies and propose a simple yet effective scheme tailored for VolVis scenes, improving reconstruction accuracy and accelerating convergence. We evaluate ECoNGS qualitatively and quantitatively across various univariate and multivariate VolVis scenes, highlighting its superior performance over prior methods in training time, reconstruction quality, and model size. In particular, compared with the prior method iVR-GS, ECoNGS improves reconstruction quality by up to 2.2 dB in PSNR while reducing the model size by up to 6.1x and the training time by up to 5.9x. The code is available at https://github.com/TouKaienn/ECoNGS.
