Search papers, labs, and topics across Lattice.
This study investigates the effects of lossy compression on the quality of neural generative surrogate models used in scientific simulations. By characterizing the inherent uncertainty in neural network training, the authors develop a method to quantify the tolerance of surrogate models to compression-induced errors. Their findings reveal that lossy compression can achieve data storage reductions of up to 39x while maintaining high model fidelity and significantly accelerating training times by up to 3x.
Lossy compression can shrink training data size by up to 39x without compromising the accuracy of generative surrogate models, revolutionizing data handling in scientific simulations.
Neural networks are used as generative surrogate models for scientific discovery, which are trainable approximations of scientific simulations. These models enable users to replace time-consuming numerical simulations with learned alternatives, providing quick solutions. However, high-fidelity generative surrogate models require massive training datasets, which can create storage and I/O challenges. Lossy compression is a promising way to reduce this burden, but compression errors may affect the model quality in subtle ways, making it challenging to quantify their impact. In this work, we examine how lossy compression of training data impacts the quality of generative surrogate models. We begin by characterizing the uncertainty inherent in training neural networks, showing that identical training configurations can produce different models. By exploiting this variability, we propose a method to estimate how much compression-induced error a surrogate model can tolerate without affecting its accuracy. Evaluation of two application simulations demonstrates that our approach significantly reduces memory/storage requirements and speeds up training while producing high-quality surrogate models. These results show that lossy compression saves data storage up to 23.7x and 39x with negligible impact on the quality of the surrogate model. Meanwhile, reducing the size of the training data set also enhances the data loading speed and reduces the training time by up to 3x.
