Search papers, labs, and topics across Lattice.
This paper introduces a mathematical framework to explicitly address the trade-off between short-time accuracy and long-time consistency in autoregressive neural surrogate models for dynamical systems. They propose a Self-refining Neural Surrogate model (SNS), implemented as a conditional diffusion model, that balances these competing objectives without hyperparameter tuning. The SNS model demonstrates its ability to perform stable, high-fidelity simulations of complex dynamical systems over arbitrarily long time horizons, either standalone or in conjunction with existing neural surrogates.
Autoregressive neural surrogates can now simulate dynamical systems for infinitely long horizons, thanks to a novel self-refining diffusion model that avoids error compounding.
Recent advances in autoregressive neural surrogate models have enabled orders-of-magnitude speedups in simulating dynamical systems. However, autoregressive models are generally prone to distribution drift: compounding errors in autoregressive rollouts that severely degrade generation quality over long time horizons. Existing work attempts to address this issue by implicitly leveraging the inherent trade-off between short-time accuracy and long-time consistency through hyperparameter tuning. In this work, we introduce a unifying mathematical framework that makes this tradeoff explicit, formalizing and generalizing hyperparameter-based strategies in existing approaches. Within this framework, we propose a robust, hyperparameter-free model implemented as a conditional diffusion model that balances short-time fidelity with long-time consistency by construction. Our model, Self-refining Neural Surrogate model (SNS), can be implemented as a standalone model that refines its own autoregressive outputs or as a complementary model to existing neural surrogates to ensure long-time consistency. We also demonstrate the numerical feasibility of SNS through high-fidelity simulations of complex dynamical systems over arbitrarily long time horizons.
