Search papers, labs, and topics across Lattice.
This paper introduces the Fractal Neural Operator (FNO), a novel architecture designed to address the spectral bias observed in traditional deep learning models when applied to chaotic dynamical systems. By employing a non-resonant prime number basis and a Harmonic Weierstrass Encoder, the FNO achieves an unprecedented extension of the prediction horizon for the Lorenz-63 system to 347 Lyapunov times, significantly outperforming existing Reservoir Computing methods. These findings indicate that chaotic systems can be effectively modeled by neural networks when utilizing appropriate fractal embedding techniques, challenging the notion that chaos is inherently unpredictable.
Extending the prediction horizon of chaotic systems by 2.3x reveals that chaos isn't inherently unpredictable鈥攊t's a matter of the right neural architecture.
Deep learning models, particularly Transformers and Neural Operators, exhibit a well-documented "spectral bias," effectively acting as low-pass filters that smooth out high-frequency information. While benign in fluid dynamics, this bias is catastrophic for Chaotic Dynamical Systems, where the underlying strange attractor is characterized by fractal geometry and infinite spectral density. We introduce the Fractal Neural Operator (FNO), a novel architecture that utilizes a non-resonant prime number basis to approximate continuous dynamical systems. Unlike geometric encodings ($2^k$), which suffer from spectral gaps and resonance, our Harmonic Weierstrass Encoder injects infinite spectral resolution into the latent space. We demonstrate that FNO extends the valid prediction horizon of the Lorenz-63 system to 347 Lyapunov times, exceeding state-of-the-art Reservoir Computing baselines by a factor of 2.3x. These results suggest that "chaos" is not inherently unpredictable to neural networks, but rather requires non-differentiable, fractal embedding manifolds.
