Search papers, labs, and topics across Lattice.
This paper introduces the Adaptive Memory Gate for Neural Operators (AMGFNO), which addresses the limitations of fixed memory weights in existing memory-augmented neural operators for solving time-dependent PDEs. By dynamically modulating memory weight based on observation conditions such as resolution and viscosity, AMGFNO significantly enhances performance, achieving a 55-79% reduction in normalized root mean square error (nRMSE) at low resolutions. The findings underscore the necessity of adaptable memory mechanisms in neural operators to optimize their effectiveness across varying scenarios.
Fixed memory weights in neural operators can hinder performance, but AMGFNO's dynamic gating adapts memory usage to drastically improve accuracy based on resolution.
Neural operators have emerged as a powerful data-driven approach for solving time-dependent PDEs. Among recent advances, memory-augmented neural operators explicitly incorporate past states and have achieved remarkable performance under low-resolution observation settings. However, existing approaches apply a fixed memory weight regardless of observation conditions, such as resolution or physical parameters, limiting their adaptability. Our preliminary experiments reveal that optimal memory weight varies with resolution and viscosity, implying that a fixed memory weight cannot simultaneously optimize performance across diverse settings. We propose AMGFNO, which dynamically modulates memory weight through a learnable gate. On the Kuramoto-Sivashinsky and Burgers'equations, AMGFNO achieves 55-79% nRMSE reduction over at low resolution, with the learned gate value automatically decreasing from $\bar{g} \approx 0.7$ to near-zero as resolution increases.
