Search papers, labs, and topics across Lattice.
This paper introduces a Jacobian-based spectral audit for evaluating in-context operator networks, addressing the limitations of traditional prediction error metrics that fail to capture local dynamical structures. By projecting the Jacobian onto Fourier modes, the authors provide a detailed spectral characterization of inferred operators, revealing phenomena such as phase transport and nonlinear mode coupling. The findings indicate that prediction accuracy and local operator fidelity are distinct, highlighting the importance of this audit in diagnosing model behavior and stability in neural operators.
Prediction accuracy alone can mask critical failures in operator fidelity, as our spectral audit uncovers hidden instabilities and inconsistencies in neural operator networks.
Existing evaluations of neural operators and in-context operator learning rely primarily on prediction error, but accurate output prediction does not guarantee the correct local dynamical structure. A model may match solutions while exhibiting incorrect sensitivities, distorted frequency response, spurious mode coupling, or unstable tangent behavior. We introduce a Jacobian-based spectral audit for in-context operator learning. For a fixed prompt, we differentiate the network output with respect to the query function and view the resulting Jacobian as a learned tangent operator. Projecting it onto Fourier modes, we obtain a local spectral characterization of the inferred operator, including frequency-dependent gains, phase structure, and cross-mode coupling. The audit complements standard prediction metrics by testing whether the model reproduces local mechanisms of the underlying PDE operator rather than only outputs. Across benchmarks, the audit reveals distinct operator-level phenomena, including phase transport, viscosity-dependent damping, nonlinear mode coupling, and reaction--diffusion stability structure. It also detects failures partially hidden by prediction-error metrics, including high-frequency degradation, incorrect phase recovery, and prompt--operator inconsistencies. Corrupted or internally inconsistent prompts lead to degraded tangent-operator structure even when pointwise predictions remain partially accurate. Our results suggest that prediction accuracy and local operator fidelity are distinct properties of learned neural operators. Our framework also provides a diagnostic for stability, sensitivity, and operator consistency.
NUS