Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
Neural networks trained offline for closed-loop control systems face sequential failure modes due to distribution shift, where learned parameters locally guarantee trajectory divergence. This paper formalizes these errors—Closed-Loop Identification Error, Action Error, and Tracking Error—using discrete-time sensitivity analysis, revealing how local loss geometry exacerbates performance degradation. Experiments on a Duffing oscillator demonstrate that time-scale separated online adaptation effectively mitigates divergence, unlike static deployments.
Offline-trained neural networks are mathematically proven to diverge in closed-loop control, but bounded online adaptation offers a practical solution.
Neural networks offer critical adaptability for controlling complex systems where nominal modeling proves intractable. However, when offline-trained neural networks are deployed within closed-loop control systems, their actions fundamentally alter the state distribution upon which they were trained. This paper introduces a unified taxonomy to categorize these sequential failure modes: the initial Closed-Loop Identification Error, the deployment-induced Action Error, and the continuous Tracking Error. Through discrete-time sensitivity analysis, this work formalizes how offline-learned parameters locally guarantee a trajectory divergence upon deployment, degrading performance due to local loss geometry. To mitigate this distribution shift, we propose actionable design policies centered on time-scale separated online adaptation. These mechanisms are validated through ablation studies on a nonlinear Duffing oscillator, demonstrating that bounded continuous learning successfully mitigates trajectory divergence whereas static deployments fail, offering concrete guidelines for practitioners deploying machine learning components in safety-critical feedback systems.