Search papers, labs, and topics across Lattice.
This paper introduces a curriculum-based continual learning framework for robust control of nonlinear dynamical systems with multiple uncertainties. The approach decomposes the complex control problem into a sequence of continual learning tasks, sequentially acquiring strategies for handling each uncertainty while extending the system into a set of plants with gradually diversified dynamic uncertainties. By jointly incorporating a model-based controller (MBC) and using a residual learning scheme, the method achieves stable policy updates across plant sets and enhances sample efficiency.
Tackle complex robust control problems by decomposing uncertainties into a curriculum of continual learning tasks, achieving sim-to-real transfer in active vibration control for automotive powertrains.
Robust control of mechanical systems with multiple uncertainties remains a fundamental challenge, particularly when nonlinear dynamics and operating-condition variations are intricately intertwined. While deep reinforcement learning (DRL) combined with domain randomization has shown promise in mitigating the sim-to-real gap, simultaneously handling all sources of uncertainty often leads to sub-optimal policies and poor learning efficiency. This study formulates a new curriculum-based continual learning framework for robust control problems involving nonlinear dynamical systems in which multiple sources of uncertainty are simultaneously superimposed. The key idea is to decompose a complex control problem with multiple uncertainties into a sequence of continual learning tasks, in which strategies for handling each uncertainty are acquired sequentially. The original system is extended into a finite set of plants whose dynamic uncertainties are gradually expanded and diversified as learning progresses. The policy is stably updated across the entire plant sets associated with tasks defined by different uncertainty configurations without catastrophic forgetting. To ensure learning efficiency, we jointly incorporate a model-based controller (MBC), which guarantees a shared baseline performance across the plant sets, into the learning process to accelerate the convergence. This residual learning scheme facilitates task-specific optimization of the DRL agent for each uncertainty, thereby enhancing sample efficiency. As a practical industrial application, this study applies the proposed method to designing an active vibration controller for automotive powertrains. We verified that the resulting controller is robust against structural nonlinearities and dynamic variations, realizing successful sim-to-real transfer.
