Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces adversarial reinforcement learning (ARL) to train planetary landing controllers by generating physically constrained, correlated disturbances that expose vulnerabilities missed by standard stochastic randomization. By framing the problem as an asymmetric sequential zero-sum game between a landing controller and a disturbance-generating agent, the ARL approach iteratively optimizes both policies to discover challenging off-nominal conditions. Preliminary experiments indicate that this method can lead to significantly improved robustness and generalization compared to conventional training.
Planetary landing controllers trained with adversarial disturbances uncover critical failure modes missed by standard randomization, suggesting a new paradigm for robust aerospace GNC.
Deep reinforcement learning (DRL) policies for planetary landing and other aerospace guidance, navigation, and control tasks are commonly trained under randomized disturbances to improve robustness. However, typical stochastic perturbation sampling assumes independent variations, whereas real mission disturbances often exhibit spatial and temporal correlation and cannot be reproduced through independent random draws. This work investigates adversarial reinforcement learning to discover challenging off-nominal conditions. A secondary agent generates physically constrained perturbations that degrade the performance of a landing controller, forming an asymmetric sequential zero-sum game. Training proceeds in three stages: baseline controller learning, robustness enhancement with stochastic perturbations, and an iterative adversarial phase in which the controller and disturbance generator are alternately optimized. Preliminary experiments in a three-degree-of-freedom landing environment show that adversarial disturbances reveal vulnerabilities missed by conventional randomization and provide early indications that, with a more extensive training campaign, the approach can yield improved robustness and stronger generalization under previously unseen perturbation regimes.