Search papers, labs, and topics across Lattice.
This paper addresses the challenge of zero-shot generalization in reinforcement learning (RL) for autonomous drone racing, where traditional methods struggle to maintain performance across diverse environments. The authors introduce a novel framework that integrates task-aware switching based on learning progress with a physically informed procedural track generator, enabling the development of a robust generalist policy. Their approach achieves a remarkable 7.4x improvement in generalization over existing methods while preserving competitive racing speeds, validated in both simulation and real-world scenarios, including complex vision-based control tasks.
Achieving a 7.4x boost in zero-shot generalization for drone racing without sacrificing speed could redefine performance benchmarks in RL applications.
Autonomous drone racing is a fundamentally challenging regime for autonomous aerial robots, requiring time-optimal control while operating under persistent actuation saturation. While reinforcement learning (RL) has achieved human-level performance in this domain, current methods fail to generalize; policies trained on specific environments often crash immediately in unseen configurations. This failure reflects the intrinsic difficulty of zero-shot generalization in agile flight, arising from high-dimensional task variation and the tight coupling between safety and performance at high speeds. Existing approaches that improve generalization impose a substantial cost on flight speed: control policies must significantly degrade performance to achieve even modest levels of generalization. In this work, we propose a framework for zero-shot generalization in agile flight for RL-based drone racing. By combining task-aware switching based on learning progress with a physically informed procedural track generator, the framework produces a fast and robust generalist policy without test-time adaptation. Our method achieves strong zero-shot performance across a wide range of unseen racetracks in the real world, demonstrating a 7.4x improvement in generalization over the state-of-the-art approaches, while maintaining competitive racing speeds. We validate our method's results in both simulation and real-world settings, including a challenging vision-based, end-to-end control setting that operates without explicit state estimation, where all prior approaches fail to generalize.
