Search papers, labs, and topics across Lattice.
This paper introduces Approximate Imitation Learning (AIL), a novel imitation learning framework designed to train event-based quadrotor control policies efficiently. AIL decouples representation learning from policy learning by first learning a task-specific representation space from a large offline dataset and then training the policy online using lightweight, simulated state information. This eliminates the need for computationally expensive event rendering during policy training, enabling faster training and deployment. The approach achieves high-speed flight (up to 9.8 m/s) in cluttered environments in both simulation and real-world experiments, outperforming standard imitation learning baselines.
Train high-speed, event-camera-guided quadrotors without expensive event rendering by decoupling representation learning from policy learning.
Event cameras offer high temporal resolution and low latency, making them ideal sensors for high-speed robotic applications where conventional cameras suffer from image degradations such as motion blur. In addition, their low power consumption can enhance endurance, which is critical for resource-constrained platforms. Motivated by these properties, we present a novel approach that enables a quadrotor to fly through cluttered environments at high speed by perceiving the environment with a single event camera. Our proposed method employs an end-to-end neural network trained to map event data directly to control commands, eliminating the reliance on standard cameras. To enable efficient training in simulation, where rendering synthetic event data is computationally expensive, we propose Approximate Imitation Learning, a novel imitation learning framework. Our approach leverages a large-scale offline dataset to learn a task-specific representation space. Subsequently, the policy is trained through online interactions that rely solely on lightweight, simulated state information, eliminating the need to render events during training. This enables the efficient training of event-based control policies for fast quadrotor flight, highlighting the potential of our framework for other modalities where data simulation is costly or impractical. Our approach outperforms standard imitation learning baselines in simulation and demonstrates robust performance in real-world flight tests, achieving speeds up to 9.8 ms-1 in cluttered environments.
