Search papers, labs, and topics across Lattice.
This paper introduces a time-optimal trajectory optimization framework for vision-based quadrotors, explicitly incorporating perception constraints alongside full nonlinear dynamics and actuation limits. They derive an information-theoretic position uncertainty metric to quantify visual state-estimation quality and integrate it into the planner through perception objectives like uncertainty minimization and field-of-view constraints. Real-world experiments demonstrate flight speeds up to 9.8 m/s with improved closed-loop success rates, showcasing the trade-offs between speed and perceptual reliability.
Quadrotors can now fly significantly faster and more reliably through complex environments by explicitly optimizing trajectories for both speed and visual perception quality.
Agile quadrotor flight pushes the limits of control, actuation, and onboard perception. While time-optimal trajectory planning has been extensively studied, existing approaches typically neglect the tight coupling between vehicle dynamics, environmental geometry, and the visual requirements of onboard state estimation. As a result, trajectories that are dynamically feasible may fail in closed-loop execution due to degraded visual quality. This paper introduces a unified time-optimal trajectory optimization framework for vision-based quadrotors that explicitly incorporates perception constraints alongside full nonlinear dynamics, rotor actuation limits, aerodynamic effects, camera field-of-view constraints, and convex geometric gate representations. The proposed formulation solves minimum-time lap trajectories for arbitrary racetracks with diverse gate shapes and orientations, while remaining numerically robust and computationally efficient. We derive an information-theoretic position uncertainty metric to quantify visual state-estimation quality and integrate it into the planner through three perception objectives: position uncertainty minimization, sequential field-of-view constraints, and look-ahead alignment. This enables systematic exploration of the trade-offs between speed and perceptual reliability. To accurately track the resulting perception-aware trajectories, we develop a model predictive contouring tracking controller that separates lateral and progress errors. Experiments demonstrate real-world flight speeds up to 9.8 m/s with 0.07 m average tracking error, and closed-loop success rates improved from 55% to 100% on a challenging Split-S course. The proposed system provides a scalable benchmark for studying the fundamental limits of perception-aware, time-optimal autonomous flight.
