Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces SWAN, an end-to-end pipeline that automates the creation of photorealistic and dynamic drone light shows from text prompts, overcoming the limitations of existing frameworks. SWAN utilizes a novel adaptive point-tracking algorithm to maintain spatial coherence during complex maneuvers and severe occlusions, while a dedicated planner ensures collision-free trajectories for individual drones. The system successfully orchestrates large-scale formations, demonstrated through simulations of 2,000 drones and real-world tests with 49 quadcopters, all on standard consumer hardware.
Automating drone choreography with generative AI could revolutionize aerial entertainment by enabling complex light shows without the need for manual animation.
Drone light shows are redefining aerial entertainment, yet their widespread adoption is bottlenecked by labor-intensive, manual animation. While generative AI promises an automated alternative, current frameworks fail to provide photorealism with fluid, dynamic motion. To address this limitation, we introduce SWAN, an end-to-end pipeline that synthesizes photorealistic, large-scale, and collision-free drone choreographies directly from text prompts. SWAN converts text into realistic reference videos and translates these pixel-space dynamics into physical swarm kinematics using a novel, adaptive point-tracking algorithm. Unlike existing trackers, this method maintains spatial coherence through severe occlusions and rapid topological shifts. A dedicated planner then allocates these trajectories to individual drones, while a subsequent safety filter ensures collision-free execution. We demonstrate scalability by safely orchestrating simulated 2,000-drone formations and validate physical feasibility on a dense real-world swarm of 49 quadcopters, operating everything entirely on standard consumer hardware. Combined, this work demonstrates how generative AI can be leveraged to automate multi-robot choreography design, providing an accessible new framework for drone light shows.