Search papers, labs, and topics across Lattice.
This paper introduces Roken, a unified diffusion transformer that generates coordinated multi-robot trajectories in a feed-forward manner, overcoming the limitations of sequential planning and post-processing in existing methods. By representing each robot as a discrete token, Roken utilizes self-attention mechanisms to facilitate direct interactions and ensure compliance with both individual safety and global connectivity constraints. Experimental results demonstrate that Roken achieves high success rates in complex environments, surpassing baseline methods and showcasing its scalability and generalization capabilities across varied team sizes and conditions.
Roken can generate coordinated multi-robot trajectories in real-time, achieving higher success rates than traditional sequential planning methods.
The success of generative models in language and visual generation has inspired extensive applications to generative robot planning. However, most existing works either focus on single-robot planning, or generate multi-robot trajectories in a sequential manner with iterative post-processing to resolve inter-robot conflicts. In this work, we investigate whether coordinated multi-robot trajectories, as a special spatiotemporal distribution, can be learned and generated with a generative model in a feed-forward manner. We propose Robots as Tokens (Roken), a unified diffusion transformer that directly generates multi-robot trajectories that satisfy both (individual) safety and (global) connectivity constraints. The core design of Roken is to represent each robot as a discrete token, allowing them to naturally interact with each other through self-attention, and cross-attend to map tokens for environment layouts. We further introduce several auxiliary tasks based on Bayes' theorem to provide multi-scale spatial-temporal supervision for efficient learning of the conditional distribution. In training, Roken absorbs diverse expert trajectories from different team sizes. During inference, Roken behaves as a versatile multi-robot planner that can handle single-robot planning, coordinated multi-robot trajectory generation, and conditional trajectory generation by fixing some robot tokens as conditions. Experiments in diverse cluttered environments show that Roken can generate coordinated multi-robot trajectories to perform connectivity-constrained goal navigation tasks with high success rates, outperforming the baseline method used to generate the training dataset. Roken also demonstrates good scalability after training with mixed team sizes, and shows generalization to unseen or partially observed environments, verifying its potential to learn from diverse data and perform versatile tasks.
NUS