Raman Goyal

Semantic communication via VLM orchestrators unlocks robust, long-horizon coordination for multi-robot systems, outperforming prior single-robot approaches on complex manipulation tasks.

This paper introduces multi-horizon multimodal prediction in ABBR, an agile tactile World Action Model for contact-rich robot control, which provides supervision for visual latent at a larger temporal offset while predicting the tactile latent in the next frame to capture fine-grained contact dynamics.

A multimodal diffusion policy outperforms traditional methods, achieving a 78% success rate in industrial cable manipulation tasks, demonstrating a leap in automation capabilities.