Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces WOLF-VLA, a unified framework that combines whole-body optimal-control motion synthesis with a large-scale multi-modal dataset to train Vision-Language-Action (VLA) models for humanoid locomotion. By constructing a comprehensive dataset of dynamically feasible humanoid trajectories across various locomotion tasks, the authors enable the generation of locomotion policies directly from natural language instructions. The resulting VLA model demonstrates strong reasoning capabilities and robustness to initial conditions, achieving competitive performance in diverse environments while providing a reproducible benchmark for future research.
WOLF-VLA enables humanoid robots to understand and execute complex locomotion tasks from natural language, bridging a critical gap in robotic manipulation and locomotion.
Vision-Language-Action (VLA) models have recently demonstrated strong generalization in robotic manipulation, yet their applicability to whole-body, contact-rich humanoid locomotion remains severely underexplored due to data scarcity, the absence of dynamically consistent demonstrations, and the difficulty of encoding optimality and safety in learning-based pipelines. This work introduces a unified framework WOLF-VLA that integrates whole-body optimal-control (OC) motion synthesis with large-scale multi-modal dataset to train VLAs capable of generating humanoid locomotion policies directly from natural-language instructions. We construct a comprehensive dataset of dynamically feasible humanoid trajectories across six locomotion-related task families, each parameterized by environmental variations, object colors, placements, and visual distractors. We train a VLA model using the collected joint trajectories, ego-centric visual observations and natural language instruction, yielding a policy that exhibits strong reasoning and robustness to initial-condition variability, and competitive performance across several tasks and environment settings. A systematic ablation study demonstrates the impact of each modality on the model performance. The full dataset, model checkpoints, and benchmarking simulation suite will be openly released, establishing a reproducible dynamically consistent benchmark for whole-body humanoid locomotion rich VLA control and enabling future research in scalable transfer of instruction-driven locomotion policies.