Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper explores the use of sparsely gated Mixture of Experts (MoE) architectures for vision-based quadruped parkour, contrasting them with traditional MLPs. They train control policies for a Unitree Go2 robot using both architectures, matching the number of active parameters at inference. Results show the MoE policy doubles the success rate in traversing large obstacles compared to the MLP baseline, while achieving comparable performance with an MLP requires significantly increased computation time.
Quadruped robots can learn to parkour more effectively and efficiently by selectively activating expert sub-networks, outperforming standard, densely-activated neural networks.
Robotic parkour provides a compelling benchmark for advancing locomotion over highly challenging terrain, including large discontinuities such as elevated steps. Recent approaches have demonstrated impressive capabilities, including dynamic climbing and jumping, but typically rely on sequential multilayer perceptron (MLP) architectures with densely activated layers. In contrast, sparsely gated mixture-of-experts (MoE) architectures have emerged in the large language model domain as an effective paradigm for improving scalability and performance by activating only a subset of parameters at inference time. In this work, we investigate the application of sparsely gated MoE architectures to vision-based robotic parkour. We compare control policies based on standard MLPs and MoE architectures under a controlled setting where the number of active parameters at inference time is matched. Experimental results on a real Unitree Go2 quadruped robot demonstrate clear performance gains, with the MoE policy achieving double the number of successful trials in traversing large obstacles compared to a standard MLP baseline. We further show that achieving comparable performance with a standard MLP requires scaling its parameter count to match that of the total MoE model, resulting in a 14.3\% increase in computation time. These results highlight that sparsely gated MoE architectures provide a favorable trade-off between performance and computational efficiency, enabling improved scaling of control policies for vision-based robotic parkour. An anonymized link to the codebase is https://osf.io/v2kqj/files/github?view_only=7977dee10c0a44769184498eaba72e44.